- Company Name
- Aarorn Technologies Inc
- Job Title
- GCP Data Engineer
- Job Description
-
**Job Title**
GCP Data Engineer
**Role Summary**
Design, develop, and maintain scalable ETL pipelines on Google Cloud Platform, leveraging Spark Serverless, Spark on GKE, and Python. Own end‑to‑end data flow from ingestion to loading, ensuring performance, cost efficiency, and compliance with data governance standards.
**Expectations**
- Deliver robust, automated data pipelines that meet quality, security, and regulatory requirements.
- Continuously optimize query performance and resource utilization.
- Collaborate with data science, analytics, and architecture teams to align solutions with business needs.
- Maintain high availability and proactive issue resolution through monitoring and alerting.
**Key Responsibilities**
- Build and maintain ETL workflows with Spark Serverless, Spark on GKE, and Python.
- Implement ingestion, transformation, and loading for structured and unstructured data.
- Utilize GCP services: BigQuery, Cloud SQL, Cloud Storage, Pub/Sub, Cloud Logging, Cloud Monitoring, and Cloud Logging.
- Optimize performance and cost for large‑scale data processes.
- Apply data governance, data quality checks, and lineage tracking using GCP tools.
- Ensure compliance with organizational and regulatory standards.
- Set up observability: logging, monitoring, and alerting for pipelines and infrastructure.
- Troubleshoot incidents to maintain high availability.
- Automate workflows and processes with Python and native GCP tools.
- Work closely with data scientists, analysts, and architects to deliver reliable solutions.
**Required Skills**
- Strong experience with Google Cloud Platform data services.
- Hands‑on expertise in Spark Serverless, Spark on GKE, and Python programming.
- Proficiency in BigQuery, Cloud SQL, Cloud Storage, Pub/Sub, and GCP-native ETL tools.
- Knowledge of data governance, quality frameworks, and lineage tools.
- Experience with Cloud Logging, Cloud Monitoring, and observability best practices.
**Required Education & Certifications**
- GCP Professional Data Engineer certification (preferred).
- (No mandatory degree specified.)