- Company Name
- CARIAN
- Job Title
- Senior Data Engineer AWS
- Job Description
-
**Job Title**
Senior Data Engineer AWS
**Role Summary**
Design, build, and maintain end‑to‑end cloud data pipelines and warehouse solutions on AWS. Lead ingestion of customer and operational data from enterprise systems (SAP, Salesforce, Google Analytics, OKTA, etc.) into S3, curate into a curated layer with Python, PySpark, and SQL, and develop scalable Redshift models. Ensure secure, compliant, and high‑performance data platforms supporting advanced analytics across the organization.
**Expectations**
- Deliver robust, production‑grade ELT/ETL workflows on AWS within a fast‑moving enterprise environment.
- Operate independently, meet project milestones, and uphold client governance and security standards.
- Collaborate with data architects, developers, and business stakeholders to translate business requirements into technical solutions.
**Key Responsibilities**
- Ingest source data (SAP, Salesforce, Google Analytics, OKTA, etc.) into S3 Raw via AppFlow or DMS.
- Curate and transform datasets into a curated layer using Python, PySpark, and SQL.
- Build and maintain ELT/ETL pipelines with AWS Glue, Step Functions, Lambda, and AppFlow.
- Design and optimize Redshift schemas, views, materialized views, and performance tuning.
- Implement CI/CD using GitHub and adhere to client governance.
- Integrate on‑premise and SaaS systems using Simplement, MuleSoft, OKTA, and JAMS.
- Monitor, secure, and audit data flows with CloudWatch, CloudTrail, and Secrets Manager.
- Manage metadata, data lineage, and catalogs with AWS Glue Data Catalog.
**Required Skills**
- 8+ years data engineering experience, strong AWS ecosystem (Glue, Step Functions, Lambda, S3, Redshift, DMS, AppFlow).
- Advanced Python, PySpark, and SQL (complex queries, performance tuning).
- Experience with SAP and Salesforce integrations.
- Knowledge of data platform security, monitoring, and compliance (access clearance).
- Familiarity with CI/CD, Git, and cloud governance practices.
**Required Education & Certifications**
- Bachelor’s degree in Computer Science, Information Systems, Engineering, Data Science, or related technical field.
- Master’s degree preferred.
- AWS certifications (Data Engineer, Solutions Architect, Developer) are a plus.
- Eligibility for US 810 access (citizen or permanent resident) may be required.
---