- Company Name
- Vallum Associates
- Job Title
- Data Engineer
- Job Description
-
Job title: AWS Data Engineer (Contract)
Role Summary:
Architect, build, and maintain end‑to‑end data pipelines and cloud data platforms on AWS. Design scalable, secure, and high‑performance data lakes and warehouses, leveraging S3, Glue, Redshift, Lambda, and Lake Formation. Develop reusable ETL/ELT processes in Python and Spark, implement IaC with Terraform, and ensure CI/CD, monitoring, and data quality throughout the data lifecycle. Support data scientists, analysts, and engineering teams, and mentor junior engineers.
Expactations:
• Start immediately or within short notice.
• 100% remote contract, with occasional onsite or ad‑hoc client workshops.
• Contract duration until end of March 2026; outside IR35.
• Deliver high‑quality, production‑ready data solutions on time.
• Communicate progress, blockers, and technical decisions clearly to stakeholders.
Key Responsibilities:
1. Design and implement scalable, secure data lake and warehouse architectures on AWS.
2. Build, test, and deploy ETL/ELT pipelines using Python, Spark, and Spark DataFrames.
3. Create and maintain IaC for infrastructure with Terraform, ensuring repeatable deployments.
4. Develop and maintain CI/CD pipelines with GitHub, CodeBuild, and CodePipeline.
5. Optimize data models and queries in SQL for performance across Redshift, Athena, and Glue.
6. Monitor, troubleshoot, and tune data pipelines, focusing on latency, throughput, and cost.
7. Mentor and review work of junior data engineers; foster best practices.
8. Participate in client workshops to gather requirements and present solutions.
Required Skills:
• AWS data services: S3, Glue, Redshift, Lambda, Lake Formation, IAM.
• Terraform (IaC) – create, manage, and version infrastructure.
• Python 3+ (data manipulation, Pandas, NumPy) and Spark/PySpark.
• Advanced SQL (Redshift, Athena, OLAP queries).
• ETL/ELT design, data modeling, and warehouse design.
• CI/CD with GitHub, GitHub Actions, CodeBuild, CodePipeline.
• Performance tuning, data migration, and cost optimization on AWS.
• Familiarity with DBT, Docker, or Microsoft BI stack is a plus.
• Excellent problem‑solving and communication skills.
Required Education & Certifications:
• Bachelor’s degree in Computer Science, Data Engineering, Applied Math, or related field, or equivalent professional experience (≥3 years).
• AWS Certified Data Analytics – Specialty or AWS Certified Solutions Architect – Associate strongly preferred.