- Company Name
- A-Line Staffing Solutions
- Job Title
- Data Engineer
- Job Description
-
**Job title:** Data Engineer – Senior Lead Developer
**Role Summary:**
Lead architectural design, development, and maintenance of scalable data solutions on AWS. Oversee code quality, data integrity, and automation for a modernized enterprise system. Guide and mentor a team of developers, translating business requirements into robust technical specifications and ensuring adherence to agile practices and CMMI Level 3 standards.
**Expectations:**
- Deliver high‑quality, production‑ready code within sprint cycles.
- Maintain system stability, security, and regulatory compliance (particularly for EHR data).
- Champion continuous integration, automated testing, and CI/CD pipelines.
- Provide timely technical guidance to team members and cross‑functional stakeholders.
- Adhere to agile ceremonies, documentation standards, and CMMI Level 3 process controls.
**Key Responsibilities:**
1. Design and implement scalable, high‑performance data pipelines using AWS services (S3, RDS, Redshift, EMR, Glue).
2. Develop clean, maintainable code in Python/Scala, integrating with Databricks notebooks.
3. Deploy and manage Elastic Search clusters for real‑time data retrieval and analysis.
4. Own full SDLC: gather requirements, author functional/technical specifications, produce design documents, and obtain stakeholder approvals.
5. Build and optimize database objects (stored procedures, functions) in Oracle and other relational systems.
6. Create and maintain CI/CD pipelines via Azure DevOps, ensuring automated builds, tests, and deployments.
7. Implement and monitor ETL processes, ensuring data quality, line‑age, and integrity across warehouse and data mart layers.
8. Apply Agile practices, including Scrum, sprint planning, and test‑driven development.
9. Ensure compliance with HL7/EHR standards and maintain robust data security controls.
10. Provide technical oversight and mentorship to developers on related applications.
**Required Skills:**
- 12 + years developing complex database systems.
- 8 + years with Databricks, Elastic Search, Kibana, S3, Python/Scala, Oracle.
- 5 + years in AWS cloud development, ETL, data warehousing, and data visualization.
- 5 + years applying CMM/CMMI Level 3 processes and Agile (TDD‑centric).
- 3 + years building CI/CD pipelines in Azure DevOps.
- Proficient with source‑control (Git), flowcharting, and system documentation.
- Experience with HL7 EHR solutions and regulatory data handling.
- Strong analytical, problem‑solving, and communication skills.
**Required Education & Certifications:**
- Bachelor’s degree in Computer Science, Information Systems, or related field (minimum).
- Professional certifications optional but highly valued: AWS Certified Solutions Architect, Databricks Certified Data Engineer Associate, Certified ScrumMaster (CSM), or equivalent.