Skills

Leadership Python SQL NoSQL Data Engineering Splunk CI/CD Test Kanban Scrum Agile methodologies Agile Analytics Hadoop Spark CI/CD Pipelines

Job Specifications

Overview:

Synechron UK is looking for a highly experienced Lead Data Engineering Consultant to lead and develop cutting-edge data engineering platforms. The ideal candidate will bring a mix of technical expertise, leadership skills, and innovative thinking to support our data-driven initiatives.

Key Responsibilities:

Lead the design, development, and optimisation of enterprise data platforms using tools such as Hadoop, Spark, and Splunk.
Develop and maintain robust ETL/ELT data pipelines to handle raw, structured, semi-structured, and unstructured data (SQL and NoSQL).
Integrate large, disparate datasets with modern tools and frameworks, ensuring smooth data flow across systems.
Collaborate closely with BI and Analytics teams in fast-paced environments, supporting their data needs.
Drive the creation of technical test plans, conduct unit and integration testing, and maintain high code quality within automated environments.
Promote a Site Reliability Engineering (SRE) culture by addressing operational challenges and ensuring service resilience and sustainability.
Support continuous integration, delivery, and deployment (CI/CD) pipelines, incorporating source control practices.

Qualifications:

Extensive experience with Hadoop, Spark, and Splunk.
Proficiency in Python scripting, with experience in handling various data formats.
Strong background in building and optimising data pipelines and supporting BI/Analytics teams.
Experience with CI/CD pipelines and source control.
Knowledge of agile methodologies such as Scrum or Kanban.
Ability to develop and implement automated test plans and ensure high-quality deliverables.

About the Company

At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver industry-leading digital solutions. Synechron's progressive technologies and optimization strategies span end-to-end Artificial Intelligence, Consulting, Digital, Cloud & DevOps, Data, and Software Engineering, servicing an array of noteworthy financial services and technology firms. Through research and development initiatives in our FinLabs we develop s... Know more