Job Specifications
Are you an experienced AI Data Engineer with a desire to excel? If so, then Talent Software Services may have the job for you! Our client is seeking an experienced AI Data Engineer to work at their company in Redmond, WA.
Position Summary: This team is responsible for designing, developing, and maintaining data platforms. You will have the opportunity to work closely with stakeholders across the company to gather business requirements, build data models, and ensure data quality and accessibility. Your expertise in Python, SQL, Airflow, and Spark will be crucial in optimizing our data infrastructure and enabling data-driven decision-making. This role will contribute to designing, developing, and maintaining efficient and reliable data pipelines.
Primary Responsibilities/Accountabilities:
Data Platform: Design, build, and maintain scalable data platforms and pipelines using Python, SQL, Airflow, and Spark.
Business Requirements Gathering: Collaborate with stakeholders to understand and translate business requirements into technical specifications.
Data Modeling: Develop and implement data models that support analytics and reporting needs.
Data Quality and Governance: Ensure data accuracy, consistency, and reliability by implementing robust data validation and quality checks.
Stakeholder Collaboration: Work with cross-functional teams, including data analysts, data scientists, and business leaders, to deliver high-quality data solutions.
Performance Optimization: Continuously monitor and optimize data pipelines for performance, scalability, and cost-efficiency.
Monitoring and Observability: Build and implement monitoring and observability metrics to ensure data quality and detect anomalies in data pipelines.
Documentation and Communication: Maintain clear and comprehensive documentation of data processes and communicate technical concepts effectively to non-technical stakeholders.
Qualifications:
Experience: 2 years of experience in data engineering and infrastructure.
Technical Skills: Proficiency in data warehouse management, Python, SQL, Airflow, and Spark.
Data Pipeline Expertise: Strong experience in building and maintaining robust data pipelines and ETL processes.
Analytical Skills: Ability to gather business requirements and debug issues for ingestion or other areas of the data warehouse.
Communication: Excellent verbal and written communication skills, with the ability to convey technical information to non-technical audiences.
Collaboration: Proven ability to work effectively in a collaborative, cross-functional environment.
Education: A Bachelor’s degree in Computer Science, Engineering, Information Systems, or a related field.
Data Engineering background that includes Python, SQL, Kubernetes, Airflow, and Scala.
Preferred:
Experience with cloud platforms such as AWS, GCP, or Azure.
Familiarity with data warehousing technology (e.g., Deltalake, Azure Fabric, Snowflake, Redshift, BigQuery).
Knowledge of data governance and data security best practices.
About the Company
TALENT Software Services is a Service Disabled Veteran-Owned Small Business (SDVOSB) providing the best IT Consulting and Professional Services nationwide for over 35 years. We are one of the most trusted partners for delivery of Project, Data Management, Application, and Infrastructure Services, TALENT staffs technologies including Java, .NET, Project Management, Analytics, Architecture, and more.
Representation that counts: This is where top Twin Cities TALENT find their value in the local marketplace.
"It's easy to g...
Know more