Job Specifications
Role: Senior Data engineer
Location: Downtown Toronto
About the Role:
Seeking an experienced Senior Data Engineer to design and optimize scalable data solutions on Microsoft Azure. You will work with Snowflake for data warehousing and Databricks for big data processing within a Lakehouse architecture using medallion principles (Bronze, Silver, Gold).
Key Responsibilities:
Data Pipelines: Build and optimize ETL/ELT pipelines using Azure Data Factory, Databricks (PySpark, SQL), and ingest data from diverse sources into ADLS and Snowflake.
Databricks Development: Create and tune Spark jobs, leverage Delta Lake, Autoloader, and advanced optimization techniques.
Data Warehousing: Design and manage Snowflake schemas, queries, and performance tuning.
Data Quality & Governance: Implement security, lineage, validation frameworks, and compliance policies.
Programming: Develop in Python, PySpark, Scala, and advanced SQL for data processing and automation.
Collaboration: Partner with data architects and mentor junior engineers.
DevOps: Maintain CI/CD pipelines using Azure DevOps; troubleshoot and optimize performance.
Required Skills:
Expertise in Azure services (ADF, Databricks, ADLS, Key Vault).
Strong Snowflake experience (data modeling, optimization, Snowpipe).
Proficiency in Python, PySpark, Scala, and advanced SQL.
Knowledge of Delta Lake, Autoloader, Z-ordering, partitioning.
Familiarity with CI/CD, Git workflows, and data security best practices.
Experience with JSON, Parquet, CSV formats.
Thanks
Prashant Bansal
Raas infotek corporation
262 Chapman road, Suite 105A, Newark, DE-19702
Phone: 302-565-0188 Ext: 144,
Email: Prashant.bansal@raasinfotek.com
Website: raasinfotek.com
About the Company
Raas Infotek is a full spectrum global Information Technology services company, providing end-to-end business solutions to our global clientele - collaborating with them to design, develop and implement solutions to add value to their business.
For close to Five years now, we have consistently contributed to the business growth of our customers which is why, we consider engagements with our customers as an enduring relationship and work towards adding value to our customer's business growth. Some of our customers have been ...
Know more