We are seeking a Lead / Senior Data Engineer to join our retail client’s growing data and analytics team. Agilus is recruiting for a Lead / Senior Data Engineer in the Retail Sector in a hybrid work environment in Mississauga, Ontario. The ideal candidate will be an expert in building and optimizing large-scale data pipelines on Azure Databricks, with hands-on experience in Azure Data Factory and continuous/real-time data streaming solutions. You will work closely with data scientists, analysts, and business stakeholders to enable advanced analytics, machine learning, and retail-specific use cases such as demand forecasting, customer behavior analysis, personalization, and supply chain optimization. A typical day: Design, develop, and maintain scalable data pipelines and architectures using Azure Databricks and Azure Data Factory. Build and optimize real-time data streaming solutions (e.g., using Spark Structured Streaming, Event Hubs, Kafka, or similar). Collaborate with stakeholders to translate retail business requirements into efficient technical data solutions. Implement data ingestion frameworks for batch and streaming from diverse sources (e.g., ERP, CRM, POS, IoT, eCommerce). Develop reusable components, frameworks, and standards to improve efficiency and consistency across data engineering practices. Ensure data quality, governance, security, and compliance with industry and organizational standards. Mentor junior engineers and guide best practices in coding, architecture, and cloud-native data solutions. Requirements: 5+ years of data engineering experience in enterprise-scale environments, preferably in retail or consumer-focused industries. Strong expertise in Azure Databricks (PySpark/Scala, Delta Lake, MLflow). Proficiency with Azure Data Factory for orchestrating complex ETL/ELT workflows. Proven experience with real-time/continuous data streaming frameworks (e.g., Spark Structured Streaming, Kafka, Event Hubs). Solid understanding of cloud data architecture principles (data lakes, medallion architecture, CI/CD for data pipelines). Advanced SQL and experience with data modeling for analytics and reporting. What's in it for you: $70.00 - $85.00 hourly Working with an Industry Leader on new cutting edge Projects Soft skills: Experience integrating data from SAP systems (ERP, BW, S/4HANA) into cloud platforms. Knowledge of retail-specific data domains (merchandising, inventory, sales, customer loyalty, supply chain). Familiarity with Azure Synapse or other modern cloud data warehouses. Exposure to DevOps for data engineering (infrastructure as code, Git, CI/CD pipelines). This posting is for an active opening.