Agilus is recruiting for a Senior Data Engineer in the Retail in a hybrid work environment in Stellarton, Nova Scotia. We are seeking a Senior Data Engineer to join our retail client’s growing data and analytics team. The ideal candidate will be an expert in building and optimizing large-scale data pipelines on Azure Databricks, with hands-on experience in Azure Data Factory and continuous/real-time data streaming solutions. You will work closely with data scientists, analysts, and business stakeholders to enable advanced analytics, machine learning, and retail-specific use cases such as demand forecasting, customer behavior analysis, personalization, and supply chain optimization. Responsibilities: Design, develop, and maintain scalable data pipelines and architectures using Azure Databricks and Azure Data Factory. Build and optimize real-time data streaming solutions (e.g., using Spark Structured Streaming, Event Hubs, Kafka, or similar). Collaborate with stakeholders to translate retail business requirements into efficient technical data solutions. Implement data ingestion frameworks for batch and streaming from diverse sources (e.g., ERP, CRM, POS, IoT, eCommerce). Develop reusable components, frameworks, and standards to improve efficiency and consistency across data engineering practices. Ensure data quality, governance, security, and compliance with industry and organizational standards. Partner with data science and BI teams to support advanced analytics, reporting, and AI/ML initiatives. Successful candidates will have: 7+ years of data engineering experience in enterprise-scale environments, preferably in retail or consumer-focused industries. Strong expertise in Azure Databricks (PySpark/Scala, Delta Lake, MLflow). Proficiency with Azure Data Factory for orchestrating complex ETL/ELT workflows. Proven experience with real-time/continuous data streaming frameworks (e.g., Spark Structured Streaming, Kafka, Event Hubs). Solid understanding of cloud data architecture principles (data lakes, medallion architecture, CI/CD for data pipelines). Advanced SQL and experience with data modeling for analytics and reporting. Strong communication and stakeholder management skills, with ability to explain technical concepts to business users. Additional Competencies: Experience integrating data from SAP systems (ERP, BW, S/4HANA) into cloud platforms. Knowledge of retail-specific data domains (merchandising, inventory, sales, customer loyalty, supply chain). Familiarity with Azure Synapse or other modern cloud data warehouses. Exposure to DevOps for data engineering (infrastructure as code, Git, CI/CD pipelines). What's in it for you: Opportunity to shape the data foundation of a leading retail organization. Work with cutting-edge cloud technologies on high-impact, high-visibility projects. Collaborative culture with strong emphasis on innovation and professional growth.