We are seeking a Data Engineer to support our government client on a high-impact legacy modernization initiative. This role focuses on migrating and rebuilding existing Datastage and SQL-based workflows into modern Python/PySpark pipelines using Databricks and Azure Data Factory.
Roles and Responsibilities
Rebuild legacy workflows by rewriting Datastage and SQL programs into modern Python/PySpark pipelines on Databricks.
Develop and optimize data pipelines using Azure Data Factory and ADLS for efficient data migration and processing.
Conduct rigorous testing to validate data accuracy, consistency, and reproducibility of migrated workflows.
Document technical specifications, data flows, and migration logic for both legacy and modernized systems.
Collaborate with cross-functional teams to ensure smooth integration, version control, and delivery through Azure DevOps.
Qualifications and Skills
5+ years of experience in data engineering with progressively complex roles and projects
Proven track record in data migration from legacy systems to modern cloud-based platforms
Proficient in SQL, PySpark, Azure Data Factory (ADF), Azure Data Lake Storage (ADLS), and Databricks
Strong hands-on experience building Python-based data pipelines
Familiarity with relational databases and legacy ETL tools such as Datastage
Deep experience working within Microsoft Azure cloud environments
Certifications in Azure, Databricks, ADF, or SQL are considered strong assets
Education
College Diploma or Certificate in Business, IT, or Administration, or equivalent experience.
We are committed to hiring military and Veteran spouses and encourage you to identify your connection with the MSEN when reaching out to us or applying to any of our open roles.
Have questions or want to learn more about us? We would love to hear from you!
Altis Recruitment Team
Email: militaryfamilies@altis.com
613-230-3700
Welcome on behalf on the Altis Recruitment team! Altis has a long-standing business relationship with the Defence community. For more than 30 years, we have been grateful to work alongside the Department of National Defence and countless military professionals. We know that family members of military personnel often make many personal sacrifices to support their loved ones. We understand that it can be difficult to pursue a career when embracing sudden changes like relocation and deployment. For some, this has meant putting a pause on career goals or professional development. We would like to provide you with everything you need for a successful and confident job search – in addition to access to job opportunities. Download the checklists our experts have created to help you be at your best from application to interview.