Role details
Large-scale data migration for one of Australia's biggest telcos, built on Azure Databricks, based in Sydney.
You'll design and build Databricks pipelines, migrate data off legacy platforms, and put proper data quality frameworks in place across a major telco transformation programme. Day-to-day you're working with architects, engineers and business stakeholders to get production-grade data solutions shipped inside an Agile consulting environment.
The role is hybrid in Sydney, and the consulting business running this programme has a strong track record delivering enterprise cloud work for household-name Australian organisations. The tech stack is modern throughout: Azure Databricks, PySpark, Azure Data Factory, Delta Lake and Unity Catalog. You won't be wrestling with outdated tooling.
This is a consulting engagement, so the pace is real and expectations are high. What you get in return is exposure to genuinely complex technical problems, a team of experienced engineers who care about doing things properly, and a pipeline of future projects that keeps the work varied. If you want to go deep on cloud data engineering at scale, this is a solid place to do it. Salary sits between $170,000 and $180,000 plus super.
What You'll Do
- Design and build Azure Databricks pipelines to migrate data from legacy platforms at enterprise scale.
- Implement data quality frameworks, validation processes and reconciliation logic across the platform.
- Optimise pipeline performance and contribute to engineering standards across the delivery team.
- Work closely with architects, engineers and business stakeholders to deliver well-governed data products.
What You'll Need
- Strong commercial experience with Azure Databricks, PySpark and SQL, plus hands-on Azure Data Factory work.
- Proven delivery of large-scale data migration projects in a commercial setting.
- Experience building data quality frameworks, validation logic and reconciliation processes.
- Exposure to Delta Lake, Unity Catalog, Git and CI/CD pipelines is a real advantage.
About the Company
They're a well-regarded Australian consulting business delivering enterprise cloud transformation projects for some of the country's largest organisations. The team is technically strong, the projects are genuinely complex, and the culture puts quality engineering ahead of cutting corners.
Apply
Please click the 'Apply' button. Don't worry if your CV isn't up to date - just send what you have.