Role details
Lead Data Engineer contract in Melbourne, six months, Databricks and AWS at the core of a modern Lakehouse platform.
You'll take technical ownership across key data services, lead solution design for significant platform changes, and set the quality bar for the engineering team. Day-to-day that means shaping how data flows through a Lakehouse architecture built on Databricks and Delta Lake, reviewing designs, managing technical risk, and mentoring the engineers around you.
This is a senior individual contributor role, so you won't be carrying headcount responsibility. What you will carry is real technical authority. You'll shape how the team approaches problems, which patterns get adopted, and how the platform evolves. The stack is genuinely modern: Databricks, AWS (MSK, Glue, Lambda, Step Functions, Athena, Fargate, S3), Kafka-based streaming, and CI/CD pipelines built with Jenkins and Ansible. AI coding tools like GitHub Copilot and Databricks Genie are already part of the workflow.
The team works across domains, so you'll interact with product, architecture, QA, and business analysts regularly. If you're someone who can translate a complex data architecture decision into plain language for a non-technical audience, you'll fit in well here. It's a six-month contract based in Melbourne, and the role sits inside a technology department that clearly invests in engineering rigour.
What You'll Do
- Own end-to-end technical delivery across key data services, identifying risks, constraints, and quality issues before they become problems.
- Lead solution design for major platform changes, ensuring alignment to Lakehouse architectural patterns and Delta Lake standards.
- Provide technical direction to the team on sequencing, approach, and delivery quality across Databricks and AWS workloads.
- Mentor engineers through code reviews, working groups, and knowledge-sharing sessions that lift the whole team's capability.
What You'll Need
- 5+ years with Databricks and modern Lakehouse frameworks including Delta Lake, Data Vault modelling, optimisation, and governance.
- 5+ years hands-on with Python, Spark or PySpark, plus advanced SQL across relational and NoSQL systems.
- Solid AWS breadth across MSK, Glue, Lambda, Step Functions, Athena, Fargate, S3, and experience designing streaming architectures with Kafka, Kinesis, or Spark Streaming.
- Strong CI/CD proficiency with Jenkins, Ansible, and shell scripting, including unit, integration, and performance testing practices.
About the Company
They're a Melbourne-based technology organisation running a cloud-first, data-centric platform. The engineering culture is built around strong delivery practices, cross-functional collaboration, and a genuine commitment to improving how the platform is built and operated.
Apply
Please click the 'Apply' button. Don't worry if your CV isn't up to date - just send what you have.
