Data Engineer - Snowflake AWS

About the Organisation

The organisation has a long-standing role in supporting land and property information services, with a history spanning more than a century. It has evolved from manual, paper-based processes to modern digital platforms, with a strong focus on reliability, integrity and accessibility of data. In recent years, there has been significant investment in modernising systems, expanding digital services and improving how customers and partners are supported.

The organisation continues to focus on delivering trusted, secure and forward-looking services that enable people, businesses and communities to operate with confidence. Primary Purpose of the Role The Data Engineer / Principal Data Engineer is responsible for enabling data-driven decision-making by designing, building and maintaining scalable data platforms and pipelines. The role supports delivery of key strategic initiatives and ensures data solutions are robust, secure and aligned with organisational objectives.

This position contributes to the ICT team’s ability to deliver high-quality, timely and reliable data services that underpin operational performance and innovation. Key Accountabilities Design and deliver scalable, reliable data pipelines to support enterprise analytics and reporting. Ensure data platforms meet performance, security and availability requirements.

Provide technical leadership and guidance across project delivery initiatives. Support testing and quality assurance throughout the delivery lifecycle. Maintain strong data governance practices, including backup and disaster recovery.

Work closely with cross-functional teams to understand and deliver data requirements. Drive continuous improvement in data engineering tools, processes and standards. Deliver and integrate cloud-based data solutions, particularly within AWS environments.

Promote DevOps principles and automation in data engineering workflows. Operate independently to resolve complex data-related issues. Key Challenges Managing complex and diverse data environments across multiple platforms.

Delivering high-quality data solutions within tight timelines and changing priorities. Balancing stakeholder expectations with technical integrity and long-term scalability. Key Relationships Internal Manager:Escalate issues, provide updates, receive direction and guidance.

ICT Team:Collaborate on solution design, share technical knowledge and ensure integrated delivery. Project Teams:Provide expert input, support testing and ensure alignment with project objectives. External Vendors and suppliers:Monitor service delivery, manage technical issues and ensure contractual compliance.

Business stakeholders:Provide data insights, support decision-making and ensure solutions meet business needs. Decision Making Make independent decisions relating to technical design and implementation. Provide recommendations on data architecture and platform improvements.

Proven experience designing and delivering scalable, reliable data platforms, pipelines and transformations for enterprise analytics and reporting. Strong experience with CI/CD, DataOps and Agile delivery approaches, including: DBMS technologies such as Snowflake, Oracle and SQL Server Cloud platforms, preferably AWS (including RDS) Version control tools (e.g. Bitbucket, Subversion) Data and analytics tools such as Airflow, Attunity, Tableau and dbt Python and shell scripting Experience in data design and governance, including: Modern data architectures (e.g. medallion architecture) Data modelling standards (Kimball, Inmon) Metadata management and lineage tools Security and compliance frameworks (e.g. ISO 27001, SOC 2) Strong communication skills with the ability to explain technical concepts to non-technical audiences. Hands-on experience with AWS, Snowflake, APIs and Oracle.

Familiarity with ETL tools such as dbt, Informatica or custom SQL-based pipelines. Advanced SQL skills, including data profiling and optimisation. Experience using data modelling or reverse engineering tools.

Strong analytical, problem-solving and troubleshooting skills. Experience working in DevOps environments with continuous build and test systems. Solid understanding of database theory, structure and performance optimisation.

Ability to learn new technologies quickly and work with minimal supervision. Ability to work confidently with peers, technical leaders and business stakeholders. Tertiary qualifications in Computer Science, Information Systems or a related discipline.

Employment screening checks and relevant clearances are required.