Lead Data Engineer

Posted 18 January 2025
Location Sydney, Brisbane, Canberra
Job type Contract
Duration 12 months
Reference3867607

Job description

We are looking for a Lead Data Engineer to join a federal government client on an initial 12-month contract. This role can be based in Brisbane, Canberra or Sydney with great flexible hybrid working options.
 
In this role you will support the Data Engineering and Operations section with the management of their azure Databricks platform, data and analytics pipeline development, design, and solution management and data modelling. You will be key to maturing their data storage capabilities, including designing solutions for internal key data centric projects.
 
You will have experience in data engineering preferably using DataBricks, proficiency in data warehousing, data modelling, developing data pipelines and expertise in SQL and Python with an ability to analyse transactional datasets to troubleshoot and proactively find gaps in requirements, modelling, and source systems.
 
Experience using Azure Databricks, Azure Data Factory, Azure DevOps, GitHub, and Snowflake would also be an advantage.
 
Responsibilities include;

  • Effectively manage competing priorities to deliver project outcomes

  • Develop and manage a range of stakeholder relationships

  • Contribute to data design and overall data architecture

  • Evolve technologies, platforms, and code accordingly

  • Build, deploy, and maintain ETL code and pipelines for data ingestion and analysis

  • Automate reconciliations and validations

  • Standardise data extraction queries and establish CI/CD pipelines accordingly

Please note that you must be an Australian citizen to be considered for this opportunity with the ability to apply for an NV1 security clearance.
 
NEXT STEPS
 
If you think this could be the right role for you APPLY TODAY or for further information, please contact Lindsey at lindsey@pinpointtalent.com.au