Lead Data Engineer
- Posted 18 January 2025
- Location Sydney, Brisbane, Canberra
- Job type Contract
- Duration 12 months
- Reference3867607
Job description
We are looking for a Lead Data Engineer to join a federal government client on an initial 12-month contract. This role can be based in Brisbane, Canberra or Sydney with great flexible hybrid working options.
In this role you will support the Data Engineering and Operations section with the management of their azure Databricks platform, data and analytics pipeline development, design, and solution management and data modelling. You will be key to maturing their data storage capabilities, including designing solutions for internal key data centric projects.
You will have experience in data engineering preferably using DataBricks, proficiency in data warehousing, data modelling, developing data pipelines and expertise in SQL and Python with an ability to analyse transactional datasets to troubleshoot and proactively find gaps in requirements, modelling, and source systems.
Experience using Azure Databricks, Azure Data Factory, Azure DevOps, GitHub, and Snowflake would also be an advantage.
Responsibilities include;
Effectively manage competing priorities to deliver project outcomes
Develop and manage a range of stakeholder relationships
Contribute to data design and overall data architecture
Evolve technologies, platforms, and code accordingly
Build, deploy, and maintain ETL code and pipelines for data ingestion and analysis
Automate reconciliations and validations
Standardise data extraction queries and establish CI/CD pipelines accordingly
Please note that you must be an Australian citizen to be considered for this opportunity with the ability to apply for an NV1 security clearance.
NEXT STEPS
If you think this could be the right role for you APPLY TODAY or for further information, please contact Lindsey at lindsey@pinpointtalent.com.au