Data Engineer, Data Capability Exchange — Canberra Region, Australian Capital Territory

New

The role sits in the Data Capability Exchange Section in the Enterprise Transformation Branch in the Enterprise Transformation Group. The Data Capability Exchange team are a collaborative and driven team of professionals, supporting and facilitating the management of AEC data assets throughout the data lifecycle. We also lead the Information and Data Management Strategy (IDMS), which aims to ensure AEC continue to deliver best practice in election management and become a modern data-driven agency by investing in our people, processes and technologies to make data use a cultural norm. We do this through our key service offerings which are Data and AI Governance, policies and governance, Data Analytics and Visualisations, Data Engineering and Geospatial services. We actively engage with our business areas to support their business needs and improve the level of information management and data maturity across the AEC. The key duties of the position include Outposted to Melbourne or Brisbane considered It is an exciting time as the team works closely with the Election Systems Modernisation program to define the landscape for the new AEC systems and processes. As part of the team, you will get to see tangible outcomes from your work: most notably in the delivery of electoral events and services. As an EL1 Data Engineer, you will lead the development, management, and optimisation of key stages of the data lifecycle within the AEC, including exploration, staging, integration, and presentation. You will also play a crucial role in shaping the broader data landscape, identifying and implementing improvements and uplift across data platforms, processes, and governance to elevate election forecasting, modelling, and reporting. The role will be responsible for, but not limited to Lead and manage data engineering projects, Identify, evaluate and understand business needs and objectives, Develop patterns for ingesting data from varied sources and types, Build, manage and optimise data pipelines - including ETL/ELT processes Design, manage and optimise data warehouses, Develop ways to enhance data quality, availability & accessibility, Prepare data for modelling and analysis, Collaborate with relevant stakeholders on projects and outcomes. Supervise and mentor junior data engineers and analysts and ensure compliance with data governance policies and standards. To excel you'll have: Extensive experience in a similar role, i.e. Data Engineer, Data Analyst, Developer, and strong numerical and analytical skills. Technical expertise in managing, optimising, overseeing and monitoring data retrieval, storage and distribution in a similar or large-size organisation, inc. ETL/ELT development, batch processing, real-time loading and data modelling. Hands-on experience with SQL database design, data warehousing, SQL Server, SSMS, SSIS and API development/management. Working knowledge of the Microsoft Azure/Fabric data engineering stack inc. Data Factory, Synapse Analytics, Databricks, Power BI, Data Lake, SQL Server database and/or Cosmos DB. Knowledge of programming languages and frameworks (e.g. Python, R, SQL, .Net/C#, Javascript). Proven leadership and project management skills, as well as strong strategic thinking and decision-making abilities. A degree and/or related certification. Desirable : Understanding of user experience (UX) design, agile delivery and collaboration techniques. Data analysis experience, including report and dashboard development. Data science experience such as building and deploying machine learning frameworks and models. Experience in developing technical/solution architectural papers for senior management.