Data Engineers (Multiple) — Barton, South Canberra

Expired

Contract period: For 7 Months (until 30 June 2024) with further period up to 12 Months Location: ACT, Offsite Must be able to obtain Baseline About the Role: SoftLabs is seeking Data Engineers (Multiple) for ICT Labour hire at their technology consulting based in Canberra. Requirements The Department of Agriculture, Fisheries and Forestry (DAFF) is looking for Data Engineers with strong experience developing Extract, Transform, Load (ETL) and Extract, Load, Transform (ELT) processes across several data and analytics platforms to join its Enterprise Analytics section. The role will be responsible for design, development and unit testing activities across several data movement and transformation processes within DAFF. These data movement processes are being developed to focus on the preparation of data for use in decision making processes across the department, utilising modern cloud technology (Azure) to enable operational analytics use cases. The successful candidate will require experience with the following techniques and technologies: MS Azure Stack: o Data Integration 1. Data Factory 2. SQL Server Integration Services 3. Databricks o Data Store 1. SQL Server 2. Data Lake Storage o Analytics 1. Azure Databricks 2. Azure Machine Learning 3. ArcGIS Enterprise Development Tools – DevOps, Visual Studio, VS Code Data technology solutions – sourcing (Oracle, Ingres, Azure, SQL Server), collecting, ingesting and storing Data Preparation: o Transformation of data into formats tailored to analytics use cases 1. Parquet 2. Delta Essential Criteria: Experience developing ETL/ELT processes for data movement and transformation. Experience preparing data optimised for query performance in cloud computed engines. E.g: • Distributed computing engines (Spark) • Graph Databases • Azure SQL. Experience working with Engineering, Storage and Analytics services in cloud infrastructure. Working with multi-disciplinary teams using an Agile methodology. Desirable criteria: Experience working with Azure Data Factory and Databricks. Experience/Knowledge of working with Data Lake and Lakehouses. Application Deadline: Tuesday, 31 October 2023 Expected Start Date: Monday, 20 November 2023 Job Type: Contract Rate: As per Australian Market Standards If you are interested in this position, please click Apply with your resume in WORD and send your details for review. If you wish to have a confidential discussion, call us on 1300207208 or 0482 693 975 for more information.