In partnership with Engineering Super. Learn more.
Engineering Super logo

Senior Data Engineer — Sydney, Sydney Region

6 months contract role with possible extension up to 1-2 years Attractive daily pay rate 2 days a week in office. Work Location: Sydney Purpose of the Role You will be responsible for designing, building, and maintaining robust data pipelines within the Microsoft data platform ecosystem. This role requires expertise in data ingestion, transformation, and processing using SSIS, Synapse Pipelines, Spark, and experience with master data management using Profisee. Also responsible for ensuring data quality, performance, and scalability of our data solutions, and contributing to the development of Power BI reports within Microsoft Fabric Key Responsibilities: Design, develop, and maintain ETL/ELT pipelines for ingesting data from various source systems into our SQL Dedicated Pool and Synapse Lakehouse platforms. Develop and optimise data transformation logic using T-SQL and Spark (Python) within Synapse Pipelines. Develop Spark notebooks for complex data transformations and processing within the Synapse environment. Implement data quality checks and validation rules to ensure data accuracy and consistency. Build and deploy Synapse Pipelines for orchestrating data ingestion, transformation, and loading processes in Azure Synapse Analytics/ Microsoft Fabric Collaborate with data architects to implement and maintain the data model and metadata management. Work with Power BI developers to provide curated and performant datasets for reporting and analytics within Microsoft Fabric; also develop analytics reports if required Understand and implement medallion architecture principles (Bronze, Silver, Gold layers) within the data platforms. Participate in code reviews and contribute to team best practices Monitor and troubleshoot data pipeline performance and resolve data-related issues in non-production environments. Essential Criteria: Bachelor's degree in computer science, Information Systems, or a related field. 5 years of experience in data engineering or a similar role. Strong understanding of data warehousing concepts, dimensional modeling, and ETL/ELT principles. Expertise in T-SQL and experience working with SQL Server and/or Azure Synapse Dedicated SQL Pools. Hands-on experience with Azure Synapse Analytics, including Synapse Pipelines and Spark Pools. Experience with Spark (Python) for data processing and transformation. Familiarity with Microsoft Fabric components (Data Factory, Synapse Data Engineering, Power BI). Experience with version control systems (e.g., Git Integrated Visual Studio and Azure DevOps). Strong analytical and problem-solving skills. Excellent communication and collaboration skills. If this sounds like you, please submit your resume by clicking the 'Apply Now' button. About Us At easyA , we connect skilled professionals with opportunities that make an impact. As authorised suppliers to multiple government and corporate organisations across NSW, ACT, QLD, and the Federal Government, we specialise in providing expert talent for critical projects. When you work with easyA , you benefit from our strong relationships with contractors and clients alike, ensuring smooth and transparent recruitment processes tailored to your needs.

Applications close Sunday, 20 April 2025
Take me to the job
Students welcome
Learn more
Engineering Super logo
General Information only. Professional Superannuation Management Pty Ltd (ABN 31 617 160 791; AFSL No. 499786).
Visit engineeringsuper.com.au to find our PDS and TMD.