Data Engineer — The Rocks, Sydney

Expired

This role involves working with a small team through a critical data migration. Data Engineer - 9 Month Contract We are looking for a Data Engineer to join our team and lead the development of a future-proof data pipeline in AWS, which will integrate with our payroll system, SuccessFactors. This role involves working with a small team through a critical data migration and building a scalable, configuration-based solution that meets both current and future business needs. Key Responsibilities: - Design and build a robust data pipeline in AWS to support payroll system integration with SuccessFactors. - Implement a future-proof, configuration-based approach to manage evolving data requirements. - Work hands-on with data engineering tasks (50% of the role), primarily using PySpark, AWS S3, Glue, and Airflow for orchestration. - Drive best practices for data quality, ensuring the accuracy and reliability of data within the medallion architecture and lakehouse engine. - Collaborate with cross-functional teams to meet business objectives and ensure seamless integration of the data pipeline. Essential Skills & Experience: - Strong proficiency in PySpark and Python for data processing and transformation. - Experience with AWS S3, Glue, and Airflow for managed orchestration. - Solid understanding of the Medallion architecture and lakehouse data engine principles. - Hands-on experience with data quality management. - Ability to work collaboratively with a team, drive a migration project, and ensure scalable, future-ready solutions. If you're passionate about building cutting-edge data pipelines in AWS and leading a high-impact migration project, we'd love to hear from you