Lead Data Engineer — The Rocks, Sydney

This is a Lead Data Engineer role with one of the leading companies in AU right now Macquarie Group with an amazing team. They are continuing to grow rapidly. This is the chance to join right as the takes off. More About the Role at Macquarie Group Join our high performing Data Team focused on collaborating across a wide range of business and technical stakeholders to deliver a transformation project within Macquarie’s Banking and Financial Services division. This is an excellent opportunity for an ambitious, problem solving and technical data professional to contribute and grow rapidly within the organisation. At Macquarie, our advantage is bringing together diverse people and empowering them to shape all kinds of possibilities. We are a global financial services group operating in 34 markets and with 55 years of unbroken profitability. You’ll be part of a friendly and supportive team where everyone - no matter what role - contributes ideas and drives outcomes. What role will you play? As an experienced Lead Data Engineer with strong Data and ETL hands-on expertise, you will be leading our regulatory epics and transforming our regulatory reporting platform. Leveraging your strategic, problem-solving mindset and technical prowess, you will guide our team of data engineers to enhance platform efficiency using AI, automation, and cutting-edge technological advancements. What You Offer * Expert Big Data and Hadoop experience with a focus on Spark, Hive, Presto (or other query engines), big data storage formats (such as Parquet, ORC, Avro) and data pipeline orchestration tools like Airflow * Expert in Spark SQL, with proven ability in tuning and optimisation * Proven hands-on experience in implementing data integration tools (such as Talend, DataStage or Informatica) and data warehouses * Strong AWS experience in one or more of the following (EC2, S3, RDS, EMR) * Strong Data Architecture expertise including different data modelling techniques * Strong knowledge of data governance areas such as data lineage, technical metadata. Data quality and reconciliation * Ability to drive platform efficiency by extending our Automation and AI capabilities – python experience preferred We love hearing from anyone inspired to build a better future with us, if you're excited about the role or working at Macquarie we encourage you to apply. About Technology Technology enables every aspect of Macquarie, for our people, our customers and our communities. We’re a global team that is passionate about accelerating the digital enterprise, connecting people and data, building platforms and applications and designing tomorrow’s technology solutions. Our commitment to diversity, equity and inclusion We are committed to fostering a diverse, equitable and inclusive workplace. We encourage people from all backgrounds to apply and welcome all identities, including race, ethnicity, cultural identity, nationality, gender (including gender identity or expression), age, sexual orientation, marital or partnership status, parental, caregiving or family status, family and domestic violence status, neurodiversity, religion or belief, disability, or socio-economic background. We welcome further discussions on how you can feel included and belong at Macquarie as you progress through our recruitment process. To learn more, contact our team by clicking here. Our aim is to provide reasonable adjustments to individuals who may need support during the recruitment process and through working arrangements. If you require additional assistance, please let us know in the application process. If you don’t think you're a perfect fit, you should still sign up to Hatch and create a profile, we'll match you to other roles that suit your profile. Hatch exists to level the playing field for people as they discover a career that’s right for them. We model this in our hiring process for our partners like Macquarie Group. ✅ Applying here is the first step in the hiring process for this role at Macquarie Group. We do not discriminate on the basis of gender identity, sexual orientation, cultural identity, disability, age, or any other non-merit factors. To put it simply, Hatch is for everyone.