Data Engineer — Sydney, Sydney Region

Expired

Back to job search Data Engineer Sydney Apply now Refer someone Within Commodities and Global Markets, our Data Platform team is responsible for building and maintaining the data warehouse and re-usable ETL pipelines for engineering teams. You will work on greenfield projects, building solutions for big data using the newest technology available. At Macquarie, we are working to create lasting value for our communities, our clients and our people. We are a global financial services group operating in 34 markets and with 54 years of unbroken profitability. You’ll be part of a supportive team where everyone - no matter what role - contributes ideas and drive outcomes. What role will you play? As a Platform Data Engineer, you will be responsible for building new features on our data platform primarily in Python, these could include re-usable data quality rules and data observability capabilities for reporting. You will also be responsible for making ease-of-use improvements to the platform for the engineering teams that use it, as well as security vulnerability and credential management on the platform. You will be working closely with different teams including the Group Data Office (GDO), data onboarding engineering teams, technical testing teams, business analysts and architects and be involved in all stages of the SDLC from solution design through to build, test and demo to the business. What you offer? Experience: using AWS or other cloud providers such as GCP or Azure setting up an ETL Orchestration framework such as Apache Airflow or alternatives (Dagster, Prefect, Luigi) setting up CI/CD systems such as ArgoCD, Jenkins, Bamboo with credential/certificate management such as AWS KMS, CyberArk, Venafi Knowledge of: Python, Bash and SQL release management/deployment for ETL pipelines (testing, linting, rollback) Git (Bitbucket) and GitOps, particularly trunk workflow containerisation such as Docker and Kubernetes (EKS) best practices for logging (Grafana, Prometheus, Splunk) server management for VMs (EC2) infrastructure as code (Terraform, Cloud Formation) event streaming (Kafka, MSK, Solace) big data/data warehouse management (Redshift) Networking (ingress/egress rules) We love hearing from anyone inspired to build a better future with us, if you're excited about the role or working at Macquarie we encourage you to apply. Benefits Macquarie employees can access a wide range of benefits which, depending on eligibility criteria and location, include: Hybrid and flexible working arrangements Wellbeing and service bonus leave Up to 20 weeks paid parental leave as well as benefits to support you as you transition to life as a working parent Paid volunteer leave and donation matching Range of benefits to support your physical, psychological and financial wellbeing About the Corporate Operations Group In our Corporate Operations Group, you will work at the heart of Macquarie. Join a collaborative team who accelerate digitalisation, sustainability and social impact for the benefit of our people, customers, shareholders and communities. Our teams include technology, digital transformation and data, operations, human resources, business services, corporate strategy and solutions and the Macquarie Group Foundation. Our commitment to Diversity, Equity and Inclusion We are committed to providing a working environment that embraces diversity, equity, and inclusion. We encourage people from all backgrounds to apply for a role regardless of their identity, including gender, race, ethnicity, cultural identity, nationality, age, sexual orientation, gender identity, intersex status, marital or family status, neurodiversity, religion or belief, disabilities, or socio-economic background. If you require adjustments to your working arrangements or the recruitment process, please let us know when applying. Apply now Refer someone About Macquarie A career at Macquarie means you’ll have the opportunity to develop new skills, explore interesting fields and do challenging work that will impact the lives of people around the world—whether it’s accelerating the green energy transition, helping sustain global food supplies, financing social housing projects or investing in essential infrastructure. At Macquarie, we’re empowering people to innovate and invest for a better future. Macquarie is a global financial group providing clients with asset management, retail and business banking, wealth management, leasing and asset financing, market access, commodity trading, renewables development, specialist advisory, capital raising and principal investment. Find out more at www.macquarie.com/careers Job no: COG-976095 Work type: Agency Worker Location: Sydney Category: Mid-senior, Data & Analytics Group: Corporate Operations Group Division: Technology Recruiter: Patrick Lockington Opening Date: 21/3/2024