Data Engineer — Brisbane CBD, Brisbane

Expired

About the role As a Data Engineer, you will play a key role supporting digital projects that support operational challenges that are currently being addressed through manual methods. Responsibilities Define the data lifecycle (including data models and data sources for analytics / ML platforms), and to gather and clean business data from the business in order to provide ready-to-work inputs for Data Scientists and other consumers. Critical in the successful development and implementation of digital solutions and products, as these are built on effective access to high-quality data. Strong expertise in data mining and information retrieval to design, develop, optimise, and maintain cloud native data architecture and pipelines that adhere to ETL principles and business goals. Utilise a product mindset to build and maintain reusable data pipelines and the data platform at a scale. Partner with the Data Modelling Engineer to ensure the data is delivered to meet the customer and quality requirements. Skills and experience Data Warehousing / Data Governance experience, including: Experience in multiple database technologies such as RDBMS and NoSQL AWS Cloud experience, including;: Experience with AWS cloud services: S3, EC2, EMR, RDS, Lambda, Cloud Watch, Step Functions and Managed Airflow; Experience in designing and building streaming data ingestion, analysis and processing pipelines in cloud native technologies; Ideally have experience with Infrastructure as Code using Terraform Software Development experience, including: Strong experience with Python and SQL; Experience with data orchestration tools such as Apache Airflow Hands on experience working in data engineering or architecture role Experience working in DevOps, Agile, Scrum, Continuous Delivery and/or Rapid Application Development environments Attitude to thrive in a fun, fast-paced start-up like environment Experience working on a collaborative Agile product team Self-motivated with strong problem-solving and learning skills Flexibility to changes in work direction as the project develops Excellent communication, listening, and influencing skills Preferred bachelor's degree in Computer Science, IT, Engineering, or related field with strong experience in cloud based technology solutions For more information or a confidential discussion, please contact Alan Kocjman - alan.kocjmanpeoplebank.com.au on quoting reference 262516. To apply please click the 'Apply Now' button. Diversity and inclusion are strongly supported at Peoplebank. People of all nationalities, gender identities, and cultural backgrounds, including Aboriginal and Torres Strait Islander Peoples, are encouraged to apply.