Senior Data Engineer — Melbourne, Melbourne Region

What are we after? We are looking for Senior Data Engineers who are keen to progress their career and grow their technical and leadership capabilities. You will be a curious, adaptable and perceptive professional, who can interpret and understand client requirements whilst leading design activities and mentoring junior Data Engineers as you build data pipelines alongside your team. We work across a range of cloud platforms building mission critical data platforms for clients across various industries. You will bring significant experience in delivering data platforms including significant experience with SQL, Python and one or more data platforms (e.g. Spark, Databricks, Snowflake, Synapse/HDInsight, etc). Commercial Databricks experience a definite plus, but not required. You must be an Australian Citizen to be eligible for security clearance, which is a requirement for this role What are the Responsibilities? Design, develop, implement, and support data management solutions to ensure that data users have access to timely and trusted information Develop, maintain, test and evaluate large-scale data processing solutions (in both batch and real time modes) Implement ETL processes/pipelines where required Operationalise predictive models/machine learning algorithms in the data platform Develop and support the data infrastructure (Data Lake & DataMarts and Dashboards) Provide expertise and practical support in developing data platform solutions Provide day-to-day coaching and advice to data engineering peers and other stakeholders on data management techniques, methodologies and technology Drive team initiatives and show an Interest in developing your skillset and the wider team capabilities formulate opinions and actively inspire other team members, whilst continuously challenging the status quo What are the essential skills and qualifications? 4 Years of experience as a Data Engineer SQL (Advanced) and Python (with an ability to write production code, not just script) Experience using AWS Data Modelling (Data Vault 2.0, Star Schema/Dimensional Modelling) Complex problem-solving and contributions to data architecture Ongoing development and support of the data infrastructure (Data Lake/Lakehouse & Data Marts and Dashboards) CI/CD knowledge is desirable (such as GIT, Azure DevOps or Octopus) Knowledge/understanding of key design patterns and relevant tech (will put you ahead of the others): Airflow, Kafka, Databricks/Spark, Synapse/SQL Server, Cassandra, MongoDB, Redshift/PostgreSQL, Snowflake Why should you join Exco Partners? Exco Partners is a Management Consulting firm that leverage capability and expertise across the digital and transformation supply chain. We are a powerful mix of experience, creativity, and engineering; focused on solving the business challenges across customer, employee, and business performance. We are committed to creating an inclusive space. We value our employees for their talent, skills, experiences, and unique perspectives. You are encouraged to bring your empowered, passionate, and authentic self to work every day. We provide a range of work arrangements within our environment, that support your wellbeing, professional development, and social activities. We do this to ensure that our team members are engaged and performing at their best and committed to creating an environment of contribution, development, and technical knowledge. At Exco Partners, we believe that excellence is learned. To get you there, we have designed development pathways to enable you to progress and upskill to the next level or role. This is achieved through mentorship, hands-on experience, and intelligent, efficient application of learning daily. We encourage all employees to mentor team members up and downstream from their roles and lead through demonstrated expertise and commitment to their personal development. Our aim is to ensure we provide a remarkable employee experience, which we deliver through our highly flexible working arrangements. We deliver a best-in-class consultant experience by providing you with a real work-life balance, that delivers more autonomy and freedom in when, where and how you work best. We encourage and support diversity and inclusion at Exco Partners such as age, ability, ethnicity, gender, gender identity or expression, religion, or sexual orientation. we believe that a diverse workforce and an inclusive work culture is integral to our company values, and we actively encourage applications from those who bring diversity of thought to our team. It is a condition of employment with Exco Partners that you are fully vaccinated against COVID-19, as all Company workers will be required to enter both Company and Client workspaces, at least from time to time, and must be fully vaccinated to do so. For any avoidance of doubt, this direction is given to all workers of the Company.