Data Engineering Lead
AUD 129K-175K (estimate) Senior-level Full Time
Tasks
- Define coding modelling and deployment standards
- Design enterprise data platform architecture
- Drive migration from legacy ETL and warehouses
- Ensure data governance and compliance
- Establish monitoring and alerting standards
- Guide lakehouse adoption
- Implement data lineage standards
- Implement data quality standards
- Implement data retention standards
- Introduce modular pipelines version control and automated testing
- Lead delivery of data initiatives
- Lead implementation and optimization of Microsoft Fabric
- Manage incident response root cause analysis and resolution
- Mentor data engineers
- Modernize legacy pipelines
- Operate production data pipelines
- Reduce technical debt and improve maintainability
- Remove delivery blockers and coordinate teams
- Translate requirements into scalable solutions
- Uplift engineering capability with modern tools
Perks/Benefits
- N/A
Skills/Tech-stack
Automated testing | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Monitor | Azure SQL | Azure SQL Database | Azure Synapse | Azure Synapse Analytics | C# | CI/CD | DBT | Data Factory | Data Governance | Data Lake Storage | Data Lineage | Data Management | Data Modeling | ERP | GitHub Actions | Grafana | Incident Management | Kusto Query | Kusto Query Language | Lakehouse Architecture | MDX | Master Data | Master Data Management | Medallion Architecture | Microsoft Fabric | Microsoft Purview | Monitoring | Multidimensional modeling | PL/SQL | Power BI | PySpark | Python | Query Language | SAP BusinessObjects | SQL | SQL Database | Semantic Modeling | Synapse Analytics | Tableau | Terraform | Version control
Related jobs
-
Cloud and AI Solution Architect - FSI AUD 129K-142KAgent-based | Agent-based AI | App Service | Application Modernization | As-a-ServiceFlexible work arrangementsSenior-level Full TimeSydney, NSW, AU; VIC,AU; Brisbane, QLD, …5h ago
-
Chief Engineer - Data Platforms AUD 60K-200KAgile | Apache Airflow | Apache Kafka | Artificial Intelligence | AzureAdditional leave options | Employee discounts | Flexible work arrangements | Tailored learning and development | Volunteering opportunitiesExecutive-level Full TimeSydney, NSW, Australia10h ago
-
Data Quality Management Lead AUD 125K-135KAgile | Critical Data Elements | Data Design | Data Design Authority | Data ElementsGender-neutral paid parental leave | Hybrid working | Income protection insurance | LinkedIn Learning | Meeting free breaksSenior-level Full TimeSydney, NSW, Australia11h ago
-
Agile | Amazon Web Services | Artificial Intelligence | Azure | Backlog ManagementEmployee banking product discounts | Flexible work arrangements | Hybrid work | Learning and development | Leave optionsMid-level Full TimeSydney, NSW, Australia1d ago
-
Advanced Analytics | Artificial Intelligence | Azure | Cloud Computing | Cloud platformAdditional rest day | Discounted health insurance | Volunteer impact daySenior-level Full TimeSydney, Australia1d ago
-
Manager – Data Platforms AUD 127K-180KAutomation | Backlog Management | Data Engineering | Data Governance | Data QualitySenior-level Full TimeSydney, Australia1d ago
-
Staff / Lead Data Engineer (AWS Cloud) AUD 130K-138KAI Model Inference | AI Model Training | AI model | AWS | AWS GlueFlexible work hours | Job shareSenior-level Full TimeSydney, NSW - CBP North, 1 …1d ago
-
Solutions Architect AUD 147K-185KApache Spark | Big Data | Big data analytics | Cloud platform | Data analyticsSenior-level Full TimeQueensland, Australia2d ago
-
Data Platform Manager AUD 120K-180KAI analytics | Analytics engineering | Data Engineering | Data Governance | Data ModelingESOP | Learning and development opportunities | Parental leave | Remote work | Subsidized egg freezingMid-level Full TimeSydney, New South Wales 2000, Australia2d ago
-
Head of Data Platforms AUD 103K-110KAIOps | Azure | CI/CD | Data Governance | Data IngestionAdditional leave | Career development opportunities | Discounts and entitlements | Flexible superannuation contributions | Flexible working optionsExecutive-level Full TimeSydney, NSW2d ago
-
AI Architect - Databricks AUD 140K-180KAmazon Web Services | Azure | CI/CD | Compliance | Data GovernanceSenior-level Contract Full TimeSydney, New South Wales, Australia3d ago
-
A/B | A/B Testing | Adobe Analytics | Attribution | Automated testingDiscounts | Fitness classes | Free parking | Free parking BBQ area mini supermarket fooderie hub school holiday program | Gym facilitySenior-level Full TimeHawthorn East Melbourne, VIC, AU, 31233d ago
-
Lead AI Engineer AUD 142K-150KAPIs | AWS | Agents | Autogen | Automated testingEmployee banking discounts | Flexible work arrangements | Learning and development | Volunteering opportunitiesSenior-level Full TimeAustralia6d ago
-
AI Solution Architect - Advisory AUD 60K-140KAI Search | Artificial Intelligence | Azure AI | Azure AI Search | Azure DataFlexible working hours | Flexible working locations | Health and wellbeing initiatives | Learning and growth opportunities | Paid parental leaveSenior-level Full TimeSydney, NSW, Australia6d ago
-
AI Solution Architect - Advisory AUD 60K-140KAI Search | Artificial Intelligence | Azure AI | Azure AI Search | Azure DataCareer breaks | Flexible working hours | Flexible working locations | Generous paid parental leave | Health and wellbeing initiativesSenior-level Full TimeSydney, NSW, Australia7d ago
-
Delivery Solutions Architect AUD 147K-209KApache Spark | Business Analysis | Data Engineering | Data analytics | Delta LakeHybrid work | Travel up to 30 percentSenior-level Full TimeBrisbane, Australia; Melbourne, Australia7d ago
-
Lead Data & AI Architect AUD 147K-195KAWS Redshift | Agent Orchestration | Apex | BigQuery | Cloud ComputingAdoption Assistance | Fertility benefits | Parental leave | Wellbeing reimbursementSenior-level Full TimeAustralia - Sydney7d ago
-
Technical Lead - Data Engineering and Reporting AUD 70K-75KAWS | Cloud Computing | Data Engineering | Data Governance | Data MigrationSenior-level Full TimeRemote Working - AUS - Adelaide, … R7d ago
-
AIX | AWS Glue | AWS Lambda | AWS S3 | AirflowSenior-level Full TimeEveleigh, NSW - 1 Locomotive Street, …7d ago
-
Lead AI Engineer AUD 135K-145KAWS | Agentic AI | Azure | Cloud platform | Deployment PipelinesCareer opportunities | Coaching and training | Generous leave entitlements | Hybrid working environment | Learning and developmentSenior-level Full TimeMelbourne, Australia7d ago
-
Artificial Intelligence - Architect AUD 120K-135KAWS | Apache Kafka | Apache Spark | Azure | Computer VisionCooperative work environment | Diversity and inclusion | Global culture | Training opportunitiesMid-level Contract Full TimeSydney, New South Wales, Australia8d ago
-
Lead Data Scientist AUD 90K-100KAWS | Agile | Azure | Databricks | DockerFinancial wellbeing services | Hybrid work | Loyalty leave | Medical support | Mental health supportSenior-level Full TimeSydney, NSW, Australia8d ago
-
Data Science Manager - Video/Social Media AUD 80K-95KData Modeling | Experimentation | Lifecycle analytics | Machine Learning | Product AnalyticsEquity packages | Flexible leave options | Inclusive parental leave | Office setup allowance | Wellbeing allowanceMid-level Full TimeMelbourne, VIC, Australia9d ago
-
Service Owner Lead - Data Platforms AUD 125K-145KAWS | Agile | Azure | Backlog prioritization | ConfluenceEmployee discounts | Flexible working | Learning and development | Parental leave | Volunteering opportunitiesSenior-level Full TimeSydney, NSW, Australia10d ago
-
Amazon Web Services | Analytics Cloud | Apache Hadoop | Apache Spark | Artificial IntelligenceContinuous learning | Flexible working models | Health and wellbeing focusSenior-level Full TimeNorth Sydney, NSW, AU, 206010d ago