Principal Data Engineer
DOCKLANDS, VIC, AU, 3008
AUD 150K-165K (estimate) Senior-level Full Time
Tasks
- Automate data product development
- Define data platform technical strategy
- Design enterprise data pipelines
- Develop reusable data engineering frameworks
- Drive DataOps and MLOps CI CD
- Enable MLOps and model governance
- Establish data engineering standards
- Implement data quality frameworks
- Implement metadata management
- Lead Data Platform Centre of Excellence
- Lead Databricks lakehouse architecture
- Lead platform observability and monitoring
- Manage pipeline orchestration
- Partner to productionize machine learning models
- Provide technical leadership and mentoring
Perks/Benefits
- N/A
Skills/Tech-stack
AWS CloudFormation | Amazon Kinesis | Apache Airflow | Apache Kafka | Apache Spark | Automated retraining | Automated testing | Azure ARM | Azure Bicep | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DevOps | Azure Event | Azure Event Hubs | Azure Key Vault | Azure Synapse | Azure Synapse Analytics | CI/CD | Compliance | Data Factory | Data Governance | Data Lake Storage | Data Lineage | Data Quality | Data Vault | Data platform | Data platform observability | DataOps | Databricks | Databricks SQL | Databricks Workflows | Delta Lake | Dimensional Modeling | Event Hubs | Feature Store | GitHub Actions | Infrastructure as Code | Jenkins | Key Vault | Lakehouse | MLOps | MLflow | Metadata Management | Microservices | Model Governance | Model Monitoring | Platform Observability | Power BI | PySpark | Python | REST APIs | SQL | Security | Spark SQL | Synapse Analytics | Tableau | Terraform | Unity Catalog | “as-code”
Education
N/A
Roles
Data Engineer | Engineer | Principal | Principal Data Engineer
Related jobs
-
Senior Machine Learning Engineer AUD 144K-180KAWS | Algorithms | Anomaly Detection | CI/CD | Cloud platformClassPass membership | Culture Swap Days | Employee resource groups | Extra annual leave | Flexible work hoursSenior-level Full TimeSydney, Australia R9h ago
-
Senior Machine Learning Engineer AUD 144K-180KAWS | Algorithms | Anomaly Detection | Azure | CI/CDClassPass membership | Employee resource groups | Extra annual leave | Flexible work | Learning and developmentSenior-level Full TimeMelbourne, Australia R9h ago
-
Agent workflows | Data | Deployment | Integration | JavaScriptCareer growth opportunities | Direct influence on customer success | Flexible working hours | Remote-friendly | Work with talented technical teamMid-level Full TimeAustralia10h ago
-
Applied AI Engineer - ANZ USD 180K-225KAgentic Workflows | DeepWiki | Developer Enablement | JavaScript | LLMSenior-level Full TimeSydney23h ago
-
Data Engineer - Data Platforms AUD 90K-120KAWS | Apache Flink | Automation | CI/CD | DBTHybrid work model | Office collaboration days | Remote work flexibilityMid-level Full TimeAU: Melbourne: (260 Burwood Rd)1d ago
-
Data Pipelines | Deep learning | Generative AI | Image Generation | Infrastructure EngineeringAnnual wellbeing allowance | Equity packages | Flexible leave options | Inclusive parental leaveSenior-level Full TimeSydney, Australia R1d ago
-
Senior Data Engineer AUD 121K-136KApache Airflow | Apache Spark | Cloud Computing | Data Modeling | Data WarehousingSenior-level Full TimeCity Campus, Australia1d ago
-
Principal Consultant – AI & Data Science AUD 146K-185KAI Services | AI orchestration | AI orchestration frameworks | Apache Spark | Azure AIHybrid workingSenior-level Full TimeBrisbane, Australia1d ago
-
Staff Gen AI Engineer, Forward Deployed, Google Cloud AUD 152K-180KAgent systems | Cloud platform | Cost Optimization | Evaluation | Generative AISenior-level Full TimeSydney NSW, Australia2d ago
-
Senior Consultant / Principal Consultant - Strategic Risk Consulting | Risk & Analytics AUD 90K-110KActuarial Science | Alternative risk transfer | Capital modeling | Captive insurance | Catastrophe modelingCareer growth opportunities | Flexible working arrangements | Professional developmentSenior-level Full TimeSYDNEY, NSW, Australia2d ago
-
Senior Embedded Linux Software Engineer – Edge AI & IoT AUD 120K-150KAudio signal processing | C# | C++ | CSI | Cloud APIsSenior-level Full TimeRyde, NSW, Australia2d ago
-
API Integration | Access Control | Audit Logging | Automated Quality | Automated quality gatesAnnual company offsite gatherings | Annual professional development budget | Coworking allowance | Dependent coverage support | Employee equityMid-level Full TimeAustralia R2d ago
-
Data Engineer AUD 100K-110KAccess Control | Data Governance | Data Modeling | Data Quality | Data integrationBi-weekly breakfasts | Clothing allowance | Culture incentives | Employee discount | Flexible working arrangementsMid-level Full TimeMascot, New South Wales 2020, Australia2d ago
-
Solution Designer / Lead Data Engineer AUD 135K-158KAPI Integration | Amazon Kinesis | Amazon Redshift | Apache Airflow | Apache SparkAI Driven Learning Platform | Career Development Programs | Community and interest groups | Discounted health insurance | Paid parental leaveSenior-level Full TimeSydney, NSW, Australia2d ago
-
Senior Machine Learning Engineer (Platform / MLOPs) AUD 129K-150KAPI Development | Amazon EKS | ArgoCD | Arize AI | Batch inferenceAnnual flu vaccinations | Cycling friendly | Hybrid flexibility | In-office lunch | Quarterly wellbeing day offSenior-level Full TimeBarangaroo, NSW, Australia2d ago
-
Advanced Analytics Analyst AUD 95K-100KAWS | Agile | Artificial Intelligence | Data Visualization | Machine LearningEntry-level Full TimeSydney, NSW - CBP South, 11 …2d ago
-
Data Engineer AUD 100K-114KAWS | Airflow | DBT | Data Modeling | Data PipelinesCommunity grants | Flexible leave | Flexible parental leave | Hackdays | Hybrid workMid-level Full TimeRichmond, Melbourne VIC, Australia2d ago
-
Machine Learning Engineer (Content Understanding) Intern, (TikTok Live Foundation Sydney) - 2027 start (PhD) AUD 65K-70KC++ | Computer Vision | Deep learning | Distributed Systems | GoEntry-level InternshipSydney, New South Wales, Australia3d ago
-
Senior Robotics Software Engineer, Payload Integration AUD 147K-196KAPI Design | ARINC | Bare Metal | C++ | DO-178CComprehensive benefits package | Health benefits | Paid travel opportunities | Recovery BenefitsSenior-level Full TimeSydney, New South Wales, Australia3d ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerAsynchronous culture | Competitive salary | Friendly laid-back atmosphere | Opportunities for impact on learningMid-level Full TimeSydney, Australia3d ago
-
Data Engineer, AI and Data, Technology Consulting AUD 89K-112KAWS | Apache Airflow | Apache Spark | Azure Data | Azure Data FactoryCareer development | Comprehensive benefits package | Flex leave | Flexible work arrangements | Paid parental leaveMid-level Full TimeMelbourne, VIC, AU, 30003d ago
-
Forward Deployed AI Engineer, Australia AUD 119K-161KAWS | Agentic Workflows | Apache Iceberg | Apache NiFi | Apache SparkContinued Career Development | Employee resource groups | Flexible WFH | Generous PTO | Mental and physical wellness programsSenior-level Full TimeAustralia-Sydney-Remote R3d ago
-
Data Engineer AUD 140K-140KAWS | AWS Glue | Airflow | Amazon Athena | Amazon DataZoneFlexible working | Hybrid working | Inclusion networks | Wellbeing supportSenior-level Full TimeSydney Office, Australia3d ago
-
Principal Data Engineer (AWS & Snowflake) AUD 146K-155KAWS | Agile | CI/CD | Data Lake | Data WarehouseFlexible start and finish times | Flexible work arrangements | Job share | Part-time optionsSenior-level Full TimeSydney, NSW - CBP North, 1 …3d ago
-
Data Platform Engineer AUD 100K-125KAggregation | Alteryx | Cloud platform | Continuous integration | CrosstabCareer growth opportunities | Free coffee | Hybrid work | Regular team events | Weekly lunchesMid-level Full TimeChippendale, New South Wales, Australia3d ago