Principal Data Engineer
AUD 150K-165K (estimate) Senior-level Full Time
Tasks
- Automate data product development
- Define data platform technical strategy
- Design enterprise data pipelines
- Develop reusable data engineering frameworks
- Drive DataOps and MLOps CI CD
- Enable MLOps and model governance
- Establish data engineering standards
- Implement data quality frameworks
- Implement metadata management
- Lead Data Platform Centre of Excellence
- Lead Databricks lakehouse architecture
- Lead platform observability and monitoring
- Manage pipeline orchestration
- Partner to productionize machine learning models
- Provide technical leadership and mentoring
Perks/Benefits
- N/A
Skills/Tech-stack
AWS CloudFormation | Amazon Kinesis | Apache Airflow | Apache Kafka | Apache Spark | Automated retraining | Automated testing | Azure ARM | Azure Bicep | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DevOps | Azure Event | Azure Event Hubs | Azure Key Vault | Azure Synapse | Azure Synapse Analytics | CI/CD | Compliance | Data Factory | Data Governance | Data Lake Storage | Data Lineage | Data Quality | Data Vault | Data platform | Data platform observability | DataOps | Databricks | Databricks SQL | Databricks Workflows | Delta Lake | Dimensional Modeling | Event Hubs | Feature Store | GitHub Actions | Infrastructure as Code | Jenkins | Key Vault | Lakehouse | MLOps | MLflow | Metadata Management | Microservices | Model Governance | Model Monitoring | Platform Observability | Power BI | PySpark | Python | REST APIs | SQL | Security | Spark SQL | Synapse Analytics | Tableau | Terraform | Unity Catalog | “as-code”
Education
N/A
Roles
Data Engineer | Engineer | Principal | Principal Data Engineer
Related jobs
-
Senior Data Engineer AUD 146K-155KAnomaly Detection | CI/CD | DBT | Data Modeling | Data pipelineCareer growth opportunities | Employee discounts | Flexible working arrangements | Health and wellbeing servicesSenior-level Full TimeMelbourne, AU19h ago
-
Databricks Engineer AUD 100K-140KAPIs | AWS | Azure | CI/CD | Data ModelingCareer breaks | Career development program | Family Inclusive Workplace certification | Flexible work arrangements | Local and international career opportunitiesMid-level Full TimeSydney, International House, 3 Sussex St, …19h ago
-
Senior Engineer- AI AUD 160K-180KADLS | AI Search | AKS | Azure | Azure AIFlexible working arrangements | Inclusion and diversity focus | Professional learning and career pathways | Remote/hybrid work | Supportive workplaceSenior-level Full TimeAustralia1d ago
-
Senior Engineer- AI AUD 160K-180KAI Search | AKS | APIs | Access Control | AzureCareer pathways | Inclusion and diversity | Mentorship | Ongoing learning | Remote/hybrid workSenior-level Full TimeAustralia1d ago
-
Senior Analytics Engineer AUD 150K-170KA/B | A/B Testing | B testing | BigQuery | DBTCareer growth | Health impact mission | Supportive work environment | Work from anywhereSenior-level Full TimeAustralia R1d ago
-
Senior AI Engineer (Risk & Payments) AUD 160K-188KAI monitoring | Agent architecture | Autogen | CrewAI | Fine TuningSenior-level Full TimeAU - Sydney1d ago
-
Senior Data Engineer AUD 133K-146KAgile | Azure Data | Azure Data Factory | Azure Data Governance | Azure DevOpsHybrid work environment | Learning and career development | Paid parental leave | Retail discounts | Salary continuance insuranceSenior-level Full TimeMacquarie Park, New South Wales 2113, …1d ago
-
Applied AI Engineer | Senior Analyst | Tax AUD 119K-161KAPI Integration | Access Management | Agent Orchestration | Agent systems | Automated testingFlexible working options | Market-leading parental leave | Paid volunteering days | Retail discounts | Return to work support packageSenior-level Full TimeMelbourne, VIC, AU1d ago
-
Analytics Engineer AUD 78K-90KApache Airflow | BI Dashboards | DBT | Data Modeling | Data PipelinesDog Training Allowance | Flexible working | Paid parental leave top up | Personal development budget | Pet DiscountsEntry-level Full TimeSydney, New South Wales, Australia1d ago
-
AI Explainability | Architecture governance | Artificial Intelligence | CI/CD | Cloud ComputingSenior-level Full TimeCanberra, Australian Capital Territory, Australia2d ago
-
Senior / Staff Applied Scientist - AI Products AUD 130K-160KCalculus | Computer Vision | Data Pipelines | Data Processing | Language ModelsCollaborative boost days | Hybrid working model | Office access | Remote work flexibilitySenior-level Full TimeAU: Melbourne: (260 Burwood Rd) R2d ago
-
Senior Data Engineer AUD 140K-155KCode review | Dimensional Modeling | ELT | ETL | JSONFlexible work hours | Free breakfast | Free snacks | Hybrid work | Live Sports EventsSenior-level Full TimeBrisbane, Queensland, Australia R2d ago
-
AI Agents | API Design | AWS | Agentic Workflows | Amazon BedrockSenior-level Full TimeMelbourne, VIC - 435 Bourke Street, …2d ago
-
Chief Engineer - Engineering Data Platform AUD 150K-200KAPIs | AWS | Artificial Intelligence | CI/CD | ContainersExecutive-level Full TimeEveleigh, NSW - 1 Locomotive Street, …2d ago
-
Senior Designated Support Engineer AUD 150K-186KAWS | Alerting | Amazon Redshift | Apache Spark | AzureSenior-level Full TimeSydney, Australia4d ago
-
Staff Designated Support Engineer AUD 150K-215KAWS | Alerting | Amazon Redshift | Apache Spark | AzureSenior-level Full TimeSydney, Australia4d ago
-
AI Foundry | AWS Bedrock | AWS GovCloud | AWS SageMaker | Agentic AI401k match | Career development resources | Dental and vision insurance | Flexible work arrangements | Medical planSenior-level Full TimeAustralia5d ago
-
APIs | Cloud platform | Debugging | Evaluation Pipelines | Google CloudDirect access to research and engineering experts | High travelMid-level Full TimeSydney NSW, Australia5d ago
-
Digital Analytics Specialist AUD 80K-95KBigQuery | Campaign Manager | Conversion API | Customer Match | Data ModelingMid-level Full TimeMelbourne R5d ago
-
Automation | Azure | Azure Data | Azure Data Explorer | CSVRemote work opportunityMid-level Full TimeAustralia R5d ago
-
Senior Data Engineer AUD 260K-340KAWS RDS | Azure | CDC | DAX | DBTAnnual short term incentive scheme | Hybrid work model | Paid parental leave | Restricted stock awards | Up to 5 weeks annual leaveSenior-level Full TimeSurry Hills, NSW, Australia R5d ago
-
AWS | Apache Spark | Audit Logging | Automated testing | CI/CDSenior-level Full TimeMelbourne, VIC, AU6d ago
-
Senior AI Engineer, AI Accelerator AUD 143K-180KAgent Design | Amazon Web Services | Artificial Intelligence | Azure OpenAI | CI/CDCareer development opportunities | Convenient location | Free OnePass membership | Hybrid working | Modern end of trip facilitiesSenior-level Full TimeMelbourne, VIC, AU6d ago
-
Data Engineer – AI/ML | Google Cloud AUD 110K-140KAPI Integration | Backtesting | BigQuery | Cloud Functions | Cloud MonitoringEmployee discounts | On-site work | Parking providedMid-level Full TimeSydney Olympic Park, New South Wales …6d ago
-
Staff Data Engineer AUD 140K-146KAPI Gateway | AWS DataZone | AWS Glue | AWS Lake | AWS Lake FormationChanging start and finish times | Flexible working arrangements | Hybrid work with office time | Job share | Part-time arrangementsSenior-level Full TimeSydney, NSW - CBP South, 11 …6d ago