Data Platforms Engineer (Azure DataBricks)
North Ryde, NSW, Australia
AUD 129K-138K (estimate) Senior-level Full Time
Tasks
- Build maintain ETL processes
- Design scalable data pipelines
- Develop PySpark notebooks and workflows
- Ensure data security and governance
- Implement CI CD deployments
- Integrate data from multiple sources
- Maintain data quality reliability performance
- Maintain platform performance reporting
- Monitor optimize data workflows
- Support cloud data platform development
- Write Spark SQL queries
Perks/Benefits
- Access to professional memberships and industry networks
- Discounted services
- Employee assistance program
- Flexible work arrangements
- Parental leave
- Professional development programs
Skills/Tech-stack
Apache Spark | Azure Data | Azure Data Factory | Azure DevOps | CI/CD | Data Factory | Data Governance | Data Security | Data integration | Databricks | Delta Lake | ETL | Git | PySpark | Spark SQL
Regions
Countries
States
Related jobs
-
Data Engineer AUD 130K-165KAgile | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageDiversity and inclusion | Hybrid working | Professional growthSenior-level Full TimeMelbourne, Australia17h ago
-
AWS | Access Management | CI/CD | Data Engineering | Data platformFlexible working options | Market-leading parental leave | Paid volunteering days | Retail discounts | Return to work support packageSenior-level Full TimeSydney, NSW, AU1d ago
-
Senior-level Full TimeAU-NSW-Sydney3d ago
-
AI Engineer EUR 49K-67KAPIs | Azure | CI/CD | Databricks | JavaScriptCollaborative team | Inclusive workplace | On-site work | Professional developmentMid-level Full TimeEssendon, Victoria 3040, Australia3d ago
-
AI and Automation Specialist - Risk AUD 129K-143KAnalytics | Automation | DAX | Data Governance | Data ModelingSenior-level Full TimeSYDNEY, NSW, AU, 20003d ago
-
Staff Software Development Engineer - Data Acquisition AUD 150K-185KAI Assisted Development | API Development | Agents | Amazon S3 | Amazon Web ServicesSenior-level Full TimeAustralia - Melbourne Office3d ago
-
Staff Data Engineer AUD 129K-140KBatch Processing | Big Data | CI/CD | Data Cleansing | Data EngineeringSenior-level Full TimeMelbourne, VIC - 435 Bourke Street, …3d ago
-
Senior Data Scientist, ML, NLP, GenAI, Agentic AI AUD 137K-147KAdversarial Testing | Agentic AI | CI/CD | Data Governance | Data QualitySenior-level Full TimeEveleigh, NSW - 1 Locomotive Street, …3d ago
-
Senior-level Full TimeMelbourne, Victoria 3000, Australia4d ago
-
AWS | AWS CloudFormation | AWS Glue | AWS Lambda | AWS Step FunctionsFlexible work location | Fully remote | Ownership and leadership opportunities | Technical autonomySenior-level Contract Full TimeAustralia R4d ago
-
Senior Machine Learning Engineer AUD 144K-180KAWS | Algorithms | Anomaly Detection | CI/CD | Cloud platformClassPass membership | Culture Swap Days | Employee resource groups | Extra annual leave | Flexible work hoursSenior-level Full TimeSydney, Australia R4d ago
-
Senior Machine Learning Engineer AUD 144K-180KAWS | Algorithms | Anomaly Detection | Azure | CI/CDClassPass membership | Employee resource groups | Extra annual leave | Flexible work | Learning and developmentSenior-level Full TimeMelbourne, Australia R4d ago
-
Principal Data Engineer AUD 150K-165KAWS CloudFormation | Amazon Kinesis | Apache Airflow | Apache Kafka | Apache SparkSenior-level Full TimeDOCKLANDS, VIC, AU, 30084d ago
-
Data Engineer AUD 100K-130KAWS | AWS CDK | AWS Glue | Apache Airflow | Apache FlinkExtra annual leave | Leadership development programs | LinkedIn Learning | Perkbox discountsMid-level Full TimeSydney, Australia4d ago
-
Senior Data Engineer - Data Platform AUD 120K-140KAPIs | AWS | AWS Cloud | AWS Cloud Development Kit | AWS GlueCollaborative work culture | Extra annual leave days | Innovation culture | Leadership development programs | LinkedIn LearningSenior-level Full TimeSydney, Australia4d ago
-
Infrastructure Engineer, APAC AUD 92K-127KAWS | Ansible | Bash | CI/CD | DockerCompany-provided equipment | Growth opportunities | Happy hours | Internet reimbursement | Learning opportunitiesMid-level Full TimeAdelaide (Hybrid) R4d ago
-
Data Engineer - Data Platforms AUD 90K-120KAWS | Apache Flink | Automation | CI/CD | DBTHybrid work model | Office collaboration days | Remote work flexibilityMid-level Full TimeAU: Melbourne: (260 Burwood Rd)5d ago
-
API Integration | Access Control | Audit Logging | Automated Quality | Automated quality gatesAnnual company offsite gatherings | Annual professional development budget | Coworking allowance | Dependent coverage support | Employee equityMid-level Full TimeAustralia R6d ago
-
Data Engineer AUD 100K-110KAccess Control | Data Governance | Data Modeling | Data Quality | Data integrationBi-weekly breakfasts | Clothing allowance | Culture incentives | Employee discount | Flexible working arrangementsMid-level Full TimeMascot, New South Wales 2020, Australia6d ago
-
Solution Designer / Lead Data Engineer AUD 135K-158KAPI Integration | Amazon Kinesis | Amazon Redshift | Apache Airflow | Apache SparkAI Driven Learning Platform | Career Development Programs | Community and interest groups | Discounted health insurance | Paid parental leaveSenior-level Full TimeSydney, NSW, Australia6d ago
-
Senior Machine Learning Engineer (Platform / MLOPs) AUD 129K-150KAPI Development | Amazon EKS | ArgoCD | Arize AI | Batch inferenceAnnual flu vaccinations | Cycling friendly | Hybrid flexibility | In-office lunch | Quarterly wellbeing day offSenior-level Full TimeBarangaroo, NSW, Australia6d ago
-
Data Engineer, AI and Data, Technology Consulting AUD 89K-112KAWS | Apache Airflow | Apache Spark | Azure Data | Azure Data FactoryCareer development | Comprehensive benefits package | Flex leave | Flexible work arrangements | Paid parental leaveMid-level Full TimeMelbourne, VIC, AU, 30007d ago
-
Forward Deployed AI Engineer, Australia AUD 119K-161KAWS | Agentic Workflows | Apache Iceberg | Apache NiFi | Apache SparkContinued Career Development | Employee resource groups | Flexible WFH | Generous PTO | Mental and physical wellness programsSenior-level Full TimeAustralia-Sydney-Remote R7d ago
-
Data Engineer AUD 140K-140KAWS | AWS Glue | Airflow | Amazon Athena | Amazon DataZoneFlexible working | Hybrid working | Inclusion networks | Wellbeing supportSenior-level Full TimeSydney Office, Australia7d ago
-
Principal Data Engineer (AWS & Snowflake) AUD 146K-155KAWS | Agile | CI/CD | Data Lake | Data WarehouseFlexible start and finish times | Flexible work arrangements | Job share | Part-time optionsSenior-level Full TimeSydney, NSW - CBP North, 1 …7d ago