Senior Data Engineer – Databricks / AWS
Melbourne, Victoria 3000, Australia
AUD 150K-190K (estimate) Senior-level Full Time
Tasks
- Apply data lake and data warehouse architecture
- Build CI/CD pipelines
- Build data pipelines
- Create data prototypes and dashboards
- Deploy enterprise data platforms
- Design data platforms
- Develop Python and PySpark pipelines
- Ensure code quality and testing
- Implement ETL workflows
- Process and transform large scale datasets
- Provision and manage Databricks with Terraform
- Translate requirements into scalable data solutions
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Apache Spark | CI/CD | DBT | Databricks | Deployment Automation | Git | GitHub Actions | PySpark | Python | Terraform | Testing
Education
N/A
Roles
Related jobs
-
Senior-level Full TimeAU-NSW-Sydney8h ago
-
AI Engineer EUR 49K-67KAPIs | Azure | CI/CD | Databricks | JavaScriptCollaborative team | Inclusive workplace | On-site work | Professional developmentMid-level Full TimeEssendon, Victoria 3040, Australia14h ago
-
AI and Automation Specialist - Risk AUD 129K-143KAnalytics | Automation | DAX | Data Governance | Data ModelingSenior-level Full TimeSYDNEY, NSW, AU, 200021h ago
-
Staff Software Development Engineer - Data Acquisition AUD 150K-185KAI Assisted Development | API Development | Agents | Amazon S3 | Amazon Web ServicesSenior-level Full TimeAustralia - Melbourne Office21h ago
-
Junior Data Scientist AUD 80K-90KDAX | Machine Learning | Power BI | Power Pivot | Power QueryEmployee discounts | Hybrid work | Incentives | Onsite parking | Team learning and knowledge sharingEntry-level Full TimeMacquarie Park, NSW, AU1d ago
-
AWS | AWS CloudFormation | AWS Glue | AWS Lambda | AWS Step FunctionsFlexible work location | Fully remote | Ownership and leadership opportunities | Technical autonomySenior-level Contract Full TimeAustralia R1d ago
-
Forward Deployed Engineer, GenAI, Financial Services AUD 118K-135KAPI Integration | Agent systems | Cloud platform | Cost Optimization | CrewAIMid-level Full TimeSydney NSW, Australia; Melbourne VIC, Australia1d ago
-
Senior Machine Learning Engineer AUD 144K-180KAWS | Algorithms | Anomaly Detection | CI/CD | Cloud platformClassPass membership | Culture Swap Days | Employee resource groups | Extra annual leave | Flexible work hoursSenior-level Full TimeSydney, Australia R1d ago
-
Senior Machine Learning Engineer AUD 144K-180KAWS | Algorithms | Anomaly Detection | Azure | CI/CDClassPass membership | Employee resource groups | Extra annual leave | Flexible work | Learning and developmentSenior-level Full TimeMelbourne, Australia R1d ago
-
Agent workflows | Data | Deployment | Integration | JavaScriptCareer growth opportunities | Direct influence on customer success | Flexible working hours | Remote-friendly | Work with talented technical teamMid-level Full TimeAustralia1d ago
-
Principal Data Engineer AUD 150K-165KAWS CloudFormation | Amazon Kinesis | Apache Airflow | Apache Kafka | Apache SparkSenior-level Full TimeDOCKLANDS, VIC, AU, 30081d ago
-
Data Engineer AUD 100K-130KAWS | AWS CDK | AWS Glue | Apache Airflow | Apache FlinkExtra annual leave | Leadership development programs | LinkedIn Learning | Perkbox discountsMid-level Full TimeSydney, Australia1d ago
-
Senior Data Engineer - Data Platform AUD 120K-140KAPIs | AWS | AWS Cloud | AWS Cloud Development Kit | AWS GlueCollaborative work culture | Extra annual leave days | Innovation culture | Leadership development programs | LinkedIn LearningSenior-level Full TimeSydney, Australia1d ago
-
AI Engineering Lead AUD 137K-143KAgile | Amazon Web Services | Docker | IAM | LoggingDiscounted flights | Discounts on accommodation | Discounts on car hire | Discounts on experiences | Discounts on lounge membershipSenior-level Full TimeBrisbane, Sydney R2d ago
-
Applied AI Engineer - ANZ USD 180K-225KAgentic Workflows | DeepWiki | Developer Enablement | JavaScript | LLMSenior-level Full TimeSydney2d ago
-
Data Engineer - Data Platforms AUD 90K-120KAWS | Apache Flink | Automation | CI/CD | DBTHybrid work model | Office collaboration days | Remote work flexibilityMid-level Full TimeAU: Melbourne: (260 Burwood Rd)2d ago
-
Data Pipelines | Deep learning | Generative AI | Image Generation | Infrastructure EngineeringAnnual wellbeing allowance | Equity packages | Flexible leave options | Inclusive parental leaveSenior-level Full TimeSydney, Australia R2d ago
-
Senior Data Engineer AUD 121K-136KApache Airflow | Apache Spark | Cloud Computing | Data Modeling | Data WarehousingSenior-level Full TimeCity Campus, Australia2d ago
-
Staff Gen AI Engineer, Forward Deployed, Google Cloud AUD 152K-180KAgent systems | Cloud platform | Cost Optimization | Evaluation | Generative AISenior-level Full TimeSydney NSW, Australia3d ago
-
Senior Embedded Linux Software Engineer – Edge AI & IoT AUD 120K-150KAudio signal processing | C# | C++ | CSI | Cloud APIsSenior-level Full TimeRyde, NSW, Australia3d ago
-
API Integration | Access Control | Audit Logging | Automated Quality | Automated quality gatesAnnual company offsite gatherings | Annual professional development budget | Coworking allowance | Dependent coverage support | Employee equityMid-level Full TimeAustralia R3d ago
-
Data Engineer AUD 100K-110KAccess Control | Data Governance | Data Modeling | Data Quality | Data integrationBi-weekly breakfasts | Clothing allowance | Culture incentives | Employee discount | Flexible working arrangementsMid-level Full TimeMascot, New South Wales 2020, Australia3d ago
-
Solution Designer / Lead Data Engineer AUD 135K-158KAPI Integration | Amazon Kinesis | Amazon Redshift | Apache Airflow | Apache SparkAI Driven Learning Platform | Career Development Programs | Community and interest groups | Discounted health insurance | Paid parental leaveSenior-level Full TimeSydney, NSW, Australia3d ago
-
Senior Machine Learning Engineer (Platform / MLOPs) AUD 129K-150KAPI Development | Amazon EKS | ArgoCD | Arize AI | Batch inferenceAnnual flu vaccinations | Cycling friendly | Hybrid flexibility | In-office lunch | Quarterly wellbeing day offSenior-level Full TimeBarangaroo, NSW, Australia3d ago
-
Advanced Analytics Analyst AUD 95K-100KAWS | Agile | Artificial Intelligence | Data Visualization | Machine LearningEntry-level Full TimeSydney, NSW - CBP South, 11 …3d ago