Senior Databricks Specialist Lead | AI & Data | Sydney
Tasks
- Architect end to end Databricks platforms
- Build and scale lakehouse solutions
- Design data and AI platforms
- Drive delivery across multiple workstreams
- Ensure performance reliability and governance
- Guide engineering teams on best practices
- Lead technical solution design sessions
- Manage infrastructure as code deployments
- Mentor engineers and define best practices
- Optimize SQL queries and Spark performance
- Perform batch and streaming pipeline engineering
- Support CI/CD pipelines
- Translate requirements into scalable data solutions
Perks/Benefits
- Flexible working options
- Market-leading parental leave
- Paid volunteering days
- Retail discounts
- Return to work support package
- Wellbeing leave
Skills/Tech-stack
AWS | Apache Spark | Azure | Batch Processing | CI/CD | Cloud platform | DBT | Data Governance | Databricks | Delta Lake | Delta Live Tables | Delta Live) | Git | Google Cloud | Google Cloud Platform | Infrastructure as Code | Medallion Architecture | Performance Tuning | PySpark | Python | Real Time | Real-time analytics | SQL | Scala | Streaming Data | Terraform | “as-code”
Education
N/A
Roles
Regions
Countries
States
Cities
Related jobs
-
Senior Data Engineer | Snowflake & DBT AUD 115K-125KAWS Lambda | AWS S3 | Apache Airflow | CI/CD | DBTContract extension potential | Hybrid work modelSenior-level ContractSydney, New South Wales, Australia R13h ago
-
Software Engineer (Machine Learning & Multimodal AI) AUD 113K-123KDeep learning | Git | GitHub | GitLab | Machine LearningFlexible work options | Workplace adjustments for disabilityMid-level Full TimeSydney, NSW16h ago
-
Data Engineer AUD 115K-125KAPI Gateway | AWS | AWS Glue | AWS Lambda | Airflow9-day fortnight | Additional Well Being Days | Flexible work hours | Long Service Leave Pro Rata | Paid leave optionsMid-level Full TimeLeederville, WA, AU21h ago
-
Bash | Cloud platform | Data Pipelines | Distributed Systems | DockerAutonomy | Bonus opportunities | Collaborative culture | Distributed first work environment | Equity opportunitiesSenior-level Full TimeAustralia R1d ago
-
Senior Data Engineer – Snowflake / dbt / Airflow AUD 150K-185KAirflow | CI/CD | Cost Optimization | DBT | Data GovernanceSenior-level Full TimeSydney, New South Wales 2000, Australia1d ago
-
LLM Ops Engineer AUD 130K-150KA B Deployment | A/B | AWS | Alerting | AutoscalingEquity compensation | Flexible hybrid working | Personal development budgetSenior-level Full TimeMelbourne1d ago
-
Senior Marketing Analytics Engineer - Remote AUD 110K-120KBusiness Intelligence | Data Catalog | Data Modeling | Data Visualization | ForecastingEmployee stock options | Learning and development | Parental leave | Remote work | WFH office expense budgetSenior-level Full TimeSydney, New South Wales 2000, Australia R1d ago
-
ML Engineer AUD 150K-200KAmazon SageMaker | BigQuery | CI/CD | Cloud Run | Cloud platformCareer development opportunities | Community volunteering | Company events and celebrations | Hackathons | Health and wellness programSenior-level Full TimeSouth Melbourne, Victoria1d ago
-
Data Engineer AUD 90K-120KA/B | A/B Testing | Attribution | B testing | BigQueryFlexible work environment | Learning and training budget | Snacks and drinks | Team eventsMid-level Full TimeBarangaroo, NSW, Australia1d ago
-
Advanced Analytics Senior Analyst AUD 129K-142KCompliance testing | Controls Testing | Dashboards | Data Pipelines | Data WarehousingSenior-level Full TimeEveleigh, NSW - 5-7 Central Ave, …1d ago
-
Staff Data Engineer AUD 130K-142KAWS | AWS Glue | AWS Lambda | Agile | Amazon AthenaEmployee assistance support | Flexible work scheduleSenior-level Full TimeEveleigh, NSW - 1 Locomotive Street, …1d ago
-
Staff Data Engineer (AWS Cloud and AI) AUD 129K-140KAPI Gateway | AWS CloudFormation | AWS DataZone | AWS Glue | AWS Lake FormationFlexible work hours | Hybrid work model | Job-sharing | Part-time optionsSenior-level Full TimeSydney, NSW - CBP South, 11 …1d ago
-
Senior Data Engineer AUD 129K-142KAccess Control | Agile | Azure | Data Governance | Data ModelingAnnual salary review | Career growth opportunities | Employee assistance programs | Employee discounts | Health and wellness programsSenior-level Full TimeAustralia | SEQ | Brisbane - …1d ago
-
AI Observability | AWS | Azure | CI/CD | Cost ControlCareer advancement | Exposure to emerging technologies | Fully remote | Professional development | Work-life balanceSenior-level Full TimeAustralia R3d ago
-
Forward Deployed Engineer, Gen AI, Google Cloud AUD 110K-130KAPIs | Agent systems | Cloud platform | CrewAI | EvaluationMid-level Full TimeDocklands VIC, Australia; Sydney NSW, Australia4d ago
-
AI Deployment Engineer AUD 130K-180KChatGPT | Cloud Architecture | Generative AI | JavaScript | Machine LearningHybrid work model | Relocation assistanceSenior-level Full TimeSydney, Australia4d ago
-
Senior Data Engineer AUD 135K-155KArangoDB | Azure | CCPA | CI/CD | Conformed DimensionsAnnual leave | Collaborative team culture | Flexible working environment | Generous parental leave | Global work experienceSenior-level Full TimeMelbourne, VIC, Australia4d ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerAsynchronous culture | Competitive salary | Friendly work environment | Remote/distributed teamMid-level Full TimeSydney, Australia4d ago
-
Data Engineer AUD 122K-135KDimensional Modeling | ELT | ETL | Git | GitHubFlexible schedule | Free breakfast | Free snacks | Hybrid work | Live sportsSenior-level Full TimeBrisbane, Queensland, Australia4d ago
-
Chief Engineer - Engineering Data Platform AUD 100K-190KAPIs | AWS | Automation | CI/CD | Cloud ComputingExecutive-level Full TimeEveleigh, NSW - 1 Locomotive Street, …4d ago
-
Staff Engineer Chapter Lead – Generative AI AUD 140K-150KAI Governance | AI ML system security | AI/ML | AWS | AWS CDKSenior-level Full TimeSydney, NSW - CBP South, 11 …4d ago
-
Data Engineering & Modelling Lead AUD 129K-142KCybersecurity | Data Governance | Integration | Internet of Things | IoT platformsFlexible work options | Hybrid work optionsSenior-level Full TimeSouth Eveleigh, NSW, AU, 20154d ago
-
Principal Data Engineer AUD 149K-173KAutomated testing | CI/CD | Cloud Architecture | Data Engineering | Data GovernanceHybrid workingSenior-level Full TimeSydney, New South Wales 2000, Australia4d ago
-
Staff Machine Learning Engineer (Platform) AUD 130K-180KAWS | Azure | CUDA | Data Quality | Data WarehousingEquity compensation | Flexible work environment | Office snacks | Regular office eventsSenior-level Full TimeSydney5d ago
-
Senior Data Engineer AUD 125K-138KBackup and Recovery | Data Architecture | Data Cleansing | Data Governance | Data ModelingCollaborative environment | Flexible work arrangements | Onsite work | Supportive team cultureSenior-level Full TimeCanberra, Australian Capital Territory 2600, Australia5d ago