Senior Databricks Specialist Lead | AI & Data | Sydney
Tasks
- Architect end to end Databricks platforms
- Build and scale lakehouse solutions
- Design data and AI platforms
- Drive delivery across multiple workstreams
- Ensure performance reliability and governance
- Guide engineering teams on best practices
- Lead technical solution design sessions
- Manage infrastructure as code deployments
- Mentor engineers and define best practices
- Optimize SQL queries and Spark performance
- Perform batch and streaming pipeline engineering
- Support CI/CD pipelines
- Translate requirements into scalable data solutions
Perks/Benefits
- Flexible working options
- Market-leading parental leave
- Paid volunteering days
- Retail discounts
- Return to work support package
- Wellbeing leave
Skills/Tech-stack
AWS | Apache Spark | Azure | Batch Processing | CI/CD | Cloud platform | DBT | Data Governance | Databricks | Delta Lake | Delta Live Tables | Delta Live) | Git | Google Cloud | Google Cloud Platform | Infrastructure as Code | Medallion Architecture | Performance Tuning | PySpark | Python | Real Time | Real-time analytics | SQL | Scala | Streaming Data | Terraform | “as-code”
Education
N/A
Roles
Regions
Countries
States
Cities
Related jobs
-
Senior AI Engineer, AI Accelerator AUD 130K-157KAWS | Agent Design | Artificial Intelligence | Azure OpenAI | CI/CDCareer development opportunities | Convenient city location | Free Membership | Hybrid working | Modern end of trip facilitiesSenior-level Full TimeMelbourne, VIC, AU10h ago
-
Senior Data Engineer - MS Fabric AUD 150K-155KAccess Control | Automation | Azure | Backup/Restore | Data ModelingSenior-level Full TimeMelbourne, Victoria 3000, Australia20h ago
-
Black box testing | Black-box | Box testing | CAPL | Case DevelopmentAdditional annual leave purchase | Career opportunities local and international | Discounts on products | Employee assistance program | Flexible work arrangementsSenior-level Full TimeClayton, VIC, Australia21h ago
-
Senior MLOps Engineer AUD 75K-100KAWS | AWS Lambda | Amazon EC2 | Amazon EKS | Amazon SageMakerContinuous learning | Hackathons | Hybrid work | Paid gender-affirming care leave | Paid parental leaveSenior-level Full TimeMelbourne, VIC, Australia23h ago
-
Senior Robotics Engineer - Universal Field Robots AUD 116K-127KAgile | Artificial Intelligence | Automated testing | C++ | CI/CDEmployee benefits program | Length of service recognition | Salary sacrifice options | Sandvik wellness program | Training opportunitiesSenior-level Full TimeBrisbane UFR, Australia1d ago
-
Forward Deployed Engineer III, Conversational AI AUD 147K-180KAPIs | Agent systems | Cloud Platforms | Cloud platform | Data PipelinesSenior-level Full TimeMelbourne VIC, Australia; Sydney NSW, Australia3d ago
-
Staff Engineer, Datacenter Server Lifecycle AUD 149K-191KAWS | Asset tracking | Azure | Cloud platform | Firmware verificationFlexible working hours | Generous vacation | Optional equity donation matching | Parental leaveSenior-level Full TimeSydney, Australia3d ago
-
Forward Deployed AI Engineer AUD 148K-180KAWS Bedrock | Apex | CI/CD | Cloud platform | EvalsFlexible working arrangements | Home office expense allowance | MuleSoft certifications paid | Paid parental leave | Project management certifications paidSenior-level Full TimeSydney, Australia R3d ago
-
Associate Data Scientist AUD 100K-120KAirflow | Amazon Redshift | Continuous Deployment | Data Enrichment | Data ModelingCoaching | Equity | Extended end of year break | Five social impact days | Home workspace setup allowanceMid-level Full TimeSydney3d ago
-
Senior Data Engineer (Databricks/Azure) - Hybrid, QLD AUD 150K-165KApache Spark | Azure Data | Azure Data Factory | Azure DevOps | Azure SQLAdditional paid leave for certifications and exams | Digital library access | Employee assistance program | Equipment incentive | Gym and wellbeing programSenior-level Full TimeQueensland, Australia R4d ago
-
Applied AI Engineer AUD 100K-100KAutomation workflows | Compliance | Evaluation | Guardrails | JavaScriptCompetitive benefits | Fast hiring process | Remote workMid-level Full TimeSydney, Australia4d ago
-
Agile | Analytical Skills | Apache Kafka | Apache NiFi | Data MigrationHybrid work | Mentoring coaching and training | Professional development | Work from home flexible arrangementsSenior-level Full TimeCanberra, Australian Capital Territory, Australia R4d ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Competitive compensation | Flexible management | Remote-friendlyMid-level Full TimeMelbourne, Australia4d ago
-
GCP Data Engineer AUD 100K-150KAutomated testing | BigQuery | CI/CD | Cloud Composer | Cloud platformCareer development and learning opportunitiesMid-level Full TimeMELBOURNE, VIC, AU, 30085d ago
-
Data Engineer AUD 66K-76KAPIs | Agile | Azure Data | Azure Data Factory | Data FactoryCultural leave | Discounted childcare | Discounted health care | Employee wellbeing program access | First Nations supportMid-level Full TimeMURARRIE, BRISBANE, QLD, AU, 41725d ago
-
Consultant - Data Engineer AUD 150K-170KCI/CD | DBT | Data Lineage | Data Warehousing | Dimensional Modeling360° feedback | Innovation days | Mentorship support | Paid certifications | Professional development pathwaysSenior-level Full TimeSydney, New South Wales, Australia5d ago
-
Senior AI Engineer AUD 120K-150KC plus plus | C# | CI/CD | Cloud Computing | Data GovernanceCareer development | Collaborative culture | Flexible working | Learning opportunitiesSenior-level Full TimeCannon Hill, QLD, AU, 41705d ago
-
Engineer, Machine Learning Systems (AI Products) AUD 180K-200KAWS | Apache Airflow | Apache Spark | Dask | Data orchestrationAccess to modern office spaces | Collaborative boost days | Hybrid work model | Mentoring and coaching cultureSenior-level Full TimeAU: Sydney (45 Clarence St)6d ago
-
Data Engineer AUD 89K-111KAirflow | Azure Data | Azure Data Factory | Code Repository | Code reviewCareer development | Flex leave | Flexible work arrangements | Paid parental leave | Wellness incentivesEntry-level Full TimeMelbourne, VIC, AU, 30006d ago
-
Databricks Platform Engineer AUD 90K-112KAWS | Access Control | Access Management | Apache Spark | AutomationCareer development | Comprehensive benefits package | Flex leave | Flexible work arrangements | Paid parental leaveSenior-level Full TimeMelbourne, VIC, AU, 30006d ago
-
Senior Generative AI Developer (GCP) AUD 130K-180KBigQuery | BigQuery ML | CI/CD | Chroma | Cloud platformFlexible working | Hybrid working | Income protection insurance | Leave options | Parental leaveSenior-level Full TimeMelbourne, Australia6d ago
-
Lead Gen AI Engineer (GCP) AUD 130K-146KAPI | CI/CD | Cloud platform | Continuous Testing | GCPFlexible working | Hybrid working | Income protection insurance | Parental leave | Study leaveSenior-level Full TimeMelbourne, Australia6d ago
-
Data Engineer AUD 94K-130KAWS CDK | AWS Glue | Apache Airflow | Apache Flink | Apache IcebergExtra annual leave days | Leadership development programs | LinkedIn Learning | Perkbox discountsMid-level Full TimePyrmont, New South Wales, Australia6d ago
-
Senior Quantitative Data Engineer - 2-year fixed-term AUD 122K-127KAWS | Agile methodology | Algorithmic trading | Apache Spark | AzureFlexible interview adjustments | Flexible working | Hybrid workingSenior-level Full Time TemporarySydney Office, Australia6d ago
-
Data Engineer AUD 94K-130KAWS CDK | AWS Glue | Amazon Web Services | Apache Airflow | Apache FlinkExtra annual leave days | Leadership development programs | LinkedIn Learning | Perkbox discountsMid-level Full TimeSydney, Australia6d ago