Senior Data Engineer — Platform & Architecture
Brisbane, Queensland 4000, Australia
AUD 139K-146K (estimate) Senior-level Full Time
Tasks
- Define Databricks compute strategies cluster policies and workload optimization
- Define medallion layer structures
- Define table formats partitioning and clustering
- Design and maintain Databricks lakehouse architecture
- Design and maintain catalog and schema structures
- Establish data lifecycle policies
- Establish engineering standards for code quality testing and documentation
- Establish schema evolution practices
- Implement CI/CD workflows
- Implement cost optimization guardrails
- Manage data access controls classification and governance
- Mentor data engineers
- Monitor and optimize platform spend
- Review architecture decisions and guide complex data issues
Perks/Benefits
Skills/Tech-stack
CI/CD | Clustering | Cost Optimization | Data Governance | Data Modeling | Databricks | Delta Lake | Infrastructure as Code | Partitioning | Performance optimization | Python | SQL | Scalability | Schema evolution | Terraform | Unity Catalog | “as-code”
Education
N/A
Roles
Related jobs
-
Senior AI Engineer AUD 131K-162KAI Foundry | AI Services | Agile | Azure AI | Azure AI FoundryAccess to modern cloud technologies | Collaborative culture | Free onsite parking | Hybrid work | Work from home 2 days per weekSenior-level Full TimeMulgrave, VIC, 3170, AU5h ago
-
Test Lead - Data AUD 90K-125KAlteryx | Data Governance | Data Quality | Data Validation | Data profilingSenior-level Full TimeAustralia11h ago
-
Staff AI & Data Engineer AUD 150K-200KAgentic AI | Anthropic | Apache Kafka | Azure | Azure EventFlexible working environment | Health and safety support | Inclusive workplaceSenior-level Full TimeAirTrunk HQ - North Sydney15h ago
-
Senior Data Engineer — Integration & Pipelines AUD 118K-120KAPI pagination | Anomaly Detection | CI/CD | Data Governance | Data QualityEAP support | Fitness passport | Salary packagingSenior-level Full TimeBowen Hills, Queensland 4006, Australia16h ago
-
Senior Machine Learning Engineer AUD 131K-148K3D Perception | Airflow | C++ | Computer Vision | Continuous MonitoringEquity grants | Health insurance | Recovery BenefitsSenior-level Full TimeSydney, New South Wales, Australia17h ago
-
Data Engineer (AWS Cloud) AUD 129K-142KAWS Aurora | AWS Aurora RDS | AWS CodeCommit | AWS EMR | AWS GlueFlexible start and finish times | Flexible work arrangements | Job share options | Part-time arrangements | Work location flexibilitySenior-level Full TimeSydney, NSW - CBP North, 1 …19h ago
-
AI Solutions Architect / AI Engineer AUD 170K-180KAI Agents | API Development | Automated testing | CI/CD | Cloud NativeHybrid work | Paid time offSenior-level Full TimeSurry Hills, NSW, Australia19h ago
-
Analytics Platforms | Apache Airflow | BigQuery | Cloud platform | DBTAnnual off-site events | Co-working space allowance | Equity participation | Flexible asynchronous schedule | Fully remoteSenior-level Full TimeAustralia R1d ago
-
Staff Robotics Software Engineer USD 200K-225KC# | C++ | CAN | Concurrency | Continuous integration401k | Accident insurance | Commuter benefits | Company-Paid Holidays | Critical illness insuranceSenior-level Full TimeBrisbane, CA1d ago
-
Senior Analytics Engineer AUD 140K-165KAutomated testing | BigQuery | DBT | Data Modeling | Data QualitySenior-level Full TimeAU - HQ - NSW1d ago
-
Analytics Engineer AUD 140K-165KAutomated testing | BigQuery | COGS | Customer Acquisition | Customer Acquisition CostSenior-level Full TimeAU - HQ - NSW1d ago
-
Lead Data Engineer AUD 125K-135KAWS | Auditability | Automation | CI/CD | CoalesceCareer advancement opportunities | Corporate discounts | Employee Assistance Program (EAP) | Employee share plan | Fitness passportSenior-level Full TimePyrmont, NSW, AU, 20091d ago
-
AI / Data Platform Engineer AUD 100K-127KAPI Design | Azure | Azure OpenAI | BI Dataflows | BI Semantic ModelAdditional leave benefits | Annual volunteer days | Birthday leave | Discounts on products | Dog-friendly officesEntry-level Full TimeBrisbane, Queensland (AU) - Bell-Are Ave, … R1d ago
-
Senior Software Engineer AUD 148K-180KAWS | Artificial Intelligence | Auditability | CI/CD | Code reviewSenior-level Full TimeAU Sydney Bella Vista, Australia1d ago
-
Customer Analytics Applications Spec AUD 117K-132KCloud Computing | Code Quality | Dash | Data Manipulation | Data VisualizationFlexible work options | Hybrid work model | Support for Aboriginal inclusion | Support for disability inclusionMid-level Full TimeMacquarie Park, NSW, AU, 21131d ago
-
GCP Data Engineer AUD 100K-150KAutomated testing | BigQuery | CI/CD | Cloud Composer | Cloud platformCareer development | Learning opportunitiesMid-level Full TimeMELBOURNE, VIC, AU, 30081d ago
-
BigQuery | CI/CD | Cloud Native | Cloud Run | Cloud SQLContinuous learning | Flexible working arrangements | Fully remote | High autonomy | International engineering teamSenior-level Full TimeAustralia R2d ago
-
Applied AI Engineer - Finance Super App (Australia) AUD 115K-135KAPI Integration | APIs | Agent systems | Data integration | EvaluationFlexible work environment | Remote workMid-level Full TimeSydney, Australia2d ago
-
BIOS/UEFI | Bootloader | Buildroot | C# | C++Annual leave | Employee wellbeing support | International travel | Learning and development budget | Parental leaveSenior-level Full TimeAustralia3d ago
-
Bash | Data Processing | Docker | GCP | Infrastructure as CodeAsynchronous culture | Competitive salary | Entrepreneurial team | Flexible remote work | Friendly work environmentMid-level Full TimeSydney, Australia3d ago
-
Data Engineer AUD 110K-140KAPIs | Azure | Azure Data | Azure Data Factory | Azure DevOpsCareer progression opportunities | Community partnerships | Flexibility in work location | Volunteering opportunitiesMid-level Full TimeMelbourne, VIC, AU4d ago
-
Data Engineer AUD 100K-120KAsynchronous programming | Azure DevOps | CI/CD | Data Quality | Data ReconciliationCoaching and career development | Flexible work arrangements | Flexible working options | Flu vaccinations | Health and wellbeing programMid-level Full TimeSydney, NSW, AU4d ago
-
Principal Data Platform Engineer AUD 150K-185KAWS | Airflow | Amazon Kinesis | Apache Spark | ArgoCDAutonomy | High-impact projects | Influence | Room to grow | Senior mentorshipSenior-level Full TimeSydney, New South Wales, Australia4d ago
-
Data Engineer AUD 118K-127KAWS | AWS Data | AWS Data Factory | AWS Glue | AgileDiscounted health insurance | Paid parental leave | Paid training | Product and service discounts | Wellbeing initiativesMid-level Full TimeMelbourne, VIC, Australia4d ago
-
Principal Data Engineer AUD 145K-151KAWS | Agile | Change Management | Cloud Native | Data LakeFlexible work location | Flexible working hours | Job-sharing | Part-time options | Support for job application processSenior-level Full TimeSydney, NSW - CBP North, 1 …4d ago