Senior Data Engineer
Tasks
- Build and optimize streaming and CDC pipelines
- Build infrastructure as code and automate testing
- Design and evolve real-time data platform
- Design curated datasets and data quality frameworks
- Establish engineering standards and best practices
- Implement monitoring, alerting, and incident response
- Lead migration from legacy systems to Databricks Lakehouse
- Mentor data engineers and provide technical guidance
- Optimize costs and performance
Perks/Benefits
- Dabble Day Dividend
- Flexible working hours
- Paid annual leave
- Paid parental leave
- Performance bonus
- Sponsored flights
- Wellness support
Skills/Tech-stack
Data Engineering | Data Governance | Data Modeling | Data engineering languages | Databricks | Debezium | Delta Lake | Distributed Systems | Event time | Event-time processing | Exactly-once semantics | Kafka | Orchestration | Performance Tuning | Pulumi | SQL | Spark | Streaming Architecture | Terraform | Time processing | Troubleshooting distributed systems
Education
Roles
Related jobs
-
Senior Data Engineer AUD 80K-95KAcceptance Testing | Amazon Web Services | Apache Airflow | Apache Spark | Automation TestingPaid training | Professional development | Supportive workplace cultureSenior-level Full TimeNorth Sydney, NSW, AU15h ago
-
Data pipeline | Deep learning | Distributed Systems | Distributed Training | Hugging FaceAccess to high performance computing infrastructure | Collaborative research environment | High autonomy | Remote-friendly work environmentSenior-level Full TimeAustralia17h ago
-
Mid-level Full TimeSydney1d ago
-
Data Engineer AUD 90K-150KAWS | Agile | Alerting | CI/CD | Code reviewEmployee discounts | Flexible working | Frequent events | Health and wellbeing programs | Income protection insuranceMid-level Full TimeCremorne, Victoria, Australia1d ago
-
Lead Data Engineer (Akira) AUD 125K-150KAutomation | Data Engineering | Data Governance | Data Integrity | Data ManagementSenior-level Full TimeSydney, Australia1d ago
-
Junior Machine Learning Engineer AUD 60K-65KAWS | Azure | CI/CD | Databricks | DockerFlexible schedule | Hybrid work | Retailer discounts | Wellbeing benefitsEntry-level Full TimeMelbourne, Victoria, Australia1d ago
-
TL Data and Analytics Legacy AUD 89K-110KAgile | Azure | Azure Data | Azure Data Factory | Azure Data LakeAdditional leave days | Career development via internal mobility | Flexible working arrangements | Health and wellbeing initiatives | Supportive and inclusive managersMid-level Full TimeMelbourne: 509 St Kilda Rd, Australia1d ago
-
Cloud Database Administrator AUD 113K-122KAzure | Cause analysis | Data Modeling | Database Administration | Database normalizationAnnual flu vaccinations | Career break | Digital wellbeing support | Employee share plan | Income protection insuranceMid-level Full TimeMelbourne Central Towers - Level 21, …1d ago
-
Staff Data Engineer AUD 129K-143KAWS | AWS architecture | Agile | AppDynamics | Auto ScalingFlexible work location | Flexible working hours | Job flexibility | Job share | Part-time optionsSenior-level Full TimePerth, WA - 300 Murray Street …1d ago
-
Principal Data Engineer AUD 149K-170KAWS | Agile | Change Management | Cloud Native | Data LakeFlexible start and finish times | Flexible work arrangements | Hybrid work options | Job share optionsSenior-level Full TimeSydney, NSW - CBP North, 1 …1d ago
-
Enterprise Data Engineer USD 92K-120KAzure Data | Azure Data Factory | Azure DevOps | Azure Synapse | Azure Synapse Analytics401k match | Dependent Care Match | Employee referrals | Flexible work schedules | Health insuranceMid-level Full TimeAtwell1d ago
-
Amazon Redshift | DBT | Data Architecture | Data Modeling | Data QualityFully remote | Global team collaboration | Healthcare coverage | Home office equipment allowance | Learning and development budgetSenior-level Full TimeAustralia R1d ago
-
Senior-level Full TimeSydney2d ago
-
Azure AI Developer Consultant AUD 85K-95K.NET | API Management | App Service | Automated testing | Azure APIFlexible work environment | On site customer presence when required | Remote work option | Split time between home and officeSenior-level Full TimeBrisbane, QLD, AU2d ago
-
Data Engineer AUD 150K-155KApache Spark | Azure | Azure Data | Azure Data Factory | Azure Data LakeAdditional annual leave | Employee assistance program | Flexible location | Paid parental leave | Salary packagingSenior-level Full TimeWest Melbourne, VIC, AU, 30033d ago
-
Staff Data Engineer (AWS Cloud and AI) AUD 70K-80KAPI Gateway | AWS DataZone | AWS Glue | AWS IAM | AWS Lake FormationChanging start and finish times | Flexible working arrangements | Job share | Part-time optionsSenior-level Full TimeSydney, NSW - CBP South, 11 …3d ago
-
Data Analyst AUD 90K-110KAzure SQL | DAX | Data Lakehouse | Delta Lake | Dimensional ModelingEmployee assistance program | Employee discounts | Hybrid working | Professional growth | Wellbeing initiativesMid-level Full TimeSouth Brisbane, QLD, Australia4d ago
-
Senior-level Full TimeSydney Olympic Park, New South Wales, …4d ago
-
Chief Engineer – Data Platforms AUD 60K-200KCloud Native | Data Governance | Data Ingestion | Data Lineage | Data MigrationAdjusted hours | Career growth opportunities | Flexible working options | Hybrid working | Inclusive workplaceExecutive-level Full TimeEveleigh, NSW - 1 Locomotive Street, …4d ago
-
Senior Algorithms Engineer - SensorFusion (AU) AUD 116K-127KAlgorithms | C++ | CI/CD | CMake | CUDASenior-level Full TimeSydney, Australia4d ago
-
Data Engineer AUD 142K-175KAPIs | AWS Glue | Airflow | BigQuery | CI/CDCareer development opportunities | Community volunteering | Company events | Complimentary membership | Employee discountsSenior-level Full TimeSouth Melbourne, Victoria8d ago
-
Chief Engineer - Data Platforms AUD 60K-200KAgile | Apache Airflow | Apache Kafka | Artificial Intelligence | AzureAdditional leave options | Employee discounts | Flexible work arrangements | Tailored learning and development | Volunteering opportunitiesExecutive-level Full TimeSydney, NSW, Australia9d ago
-
Senior Solution Engineer AUD 146K-216KAnalytics | Business Intelligence | C++ | Data Architecture | Data ModelingSenior-level Full TimeAU-Sydney9d ago
-
Expressions of Interest: Staff Data Engineer AUD 120K-130KA/B | A/B Testing | AWS | Amplitude | B testingEquity and ownership | Free food | Paid time offSenior-level Full TimeSydney, New South Wales10d ago
-
Analytics & Insight Specialist AUD 90K-120KAttribution | BigQuery | Browser Developer Tools | Consent Management | CookiesBirthday leave | Career development | End of year party | Hybrid working | Remote WorkingMid-level Full TimeMillers Point, New South Wales 2000, …10d ago