Senior Data Engineer
Tasks
- Build and optimize streaming and CDC pipelines
- Build infrastructure as code and automate testing
- Design and evolve real-time data platform
- Design curated datasets and data quality frameworks
- Establish engineering standards and best practices
- Implement monitoring, alerting, and incident response
- Lead migration from legacy systems to Databricks Lakehouse
- Mentor data engineers and provide technical guidance
- Optimize costs and performance
Perks/Benefits
- Dabble Day Dividend
- Flexible working hours
- Paid annual leave
- Paid parental leave
- Performance bonus
- Sponsored flights
- Wellness support
Skills/Tech-stack
Data Engineering | Data Governance | Data Modeling | Data engineering languages | Databricks | Debezium | Delta Lake | Distributed Systems | Event time | Event-time processing | Exactly-once semantics | Kafka | Orchestration | Performance Tuning | Pulumi | SQL | Spark | Streaming Architecture | Terraform | Time processing | Troubleshooting distributed systems
Education
Roles
Related jobs
-
Sr. Solutions Engineer AUD 150K-205KApache Spark | Cloud platform | Data Architecture | Delta Lake | JavaSenior-level Full TimeBrisbane, Australia12h ago
-
Data Science Lead AUD 130K-160KArtificial Intelligence | BigQuery | Cloud Computing | DBT | Data EngineeringCertification support | Conference access | Employee assistance program | Health and wellness programs | Learning budgetSenior-level Full TimeAU - HQ - NSW1d ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerAsynchronous culture | Career growth opportunities | Collaborative team environment | Remote distributed setting | Support for learning accessibilityMid-level Full TimeSydney, Australia1d ago
-
Bash | Cloud infrastructure | Cloud platform | Data Pipelines | Data ProcessingAsynchronous culture | Competitive salary | Remote workMid-level Full TimeMelbourne, Australia1d ago
-
Senior Software Engineer - MLOps AUD 122K-136KAWS | AWS KMS | Amazon Aurora | Amazon CloudWatch | Amazon ECRFlexible working arrangements | Job mentoring | Job share | Part-time arrangementsSenior-level Full TimeEveleigh, NSW - 1 Locomotive Street, …1d ago
-
Specialist Data Warehouse Developer AUD 117K-132K.NET | Business Intelligence | Data Warehouse | Microsoft .NET | SQLAffordable parking | Career development opportunities | Employee assistance program | Fitness Passport access | Flexible working hoursMid-level Full TimeSt Lucia Campus, Australia1d ago
-
Staff / Lead Data Engineer (AWS Cloud) AUD 129K-149KAWS | AWS Glue | AWS Kendra | AWS Lambda | AWS RDSFlexible start and finish times | Flexible work arrangements | Flexible work locations | Job share | Part-time optionsSenior-level Full TimeSydney, NSW - CBP North, 1 …1d ago
-
Data & DevOps Engineer AUD 119K-138KAI Foundry | AI Services | Azure | Azure AI | Azure AI FoundryBlended working arrangement | Collaborative team culture | Defined career pathways | Internal mobility | Learning and developmentMid-level Full TimeSydney, NSW 20001d ago
-
Principal Data & Analytics AUD 500KAgile | Asana | Azure | Azure Data | Azure Data FactoryDiscounted private health insurance | Employee assistance program | Fitness passport | Novated leasingSenior-level Full TimeParramatta, NSW, AU2d ago
-
APIs | AWS | Benchmarking | Cloudflare Workers | EvaluationEquity packages | Flexible leave options | Inclusive parental leave | Virtual interviews | Wellbeing allowanceSenior-level Full TimeMelbourne, VIC, Australia R2d ago
-
API Design | AWS | Cloudflare Workers | Evaluation | Language ModelsEquity packages | Flexible leave options | Inclusive parental leave | Office setup allowance | Social connection allowanceSenior-level Full TimeSydney, Australia R2d ago
-
AI Engineer - Data Intelligence - AI Platform AUD 137K-186KAWS | Batch Processing | Data Governance | Data Lakes | Data ProcessingCoaching Budgets | Employee share options | Extended year-end breaks | Medical insurance | Mental wellbeing supportSenior-level Full TimeMelbourne2d ago
-
Data Engineer (SAP BODS) AUD 80K-100KAWS | Apache Spark | Business Intelligence | BusinessObjects Data Services | Crystal ReportsAccess to discounts via Cuscal Advantage | Hybrid work model | IGNITE recognition program | Wellbeing initiativesMid-level Full TimeSydney, NSW, Australia2d ago
-
Chief Engineer, Treasury Trading & Analytics AUD 60K-180KAWS | Automated Pipeline | Automated pipeline optimization | Automated testing | AzureAccessibility accommodations for recruitment process | Inclusive workplace supportExecutive-level Full TimeSydney, NSW, Australia2d ago
-
.NET | AWS | AWS Athena | AWS Glue | Amazon RedshiftFlexible working | Hybrid workingSenior-level Full TimeSydney Office, Australia2d ago
-
AI Engineer - Intelligent Automation AUD 115K-135KAI Document Intelligence | Automation Development | Azure AI | Azure AI Document Intelligence | Cloud NativeCareer break | Digital wellbeing support | Exempt employee share plan | Flu vaccinations | Income protection insurance reimbursementMid-level Full TimeMelbourne Central Towers - Level 19, …2d ago
-
Data Engineer (Financial Analytics focus) AUD 110K-140KApache Airflow | CTE | DAG | Data Modeling | Data PipelinesFlexible benefits | Flexible working | Paid leave | Private medical insuranceMid-level Full TimeMelbourne, Victoria, Australia R3d ago
-
Automation | Distributed Systems | Incident Response | Machine Learning | MonitoringSenior-level Full TimeSydney, New South Wales, Australia3d ago
-
Senior DataOps Engineer AUD 120K-130KAWS | Access Control | Airflow | Amazon Kinesis | Automated alertingDaily breakfast | EAP access | Flexible career development | Hands-on learning | Happy hourSenior-level Full TimeMelbourne, Australia3d ago
-
Senior Data Engineer AUD 120K-130KAWS | AWS DMS | AWS Lambda | Access Control | AlertingBarista coffee | Breakfast | EAP support | Happy hour | Learning platform coursesSenior-level Full TimeMelbourne, Australia3d ago
-
Data Engineering | Data Processing | Data Visualization | GenAI | LangchainFlexible schedule | Impact on AI development | Part-time | Professional development | Remote workMid-level FreelanceAustralia - Remote R3d ago
-
Senior-level Full TimeSydney, New South Wales, AUS3d ago
-
Senior-level Full TimeSydney4d ago
-
Database Engineer AUD 105K-115KDatabase Administration | Database Design | Disaster Recovery | NoSQL | OracleMid-level Full TimeSydney4d ago
-
Forward-Deployed Data Scientist II AUD 120K-171KCI/CD | CatBoost | Data Pipelines | Data integration | DevOpsCommunity engagement opportunities | Family benefits | Flexible paid time off | Health insurance | Professional developmentMid-level Full TimeSydney4d ago