Senior Data Engineer - Permanent, full-time position
Tasks
- Advise on continuous improvement
- Define data warehouse processes
- Design dimensional models
- Establish CI/CD pipelines
- Facilitate design workshops
- Implement ETL/ELT pipelines
- Lead data engineering task planning and estimation
- Maintain data pipeline documentation
- Mentor junior data engineers
- Monitor data platform costs
- Optimize Databricks performance
- Perform unit testing and validation
- Resolve data warehouse issues
- Support data warehouse queries
Perks/Benefits
- N/A
Skills/Tech-stack
Availability Monitoring | Azure Data | Azure Data Factory | Azure Databricks | CI/CD | Capacity Planning | Cloud Architecture | Cost monitoring | Data Factory | Data Modeling | Data Warehouse | Data pipeline | Data pipeline optimization | Dimensional Modeling | ELT | ETL | Medallion Architecture | Pipeline Optimization | Python | SQL | Unit Testing | Version control
Education
Bachelor of Engineering | Bachelor of Science | Master of Science | PhD
Roles
Related jobs
-
Forward Deployed Engineer, Gen AI, Google Cloud AUD 110K-130KAPI Integration | Agent systems | Cloud deployment | Cloud platform | CrewAIMid-level Full TimeSydney NSW, Australia; Docklands VIC, Australia14h ago
-
Data Engineer AUD 120K-125KAzure | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOpsCareer development opportunities | Discounted insurance | Employee assistance program | Flexibility | Hybrid workingMid-level Full TimeSA, Australia21h ago
-
Senior Data Engineer AUD 60K-78KAWS | AWS IAM | AWS Lambda | AWS MWAA | Amazon S3Employee network groups | Hybrid working | Staff travel discount | Travel benefitSenior-level Full TimeMelbourne, Victoria, Australia1d ago
-
Data Scientist | LLM Engineer | Senior Associate/Manager AUD 118K-140KAgile | Azure | Azure Functions | Azure Machine Learning | Azure OpenAIFlexible work | Parental leave | Work-life balanceSenior-level Full TimeSydney, Australia1d ago
-
Lead Data Engineer AUD 117K-132KAgile delivery | Analytics | Big Data | Cloud Computing | Data ArchitectureAffordable parking | Career development opportunities | Employee assistance program | Flexible working arrangements | Health and wellness discountsSenior-level Full TimeSt Lucia Campus, Australia1d ago
-
Senior Solution Engineer AUD 151K-216KAnalytics | Cloud Computing | Data Lake | Data Warehouse | Data fabricSenior-level Full TimeAU-Perth-WW1d ago
-
Lead Data Engineering Consultant AUD 125K-145KAWS | Airflow | Azure | Consulting | DBTConference attendance | Flexible work schedule | Four day week option | Professional development | TrainingSenior-level Full TimeMelbourne1d ago
-
Staff Software Engineer - (Data Platform Workflow) AUD 129K-145KAPI Design | AWS | Agent Skills Framework | Agent skills | CI/CDEquity packages | Flexible leave options | Flexible remote work | Inclusive parental leave | Wellbeing allowanceSenior-level Full TimeMelbourne, VIC, Australia R1d ago
-
Staff Software Engineer - (Data Platform Workflow) AUD 129K-145KAPI Design | AWS | Agent Skills Framework | Agent skills | BI toolsAnnual wellbeing allowance | Equity package | Flexible leave options | Flexible work arrangements | Parental leaveSenior-level Full TimeSydney, Australia R1d ago
-
Senior DevOps AI Engineer AUD 157K-200KAWS | Agent systems | Ansible | ArgoCD | AsyncioHybrid work | On-call rotationsSenior-level Full TimeSydney, Australia1d ago
-
Senior Quants/Analytics Specialist - CTT AUD 129K-142KApplied Mathematics | Azure | C# | C++ | CI/CDDiscounts on banking products | Flexible work arrangements | Learning and development opportunities | Volunteering opportunitiesSenior-level Full TimeSydney, NSW, Australia2d ago
-
Data Engineer AUD 105K-125KAWS | Anomaly Detection | Azure | CI/CD | Data GovernanceAdditional leave days | Employee assistance programs | Employee discounts | Micro-credentials | Parental leaveMid-level Full TimeMacquarie Park, Australia2d ago
-
Senior Data Scientist AUD 150K-175KAutoARIMA | AutoETS | Automl | CI/CD | Causal reasoningAI-first culture | Async workflows | Flexible experimentation pace | Humans in final review | Ownership cultureSenior-level Full TimeSydney, New South Wales, Australia2d ago
-
Azure | Azure Functions | Azure ML | Azure OpenAI | CI/CDFlexible work arrangements | Generous leave entitlements | Parental leave | Public holiday flexibility | Work visa sponsorshipSenior-level Full TimeSydney, Australia2d ago
-
Senior Software Engineer – Data Platform AUD 130K-155KAmazon S3 | Apache Flink | Apache Spark | Batch Processing | CQRSSenior-level Full TimeBrisbane, Queensland, Australia2d ago
-
Applied AI Engineer AUD 90K-100KASR | Agent Orchestration | Agent/tool use | Azure Cognitive | Azure Cognitive ServicesCommunity involvement support | Hybrid work | Remote work | Work-life balanceMid-level Full TimeRemote (AUS), Australia R2d ago
-
Bash | Code Coverage | Coverage.py | Dagger | DockerFlexible schedule | Fully remote | Project-based collaboration | Supportive global communitySenior-level Full TimeAustralia - Remote R2d ago
-
Senior Data Engineer AUD 125KAzure Data | Azure Data Factory | Azure Databricks | CI/CD | Data FactoryHybrid workSenior-level Full Time TemporaryGeelong2d ago
-
Data Engineer (Python) - 2 weeks contract AUD 75K-150KAzure Functions | CSV | Data Validation | Delta detection | ExcelFlexible working options | Leadership programs | Learning and development initiatives | MentorshipMid-level Full TimeMelbourne, Victoria, Australia2d ago
-
Bash | Cloud platform | Data Processing | Docker | GCPAsynchronous work culture | Flexible management approach | Remote/distributed teamMid-level Full TimeBrisbane, Australia2d ago
-
C# | MATLAB | NumPy | Pandas | PythonNon permanent employment | Part-time project workSenior-level Full TimeAustralia - Remote R3d ago
-
AI Solution Specialist, ANZ (Sydney/Melbourne-based) AUD 120K-152KAI Application Development | AI application | AI infrastructure | Application development | Artificial IntelligenceTravel opportunitiesExecutive-level Full TimeRemote Australia R4d ago
-
Senior Perception Software Engineer AUD 170K-224K3D LiDAR | C++ | CUDA | Ceres-Solver | Computer Vision401k contribution | Dental insurance | Federal Holidays | Health insurance | State HolidaysSenior-level Full TimeCharlestown, MA4d ago
-
Embedded Software Engineer - Intern AUD 70K-85KARM | AVR | Bare Metal | Basic electronics | C#Mentorship | Real-world project experience | Remote work opportunitiesEntry-level InternshipMelbourne, VIC, Australia4d ago
-
Amazon Web Services | Apache Airflow | Apache Superset | BI Dashboards | Cloud DataAnnual vacation | English learning discounts | Fully remote work environment | Health reimbursement | High autonomySenior-level Full TimeAustralia R4d ago