Data Engineer
Tasks
- Automate infrastructure with IaC
- Build curated data layers
- Contribute to CI/CD pipelines
- Deploy cloud data services
- Design data pipelines
- Implement data access controls
- Integrate structured and unstructured data
- Monitor pipeline performance
Perks/Benefits
- Additional annual leave
- Employee assistance program
- Flexible location
- Paid parental leave
- Salary packaging
Skills/Tech-stack
Apache Spark | Azure | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2 | Azure DevOps | CI/CD | Data Factory | Data Lake Storage Gen2 | Data Vault | Data Vault 2.0 | Databricks | Delta Lake | Delta Live Tables | Delta Live) | ELT | ETL | Git | Medallion Architecture | Parquet | PySpark | Python | SQL | Slowly Changing Dimensions | Star Schema | Terraform | Unity Catalog
Education
N/A
Roles
Related jobs
-
Senior Machine Learning / ML Engineer AUD 170K-190KAirflow | Amazon EMR | Apache Spark | Dask | Data orchestrationEngineering standards | Hybrid work model | MentoringSenior-level Full TimeAU: Melbourne: (260 Burwood Rd)11h ago
-
Senior AI/Analytics Engineer - CTT AUD 130K-150KApache Airflow | Apache Kafka | Autogen | Container Services | DockerEmployee discounts | Employee-only mortgage rates | Flexible work arrangements | Learning and development | Leave optionsSenior-level Full TimeSydney, NSW, Australia12h ago
-
Sr. Forward Deployed Engineer AUD 145K-185KAnthropic | Apache Spark | Artificial Intelligence | Backend Development | Cloud ComputingSenior-level Full TimeMelbourne, Australia; Sydney, Australia15h ago
-
Staff Data Engineer AUD 125K-138KAWS | Apache Spark | Cloud Computing | Cloud platform | Data ModelingEmissions reduction focus net zero by FY2050 | Flexible working | Paid leave | Parental leave | Personal Flexi DaysSenior-level Full TimeCremorne, Victoria, Australia1d ago
-
Data labeling | Data pipeline | Debugging | Inference | Inference OptimizationEquity compensation | Flexible leave options | Inclusive parental leave | Remote work within Australia | Wellbeing allowanceSenior-level Full TimeSydney, Australia R1d ago
-
AI Engineer (Senior) AUD 145K-156KAWS | Agentic AI | Agile | Amazon SageMaker | Artificial IntelligenceSenior-level Full TimeMelbourne, VIC, Australia1d ago
-
AWS | Ataccama | Azure | Cloud platform | CollibraExperian Shares Discount | Flexible time off | Flexible work environment | Hybrid work model | Novated leasingSenior-level Full TimeSouthbank, VIC, Australia R1d ago
-
Data Engineer AUD 90K-110KAWS Cloud | AWS Cloud Development Kit | AWS Glue | AWS cloud development | Amazon AuroraAdditional leave | Board games | Hybrid work | In-house workshops | Learning and development budgetEntry-level Full TimeSydney, New South Wales, Australia1d ago
-
Data Platform Engineer AUD 100K-120KAWS | Alerting | CI/CD | DBT | DataOps5 weeks annual leave | Family care parental leave | Global mobility opportunities | Hybrid working | Personal Carer LeaveMid-level Full TimeNorth Sydney, AU1d ago
-
NumPy | Pandas | Python | SciPy | SymPyFlexible part-time schedule | Freelance work | Project based workSenior-level FreelanceAustralia - Remote R1d ago
-
Senior-level Full TimeMelbourne, Australia2d ago
-
Entry-level Full TimeMelbourne, Australia2d ago
-
AI Engineer - DDAI AUD 126K-150KA/B | A/B Testing | Apache Spark | Autogen | B testingAdditional leave | Community volunteering opportunities | Employee benefits | Flexible work | Learning and developmentMid-level Full TimeSydney, NSW, Australia2d ago
-
Mid-level Full TimeSydney, NSW2d ago
-
Azure Functions | CI/CD | Code review | Databricks | Delta LakeFlexible working options | Paid volunteering days | Parental leave | Retail discounts | Return to work supportSenior-level Full TimeMelbourne, VIC, AU2d ago
-
Combinatorics | Graph theory | Mathematical Modeling | NumPy | Number theoryFlexible schedule | Freelance project-based work | Part-time opportunitiesSenior-level FreelanceAustralia - Remote R2d ago
-
Lead Data Engineer AUD 118K-127KAccess Control | Ansible | Batch Processing | CI/CD | ChefCareer development | Collaborative environment | Flexible work culture | Supportive team cultureSenior-level Full TimeCanberra, Australian Capital Territory 2600, Australia2d ago
-
Data Engineer AUD 80K-150KDBT | Data Ingestion | Data Transformation | ELT | ETLAdditional leave | Corporate partner discounts | Free NBN plan | Free mobile plan | Hybrid workMid-level Full TimeBarangaroo, NSW, AU5d ago
-
Senior AI Engineer AUD 142K-163KAWS | Autogen | Azure | CI/CD | Clean CodeAutonomy in role | Learning and development programs | Mentorship cultureSenior-level Full TimeMelbourne, Australia R5d ago
-
Data Engineer - Coles 360 - Melbourne AUD 110K-140KAzure | BigQuery | CI/CD | DBT | Data ModelingDiscounts on supermarket and liquor | Fitness classes | Free parking | Gym facility | Hybrid working optionsMid-level Full TimeHawthorn East Melbourne, VIC, AU, 31235d ago
-
LLMs | Langchain | MLOps | NumPy | PandasProject based workMid-level FreelanceAustralia - Remote R5d ago
-
Freelance Machine Learning Engineer AUD 110KLLMs | Langchain | MLOps | Machine Learning | NumPyPart-time availability | Project based workMid-level FreelanceAustralia - Remote R5d ago
-
Principal Data Engineer (AWS) AUD 140K-154KAWS | Airflow | Apache Spark | Automated testing | Batch ProcessingCareer support | Flexible work arrangements | Flexible work locations | Job share options | Part-time arrangementsSenior-level Full TimeSydney, NSW - CBP North, 1 …5d ago
-
Data Engineer AUD 100K-138KAzure Synapse | Azure Synapse Analytics | Cloud Data | Cloud Data Platforms | DBTCareer development | Discounted private health insurance | Employee assistance program | Employee discounts | Free health checksMid-level Full TimeAustralia | SEQ | Brisbane - …5d ago
-
Senior-level Full TimePerth, Australia5d ago