Data Engineer (DataX)
Tasks
- Build and maintain feature stores
- Collaborate with data scientists on feature design
- Design ingestion pipelines across data sources
- Develop medallion architecture data layers
- Implement monitoring and data quality checks
- Maintain documentation for datasets pipelines and lineage
Perks/Benefits
- Employee banking discounts
- Flexible work arrangements
- Learning and development opportunities
- Leave options
- Volunteer opportunities
Skills/Tech-stack
Apache Spark | Azure | Azure DevOps | Azure Synapse | Azure Synapse Analytics | CI/CD | Data Modeling | Data Quality | Databricks | ELT | ETL | Feature Store | GitHub Actions | Machine Learning | Machine Learning Pipelines | Python | SQL | Schema Design | Snowflake | Synapse Analytics
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Regions
Countries
States
Cities
Related jobs
-
Senior Software Engineer - Azure Storage AUD 150K-190KAzure | Azure Storage | C# | C++ | Call monitoringOn-call supportSenior-level Full TimeSydney, NSW, AU; VIC,AU9h ago
-
TL Data and Analytics Legacy AUD 89K-100KAgile | Azure Data | Azure Data Factory | Azure Data Lake | CI/CDAdditional leave days | Career development through internal mobility | Flexible working arrangements | Health and wellbeing initiatives | Supportive and inclusive managersMid-level Full TimeMelbourne: 509 St Kilda Rd, Australia16h ago
-
Senior Manufacturing Engineer, Test Analytics AUD 120K-150KLean Manufacturing | Microsoft Excel | Microsoft Power | Microsoft Power BI | Power BIFlexible work environment | Health benefits | Paid leaveSenior-level Full TimeSydney, New South Wales, Australia21h ago
-
Data Platform Solution Presales Engineer AUD 90K-120KAmazon Redshift | Azure | BigQuery | Cloudera | Cosmos DBMid-level Full TimeSydney, NSW, AU; VIC,AU1d ago
-
Autoregressive models | Deep learning | Diffusion Models | Distributed Training | Experimentation FrameworksAccess To Large Scale Experimentation Infrastructure | Autonomy | Fully remote | Global First Work Environment | Innovation cultureMid-level Full TimeAustralia R1d ago
-
Agent systems | Benchmarking | Data Curation | Data pipeline | Deep learningContinuous learning | High-impact work | Professional growth opportunities | Remote-first environmentSenior-level Full TimeAustralia1d ago
-
Senior Data Engineer AUD 120K-130KA/B | A/B Testing | AWS | Amplitude | B testingAnnual leave | Catered lunch | Equity | Flexible leave policy | Hybrid workSenior-level Full TimeMelbourne, Victoria1d ago
-
API Development | AWS | Agentic Systems | Anthropic | AzureCareer development | Flex leave | Flexible work arrangements | Paid parental leave | Wellness incentiveSenior-level Full TimeSydney, NSW, AU, 20001d ago
-
Analytics Engineer AUD 80K-108KCI/CD | DBT | Data Lineage | Data Modeling | Data QualityAnniversary leave | Cyclist end of trip facilities | Employee share option plan | Hybrid working | Pantry snacks and drinksMid-level Full TimeSydney, NSW1d ago
-
Specialist Data Engineer AUD 80K-110KAPI Integration | Agile | Airflow | Apache Hadoop | Apache KafkaExtended leave entitlements | Flexible working options | Paid parental leave | Parent roomsMid-level Full TimeAustralia1d ago
-
Director - Data Platform Engineering AUD 60K-200KAirflow | Amazon Web Services | Apache Kafka | Apache Spark | CI/CDExecutive-level Full TimeSydney, New South Wales, Australia1d ago
-
Senior Data Engineer – Data & AI Practice AUD 70K-80KApache Airflow | Apache Kafka | CI/CD | DBT | Data GovernanceFlexibility | Health and wellbeing programs | Learning program | Novated leasing options | Purchased leaveSenior-level Full TimeMelbourne, Australia1d ago
-
Data Engineer – Data & AI Practice AUD 80K-120KAWS | Apache Airflow | Azure | CI/CD | DBTFlexible work arrangements | Health and wellbeing program | Learning & development program | Novated leasing options | Paid leaveMid-level Full TimeMelbourne, Australia1d ago
-
Senior AI Engineer AUD 135K-180KAWS | Automl | Azure | CI/CD | Cloud platformCareer growth | Flexible working environment | Remote-friendly cultureSenior-level Full TimeSydney1d ago
-
AWS | AWS Glue | AWS Lambda | Amazon Redshift | Amazon S3Additional paid leave | Corporate partner discounts | Hybrid work | Learning platform access | Mobile PlanSenior-level Full TimeBarangaroo, NSW, AU2d ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerMid-level Full TimeSydney, Australia2d ago
-
AI infrastructure | Benchmarking | Error rate | Error rate analysis | Inference OptimizationAutonomy | Continuous learning | Flexible location | Fully remote | International teamMid-level Full TimeAustralia R2d ago
-
Data Processing | Data use | Diffusion Models | Embedding systems | Ethical AIEquity packages | Flexible leave policies | Inclusive parental leave | Professional growth learning and technical leadership | Remote friendly flexible working arrangementsSenior-level Full TimeAustralia2d ago
-
Senior Machine Learning / ML Engineer AUD 170K-190KAirflow | Amazon EMR | Apache Spark | Dask | Data orchestrationEngineering standards | Hybrid work model | MentoringSenior-level Full TimeAU: Melbourne: (260 Burwood Rd)2d ago
-
Senior AI/Analytics Engineer - CTT AUD 130K-150KApache Airflow | Apache Kafka | Autogen | Container Services | DockerEmployee discounts | Employee-only mortgage rates | Flexible work arrangements | Learning and development | Leave optionsSenior-level Full TimeSydney, NSW, Australia2d ago
-
Sr. Forward Deployed Engineer AUD 145K-185KAnthropic | Apache Spark | Artificial Intelligence | Backend Development | Cloud ComputingSenior-level Full TimeMelbourne, Australia; Sydney, Australia2d ago
-
C# | MATLAB | NumPy | Pandas | PythonPart-time project-based workSenior-level Full TimeAustralia - Remote R2d ago
-
Staff Data Engineer AUD 125K-138KAWS | Apache Spark | Cloud Computing | Cloud platform | Data ModelingEmissions reduction focus net zero by FY2050 | Flexible working | Paid leave | Parental leave | Personal Flexi DaysSenior-level Full TimeCremorne, Victoria, Australia3d ago
-
Data labeling | Data pipeline | Debugging | Inference | Inference OptimizationEquity compensation | Flexible leave options | Inclusive parental leave | Remote work within Australia | Wellbeing allowanceSenior-level Full TimeSydney, Australia R3d ago
-
AI Engineer (Senior) AUD 145K-156KAWS | Agentic AI | Agile | Amazon SageMaker | Artificial IntelligenceSenior-level Full TimeMelbourne, VIC, Australia3d ago