Senior Data Engineer – Data & AI Practice
Tasks
- Build batch and streaming data pipelines
- Collaborate with engineers analysts and stakeholders
- Conduct root cause analysis for data issues
- Contribute to code reviews and engineering standards
- Design scalable data ingestion pipelines
- Develop production data structures
- Document data lineage and operational standards
- Ensure data performance reliability maintainability
- Implement data transformation workflows
- Optimize SQL queries and transformations
- Orchestrate data workflows
- Perform data quality testing
- Provide technical input for delivery planning and estimation
- Validate AI assisted workflows output
- Write unit and integration tests
Perks/Benefits
- Flexibility
- Health and wellbeing programs
- Learning program
- Novated leasing options
- Purchased leave
- Recognition programs
- Salary packaging
- Social activities
Skills/Tech-stack
Apache Airflow | Apache Kafka | CI/CD | DBT | Data Governance | Data Lineage | Data Modeling | Data Observability | Data Quality | Data pipeline | Data pipeline orchestration | Databricks | ELT | ETL | Integration Testing | Pipeline Orchestration | PySpark | Python | SQL | Snowflake | Unit Testing
Education
N/A
Roles
Related jobs
-
API Development | AWS | Agentic Systems | Anthropic | AzureCareer development | Flex leave | Flexible work arrangements | Paid parental leave | Wellness incentiveSenior-level Full TimeSydney, NSW, AU, 200019h ago
-
Analytics Engineer AUD 80K-108KCI/CD | DBT | Data Lineage | Data Modeling | Data QualityAnniversary leave | Cyclist end of trip facilities | Employee share option plan | Hybrid working | Pantry snacks and drinksMid-level Full TimeSydney, NSW21h ago
-
Specialist Data Engineer AUD 80K-110KAPI Integration | Agile | Airflow | Apache Hadoop | Apache KafkaExtended leave entitlements | Flexible working options | Paid parental leave | Parent roomsMid-level Full TimeAustralia21h ago
-
Director - Data Platform Engineering AUD 60K-200KAirflow | Amazon Web Services | Apache Kafka | Apache Spark | CI/CDExecutive-level Full TimeSydney, New South Wales, Australia21h ago
-
Data Engineer – Data & AI Practice AUD 80K-120KAWS | Apache Airflow | Azure | CI/CD | DBTFlexible work arrangements | Health and wellbeing program | Learning & development program | Novated leasing options | Paid leaveMid-level Full TimeMelbourne, Australia21h ago
-
AWS | AWS Glue | AWS Lambda | Amazon Redshift | Amazon S3Additional paid leave | Corporate partner discounts | Hybrid work | Learning platform access | Mobile PlanSenior-level Full TimeBarangaroo, NSW, AU1d ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerMid-level Full TimeSydney, Australia1d ago
-
Data Processing | Data use | Diffusion Models | Embedding systems | Ethical AIEquity packages | Flexible leave policies | Inclusive parental leave | Professional growth learning and technical leadership | Remote friendly flexible working arrangementsSenior-level Full TimeAustralia1d ago
-
Senior Machine Learning / ML Engineer AUD 170K-190KAirflow | Amazon EMR | Apache Spark | Dask | Data orchestrationEngineering standards | Hybrid work model | MentoringSenior-level Full TimeAU: Melbourne: (260 Burwood Rd)1d ago
-
Senior AI/Analytics Engineer - CTT AUD 130K-150KApache Airflow | Apache Kafka | Autogen | Container Services | DockerEmployee discounts | Employee-only mortgage rates | Flexible work arrangements | Learning and development | Leave optionsSenior-level Full TimeSydney, NSW, Australia1d ago
-
Sr. Forward Deployed Engineer AUD 145K-185KAnthropic | Apache Spark | Artificial Intelligence | Backend Development | Cloud ComputingSenior-level Full TimeMelbourne, Australia; Sydney, Australia1d ago
-
C# | MATLAB | NumPy | Pandas | PythonPart-time project-based workSenior-level Full TimeAustralia - Remote R1d ago
-
Staff Data Engineer AUD 125K-138KAWS | Apache Spark | Cloud Computing | Cloud platform | Data ModelingEmissions reduction focus net zero by FY2050 | Flexible working | Paid leave | Parental leave | Personal Flexi DaysSenior-level Full TimeCremorne, Victoria, Australia2d ago
-
Data labeling | Data pipeline | Debugging | Inference | Inference OptimizationEquity compensation | Flexible leave options | Inclusive parental leave | Remote work within Australia | Wellbeing allowanceSenior-level Full TimeSydney, Australia R2d ago
-
AI Engineer (Senior) AUD 145K-156KAWS | Agentic AI | Agile | Amazon SageMaker | Artificial IntelligenceSenior-level Full TimeMelbourne, VIC, Australia2d ago
-
AWS | Ataccama | Azure | Cloud platform | CollibraExperian Shares Discount | Flexible time off | Flexible work environment | Hybrid work model | Novated leasingSenior-level Full TimeSouthbank, VIC, Australia R2d ago
-
Communication skills | Data Analysis | Data Auditing | Data Catalog | Data CleansingFlexible time off | Flexible work environment | Hybrid model | Paid parental leave | Study leaveSenior-level Full TimeNorth Sydney, Australia R2d ago
-
Data Engineer AUD 90K-110KAWS Cloud | AWS Cloud Development Kit | AWS Glue | AWS cloud development | Amazon AuroraAdditional leave | Board games | Hybrid work | In-house workshops | Learning and development budgetEntry-level Full TimeSydney, New South Wales, Australia2d ago
-
Data Platform Engineer AUD 100K-120KAWS | Alerting | CI/CD | DBT | DataOps5 weeks annual leave | Family care parental leave | Global mobility opportunities | Hybrid working | Personal Carer LeaveMid-level Full TimeNorth Sydney, AU2d ago
-
NumPy | Pandas | Python | SciPy | SymPyFlexible part-time schedule | Freelance work | Project based workSenior-level FreelanceAustralia - Remote R2d ago
-
Senior-level Full TimeMelbourne, Australia3d ago
-
AI Engineer - DDAI AUD 126K-150KA/B | A/B Testing | Apache Spark | Autogen | B testingAdditional leave | Community volunteering opportunities | Employee benefits | Flexible work | Learning and developmentMid-level Full TimeSydney, NSW, Australia3d ago
-
Mid-level Full TimeSydney, NSW3d ago
-
Azure Functions | CI/CD | Code review | Databricks | Delta LakeFlexible working options | Paid volunteering days | Parental leave | Retail discounts | Return to work supportSenior-level Full TimeMelbourne, VIC, AU3d ago
-
Combinatorics | Graph theory | Mathematical Modeling | NumPy | Number theoryFlexible schedule | Freelance project-based work | Part-time opportunitiesSenior-level FreelanceAustralia - Remote R3d ago