Senior Data Engineer – Data & AI Practice
Tasks
- Build batch and streaming data pipelines
- Collaborate with engineers analysts and stakeholders
- Conduct root cause analysis for data issues
- Contribute to code reviews and engineering standards
- Design scalable data ingestion pipelines
- Develop production data structures
- Document data lineage and operational standards
- Ensure data performance reliability maintainability
- Implement data transformation workflows
- Optimize SQL queries and transformations
- Orchestrate data workflows
- Perform data quality testing
- Provide technical input for delivery planning and estimation
- Validate AI assisted workflows output
- Write unit and integration tests
Perks/Benefits
- Flexibility
- Health and wellbeing programs
- Learning program
- Novated leasing options
- Purchased leave
- Recognition programs
- Salary packaging
- Social activities
Skills/Tech-stack
Apache Airflow | Apache Kafka | CI/CD | DBT | Data Governance | Data Lineage | Data Modeling | Data Observability | Data Quality | Data pipeline | Data pipeline orchestration | Databricks | ELT | ETL | Integration Testing | Pipeline Orchestration | PySpark | Python | SQL | Snowflake | Unit Testing
Education
N/A
Roles
Related jobs
-
Data Scientist, People Analytics AUD 129K-142KAWS | AWS Glue | AWS Lambda | Amazon Bedrock | Amazon S3Career development opportunities | TrainingSenior-level Full TimeSydney, NSW - CBP North, 1 …20h ago
-
Data Engineer - 12 Month Opportunity AUD 110K-140KAWS | Agile | Artificial Intelligence | Bash | Business IntelligenceAll-team events | Hybrid social events | Learning and development | Team discounts | Volunteer leaveMid-level Full TimeMelbourne, VIC, AU R1d ago
-
Senior Applied AI Engineer AUD 119K-161KAgent Orchestration | Agent systems | Bias Testing | Context engineering | Evaluation datasetsCoaching | Equity | Extended end of year break | Home workspace setup budget | Inclusive parental leaveSenior-level Full TimeMelbourne1d ago
-
Staff Machine Learning Engineer - Recommendations AUD 119K-136KData-Driven Decision Making | Data-driven | Decision Making | Machine Learning | Model EvaluationEquity packages | Flexible leave options | Parental leave | Virtual interviews | Wellbeing allowanceSenior-level Full TimeSydney, Australia1d ago
-
Mid-level Full TimeAU: Sydney (45 Clarence St)1d ago
-
Data pipeline | Debugging | Inference Optimization | Java | KubernetesFlexible leave options | Flexible work hours | Inclusive parental leave | Office setup allowance | Remote friendly within AustraliaSenior-level Full TimeSydney, Australia1d ago
-
Applied AI Engineer AUD 70K-97KAgent architecture | CI/CD | Data pipeline | Docker | Infrastructure as CodeFlexible work arrangements | Leadership programs | Learning programs | Paid parental leave | Paid volunteering daysSenior-level Full TimeMelbourne, VIC, AU1d ago
-
Data Engineer AUD 113K-117KAzure Data | Azure Data Factory | Azure Databricks | Azure Synapse | Azure Synapse AnalyticsDiscounts | Flexible working | Growth opportunities | Inclusive culture | Paid leaveMid-level Full TimeVIC - Melbourne - 655 Collins …1d ago
-
Forward Deployed AI Engineer AUD 80K-91KAI Governance | APIs | Agent Frameworks | Cloud Computing | Data PrivacyAdditional leave types | Discounted health insurance | Flexible work arrangements | Lifestyle discounts | On going training and developmentEntry-level Full TimeGarvan / TKCC Sydney, Australia1d ago
-
Apache Spark | Azure Blob | Azure Blob Storage | Azure Data | Azure Data FactorySenior-level Full TimeSydney, International House, 3 Sussex St, …1d ago
-
Adtech | Distributed Systems | Docker | Embeddings | JavaAccess to technical leadership | Collaborative engineering culture | Exposure to cutting edge generative AI | High autonomy and flexibility | High ownership and real world production impactEntry-level Full TimeAustralia R2d ago
-
Bash | Cloud platform | Data Ingestion | Data Ingestion Pipeline | Data ProcessingAsynchronous culture | Friendly atmosphere | Portfolio link support | Remote or distributed workMid-level Full TimeBrisbane, Australia2d ago
-
Cyber Security Data Engineer AUD 135K-165KArtificial Intelligence | Automation | Compliance reporting | Control assessments | Control mappingEmployee discounts | Flexible work arrangements | Learning and development opportunities | Leave options | Volunteering opportunitiesMid-level Full TimeSydney, NSW, Australia2d ago
-
Agile | Apex | CI/CD | Change Data Capture | CopadoFlexible working | Hybrid working options | Wellbeing supportSenior-level Full TimeSydney Office, Australia2d ago
-
Data Engineer-Medicare Mental Health Check In AUD 96K-119KAutomated testing | Azure | Azure Data | Azure Data Factory | CI/CDCompetitive salary packaging benefits | Hybrid working | Inclusive and supportive culture | Professional development and learning opportunitiesMid-level Full TimeVIC Group Office - Melbourne, Australia2d ago
-
AI Engineer - Melbourne AUD 92K-125KAPI Development | AWS | Automated testing | CI/CD | Cloud platformMid-level Full TimeMelbourne - 727 Collins, Australia R2d ago
-
Mid-level Full TimeSydney - Barangaroo, Australia R2d ago
-
Azure Databricks | Azure Synapse | CI/CD | DAX | Data LakeSenior-level Full TimePerth, Exchange Tower, Australia2d ago
-
AI Software Engineer AUD 111K-161KASP.NET Web | ASP.NET Web API | AWS ECS | AWS Lambda | AWS S3Additional time off | Flexible and hybrid working | Gym membership | Learning opportunities | Social eventsMid-level Full TimeSydney, New South Wales, Australia3d ago
-
Mid-level Full TimeHong Kong, Hong Kong; Sydney, Australia4d ago
-
Reporting & Data Engineers AUD 150K-180KAgile | Azure | CI/CD | Data Modeling | Data WarehousingClient office access | Hybrid workMid-level Full TimeMelbourne, Victoria 3000, Australia5d ago
-
Data Engineer AUD 125K-128KAI Agents | AWS | Automation | Azure | Data GovernanceCharity volunteering opportunities | EAP support | Financial planning support | Flexible work options | Generous leaveMid-level Full TimeNorwest, New South Wales 2153, Australia5d ago
-
Data Engineer AUD 110K-140KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2Birthday day off | End-of-trip facilities | Flexible working | Paid parental leaveMid-level Full TimeSydney5d ago
-
Senior Software Engineer AUD 140K-143KAPI Design | Agile | Automated testing | CI/CD | Distributed SystemsFlexible working hours | Job share | Office connection at least half time per month | Part-time arrangementsSenior-level Full TimeEveleigh, NSW - 1 Locomotive Street, …5d ago
-
Data Engineering Lead AUD 120K-125KAWS | Azure | CI/CD | Cloud Computing | Data ArchitectureCareer development opportunities | Discounted healthcare memberships | Employee counselling support | Employee discounts | Flexible leave optionsSenior-level Full TimeHead Office Sydney, Australia5d ago