Lead Data Engineer
Tasks
- Apply cloud security standards
- Build data warehousing and analytics solutions
- Define data quality assurance and validation processes
- Deploy machine learning and generative AI solutions
- Develop ETL pipelines
- Evaluate emerging technologies
- Implement infrastructure-as-code
- Lead cloud data engineering design and delivery
- Mentor and coach data engineering team
- Set CI CD pipeline standards
- Translate business requirements into technical specifications
Perks/Benefits
- N/A
Skills/Tech-stack
Acceptance Testing | Apache Airflow | Apache Beam | BigQuery | CI/CD | Cloud Composer | Cloud Functions | Cloud Run | Cloud Security | Cloud Storage | Cloud platform | Data Validation | Data Warehousing | Dataflow | DevOps | ETL | Generative AI | GitHub Actions | Google Cloud | Google Cloud Platform | Infrastructure as Code | Machine Learning | Marketing Mix | Marketing mix modelling | Networking | Python | Quality Assurance | SQL | Terraform | User Acceptance | User Acceptance Testing | “as-code”
Education
Bachelor of Engineering | Bachelor of Science | Bachelor of Technology | Master of Science | PhD
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Regions
Countries
States
Cities
Related jobs
-
Senior AI Engineer - Digital & Contact Centre AUD 129K-143KAI Agents | AI Governance | AI Safety | Artificial Intelligence | Cloud NativeEmployee discounts | Flexible work arrangements | Learning and development | Leave options | Volunteering initiativesSenior-level Full TimeSydney, NSW, Australia15h ago
-
Senior Applied AI Engineer AUD 119K-161KAgent Orchestration | Agent systems | Bias Testing | Context engineering | Evaluation datasetsCoaching | Equity | Extended end of year break | Home workspace setup budget | Inclusive parental leaveSenior-level Full TimeMelbourne15h ago
-
Staff Machine Learning Engineer - Recommendations AUD 119K-136KData-Driven Decision Making | Data-driven | Decision Making | Machine Learning | Model EvaluationEquity packages | Flexible leave options | Parental leave | Virtual interviews | Wellbeing allowanceSenior-level Full TimeSydney, Australia16h ago
-
Mid-level Full TimeAU: Sydney (45 Clarence St)17h ago
-
Data pipeline | Debugging | Inference Optimization | Java | KubernetesFlexible leave options | Flexible work hours | Inclusive parental leave | Office setup allowance | Remote friendly within AustraliaSenior-level Full TimeSydney, Australia18h ago
-
Applied AI Engineer AUD 70K-97KAgent architecture | CI/CD | Data pipeline | Docker | Infrastructure as CodeFlexible work arrangements | Leadership programs | Learning programs | Paid parental leave | Paid volunteering daysSenior-level Full TimeMelbourne, VIC, AU20h ago
-
Applied AI Specialist AUD 90K-118KAPI Integration | Artificial Intelligence | Data Contracts | Data schemas | JSONFlexible work arrangements | Learning and leadership programs | Market-leading parental leave | Paid volunteering days | Retail discountsSenior-level Full TimeMelbourne, VIC, AU20h ago
-
Apache Spark | Azure Blob | Azure Blob Storage | Azure Data | Azure Data FactorySenior-level Full TimeSydney, International House, 3 Sussex St, …20h ago
-
Adtech | Distributed Systems | Docker | Embeddings | JavaAccess to technical leadership | Collaborative engineering culture | Exposure to cutting edge generative AI | High autonomy and flexibility | High ownership and real world production impactEntry-level Full TimeAustralia R1d ago
-
Bash | Cloud platform | Data Ingestion | Data Ingestion Pipeline | Data ProcessingAsynchronous culture | Friendly atmosphere | Portfolio link support | Remote or distributed workMid-level Full TimeBrisbane, Australia1d ago
-
Cyber Security Data Engineer AUD 135K-165KArtificial Intelligence | Automation | Compliance reporting | Control assessments | Control mappingEmployee discounts | Flexible work arrangements | Learning and development opportunities | Leave options | Volunteering opportunitiesMid-level Full TimeSydney, NSW, Australia1d ago
-
Lead Data Scientist AUD 150K-180KAccountability | CD4ML | Computer Vision | Data Mining | Data PreprocessingCareer development support | Learning and development programs | MentorshipSenior-level Full TimeMelbourne, Australia1d ago
-
Agile | Apex | CI/CD | Change Data Capture | CopadoFlexible working | Hybrid working options | Wellbeing supportSenior-level Full TimeSydney Office, Australia1d ago
-
Data Engineer-Medicare Mental Health Check In AUD 96K-119KAutomated testing | Azure | Azure Data | Azure Data Factory | CI/CDCompetitive salary packaging benefits | Hybrid working | Inclusive and supportive culture | Professional development and learning opportunitiesMid-level Full TimeVIC Group Office - Melbourne, Australia1d ago
-
AI Engineer - Melbourne AUD 92K-125KAPI Development | AWS | Automated testing | CI/CD | Cloud platformMid-level Full TimeMelbourne - 727 Collins, Australia R1d ago
-
Mid-level Full TimeSydney - Barangaroo, Australia R1d ago
-
Azure Databricks | Azure Synapse | CI/CD | DAX | Data LakeSenior-level Full TimePerth, Exchange Tower, Australia1d ago
-
AI Software Engineer AUD 111K-161KASP.NET Web | ASP.NET Web API | AWS ECS | AWS Lambda | AWS S3Additional time off | Flexible and hybrid working | Gym membership | Learning opportunities | Social eventsMid-level Full TimeSydney, New South Wales, Australia2d ago
-
Mid-level Full TimeHong Kong, Hong Kong; Sydney, Australia3d ago
-
Reporting & Data Engineers AUD 150K-180KAgile | Azure | CI/CD | Data Modeling | Data WarehousingClient office access | Hybrid workMid-level Full TimeMelbourne, Victoria 3000, Australia4d ago
-
Data Engineer AUD 125K-128KAI Agents | AWS | Automation | Azure | Data GovernanceCharity volunteering opportunities | EAP support | Financial planning support | Flexible work options | Generous leaveMid-level Full TimeNorwest, New South Wales 2153, Australia4d ago
-
Data Engineer AUD 110K-140KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2Birthday day off | End-of-trip facilities | Flexible working | Paid parental leaveMid-level Full TimeSydney4d ago
-
Senior Software Engineer AUD 140K-143KAPI Design | Agile | Automated testing | CI/CD | Distributed SystemsFlexible working hours | Job share | Office connection at least half time per month | Part-time arrangementsSenior-level Full TimeEveleigh, NSW - 1 Locomotive Street, …4d ago
-
Data Engineering Lead AUD 120K-125KAWS | Azure | CI/CD | Cloud Computing | Data ArchitectureCareer development opportunities | Discounted healthcare memberships | Employee counselling support | Employee discounts | Flexible leave optionsSenior-level Full TimeHead Office Sydney, Australia4d ago
-
Principal AI Engineer AUD 130K-180KAPI Development | Agentic Workflows | Backend Services | CI/CD | ClassificationCareer growth | Flexible working environment | Remote-friendly cultureSenior-level Full TimeSydney4d ago