Lead Data Engineer
Canberra, Australian Capital Territory 2600, Australia
AUD 118K-127K (estimate) Senior-level Full Time
Tasks
- Automate infrastructure provisioning and operations
- Build observable data ingestion pipelines
- Communicate data risk and issues
- Configure scalable resilient observable analytics platforms
- Design and support data pipelines end to end
- Develop data storage tables and message schemas
- Improve data ingestion standards
- Install configure and operate search and analytics clusters
- Maintain batch and streaming data pipelines
- Manage data lake access controls
- Monitor data platform health and performance
- Optimize data ingestion pipelines
- Remediate platform issues
Perks/Benefits
Skills/Tech-stack
Access Control | Ansible | Batch Processing | CI/CD | Chef | Data Enrichment | Data Lake | Data Transformation | Hadoop | Java | Kafka | Linux | Message serialization | Nifi | Puppet | Python | Role-Based Access | Role-Based Access Control | Scala | Schema Design | Spark | Streaming Data
Education
N/A
Regions
Countries
Related jobs
-
Senior Applied AI Engineer AUD 119K-161KAgent Orchestration | Agent systems | Bias Testing | Context engineering | Evaluation datasetsCoaching | Equity | Extended end of year break | Home workspace setup budget | Inclusive parental leaveSenior-level Full TimeMelbourne9h ago
-
Staff Machine Learning Engineer - Recommendations AUD 119K-136KData-Driven Decision Making | Data-driven | Decision Making | Machine Learning | Model EvaluationEquity packages | Flexible leave options | Parental leave | Virtual interviews | Wellbeing allowanceSenior-level Full TimeSydney, Australia10h ago
-
Data pipeline | Debugging | Inference Optimization | Java | KubernetesFlexible leave options | Flexible work hours | Inclusive parental leave | Office setup allowance | Remote friendly within AustraliaSenior-level Full TimeSydney, Australia12h ago
-
Apache Spark | Azure Blob | Azure Blob Storage | Azure Data | Azure Data FactorySenior-level Full TimeSydney, International House, 3 Sussex St, …14h ago
-
Adtech | Distributed Systems | Docker | Embeddings | JavaAccess to technical leadership | Collaborative engineering culture | Exposure to cutting edge generative AI | High autonomy and flexibility | High ownership and real world production impactEntry-level Full TimeAustralia R1d ago
-
Bash | Cloud platform | Data Ingestion | Data Ingestion Pipeline | Data ProcessingAsynchronous culture | Friendly atmosphere | Portfolio link support | Remote or distributed workMid-level Full TimeBrisbane, Australia1d ago
-
Cyber Security Data Engineer AUD 135K-165KArtificial Intelligence | Automation | Compliance reporting | Control assessments | Control mappingEmployee discounts | Flexible work arrangements | Learning and development opportunities | Leave options | Volunteering opportunitiesMid-level Full TimeSydney, NSW, Australia1d ago
-
Agile | Apex | CI/CD | Change Data Capture | CopadoFlexible working | Hybrid working options | Wellbeing supportSenior-level Full TimeSydney Office, Australia1d ago
-
Data Engineer-Medicare Mental Health Check In AUD 96K-119KAutomated testing | Azure | Azure Data | Azure Data Factory | CI/CDCompetitive salary packaging benefits | Hybrid working | Inclusive and supportive culture | Professional development and learning opportunitiesMid-level Full TimeVIC Group Office - Melbourne, Australia1d ago
-
AI Engineer - Melbourne AUD 92K-125KAPI Development | AWS | Automated testing | CI/CD | Cloud platformMid-level Full TimeMelbourne - 727 Collins, Australia R1d ago
-
Mid-level Full TimeSydney - Barangaroo, Australia R1d ago
-
Azure Databricks | Azure Synapse | CI/CD | DAX | Data LakeSenior-level Full TimePerth, Exchange Tower, Australia1d ago
-
AI Software Engineer AUD 111K-161KASP.NET Web | ASP.NET Web API | AWS ECS | AWS Lambda | AWS S3Additional time off | Flexible and hybrid working | Gym membership | Learning opportunities | Social eventsMid-level Full TimeSydney, New South Wales, Australia2d ago
-
Mid-level Full TimeHong Kong, Hong Kong; Sydney, Australia3d ago
-
Reporting & Data Engineers AUD 150K-180KAgile | Azure | CI/CD | Data Modeling | Data WarehousingClient office access | Hybrid workMid-level Full TimeMelbourne, Victoria 3000, Australia3d ago
-
Data Engineer AUD 110K-140KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2Birthday day off | End-of-trip facilities | Flexible working | Paid parental leaveMid-level Full TimeSydney4d ago
-
Senior Software Engineer AUD 140K-143KAPI Design | Agile | Automated testing | CI/CD | Distributed SystemsFlexible working hours | Job share | Office connection at least half time per month | Part-time arrangementsSenior-level Full TimeEveleigh, NSW - 1 Locomotive Street, …4d ago
-
Data Engineering Lead AUD 120K-125KAWS | Azure | CI/CD | Cloud Computing | Data ArchitectureCareer development opportunities | Discounted healthcare memberships | Employee counselling support | Employee discounts | Flexible leave optionsSenior-level Full TimeHead Office Sydney, Australia4d ago
-
Principal AI Engineer AUD 130K-180KAPI Development | Agentic Workflows | Backend Services | CI/CD | ClassificationCareer growth | Flexible working environment | Remote-friendly cultureSenior-level Full TimeSydney4d ago
-
Senior Data & Analytics Engineer, Strategic Finance AUD 150K-222KDBT | Data Modeling | Data Pipelines | Data Quality | Dimensional ModelingEmployee stock options | Health insurance coverage | Hybrid work | Paid time off | Parental leaveSenior-level Full TimeMelbourne, VIC, Sydney, NSW R4d ago
-
Data Engineer - 12 month FTC AUD 100K-134KAWS S3 | Agile | Amazon Redshift | Amazon Web Services | Apache AirflowAdditional leave | Corporate partner discounts | Flexible-hybrid work | Free NBN plan | Free mobile planEntry-level Contract Full Time TemporaryBarangaroo, NSW, AU4d ago
-
Azure AI Developer Consultant AUD 70K-100K.NET | API Management | App Service | Azure API | Azure API ManagementFlexible work schedule | Onsite customer visits when required | Work from home optionSenior-level Full TimeMelbourne, VIC, AU4d ago
-
Senior Analytics Engineer - Security Insights AUD 118K-130KAlerting | Batch Processing | Cost Optimization | DBT | Data GovernanceEquity packages | Flexible leave | Parental leave | Wellbeing allowanceSenior-level Full TimeSydney, Australia R5d ago
-
Entry-level Full TimeMelbourne, Australia5d ago
-
Analytics Engineer - Personalisation AUD 110K-140KDBT | Data Modeling | Data Pipelines | Data Warehousing | ELTEquity packages | Flexible leave options | Flexible remote work | Inclusive parental leave | Wellbeing allowanceMid-level Full TimeSydney, Australia R5d ago