Lead Data Engineer
Canberra, Australian Capital Territory 2600, Australia
AUD 118K-127K (estimate) Senior-level Full Time
Tasks
- Automate infrastructure provisioning and operations
- Build observable data ingestion pipelines
- Communicate data risk and issues
- Configure scalable resilient observable analytics platforms
- Design and support data pipelines end to end
- Develop data storage tables and message schemas
- Improve data ingestion standards
- Install configure and operate search and analytics clusters
- Maintain batch and streaming data pipelines
- Manage data lake access controls
- Monitor data platform health and performance
- Optimize data ingestion pipelines
- Remediate platform issues
Perks/Benefits
Skills/Tech-stack
Access Control | Ansible | Batch Processing | CI/CD | Chef | Data Enrichment | Data Lake | Data Transformation | Hadoop | Java | Kafka | Linux | Message serialization | Nifi | Puppet | Python | Role-Based Access | Role-Based Access Control | Scala | Schema Design | Spark | Streaming Data
Education
N/A
Regions
Countries
Related jobs
-
Data Processing | Diffusion Models | Embedding Models | Experimentation | Fine TuningEquity packages | Flexible leave | Parental leave | Remote work within Australia | Wellbeing allowanceSenior-level Full TimeSydney, Australia R8h ago
-
Data Platform Engineer AUD 103K-125KAI Foundry | Automated testing | Azure AI | Azure AI Foundry | Azure DataAccredited family friendly workplace | Additional inclusive leave | Bonus paid time off | Flexible work options | Hybrid workingMid-level Full TimeSydney, NSW, Australia11h ago
-
Data Platform Engineer AUD 103K-125KAI Foundry | Automated testing | Azure AI | Azure AI Foundry | Azure DataAdditional leave options | Flexible working options | Hybrid working | Inclusive leave optionsMid-level Full TimeMelbourne, VIC, Australia11h ago
-
Data Engineer AUD 140K-175KAWS | Access Control | Agile | Automated testing | AzureContinuous learning | Discount Store Financial Benefits | Employee assistance program | Flexible working options | Novated leasingSenior-level Full TimePerth, Western Australia, Australia13h ago
-
Staff Applied AI Scientist AUD 148K-180KAgentic Systems | Data labeling | Human-in-the-loop | LLM Evaluation | LLM-as-a-JudgeExtended end of year break | Home workspace setup budget | Inclusive parental leave | Learning programs and coaching | MacBook provisionSenior-level Full TimeSydney13h ago
-
Senior Data Engineer - Data & AI AUD 102K-120KAWS | CI | CI/CD | DevOps | NLPConference access | Corporate discounts and vouchers | Generous parental leave | Home office setup support | Hybrid workSenior-level Full TimeBrisbane, Australia13h ago
-
Senior Data Engineer - Data & AI AUD 102K-120KAWS | CI/CD | Data Governance | Data Pipelines | Data QualityCommunity leave | Conferences and study assistance | Corporate discounts and vouchers | Home office stipend | Hybrid workSenior-level Full TimeSydney, Australia13h ago
-
Senior Data Engineer - Data & AI AUD 102K-120KCI/CD | Clean Code | Data Governance | Data Quality | Data pipelineConferences | Corporate discounts | Home office support | Hybrid workplace | In-house trainingSenior-level Full TimeMelbourne, Australia13h ago
-
Azure AI Developer Consultant AUD 120K-143K.NET | API Management | App Service | Automated testing | Azure APIFlexible work schedule | Presence on customer site when required | Work-from-home hybridSenior-level Full TimeMelbourne, VIC, AU21h ago
-
Junior MLOps Engineer AUD 65K-75KAlerting | CI/CD | Cloud infrastructure | Containerization | DockerCompany-wide events | Daily catered breakfast | Free coffee | Learning opportunities | Modern office spaceEntry-level Full TimeMelbourne, Australia1d ago
-
Mid-level Full TimeAU: Sydney (45 Clarence St)1d ago
-
Staff Machine Learning Engineer NZD 135K-165KAWS EMR | Airflow | Apache Spark | Dask | Distributed ProcessingSenior-level Full TimeAU: Sydney (45 Clarence St)1d ago
-
Senior AI Engineer (Sydney, Australia - Hybrid) AUD 146K-180KAI Observability | AWS Bedrock | AWS IAM | Agentic Frameworks | Amazon CloudWatchHybrid work | Relocation provided noneSenior-level Full TimeSydney, Australia R1d ago
-
Data Platform Architect AUD 129K-155KAccess Control | Auditing | Azure | Azure Data | Azure Data BricksBaseline clearance sponsorship or eligibility | Hybrid work model | Potential contract extensionSenior-level ContractSydney, New South Wales, Australia R1d ago
-
Backend Software Engineer – Human-Robot Interaction AUD 140K-175KC++ | Concurrency | Distributed Systems | Event Driven | Event-driven architecture401k contributions | Dental insurance | Federal Holidays | Health insurance | State HolidaysSenior-level Full TimeCharlestown, MA1d ago
-
Agentic Frameworks | CI/CD | Cloud Computing | Containers | Deep learningCareer growth support | Flexible work arrangement | Hybrid work arrangement | Inclusive engineering culture | Learning and development supportSenior-level Full TimeAustralia2d ago
-
AI Agents | API Integration | Language Models | Large Language Models | Next.jsAccess to cutting-edge technologies | Continuous learning | Fully remote | High autonomy | Location flexibilityMid-level Full TimeAustralia R2d ago
-
Embedded Linux Engineer AUD 100K-140KAI hardware | AI hardware optimization | Assembly | Automated Deployment | Bare MetalFlexible work options | Give back day | Global wellness paid day off | Health and wellbeing timeMid-level Full TimeSydney2d ago
-
Senior Robotics Simulation Engineer USD 190K-200KAPIs | C++ | CI/CD | Communication Interfaces | Embedded Systems401k | Accident insurance | Commuter benefits | Company-Paid Holidays | Critical illness insuranceSenior-level Full TimeBrisbane, CA3d ago
-
Senior AI Engineer, AI Accelerator AUD 160K-180KAI Operationalisation | AWS | Agent Frameworks | Azure OpenAI | CI/CDCareer development opportunities | Convenient city location | Free Membership | Hybrid working | Modern end of trip facilitiesSenior-level Full TimeMelbourne, VIC, AU4d ago
-
Applied AI Engineer AUD 137K-181KAPI Integration | Agent Development | Evaluation Frameworks | LLM Deployment | Language ModelsEquity donation matching | Flexible working hours | Generous vacation | Office space | Parental leaveSenior-level Full TimeSydney, Australia5d ago
-
CI/CD | Data Analysis | Data Visualization | Git | Integer optimizationCollaborative culture | Equity participation | Fully remote work flexibility | High-impact projects | Mission-driven cultureSenior-level Full TimeAustralia R5d ago
-
Data Engineer AUD 135K-165KAgile | Apache Airflow | Apache Spark | Cloud Computing | Data ModelingAnnual bonus opportunity | Collaborative technology environment | Discounted retail gift cards | Permanent full time opportunity | Wellness programsMid-level Full TimeMelbourne, Victoria 3000, Australia5d ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Distributed remote work | Friendly work environmentMid-level Full TimeSydney, Australia5d ago
-
Senior Data Engineer AUD 125K-135KAlerting | Apache Spark | Automated testing | CI/CD | Data CatalogAdditional paid leave | Company events | Diversity support | Floating public holidays | Hybrid work arrangementSenior-level Full TimeSydney, New South Wales 2000, Australia5d ago