AWS Data Engineering Lead
Tasks
- Apply data governance for quality security compliance
- Build CI CD pipelines and monitoring for data platforms
- Design and deliver scalable secure AWS data platforms
- Design real-time streaming data pipelines
- Develop ETL and ELT pipelines using SQL and Python
- Implement DevOps practices automation and infrastructure as code
- Implement data modeling data warehousing and data lakes
- Lead multidisciplinary teams for data engineering solutions
- Optimize platforms for scalability reliability and cost
- Provide technical leadership, coaching, and mentoring
Perks/Benefits
- Coaching
- Flexible working options
- Paid parental leave
- Paid volunteering days
- Retail discounts
- Return to work support
- Wellbeing leave
- Work from select countries
Skills/Tech-stack
AWS | AWS Glue | AWS Lambda | Amazon Athena | Amazon MSK | Amazon RDS | Amazon Redshift | Apache Airflow | Apache Flink | Apache Kafka | CI/CD | DBT | Data Lakes | Data Modeling | Data Warehousing | DevOps | Docker | ELT | ETL | Infrastructure as Code | Python | Real Time | Real-time analytics | SQL | SageMaker | Spark | Storm | Stream processing | Terraform | “as-code”
Education
N/A
Regions
Countries
States
Cities
Related jobs
-
Cloud Data Engineering Solution Architect AUD 140K-155KAccess Control | Apache Spark | Azure | CI/CD | Data GovernanceSenior-level Full TimeSydney, NSW, Australia12h ago
-
Account Manager - Digital Analytics AUD 70K-80KAWS | Account Management | Adobe Analytics | Adobe Experience | Adobe Experience PlatformMid-level Full TimeSydney14h ago
-
Account Manager - Digital Analytics AUD 70K-80KAWS | Account Management | Adobe Analytics | Adobe Experience | Adobe Experience PlatformMid-level Full TimeMelbourne14h ago
-
Data Enablement Lead NZD 130K-152KDBT | Data Governance | Data Modeling | Data pipeline | GitHubCollaborative team days | Hybrid working | Location flexibilitySenior-level Full TimeAU: Melbourne: (260 Burwood Rd)1d ago
-
Data Engagement Manager AUD 80K-100KAWS | Account Management | Adobe Analytics | Billing Management | Budget trackingMid-level Full TimeSydney1d ago
-
Data Engagement Manager AUD 80K-100KAWS | Account Management | Adobe Analytics | Analytics engineering | BudgetingMid-level Full TimeMelbourne1d ago
-
Senior Manager, Applied AI AUD 127K-140KAI Evaluation | AI Observability | AI monitoring | Agent Orchestration | Agentic patternsDiscounted travel | Flexible working | Paid parental leave | Professional memberships | Rewards and discountsSenior-level Full TimeAdelaide, South Australia, Australia1d ago
-
Advanced Analytics Manager AUD 110K-130KAWS | Fraud Detection | Python | Rule Logic | SASAccess to technology tools | Central office access | Flexible working | Hybrid environment | Learning opportunitiesMid-level Full TimeEveleigh, NSW - 5-7 Central Ave, …1d ago
-
Snr Engineering Manager / Chapter Lead (Data Engineering) - 12 Months Fixed Term Contract AUD 129K-142KAWS Glue | AWS Lambda | AWS S3 | AWS Step Functions | AgileFlexible start and finish times | Hybrid work flexibility | Job share options | Part-time arrangementsSenior-level Contract Full Time TemporarySydney, NSW - CBP North, 1 …1d ago
-
Senior Manager, Global Premier Support AUD 144K-180KAWS | Azure | Business reviews | Customer satisfaction | GCPComprehensive benefits | Occasional travelSenior-level Full TimeSydney, Australia3d ago
-
Senior/Tech Lead - AI Development AUD 150K-180KAI Foundry | AI Search | AWS Bedrock | Amazon SageMaker | Artificial IntelligenceChill-out spaces | Flexible hours | Professional development courses | Remote Working | Social eventsSenior-level Full TimeSydney, New South Wales, Australia4d ago
-
GM/VP Data Engineering AUD 60K-200KArchitecture assessment | Continuous Improvement | Dashboards | Data Engineering | Data GovernanceExecutive-level Full TimeAU: Melbourne: (260 Burwood Rd)5d ago
-
Data Engineer - Consultant AUD 120K-130KAWS | Azure | CI/CD | Cloud Data | Cloud data lake360 feedback loops | Career development pathways | Community clubs | Innovation days | Mentoring support leadSenior-level Full TimeMelbourne, Victoria, Australia6d ago
-
Agentic Frameworks | CI/CD | Cloud Computing | Containers | Deep learningCareer growth support | Flexible work arrangement | Hybrid work arrangement | Inclusive engineering culture | Learning and development supportSenior-level Full TimeAustralia8d ago
-
Senior Manager, AI Engineering Platforms AUD 116K-127KAgent Orchestration | Automation | C# | C++ | CI/CDCareer development | Employee wellbeing | Flexible working arrangementsSenior-level Full TimeMelbourne Support Centre11d ago
-
Data Engineering Lead (AWS) AUD 70K-97KAWS Glue | AWS Lambda | Amazon Athena | Amazon Managed Streaming for Apache Kafka | Amazon RDSCoaching support | Flexible work options | Paid parental leave | Paid volunteering days | Retail discountsSenior-level Full TimeSydney, NSW, AU11d ago
-
Lead Agentic AI Developer AUD 130K-150KADK | Agent Development Kit | CI/CD | Cloud platform | FastAPIBirthday leave | Career break | Compassionate leave | Employee resource groups | Health and wellbeingSenior-level Full TimeNSW - SHS 2 Holt Street …12d ago
-
AWS | Automated testing | Azure | Big Data | CI/CDEmployee assistance program | Employee share plan | Flexible leave | Health and wellness discounts | Learning and developmentExecutive-level Full TimeAustralia, Queensland12d ago
-
Senior Consultant / Manager - Advanced Data Analyst - Planning and Infrastructure Economics AUD 60K-250KArcGIS | Dashboards | Demand Modeling | Demand forecasting | Energy DemandCareer breaks | Flexible hours | Health and wellbeing initiatives | Learning and growth opportunities | Paid parental leaveExecutive-level Full TimeMelbourne, VIC, Australia13d ago
-
Insights Analytics Manager AUD 100K-120KAdobe Audience | Adobe Audience Manager | Adobe Experience | Adobe Experience Manager | Adobe Journey OptimizerCareer development | Collaborative culture | Hybrid workingMid-level Full TimeEveleigh, NSW - 1 Locomotive Street, …13d ago
-
Senior Lead, Data Analytics AUD 148K-148KAnalytics architecture | Automation | Business Intelligence | Cloud analytics | Data GovernanceSenior-level Full TimeAustralia, UniSC Sunshine Coast, Australia, UniSC …13d ago
-
Head of AI Engineering AUD 150K-200KAWS | Agentic Workflows | Application development | Artificial Intelligence | CI/CD4-day work week option | Competitive remuneration | Flexible working arrangements | Ongoing professional development | Work-life balanceExecutive-level Full TimeMelbourne14d ago
-
Lead Data Engineer AUD 117K-132KAgile delivery | Analytics | Big Data | Cloud Computing | Data ArchitectureAffordable parking | Career development opportunities | Employee assistance program | Flexible working arrangements | Health and wellness discountsSenior-level Full TimeSt Lucia Campus, Australia14d ago
-
Lead Data Engineering Consultant AUD 125K-145KAWS | Airflow | Azure | Consulting | DBTConference attendance | Flexible work schedule | Four day week option | Professional development | TrainingSenior-level Full TimeMelbourne15d ago
-
Lead Data Scientist AUD 112K-125KBig Data | Data Analysis | Data Modeling | Machine Learning | PythonDollar matching for fundraising | Generous leave options | Hybrid working | Inclusion and diversity initiatives | Learning and development platformSenior-level Full TimeBrisbane, Queensland, Australia15d ago