AWS Data Engineering Lead
Tasks
- Apply data governance for quality security compliance
- Build CI CD pipelines and monitoring for data platforms
- Design and deliver scalable secure AWS data platforms
- Design real-time streaming data pipelines
- Develop ETL and ELT pipelines using SQL and Python
- Implement DevOps practices automation and infrastructure as code
- Implement data modeling data warehousing and data lakes
- Lead multidisciplinary teams for data engineering solutions
- Optimize platforms for scalability reliability and cost
- Provide technical leadership, coaching, and mentoring
Perks/Benefits
- Coaching
- Flexible working options
- Paid parental leave
- Paid volunteering days
- Retail discounts
- Return to work support
- Wellbeing leave
- Work from select countries
Skills/Tech-stack
AWS | AWS Glue | AWS Lambda | Amazon Athena | Amazon MSK | Amazon RDS | Amazon Redshift | Apache Airflow | Apache Flink | Apache Kafka | CI/CD | DBT | Data Lakes | Data Modeling | Data Warehousing | DevOps | Docker | ELT | ETL | Infrastructure as Code | Python | Real Time | Real-time analytics | SQL | SageMaker | Spark | Storm | Stream processing | Terraform | “as-code”
Education
N/A
Regions
Countries
States
Cities
Related jobs
-
Lead Data Engineer AUD 125K-135KAWS | Auditability | Automation | CI/CD | CoalesceCareer advancement opportunities | Corporate discounts | Employee Assistance Program (EAP) | Employee share plan | Fitness passportSenior-level Full TimePyrmont, NSW, AU, 20091d ago
-
Advanced Analytics Manager AUD 100K-120KC++ | CPLEX | Cloud Computing | Databases | DatabricksAccommodation discounts | Car hire discounts | Discounted flights | Discounts on retail and services | Free counselingMid-level Full TimeBrisbane4d ago
-
Technical Lead - Data Engineering and Reporting AUD 114K-125KAWS | Cloud Platforms | Data Engineering | Data Governance | Data MigrationCareer development | Healthcare mission driven work | Hybrid workSenior-level Full TimeAUS - Melbourne, Australia4d ago
-
Customer Segmentation | Dashboarding | Data Risk | Data risk management | Data useCareer development support | High-impact projects | Hybrid workingMid-level Full TimeEveleigh, NSW - 1 Locomotive Street, …6d ago
-
Manager, Advanced Analytics & Insights AUD 88K-109KBehavior Analysis | Cohort Analysis | Customer Behavior Analysis | Customer behavior | Data ModelingFlexible work arrangements | Learning and development opportunities | Leave options | Volunteering initiativesMid-level Full TimeAustralia6d ago
-
Advanced Analytics Manager AUD 110K-125KAWS | Agile | Automation | Confluence | Data GovernanceFlexible work arrangements | Office based collaboration in SydneyMid-level Full TimeSydney, NSW - CBP South, 11 …7d ago
-
Advanced Analytics Manager AUD 103K-125KAWS | Agile | Confluence | Data Governance | Data LineageFlexible working options | Hybrid work in Sydney officeMid-level Full TimeSydney, NSW - CBP South, 11 …7d ago
-
Advanced Analytics Manager AUD 100K-120KAWS | Agile | Automated Workflows | Data Governance | Data ModelingFlexible start and finish times | Flexible working | Hybrid workMid-level Full TimeSydney, NSW - CBP South, 11 …7d ago
-
Advanced Analytics Manager AUD 95K-120KCampaign analytics | Customer Segmentation | Data Transformation | Data use | ExperimentationCareer development | Hybrid working | Inclusive cultureMid-level Full TimeEveleigh, NSW - 1 Locomotive Street, …7d ago
-
Principal Consultant - Data Engineering AUD 160K-190KApplication Insights | Azure | Azure Data | Azure Data Factory | Azure Data LakeCareer pathways | Diversity | Flexible working hours | Inclusion | Ongoing learningSenior-level Full TimeAustralia7d ago
-
Principal Consultant - Data Engineering AUD 160K-190KAnalysis Services | App Insights | Azure | Azure Data | Azure Data FactoryCareer pathways | Diversity and equal opportunity | Flexibility | Inclusion | Ongoing learningSenior-level Full TimeAustralia7d ago
-
Advanced Analytics Manager AUD 103K-125KAWS | Agile | Automated Workflows | Dashboarding | Data GovernanceFlexible working hours | Hybrid work model | Job-sharing | Part-time optionsMid-level Full TimeSydney, NSW - CBP South, 11 …8d ago
-
Artificial Intelligence | Batch Processing | Cloud Architecture | Data Governance | Data PipelinesSenior-level Full TimeSydney NSW, Australia; Melbourne VIC, Australia9d ago
-
Senior Manager - Responsible AI, Gen AI AUD 130K-143KAI Governance | Foundational models | Generative AI | Machine Learning | Model EvaluationFlexible working hours | In office collaboration at least half time per month | Job flexibility | Job-sharingSenior-level Full TimeEveleigh, NSW - 1 Locomotive Street, …10d ago
-
Manager - Data Analytics and AI AUD 100K-135KAnalytics | Business Intelligence | Data Architecture | Data Governance | Data LineageAdditional leave | Employee assistance program | Flexible work arrangements | Parental leave | Professional mentorshipMid-level Full TimeMelbourne, VIC, Australia11d ago
-
Data & Analytics Manager AUD 113K-130KAI Agents | API Integration | AWS | Advanced Analytics | AutomationCharity volunteering opportunities | EAP | Emergency services leave | Flexible work options | Free wellbeing supportMid-level Full TimeNorwest, New South Wales 2153, Australia11d ago
-
Senior Director, Data and AI Engineering AUD 130K-146KArtificial Intelligence | Automation | CI/CD | Cloud | Data EngineeringAdditional leave days | Carer neutral parental leave | Employee Learning and Development | Employee discounts | Flexible workingSenior-level Full TimeSydney, Australia11d ago
-
Data Engineering Lead AUD 120K-125KAWS | Azure | CI/CD | Cloud Computing | Data ArchitectureCareer development opportunities | Discounted healthcare memberships | Employee counselling support | Employee discounts | Flexible leave optionsSenior-level Full TimeHead Office Sydney, Australia11d ago
-
Marketing Analytics & Insights Lead AUD 90K-100KAdobe Analytics | Data Governance | Data Visualization | Digital analytics | DomoSenior-level Full TimeVIC - Cremorne - 57 Balmain …11d ago
-
Sr. Manager, Capability Engineering & AI Adoption — APJ AUD 150K-186KAgentic Workflows | Apache Spark | Automation | Customer Success | Data EngineeringSenior-level Full TimeSydney, Australia11d ago
-
Sr. Manager, Capability Engineering & AI Adoption — APJ AUD 150K-186KAgentic Workflows | Customer enablement | Data Engineering | Data Governance | ETLSenior-level Full TimeMelbourne, Australia11d ago
-
Account Manager - Digital Analytics AUD 70K-80KAWS | Account Management | Adobe Analytics | Adobe Experience | Adobe Experience PlatformMid-level Full TimeSydney11d ago
-
Account Manager - Digital Analytics AUD 70K-80KAWS | Account Management | Adobe Analytics | Adobe Experience | Adobe Experience PlatformMid-level Full TimeMelbourne11d ago
-
Senior-level Full TimePERTH, WESTERN AUSTRALIA, Australia11d ago
-
Partner Risk Data Analytics AUD 122K-135KAgile | Automation | Data Governance | Data Management | Data ModelingAccess to employee network groups | Discounted Financial Products | Discounted private health insurance | Employee Assistance Program (EAP) | Flexible working arrangementSenior-level Full TimeBrisbane Office - Newstead Village, Australia12d ago