AWS Data Engineering Lead
Tasks
- Apply data governance for quality security compliance
- Build CI CD pipelines and monitoring for data platforms
- Design and deliver scalable secure AWS data platforms
- Design real-time streaming data pipelines
- Develop ETL and ELT pipelines using SQL and Python
- Implement DevOps practices automation and infrastructure as code
- Implement data modeling data warehousing and data lakes
- Lead multidisciplinary teams for data engineering solutions
- Optimize platforms for scalability reliability and cost
- Provide technical leadership, coaching, and mentoring
Perks/Benefits
- Coaching
- Flexible working options
- Paid parental leave
- Paid volunteering days
- Retail discounts
- Return to work support
- Wellbeing leave
- Work from select countries
Skills/Tech-stack
AWS | AWS Glue | AWS Lambda | Amazon Athena | Amazon MSK | Amazon RDS | Amazon Redshift | Apache Airflow | Apache Flink | Apache Kafka | CI/CD | DBT | Data Lakes | Data Modeling | Data Warehousing | DevOps | Docker | ELT | ETL | Infrastructure as Code | Python | Real Time | Real-time analytics | SQL | SageMaker | Spark | Storm | Stream processing | Terraform | “as-code”
Education
N/A
Regions
Countries
States
Cities
Related jobs
-
Parts Order Fulfillment Manager ANZ AUD 68K-100KChain management | Data analytics | Demand forecasting | Distribution operations | Inventory ManagementEmployee benefits | Employee wellbeing programs | Flexible work arrangements | Higher education support | Paid parental leaveMid-level Full TimeCrestmead, Queensland, AU, 413211h ago
-
Lead Data Scientist AUD 120K-130KAWS | Deep learning | Digital Signal | Digital Signal Processing | Ensemble MethodsSenior-level Full TimeAU Sydney Bella Vista, Australia3d ago
-
Analytics Lead AUD 60K-60KAgile | Artificial Intelligence | Data Analysis | Data Modeling | Exploratory Data AnalysisBonus program | Career development opportunities | Discount program | Hybrid working | Learning and Support ProgramSenior-level Full TimeChadstone, VIC, AU4d ago
-
Technical Lead - Data Engineering AUD 137K-147KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DatabricksAdditional leave days | Career development through internal mobility | Flexible working | Health and wellbeing initiatives | Supportive and inclusive work environmentSenior-level Full TimeMelbourne: 509 St Kilda Rd, Australia4d ago
-
Reporting & Analytics Team Lead AUD 135K-142KAnalytics | Business Objects | Business Requirements | Dashboard Development | Data WarehousingEV subscriptions | Employee assistance program | Flexible working | Hybrid working | Incentivise recognitionSenior-level Full TimeMelbourne, VIC, AU4d ago
-
Chief Data Engineer AUD 163K-220KApache Airflow | Cloud Architecture | Code review | DBT | Data GovernanceExecutive-level Full TimeSydney, New South Wales 2000, Australia5d ago
-
Geospatial Analytics | Location Intelligence | Network Optimization | Power BI | PythonMid-level Full TimeEveleigh, NSW - 1 Locomotive Street, …5d ago
-
AWS Glue | Alteryx | Amazon Redshift | Azure | Change ManagementChallenging modern ICT environment | Flexible work environment | Mentorship and professional development | Optional rostered days off | Tax benefitsSenior-level Full TimeAustralia Wide, Australia (location flexible) R5d ago
-
Geospatial Analytics | Location Intelligence | Network Optimization | Power BI | PythonMid-level Full TimeEveleigh, NSW - 1 Locomotive Street, …6d ago
-
Senior Manager - Data Engineering AUD 110K-120KAPI Development | Automated Quality | Automated quality assurance | CI/CD | Cloud platformDiscount card | Free services for mental and financial wellbeing | Health and wellbeing services | Hybrid work schedule | Learning and development opportunitiesSenior-level Full TimeSYDNEY, NSW, Australia10d ago
-
Lead Data Analyst - Strategic Partnering AUD 120K-140KAnalytics engineering | Business Intelligence | Data Science | Data analytics | DatabricksHybrid workSenior-level Full TimeNew South Wales, St Leonards 8 …10d ago
-
AWS | AWS Glue | Apache Spark | Artificial Intelligence | AutomationSenior-level Full TimeSydney, NSW - CBP North, 1 …10d ago
-
Advanced Analytics Lead AUD 60K-78KAdvanced Analytics | Artificial Intelligence | Automation | Data Modeling | Data QualityAccommodation discounts | Car hire discounts | Discounted flights | Flexible-hybrid work | Free counsellingSenior-level Full TimeNational, Australia Wide10d ago
-
Data Engagement Manager AUD 75K-90KAWS | Adobe Analytics | Adobe Experience | Adobe Experience Platform | Billing reconciliationMid-level Full TimeMelbourne11d ago
-
Associate Director, Financial Frameworks and Analytics AUD 106K-116KBudgeting | Data Analysis | Data Modeling | Financial Analysis | Financial ModellingAffordable parking | Discounted Study for Staff | Flexible working | Health and wellbeing programs | Hybrid workingMid-level Full TimeSt Lucia Campus, Australia12d ago
-
Data Architect & Governance Lead AUD 125K-135KAI Ready | AI-Ready Data | Cloud Data | Cloud Data Platforms | ComplianceSenior-level Full TimeSydney, AU-NSW, Australia; Sydney Head Office12d ago
-
Amazon Redshift | DBT | Data Modeling | Databricks | ETLCareer development | Certification support | Coaching & mentoring | Global career opportunities | Hybrid remote workSenior-level Full TimeNorth Sydney, New South Wales, Australia13d ago
-
Amazon Redshift | DBT | Data Modelling | Data Warehousing | DatabricksBuddy scheme | Career development | Certification support | Coaching & mentoring | Global career opportunitiesSenior-level Full TimeNorth Sydney, New South Wales, Australia13d ago
-
Analytics Lead AUD 110K-120KAnalytics Strategy | Customer Segmentation | Data Visualization | Data analytics | DatabricksDiscounted air travel | Discounted lounge membership | Employee assistance program | Flexible working hours | Health and wellness discountsSenior-level Full TimeNational, Australia Wide13d ago
-
Data Engineering & Platforms Team Leader AUD 145K-145KAlation | Change Data Capture | Cloud analytics | DBT | Data CaptureAdditional leave purchase | Discounted gym membership | Discounted health insurance | Employee recognition programme | First Nations cultural leaveSenior-level Full TimePerth Office - CBD, WA, AU14d ago
-
Lead, Analytics & Insights AUD 142K-146KAzure Databricks | Customer Data | Customer Data Platform | Data Analysis | Data ModelingFlexible working arrangements | Health and wellbeing programs | Learning and development opportunities | Onsite collaboration 60 percent timeSenior-level Full TimeMelbourne, Victoria, Australia14d ago
-
Manager, Reporting & Analytics AUD 135K-189KAzure Data | Azure Data Factory | BigQuery | DBT | Data FactoryMid-level Full TimeSydney, Australia15d ago
-
Lead Data Scientist AUD 100K-126KAzure | Databricks | Language Models | Large Language Models | Lifecycle ManagementDiversity and inclusion | Inclusive work environmentMid-level Full TimeSydney, New South Wales, Australia18d ago
-
Lead Gen AI Engineer (GCP) AUD 130K-146KAPI | CI/CD | Cloud platform | Continuous Testing | GCPFlexible working | Hybrid working | Income protection insurance | Parental leave | Study leaveSenior-level Full TimeMelbourne, Australia19d ago
-
Senior-level Full TimeAUS-Sydney-Blue-Street, Australia19d ago