Data Engineering Lead (AWS)
Tasks
- Build CI/CD pipelines
- Build ETL and ELT pipelines
- Coach and develop team members
- Deploy and monitor data platform automation
- Design and deliver AWS data platforms
- Develop data models and data warehousing solutions
- Implement data governance initiatives
- Implement streaming data pipelines
- Lead multidisciplinary teams and technical delivery
- Use infrastructure as code for data platforms
Perks/Benefits
- Coaching support
- Flexible work options
- Paid parental leave
- Paid volunteering days
- Retail discounts
- Return to work support
- Wellbeing leave
Skills/Tech-stack
AWS Glue | AWS Lambda | Amazon Athena | Amazon Managed Streaming for Apache Kafka | Amazon RDS | Amazon Redshift | Amazon SageMaker | Amazon Web Services | Apache Airflow | Apache Flink | Apache Kafka | Continuous Delivery | Continuous Integration/Continuous Delivery | Continuous integration | DBT | Data Lakes | Data Modeling | Data Quality | Data Security | Data Warehousing | Infrastructure as Code | Managed Streaming for Apache Kafka | Metadata Driven | Metadata-driven ETL | Python | Real Time | Real-time analytics | SQL | Spark | Storm | Stream processing | Web Services | “as-code”
Education
N/A
Roles
Data Engineer | Data Engineering | Data Engineering Lead | Engineer | Engineering Lead | Lead
Regions
Countries
States
Cities
Related jobs
-
Senior Analytics Engineer - Security Insights AUD 118K-130KAlerting | Batch Processing | Cost Optimization | DBT | Data GovernanceEquity packages | Flexible leave | Parental leave | Wellbeing allowanceSenior-level Full TimeSydney, Australia R11h ago
-
Entry-level Full TimeMelbourne, Australia11h ago
-
Analytics Engineer - Personalisation AUD 110K-140KDBT | Data Modeling | Data Pipelines | Data Warehousing | ELTEquity packages | Flexible leave options | Flexible remote work | Inclusive parental leave | Wellbeing allowanceMid-level Full TimeSydney, Australia R12h ago
-
ML / AI Software Engineer, Electronic Warfare AUD 130K-142KC++ | CUDA | Data Preparation | Data Preprocessing | Data labelingSenior-level Full TimeHaymarket, NSW, Australia1d ago
-
Senior-level Full TimeMelbourne Support Centre1d ago
-
Senior-level Full TimeNorth Sydney, Australia1d ago
-
Senior Data Engineer AUD 100K-120KAWS | AWS Serverless | AWS Serverless Data Lake Framework | CI/CD | DBTFlexible schedule | Hybrid working | Opportunity to make business impact | Supportive team environmentSenior-level Full TimeAU Padstow, Australia1d ago
-
Lead Data Engineer/Solution Designer AUD 140K-160KAmazon Web Services | Apache Airflow | CI/CD | DBT | Data ModelingCertifications provided | Company events | Hybrid working | Learning and career growthSenior-level Full TimeSydney, New South Wales, Australia1d ago
-
Delivery Lead, Financial Crime Analytics, Suncorp Bank AUD 129K-140KData Visualization | Discrete Event Detection | Discrete event | Event Detection | Fraud DetectionFlexible work arrangements | Remote work support | Work-life balanceSenior-level Full TimeBrisbane, AU1d ago
-
Quantitative DevOps Engineer AUD 100K-113KArgo CD | Argo Workflows | Bash | CI/CD | Cloud platformFlexible working | Hybrid workingMid-level Full TimeSydney Office, Australia1d ago
-
Senior MLOPs Platform Engineer AUD 80K-100KAWS | Amazon EKS | ArgoCD | Arize AI | Batch inferenceAnnual flu vaccinations | Cycling showers | Hybrid flexibility | In-office lunch | Nearmap subscriptionSenior-level Full TimeBarangaroo, NSW, Australia1d ago
-
Lead Data Engineer - 12 month FTC AUD 125K-138KAWS | Amazon Redshift | Apache Airflow | Azure | Change Data CaptureAccess to learning platform | Additional leave | Corporate partner discounts | Free NBN plan | Free mobile planSenior-level Contract Full Time TemporaryBarangaroo, NSW, AU2d ago
-
Benchmarking | Dataset curation | Deep learning | Distributed Training | Efficient Fine TuningFlexible working arrangements | Fully remote work | Professional growth opportunities | Publication supportSenior-level Full TimeAustralia R2d ago
-
Senior Manager, Data Science – CJKI AUD 140K-186KAnalytics | Data Modeling | Data Product Management | Data product | ExperimentationSenior-level Full TimeSydney, Australia2d ago
-
Data Platform Solution Presales Engineer AUD 100K-120KAmazon Redshift | Azure Databricks | Azure Purview | Azure Synapse | Azure Synapse AnalyticsContinuous learning | Flexible work opportunities | Learning opportunitiesMid-level Full TimeSydney, NSW, AU; VIC,AU2d ago
-
Senior AI Engineer AUD 148K-180KAWS | Autogen | Azure | CI/CD | Clean CodeLearning and development programs | Mentorship culture | Remote workSenior-level Full TimeMelbourne, Australia R2d ago
-
Senior Data Engineer | Snowflake & DBT AUD 115K-125KAWS Lambda | AWS S3 | Apache Airflow | CI/CD | DBTContract extension potential | Hybrid work modelSenior-level ContractSydney, New South Wales, Australia R2d ago
-
Fraud Analytics & Decisioning Lead AUD 124K-140KAnalytics governance | Data Engineering | Data analytics | Data engineering pipelines | Engineering PipelinesCareer development support | Flexibility in daily life | Team collaborationSenior-level Full TimeSydney, New South Wales, Australia2d ago
-
AI and Data Engineer AUD 118K-127KAPI Development | AWS Bedrock | Azure OpenAI | Azure OpenAI API | Build toolSenior-level Full TimeMelbourne - on the lands of …2d ago
-
Senior AI Engineers - Contract AUD 125K-143KA/B | A/B Testing | AWS | B testing | BedrockContract position | Flexible working | Work from homeSenior-level Full TimeSydney, Australia2d ago
-
Software Engineer (Machine Learning & Multimodal AI) AUD 113K-123KDeep learning | Git | GitHub | GitLab | Machine LearningFlexible work options | Workplace adjustments for disabilityMid-level Full TimeSydney, NSW2d ago
-
Data Engineer AUD 115K-125KAPI Gateway | AWS | AWS Glue | AWS Lambda | Airflow9-day fortnight | Additional Well Being Days | Flexible work hours | Long Service Leave Pro Rata | Paid leave optionsMid-level Full TimeLeederville, WA, AU3d ago
-
Bash | Cloud platform | Data Pipelines | Distributed Systems | DockerAutonomy | Bonus opportunities | Collaborative culture | Distributed first work environment | Equity opportunitiesSenior-level Full TimeAustralia R3d ago
-
Senior Data Engineer – Snowflake / dbt / Airflow AUD 150K-185KAirflow | CI/CD | Cost Optimization | DBT | Data GovernanceSenior-level Full TimeSydney, New South Wales 2000, Australia3d ago
-
LLM Ops Engineer AUD 130K-150KA B Deployment | A/B | AWS | Alerting | AutoscalingEquity compensation | Flexible hybrid working | Personal development budgetSenior-level Full TimeMelbourne3d ago