Data Engineering Lead (AWS)
Tasks
- Build CI/CD pipelines
- Build ETL and ELT pipelines
- Coach and develop team members
- Deploy and monitor data platform automation
- Design and deliver AWS data platforms
- Develop data models and data warehousing solutions
- Implement data governance initiatives
- Implement streaming data pipelines
- Lead multidisciplinary teams and technical delivery
- Use infrastructure as code for data platforms
Perks/Benefits
- Coaching support
- Flexible work options
- Paid parental leave
- Paid volunteering days
- Retail discounts
- Return to work support
- Wellbeing leave
Skills/Tech-stack
AWS Glue | AWS Lambda | Amazon Athena | Amazon Managed Streaming for Apache Kafka | Amazon RDS | Amazon Redshift | Amazon SageMaker | Amazon Web Services | Apache Airflow | Apache Flink | Apache Kafka | Continuous Delivery | Continuous Integration/Continuous Delivery | Continuous integration | DBT | Data Lakes | Data Modeling | Data Quality | Data Security | Data Warehousing | Infrastructure as Code | Managed Streaming for Apache Kafka | Metadata Driven | Metadata-driven ETL | Python | Real Time | Real-time analytics | SQL | Spark | Storm | Stream processing | Web Services | “as-code”
Education
N/A
Roles
Data Engineer | Data Engineering | Data Engineering Lead | Engineer | Engineering Lead | Lead
Regions
Countries
States
Cities
Related jobs
-
Data Enablement Lead NZD 135K-152KDBT | Data Engineering | Data Governance | Data pipeline | GitHubFlexible location | Hybrid working model | In-office collaboration daysSenior-level Full TimeAU: Melbourne: (260 Burwood Rd)8h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Distributed remote work | Friendly work environmentMid-level Full TimeSydney, Australia8h ago
-
Lead AI Engineer AUD 167K-200KAgentic Frameworks | CI/CD | Cloud Platforms | Containers | Fine TuningSenior-level Full TimeSydney, Australia R10h ago
-
Staff Data Engineer AUD 120K-130KAWS | BigQuery | DBT | Data Contracts | Data GovernanceCareer growth opportunities | Healthcare impact | Supportive work environment | Work from anywhereSenior-level Full TimeAustralia R11h ago
-
Data Governance Lead AUD 15K-15KChange Management | Data Compliance | Data Governance | Data Integrity | Data ManagementAdditional paid leave | Educational scholarship program | Reduced cost of health services | Relocation assistanceSenior-level Full TimeRichmond, VIC, Australia11h ago
-
Senior Data Engineer AUD 120K-130KA/B | A/B Testing | AWS | B testing | BigQueryProfessional growth | Supportive work environment | Work from anywhereSenior-level Full TimeAustralia R11h ago
-
Chief Engineer AUD 60K-200KAWS CloudFormation | AWS Glue | AWS IAM | AWS Lambda | AWS Step FunctionsExecutive-level Full TimeEveleigh, NSW - 1 Locomotive Street, …12h ago
-
Senior Data Engineer, Business Intelligence AUD 118K-134KAzure Data | Azure Data Factory | Azure Synapse | Azure Synapse Analytics | Data FactoryCareer pathway opportunities | Discounted private health | EAP | Fitness passport | Flexible work arrangementsSenior-level Full TimeAustralia, UniSC Sunshine Coast, Australia, UniSC …13h ago
-
Senior-level Full TimeMelbourne, Australia1d ago
-
Sr. Forward Deployed Engineer AUD 140K-175KApache Spark | Cloud Computing | Data Lakes | Databricks | Delta LakeCustomer-facing work | Travel 20 to 30 percentSenior-level Full TimeSydney, Australia1d ago
-
Finance Analytics Engineer AUD 125K-130KAccess Control | Audit Logging | CI/CD | DBT | Data ModelingFlexible working arrangements | Hackathons and workshops | In house meals and snacks | Open source and community involvement | Training and development opportunitiesSenior-level Full TimeSydney1d ago
-
Data Engineer (AI Adoption) AUD 126K-143KAI Engineering | Azure | Azure Data | Azure Data Lake | Azure EventAdditional leave options | Employee discounts | Flexible work arrangements | Learning and development opportunities | Volunteering opportunitiesMid-level Full TimeSydney, NSW, Australia1d ago
-
Senior Analytics Engineer AUD 150K-170KDBT | Data Modeling | Data Quality | Data Quality Testing | Dimensional ModellingEAP services | Flexibility | L D budget | Paid parental leave | Pet-friendly officeSenior-level Full TimeSydney1d ago
-
AWS | AWS Glue | AWS Step Functions | Agile | Amazon EMRFlexible start and finish times | Flexible working hours | Hybrid work model | Job-sharing | Part-time arrangementsSenior-level Contract Full Time TemporarySydney, NSW - CBP North, 1 … R1d ago
-
Machine Learning Engineer AUD 130K-180KAWS | CI/CD | Data Pipelines | Drift Detection | Feature EngineeringEmployee recognition | Flexible work hours | Hybrid work | Retailer discounts | Wellbeing supportSenior-level Full TimeMelbourne, Australia1d ago
-
Research Engineer - Embedded Systems Engineer AUD 117K-136KAltium | Board Design | C++ | Circuit board design | Electronics debuggingCareer development | Collaborative work environment | Flexible work arrangements | Wellbeing supportSenior-level Full TimeCraigieburn, Australia1d ago
-
Lead Agentic AI Developer AUD 130K-150KADK | Agent Development Kit | CI/CD | Cloud platform | FastAPIBirthday leave | Career break | Compassionate leave | Employee resource groups | Health and wellbeingSenior-level Full TimeNSW - SHS 2 Holt Street …1d ago
-
AWS | Automated testing | Azure | Big Data | CI/CDEmployee assistance program | Employee share plan | Flexible leave | Health and wellness discounts | Learning and developmentExecutive-level Full TimeAustralia, Queensland1d ago
-
Senior Data Engineer AUD 130K-150KAWS IAM | Alerting | Amazon Web Services | BigQuery | CDCBudgeting tools | Earned wage access | Employee assistance program | Extra days leave | Financial wellbeing platformSenior-level Full TimeSydney, NSW, AU1d ago
-
Senior Data Engineer AUD 129K-142KAPI Integration | Apache Airflow | Apache Spark | CI/CD | DBT CoreAdditional leave benefits | Career development pathways | Employee referral program | Flexible work arrangements | Parental leaveSenior-level Part TimeMelbourne, VIC, AU1d ago
-
Senior AI Engineer AUD 160K-180KAWS | Autogen | Azure | CI/CD | Clean CodeAutonomy | Learning and development programs | Mentorship | Remote workSenior-level Full TimeMelbourne, Australia R2d ago
-
Senior Data Engineer (AWS Cloud, API Integration) AUD 130K-142KAPI Gateway | AWS CloudFormation | AWS Glue | AWS Lake Formation | AWS LambdaFlexible working hours | Job location flexibility | Job share | Part-time options | Work from office at least half time monthlySenior-level Full TimeEveleigh, NSW - 1 Locomotive Street, …2d ago
-
Senior Lead, Data Analytics AUD 148K-148KAnalytics architecture | Automation | Business Intelligence | Cloud analytics | Data GovernanceSenior-level Full TimeAustralia, UniSC Sunshine Coast, Australia, UniSC …2d ago
-
Machine Learning Engineer - South Bank, QLD AUD 60K-78KAI Agents | CI/CD | Cloud Computing | Context engineering | Cost TrackingEmployee assistance program | Employee discounts | Health and wellness discounts | Learning and development | Paid parental leaveSenior-level Full TimeAustralia, Queensland2d ago
-
Staff Software Engineer - Data Platform Workflow AUD 135K-155KAI Agents | APIs | AWS | CI/CD | ConcurrencyEquity packages | Flexible leave | Hybrid work flexibility | Parental leave | Wellbeing allowanceSenior-level Full TimeMelbourne, VIC, Australia R2d ago