Data Engineer – AWS Glue | Python | PySpark
Sydney, NSW, AU
A AUD 90K-130K (estimate) Mid-level Full Time Found 12d ago
Tasks
- Automate testing, security, deployment
- Design and build data pipelines on AWS
- Implement testing within Git workflows
- Maintain data processing systems
- Mentor engineering team
- Monitor system health using logging and metrics
- Optimize performance and costs
- Orchestrate workflows with Airflow
- Promote engineering standards
Perks/Benefits
Skills/Tech-stack
API Integration | AWS EMR | AWS Glue | AWS S3 | Airflow | Automation frameworks | CI/CD | CloudWatch | Dashboarding | Data pipeline | Data pipeline design | GitHub Actions | Jenkins | Linux scripting | Microservices | Observability tools | Octopus | Pipeline Design | PySpark | Python | SQL | Splunk | TeamCity | Testing Frameworks
Education
N/A
Roles
Regions
Countries
States
Cities
Language: en |
Views: 0 |
Clicks: 0
Related jobs
-
Senior Data Engineer AUD 140K-185KAirflow | ClickHouse | Cloud deployment | Communication | Data GovernanceCareer growth | Gym | Healthcare | Hybrid work | Smart casual cultureSenior-level Full TimeSydney, New South Wales, Australia1d ago
-
Analytics Engineer AUD 110K-165KAWS Data | AWS Data Services | Athena | DBT | Data Documentation11 public holidays | 4 weeks annual leave | Bereavement leave | Data-driven compensation | Office stipendMid-level Full TimeAustralia1d ago
-
Data Engineer (SAP BODS & Databricks) AUD 120K-180KAWS | Apache Spark | Cloud Platforms | Data Architecture | Data ModelingHybrid work | Recognition program | Wellbeing initiativesMid-level Full TimeSydney, NSW, Australia2d ago
-
Data Engineer AUD 70K-80KAWS Glue | Airflow | Apache Iceberg | Athena | Data ModelingDiversity and inclusion focus | Flexible working | Hybrid optionsSenior-level Full TimeSydney Office, Australia3d ago
-
Agent protocols | Cloud Native | Cloud-native Environments | Distributed Systems | Evaluation FrameworksCSR programs | Career progression | Development programs | Diversity programs | Engineering daysSenior-level Full TimeAustralia, Queensland3d ago
-
Data Engineer AUD 110K-140KAzure Databricks | Azure Monitor | Azure Security | Azure Security Centre | Data LakeBonuses | Hybrid work | Incentives | Paid parental leave | Professional developmentMid-level Full TimeCremorne, Victoria, Australia; Sydney, New South …4d ago
-
Apache Iceberg | CI/CD | DBT | Data Infrastructure | Data ModelingModern technology stack | Ownership of projects | Small team environmentSenior-level Full TimeAustralia R4d ago
-
API Development | AWS | AWS CDK | CD pipelines | CI/CD401k | Coverage for accident illness hospitalization | Education reimbursement | Employee assistance program | Legal assistanceSenior-level Full TimeAustralia R4d ago
-
Mid-level Full TimeSydney, Australia4d ago
-
Data Engineer AUD 110K-140KAdvanced Analytics | Analytical Thinking | CI/CD | Cloud Data | Cloud Data WarehousesCollaborative environment | Flexible working | Professional development supportMid-level Full TimeSydney, Australia4d ago
-
AI Engineer AUD 110K-130KAccepting Feedback | Active Listening | Analytical Thinking | C++ | CommunicationMid-level Full TimeAdelaide, Australia4d ago
-
AI Engineer AUD 110K-130KAI Implementation | Accepting Feedback | Active Listening | Analytical Thinking | C++Mid-level Full TimeAdelaide, Australia4d ago
-
Data Engineer / Report Developer AUD 125K-138KAI Assisted Development | Analytics engineering | Azure Synapse | DAX | Data GovernanceSenior-level Full TimeVIC, Melbourne VIC Australia4d ago
-
AI Software Engineers (Multiple Levels) AUD 116K-132KAI integration | API Development | Batch Processing | C# | CICDSenior-level Full TimeSydney, NSW - CBP South, 11 …5d ago
-
AI | Computational Algorithms | Generative AI | Machine Learning | Model ValidationCompetitive hourly rate up to $55 | Experience in advanced AI projects | Flexible schedule | Impact on future AI models | Portfolio developmentMid-level FreelanceAustralia - Remote R5d ago
-
Mid-level Full TimeAU-NSW-Sydney5d ago
-
Data Engineer AUD 125K-158KAccepting Feedback | Active Listening | Analytical Thinking | Artificial Intelligence | Big DataSenior-level Full TimeMelbourne, Australia6d ago
-
Data Engineer AUD 120K-130KADLS Gen2 | AKS | Automated testing | Azure Data | Azure Data FactoryBirthday leave | Diversity flex leave | Employee benefits | Employee rate | Health leaveSenior-level Full TimeLevel 12, 440 Collins Street (Melbourne …6d ago
-
Mid-level Full TimeMelbourne, Australia6d ago
-
Senior Consultant, Sydney AUD 100K-133KCloud Platforms | Data Modelling | Data Security | Data Visualization | Data WarehousingSenior-level Full TimeSydney, New South Wales, Australia6d ago
-
Software Development Engineer - Data Acquisition AUD 140K-185KData Governance | Data integration | Distributed Systems | Event Driven | Event-driven architectureSenior-level Full TimeAustralia - Melbourne Office6d ago
-
Mid-level Full TimeBrisbane, Queensland 4000, Australia8d ago
-
Senior Data Engineer AUD 155K-175KData Engineering | Data Governance | Data Modeling | Data engineering languages | DatabricksDabble Day Dividend | Flexible working hours | Paid annual leave | Paid parental leave | Performance bonusSenior-level Full TimeRichmond, Australia9d ago
-
Senior-level Full TimeMilton, Australia9d ago
-
Staff Engineer - Data Engineering AUD 123K-138KAWS DynamoDB | AWS EMR | AWS Glue | AWS Redshift | AWS S3Career growth opportunities | Collaborative work culture | Competitive compensationSenior-level Full TimeSydney - Client Location, Australia9d ago