Data Engineer
Tasks
- Build test ETL and ELT pipelines
- Design end to end data engineering solutions
- Develop data pipelines for analytics and reporting
- Enhance in house PySpark frameworks
- Ensure solution delivery with automated testing and documentation
- Implement data pipelines using Azure services and Python
- Monitor data and insights platform batch operations
- Perform exploratory data analysis
Perks/Benefits
- Career development opportunities
- Discounted insurance
- Employee assistance program
- Flexibility
- Hybrid working
- Paid parental leave
- Paid volunteering days
Skills/Tech-stack
Azure | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOps | Azure Pipelines | Azure SQL | Azure Storage | Data Analysis | Data Factory | ELT | ETL | Exploratory Data Analysis | Git | Power BI | Powershell | PySpark | Python | SQL
Education
N/A
Roles
Related jobs
-
Forward Deployed Engineer, Gen AI, Google Cloud AUD 110K-130KAPI Integration | Agent systems | Cloud deployment | Cloud platform | CrewAIMid-level Full TimeSydney NSW, Australia; Docklands VIC, Australia12h ago
-
Senior Data Engineer AUD 60K-78KAWS | AWS IAM | AWS Lambda | AWS MWAA | Amazon S3Employee network groups | Hybrid working | Staff travel discount | Travel benefitSenior-level Full TimeMelbourne, Victoria, Australia22h ago
-
Data Scientist | LLM Engineer | Senior Associate/Manager AUD 118K-140KAgile | Azure | Azure Functions | Azure Machine Learning | Azure OpenAIFlexible work | Parental leave | Work-life balanceSenior-level Full TimeSydney, Australia23h ago
-
Forward Deployed AI Engineer AUD 95K-110KAPI Integration | Artificial Intelligence | Communication | Customer support | Data AnalysisCompany travel | Flexible working hours | Paid work trialMid-level Full TimeSydney, Australia HQ1d ago
-
Senior Solution Engineer AUD 151K-216KAnalytics | Cloud Computing | Data Lake | Data Warehouse | Data fabricSenior-level Full TimeAU-Perth-WW1d ago
-
Lead Data Engineering Consultant AUD 125K-145KAWS | Airflow | Azure | Consulting | DBTConference attendance | Flexible work schedule | Four day week option | Professional development | TrainingSenior-level Full TimeMelbourne1d ago
-
Staff Software Engineer - (Data Platform Workflow) AUD 129K-145KAPI Design | AWS | Agent Skills Framework | Agent skills | CI/CDEquity packages | Flexible leave options | Flexible remote work | Inclusive parental leave | Wellbeing allowanceSenior-level Full TimeMelbourne, VIC, Australia R1d ago
-
Staff Software Engineer - (Data Platform Workflow) AUD 129K-145KAPI Design | AWS | Agent Skills Framework | Agent skills | BI toolsAnnual wellbeing allowance | Equity package | Flexible leave options | Flexible work arrangements | Parental leaveSenior-level Full TimeSydney, Australia R1d ago
-
Senior DevOps AI Engineer AUD 157K-200KAWS | Agent systems | Ansible | ArgoCD | AsyncioHybrid work | On-call rotationsSenior-level Full TimeSydney, Australia1d ago
-
Senior Quants/Analytics Specialist - CTT AUD 129K-142KApplied Mathematics | Azure | C# | C++ | CI/CDDiscounts on banking products | Flexible work arrangements | Learning and development opportunities | Volunteering opportunitiesSenior-level Full TimeSydney, NSW, Australia1d ago
-
Data Engineer AUD 105K-125KAWS | Anomaly Detection | Azure | CI/CD | Data GovernanceAdditional leave days | Employee assistance programs | Employee discounts | Micro-credentials | Parental leaveMid-level Full TimeMacquarie Park, Australia1d ago
-
Senior Data Scientist AUD 150K-175KAutoARIMA | AutoETS | Automl | CI/CD | Causal reasoningAI-first culture | Async workflows | Flexible experimentation pace | Humans in final review | Ownership cultureSenior-level Full TimeSydney, New South Wales, Australia1d ago
-
Azure | Azure Functions | Azure ML | Azure OpenAI | CI/CDFlexible work arrangements | Generous leave entitlements | Parental leave | Public holiday flexibility | Work visa sponsorshipSenior-level Full TimeSydney, Australia1d ago
-
Senior Software Engineer – Data Platform AUD 130K-155KAmazon S3 | Apache Flink | Apache Spark | Batch Processing | CQRSSenior-level Full TimeBrisbane, Queensland, Australia1d ago
-
Applied AI Engineer AUD 90K-100KASR | Agent Orchestration | Agent/tool use | Azure Cognitive | Azure Cognitive ServicesCommunity involvement support | Hybrid work | Remote work | Work-life balanceMid-level Full TimeRemote (AUS), Australia R1d ago
-
Bash | Code Coverage | Coverage.py | Dagger | DockerFlexible schedule | Fully remote | Project-based collaboration | Supportive global communitySenior-level Full TimeAustralia - Remote R1d ago
-
Senior Data Engineer AUD 125KAzure Data | Azure Data Factory | Azure Databricks | CI/CD | Data FactoryHybrid workSenior-level Full Time TemporaryGeelong2d ago
-
Senior Data Engineer - Permanent, full-time position AUD 122K-125KAvailability Monitoring | Azure Data | Azure Data Factory | Azure Databricks | CI/CDSenior-level Full TimeGeelong2d ago
-
Data Engineer (Python) - 2 weeks contract AUD 75K-150KAzure Functions | CSV | Data Validation | Delta detection | ExcelFlexible working options | Leadership programs | Learning and development initiatives | MentorshipMid-level Full TimeMelbourne, Victoria, Australia2d ago
-
Bash | Cloud platform | Data Processing | Docker | GCPAsynchronous work culture | Flexible management approach | Remote/distributed teamMid-level Full TimeBrisbane, Australia2d ago
-
C# | MATLAB | NumPy | Pandas | PythonNon permanent employment | Part-time project workSenior-level Full TimeAustralia - Remote R2d ago
-
Senior Perception Software Engineer AUD 170K-224K3D LiDAR | C++ | CUDA | Ceres-Solver | Computer Vision401k contribution | Dental insurance | Federal Holidays | Health insurance | State HolidaysSenior-level Full TimeCharlestown, MA4d ago
-
Embedded Software Engineer - Intern AUD 70K-85KARM | AVR | Bare Metal | Basic electronics | C#Mentorship | Real-world project experience | Remote work opportunitiesEntry-level InternshipMelbourne, VIC, Australia4d ago
-
Amazon Web Services | Apache Airflow | Apache Superset | BI Dashboards | Cloud DataAnnual vacation | English learning discounts | Fully remote work environment | Health reimbursement | High autonomySenior-level Full TimeAustralia R4d ago
-
Senior Data Platforms Engineer AUD 120K-130KAWS | Agile | CI/CD | Data Pipelines | Data ProcessingDiscounted flights | Discounts on retail technology beauty and wellness services | Discounts on travel insurance lounge membership car hire accommodation and experiences | Dress for your day policy | Flexible work from home or officeSenior-level Full TimeBrisbane4d ago