Specialist Data Engineer
Tasks
- Build data pipelines
- Design data pipelines
- Develop data transformation workflows
- Enable AI ready data pipelines
- Enable analytics ready datasets
- Ensure data reliability and scalability
- Ensure data security and compliance
- Implement data ingestion solutions
- Implement monitoring and alerting
- Integrate data from APIs and event streams
- Manage incident response for data platforms
- Operate data pipelines
- Orchestrate data pipelines
Perks/Benefits
Skills/Tech-stack
API Integration | Agile | Airflow | Apache Hadoop | Apache Kafka | Apache Spark | CI/CD | Data Modeling | Data Warehousing | Data integration | Data pipeline | DevOps | ELT | ETL | Git | Impala | Infrastructure as Code | Luigi | Python | SQL | Scrum | Terraform | Workflow Orchestration | “as-code”
Education
Bachelor of Engineering | Bachelor of Science | Bachelor of Science in Computer Science | Bachelor of Science in Information Management Systems
Roles
Data Engineer | Engineer | Specialist | Specialist Data Engineer
Related jobs
-
Analytics Engineer AUD 80K-108KCI/CD | DBT | Data Lineage | Data Modeling | Data QualityAnniversary leave | Cyclist end of trip facilities | Employee share option plan | Hybrid working | Pantry snacks and drinksMid-level Full TimeSydney, NSW11h ago
-
AWS | AWS Glue | AWS Lambda | Amazon Redshift | Amazon S3Additional paid leave | Corporate partner discounts | Hybrid work | Learning platform access | Mobile PlanSenior-level Full TimeBarangaroo, NSW, AU19h ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerMid-level Full TimeSydney, Australia21h ago
-
Data Processing | Data use | Diffusion Models | Embedding systems | Ethical AIEquity packages | Flexible leave policies | Inclusive parental leave | Professional growth learning and technical leadership | Remote friendly flexible working arrangementsSenior-level Full TimeAustralia1d ago
-
Senior Machine Learning / ML Engineer AUD 170K-190KAirflow | Amazon EMR | Apache Spark | Dask | Data orchestrationEngineering standards | Hybrid work model | MentoringSenior-level Full TimeAU: Melbourne: (260 Burwood Rd)1d ago
-
Senior AI/Analytics Engineer - CTT AUD 130K-150KApache Airflow | Apache Kafka | Autogen | Container Services | DockerEmployee discounts | Employee-only mortgage rates | Flexible work arrangements | Learning and development | Leave optionsSenior-level Full TimeSydney, NSW, Australia1d ago
-
Sr. Forward Deployed Engineer AUD 145K-185KAnthropic | Apache Spark | Artificial Intelligence | Backend Development | Cloud ComputingSenior-level Full TimeMelbourne, Australia; Sydney, Australia1d ago
-
Analytics Funding Specialist AUD 118K-127KAnalytics Programming | Data Modeling | Data analytics | Evaluation Frameworks | Healthcare AnalyticsMid-level Full TimeDOCKLANDS, VIC, AU, 30081d ago
-
C# | MATLAB | NumPy | Pandas | PythonPart-time project-based workSenior-level Full TimeAustralia - Remote R1d ago
-
Staff Data Engineer AUD 125K-138KAWS | Apache Spark | Cloud Computing | Cloud platform | Data ModelingEmissions reduction focus net zero by FY2050 | Flexible working | Paid leave | Parental leave | Personal Flexi DaysSenior-level Full TimeCremorne, Victoria, Australia2d ago
-
Data labeling | Data pipeline | Debugging | Inference | Inference OptimizationEquity compensation | Flexible leave options | Inclusive parental leave | Remote work within Australia | Wellbeing allowanceSenior-level Full TimeSydney, Australia R2d ago
-
AI Engineer (Senior) AUD 145K-156KAWS | Agentic AI | Agile | Amazon SageMaker | Artificial IntelligenceSenior-level Full TimeMelbourne, VIC, Australia2d ago
-
Data Engineer AUD 90K-110KAWS Cloud | AWS Cloud Development Kit | AWS Glue | AWS cloud development | Amazon AuroraAdditional leave | Board games | Hybrid work | In-house workshops | Learning and development budgetEntry-level Full TimeSydney, New South Wales, Australia2d ago
-
Data Platform Engineer AUD 100K-120KAWS | Alerting | CI/CD | DBT | DataOps5 weeks annual leave | Family care parental leave | Global mobility opportunities | Hybrid working | Personal Carer LeaveMid-level Full TimeNorth Sydney, AU2d ago
-
NumPy | Pandas | Python | SciPy | SymPyFlexible part-time schedule | Freelance work | Project based workSenior-level FreelanceAustralia - Remote R2d ago
-
Senior-level Full TimeMelbourne, Australia3d ago
-
Entry-level Full TimeMelbourne, Australia3d ago
-
AI Engineer - DDAI AUD 126K-150KA/B | A/B Testing | Apache Spark | Autogen | B testingAdditional leave | Community volunteering opportunities | Employee benefits | Flexible work | Learning and developmentMid-level Full TimeSydney, NSW, Australia3d ago
-
Mid-level Full TimeSydney, NSW3d ago
-
Azure Functions | CI/CD | Code review | Databricks | Delta LakeFlexible working options | Paid volunteering days | Parental leave | Retail discounts | Return to work supportSenior-level Full TimeMelbourne, VIC, AU3d ago
-
Combinatorics | Graph theory | Mathematical Modeling | NumPy | Number theoryFlexible schedule | Freelance project-based work | Part-time opportunitiesSenior-level FreelanceAustralia - Remote R3d ago
-
Lead Data Engineer AUD 118K-127KAccess Control | Ansible | Batch Processing | CI/CD | ChefCareer development | Collaborative environment | Flexible work culture | Supportive team cultureSenior-level Full TimeCanberra, Australian Capital Territory 2600, Australia3d ago
-
BI Reporting Specialist - Power BI AUD 76K-81KDashboarding | Data Governance | Data Modeling | Data Quality | Data SecurityEducation assistance | Employee assistance program | Flexible working | Health and wellness benefits | Learning resourcesMid-level Full TimeEast Melbourne, VIC, AU, 30024d ago
-
Data Engineer AUD 80K-150KDBT | Data Ingestion | Data Transformation | ELT | ETLAdditional leave | Corporate partner discounts | Free NBN plan | Free mobile plan | Hybrid workMid-level Full TimeBarangaroo, NSW, AU5d ago
-
AI Engineer - Conversational AUD 200K-250KAI voice | APIs | AWS | Agile | Amazon Connect5 days per week office based | Employee discounts | On-site parkingExecutive-level Full TimeSydney Olympic Park, New South Wales …6d ago