Senior Data Engineer
Tasks
- Apply AI assisted software engineering practices
- Apply AI driven design techniques for architecture
- Automate batch and streaming pipelines
- Build maintain optimize data pipelines on AWS
- Collaborate with engineering analytics and security stakeholders
- Define and operate CI CD for data pipelines
- Design build end to end data pipelines
- Develop big data processing solutions
- Embed observability and reliability practices
- Engineer operate improve data platforms
- Establish enforce data governance controls
- Implement compliance and data protection controls
- Implement infrastructure-as-code
- Implement secure data integration patterns
- Monitor and remediate data quality issues
- Optimize batch and streaming workloads
- Perform root cause analysis and remediation
- Support incident and problem management
- Translate business requirements into technical designs
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | AWS Glue | Alerting | Amazon Athena | Amazon EMR | Amazon Redshift | Amazon S3 | Apache Spark | CI/CD | Cause analysis | Data Catalog | Data Governance | Data Lineage | Data Quality | Encryption | Git | IAM | Incident Management | Infrastructure as Code | Metadata Management | Metrics | Monitoring | PySpark | Python | Root Cause Analysis | Root cause | SQL | Scala | Secrets management | Structured Logging | Terraform | “as-code”
Education
N/A
Roles
Related jobs
-
Data Engineer AUD 80K-130KAutomated testing | Data Governance | Data Modeling | Data Transformation | Data pipelineHybrid working model | Inclusive collaborative purpose driven culture | Learning and development opportunitiesMid-level Full TimeMelbourne Office (33X)7h ago
-
A/B | A/B Testing | Architecture | Artificial Intelligence | B testingFlexible leave options | Parental leave | Remote work within Australia | Wellbeing allowanceSenior-level Full TimeSydney, Australia R20h ago
-
Enterprise Sales Engineer AUD 170K-215K.NET | CRM | Csharp | Go | JavaBest in class onboarding | Career pathing | Continuous professional development | Inclusive culture | Mentor and buddy programSenior-level Full TimeCanberra, Australia R1d ago
-
Principal Data Engineer AUD 100K-138KAWS | Amazon Web Services | Apache Airflow | DBT | Data GovernanceConference attendance | Flexible schedule | Four day week option | Training opportunities | Work-life balanceSenior-level Full TimeMelbourne1d ago
-
Data Engineer-Medicare Mental Health Check In AUD 112K-132KAzure | Azure Data | Azure Data Factory | Best practices | CI/CDSalary packaging benefitsSenior-level Full TimeVIC Group Office - Melbourne, Australia1d ago
-
Freelance Machine Learning Engineer AUD 110KDeep learning | Langchain | MLOps | Machine Learning | NumPyPart-time availability | Project based workMid-level FreelanceAustralia - Remote R1d ago
-
LLM | Langchain | MLOps | Machine Learning | NumPyEnglish CV requirement | Part-time projects | Project based workMid-level FreelanceAustralia - Remote R1d ago
-
Data Pipelines | Data Preprocessing | Data Quality | Feature Engineering | Machine LearningEquity package | Flexible leave | Parental leave | Remote work within Australia | Wellbeing allowanceMid-level Full TimeSydney, Australia R1d ago
-
LLM | Langchain | MLOps | Matplotlib | Model DeploymentFlexible schedule | Freelance project based engagement | Part-time remote workMid-level FreelanceAustralia - Remote R3d ago
-
Robotics Engineer AUD 127K-143KAnomaly Detection | C++ | Cameras | Computer Vision | Data AnalysisCommuter benefits | Family planning and parenting support | Healthcare benefits | Income protection | Life and disability insuranceSenior-level Full TimeSydney, New South Wales, Australia3d ago
-
Senior Robotics Engineer AUD 127K-143KAnomaly Detection | C++ | Cameras | Computer Vision | GazeboCommuter benefits | Family planning and parenting support | Generous time off | Healthcare benefits | Income protectionSenior-level Full TimeSydney, New South Wales, Australia3d ago
-
Staff Robotics Engineer AUD 120K-140KC++ | Cameras | Computer Vision | Computer Vision Algorithms | Data AnalysisCommuter benefits | Family planning and parenting support | Generous PTO | Life and disability insurance | Medical, dental, vision plansSenior-level Full TimeSydney, New South Wales, Australia3d ago
-
C++ | Compliant Control | Contact mechanics | Dexterous Manipulation | Force-torque sensorsMid-level Full TimeAustralia4d ago
-
Docker | Kubernetes | Langsmith | MLflow | MicroservicesMid-level Full TimeAustralia4d ago
-
3D Parallelism | C++ | CUDA | DeepSpeed | InfinibandEntry-level Full TimeAustralia4d ago
-
4 bit Quantization | 4-bit | 8 bit Quantization | C++ | Edge DeploymentMid-level Full TimeAustralia4d ago
-
Lead Data Engineer AUD 170K-200K.NET | Access Management | Azure Container | Azure Container Apps | BashAnnual leave | Flexible working | Karbon Days off | Paid parental leaveSenior-level Full TimeSydney, NSW, Australia4d ago
-
Senior Machine Learning Operations Engineer (MLOps) AUD 145K-165KAWS | Alerting | Apache Spark | Azure | CI/CDBarista services | Breakfast | Employee assistance program | F1 simulators | Happy hourSenior-level Full TimeMelbourne, Australia4d ago
-
Data Engineer AUD 100K-120KAWS Glue | Airflow | Amazon EMR | Apache Spark | BuildkiteConference opportunities | Course access | Flexible working | Paid leave | Unpaid leaveMid-level Full TimeCremorne, Victoria, Australia R4d ago
-
Data Engineer AUD 90K-106KAWS Glue | AWS Lambda | Access Control | Amazon S3 | Automated testingAnnual leave | Early finish Fridays | Employee social events | Flexible hybrid working | Headspace subscriptionMid-level Full TimeRichmond, Australia4d ago
-
Staff Applied ML Engineer AUD 170K-200KA/B | A/B Testing | API Integration | AWS | B testingBirthday leave | Continuous learning | Flexible hours | Hackathons | Home office setup allowanceSenior-level Full TimeAUS NSW Remote, Australia R4d ago
-
Senior Data Engineer AUD 151K-175KAWS CloudFormation | AWS Step Functions | Amazon Kinesis | Amazon Redshift | Apache AirflowEquity | In-person collaborationSenior-level Full TimeSydney, New South Wales, Australia - … R4d ago
-
Staff Data Engineer (AWS, Big Data) AUD 130K-145KAWS CloudFormation | AWS EMR | AWS Glue | AWS Kinesis | AWS LambdaFlexible start and finish times | Flexible work arrangements | Flexible work location | Job share | Part-time optionsSenior-level Full TimeSydney, NSW - CBP North, 1 …4d ago
-
Bash | Coverage.py | Dagger | Docker | GcovFlexible schedule | Freelance project-based collaboration | Fully remote | Opportunity to contribute to AI projects | Supportive global communitySenior-level Full TimeAustralia - Remote R4d ago
-
Associate Managing Consultant, Strategy and Transformation - Generative AI Engineer / Generative AI Data Scientist AUD 120K-135KAPI Development | AWS | Azure | CI/CD | Cloud ComputingMid-level Full TimeSt Leonards, Australia4d ago