Senior Data Engineer – Cloud Data Platform (Network & Observability)
Tasks
- Build and maintain ETL/ELT pipelines
- Build and operate masking pipelines
- Build batch and near real time ingestion frameworks
- Collaborate with engineering network and business teams
- Define data lake zoning best practices
- Design and operate AWS data pipelines
- Develop reusable data models and curated data layers
- Ensure data governance with lineage and auditability
- Implement CI CD for data platform deployments
- Implement data masking and tokenisation for PII
- Implement infrastructure as code for data platforms
- Implement partitioning and performance optimisation
- Provide mentorship and technical leadership
- Transform raw data into analytics-ready datasets
- Translate requirements into scalable data architectures
Perks/Benefits
- Additional paid leave
- Corporate partner discounts
- Hybrid work
- Learning platform access
- Mobile Plan
- NBN plan
Skills/Tech-stack
AWS | AWS Glue | AWS Lambda | Amazon Redshift | Amazon S3 | Apache Airflow | Auditability | CI/CD | Data Governance | Data Lineage | Data masking | ELT | ETL | IAM | Infrastructure as Code | PII | Python | SQL | Tokenization | “as-code”
Education
N/A
Roles
Related jobs
-
Azure AI Developer Consultant AUD 120K-143K.NET | API Management | App Service | Automated testing | Azure APIFlexible work schedule | Presence on customer site when required | Work-from-home hybridSenior-level Full TimeMelbourne, VIC, AU6h ago
-
Mid-level Full TimeAU: Sydney (45 Clarence St)18h ago
-
Staff Machine Learning Engineer NZD 135K-165KAWS EMR | Airflow | Apache Spark | Dask | Distributed ProcessingSenior-level Full TimeAU: Sydney (45 Clarence St)18h ago
-
Backend Software Engineer – Human-Robot Interaction AUD 140K-175KC++ | Concurrency | Distributed Systems | Event Driven | Event-driven architecture401k contributions | Dental insurance | Federal Holidays | Health insurance | State HolidaysSenior-level Full TimeCharlestown, MA1d ago
-
Agentic Frameworks | CI/CD | Cloud Computing | Containers | Deep learningCareer growth support | Flexible work arrangement | Hybrid work arrangement | Inclusive engineering culture | Learning and development supportSenior-level Full TimeAustralia1d ago
-
AI Agents | API Integration | Language Models | Large Language Models | Next.jsAccess to cutting-edge technologies | Continuous learning | Fully remote | High autonomy | Location flexibilityMid-level Full TimeAustralia R1d ago
-
Embedded Linux Engineer AUD 100K-140KAI hardware | AI hardware optimization | Assembly | Automated Deployment | Bare MetalFlexible work options | Give back day | Global wellness paid day off | Health and wellbeing timeMid-level Full TimeSydney1d ago
-
Senior Robotics Simulation Engineer USD 190K-200KAPIs | C++ | CI/CD | Communication Interfaces | Embedded Systems401k | Accident insurance | Commuter benefits | Company-Paid Holidays | Critical illness insuranceSenior-level Full TimeBrisbane, CA2d ago
-
Senior AI Engineer, AI Accelerator AUD 160K-180KAI Operationalisation | AWS | Agent Frameworks | Azure OpenAI | CI/CDCareer development opportunities | Convenient city location | Free Membership | Hybrid working | Modern end of trip facilitiesSenior-level Full TimeMelbourne, VIC, AU4d ago
-
Applied AI Engineer AUD 137K-181KAPI Integration | Agent Development | Evaluation Frameworks | LLM Deployment | Language ModelsEquity donation matching | Flexible working hours | Generous vacation | Office space | Parental leaveSenior-level Full TimeSydney, Australia4d ago
-
CI/CD | Data Analysis | Data Visualization | Git | Integer optimizationCollaborative culture | Equity participation | Fully remote work flexibility | High-impact projects | Mission-driven cultureSenior-level Full TimeAustralia R4d ago
-
Data Engineer AUD 135K-165KAgile | Apache Airflow | Apache Spark | Cloud Computing | Data ModelingAnnual bonus opportunity | Collaborative technology environment | Discounted retail gift cards | Permanent full time opportunity | Wellness programsMid-level Full TimeMelbourne, Victoria 3000, Australia4d ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Distributed remote work | Friendly work environmentMid-level Full TimeSydney, Australia4d ago
-
Senior Data Engineer AUD 125K-135KAlerting | Apache Spark | Automated testing | CI/CD | Data CatalogAdditional paid leave | Company events | Diversity support | Floating public holidays | Hybrid work arrangementSenior-level Full TimeSydney, New South Wales 2000, Australia4d ago
-
Lead AI Engineer AUD 167K-200KAgentic Frameworks | CI/CD | Cloud Platforms | Containers | Fine TuningSenior-level Full TimeSydney, Australia R4d ago
-
Staff Data Engineer AUD 120K-130KAWS | BigQuery | DBT | Data Contracts | Data GovernanceCareer growth opportunities | Healthcare impact | Supportive work environment | Work from anywhereSenior-level Full TimeAustralia R4d ago
-
Senior Data Engineer AUD 120K-130KA/B | A/B Testing | AWS | B testing | BigQueryProfessional growth | Supportive work environment | Work from anywhereSenior-level Full TimeAustralia R4d ago
-
Data Engineering Lead (AWS) AUD 70K-97KAWS Glue | AWS Lambda | Amazon Athena | Amazon Managed Streaming for Apache Kafka | Amazon RDSCoaching support | Flexible work options | Paid parental leave | Paid volunteering days | Retail discountsSenior-level Full TimeSydney, NSW, AU4d ago
-
Chief Engineer AUD 60K-200KAWS CloudFormation | AWS Glue | AWS IAM | AWS Lambda | AWS Step FunctionsExecutive-level Full TimeEveleigh, NSW - 1 Locomotive Street, …4d ago
-
Freelance Machine Learning Engineer AUD 110KLangchain | Language Models | Large Language Models | MLOps | NumPyFlexible weekly hours | Freelance opportunities | Part-time project work | Publication and portfolio based work evaluationMid-level FreelanceAustralia - Remote R4d ago
-
Executive-level Full TimeEveleigh, NSW - 1 Locomotive Street, …4d ago
-
LLM | Langchain | MLOps | Machine Learning | NumPyFlexible schedule | Part-time schedule | Project based workMid-level FreelanceAustralia - Remote R4d ago
-
Senior Data Engineer, Business Intelligence AUD 118K-134KAzure Data | Azure Data Factory | Azure Synapse | Azure Synapse Analytics | Data FactoryCareer pathway opportunities | Discounted private health | EAP | Fitness passport | Flexible work arrangementsSenior-level Full TimeAustralia, UniSC Sunshine Coast, Australia, UniSC …4d ago
-
Senior-level Full TimeMelbourne, Australia5d ago
-
Sr. Forward Deployed Engineer AUD 140K-175KApache Spark | Cloud Computing | Data Lakes | Databricks | Delta LakeCustomer-facing work | Travel 20 to 30 percentSenior-level Full TimeSydney, Australia5d ago