Senior Data Engineer – Cloud Data Platform (Network & Observability)
Tasks
- Build and maintain ETL/ELT pipelines
- Build and operate masking pipelines
- Build batch and near real time ingestion frameworks
- Collaborate with engineering network and business teams
- Define data lake zoning best practices
- Design and operate AWS data pipelines
- Develop reusable data models and curated data layers
- Ensure data governance with lineage and auditability
- Implement CI CD for data platform deployments
- Implement data masking and tokenisation for PII
- Implement infrastructure as code for data platforms
- Implement partitioning and performance optimisation
- Provide mentorship and technical leadership
- Transform raw data into analytics-ready datasets
- Translate requirements into scalable data architectures
Perks/Benefits
- Additional paid leave
- Corporate partner discounts
- Hybrid work
- Learning platform access
- Mobile Plan
- NBN plan
Skills/Tech-stack
AWS | AWS Glue | AWS Lambda | Amazon Redshift | Amazon S3 | Apache Airflow | Auditability | CI/CD | Data Governance | Data Lineage | Data masking | ELT | ETL | IAM | Infrastructure as Code | PII | Python | SQL | Tokenization | “as-code”
Education
N/A
Roles
Related jobs
-
Senior Applied AI Engineer AUD 119K-161KAgent Orchestration | Agent systems | Bias Testing | Context engineering | Evaluation datasetsCoaching | Equity | Extended end of year break | Home workspace setup budget | Inclusive parental leaveSenior-level Full TimeMelbourne7h ago
-
Apache Spark | Azure Blob | Azure Blob Storage | Azure Data | Azure Data FactorySenior-level Full TimeSydney, International House, 3 Sussex St, …12h ago
-
Adtech | Distributed Systems | Docker | Embeddings | JavaAccess to technical leadership | Collaborative engineering culture | Exposure to cutting edge generative AI | High autonomy and flexibility | High ownership and real world production impactEntry-level Full TimeAustralia R1d ago
-
Cyber Security Data Engineer AUD 135K-165KArtificial Intelligence | Automation | Compliance reporting | Control assessments | Control mappingEmployee discounts | Flexible work arrangements | Learning and development opportunities | Leave options | Volunteering opportunitiesMid-level Full TimeSydney, NSW, Australia1d ago
-
Agile | Apex | CI/CD | Change Data Capture | CopadoFlexible working | Hybrid working options | Wellbeing supportSenior-level Full TimeSydney Office, Australia1d ago
-
Data Engineer-Medicare Mental Health Check In AUD 96K-119KAutomated testing | Azure | Azure Data | Azure Data Factory | CI/CDCompetitive salary packaging benefits | Hybrid working | Inclusive and supportive culture | Professional development and learning opportunitiesMid-level Full TimeVIC Group Office - Melbourne, Australia1d ago
-
AI Engineer - Melbourne AUD 92K-125KAPI Development | AWS | Automated testing | CI/CD | Cloud platformMid-level Full TimeMelbourne - 727 Collins, Australia R1d ago
-
Mid-level Full TimeSydney - Barangaroo, Australia R1d ago
-
Azure Databricks | Azure Synapse | CI/CD | DAX | Data LakeSenior-level Full TimePerth, Exchange Tower, Australia1d ago
-
AI Software Engineer AUD 111K-161KASP.NET Web | ASP.NET Web API | AWS ECS | AWS Lambda | AWS S3Additional time off | Flexible and hybrid working | Gym membership | Learning opportunities | Social eventsMid-level Full TimeSydney, New South Wales, Australia2d ago
-
Mid-level Full TimeHong Kong, Hong Kong; Sydney, Australia3d ago
-
Reporting & Data Engineers AUD 150K-180KAgile | Azure | CI/CD | Data Modeling | Data WarehousingClient office access | Hybrid workMid-level Full TimeMelbourne, Victoria 3000, Australia3d ago
-
Data Engineer AUD 125K-128KAI Agents | AWS | Automation | Azure | Data GovernanceCharity volunteering opportunities | EAP support | Financial planning support | Flexible work options | Generous leaveMid-level Full TimeNorwest, New South Wales 2153, Australia4d ago
-
Data Engineer AUD 110K-140KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2Birthday day off | End-of-trip facilities | Flexible working | Paid parental leaveMid-level Full TimeSydney4d ago
-
Senior Software Engineer AUD 140K-143KAPI Design | Agile | Automated testing | CI/CD | Distributed SystemsFlexible working hours | Job share | Office connection at least half time per month | Part-time arrangementsSenior-level Full TimeEveleigh, NSW - 1 Locomotive Street, …4d ago
-
Data Engineering Lead AUD 120K-125KAWS | Azure | CI/CD | Cloud Computing | Data ArchitectureCareer development opportunities | Discounted healthcare memberships | Employee counselling support | Employee discounts | Flexible leave optionsSenior-level Full TimeHead Office Sydney, Australia4d ago
-
Principal AI Engineer AUD 130K-180KAPI Development | Agentic Workflows | Backend Services | CI/CD | ClassificationCareer growth | Flexible working environment | Remote-friendly cultureSenior-level Full TimeSydney4d ago
-
Senior Data & Analytics Engineer, Strategic Finance AUD 150K-222KDBT | Data Modeling | Data Pipelines | Data Quality | Dimensional ModelingEmployee stock options | Health insurance coverage | Hybrid work | Paid time off | Parental leaveSenior-level Full TimeMelbourne, VIC, Sydney, NSW R4d ago
-
Data Engineer - 12 month FTC AUD 100K-134KAWS S3 | Agile | Amazon Redshift | Amazon Web Services | Apache AirflowAdditional leave | Corporate partner discounts | Flexible-hybrid work | Free NBN plan | Free mobile planEntry-level Contract Full Time TemporaryBarangaroo, NSW, AU4d ago
-
Azure AI Developer Consultant AUD 70K-100K.NET | API Management | App Service | Azure API | Azure API ManagementFlexible work schedule | Onsite customer visits when required | Work from home optionSenior-level Full TimeMelbourne, VIC, AU4d ago
-
Senior Analytics Engineer - Security Insights AUD 118K-130KAlerting | Batch Processing | Cost Optimization | DBT | Data GovernanceEquity packages | Flexible leave | Parental leave | Wellbeing allowanceSenior-level Full TimeSydney, Australia R5d ago
-
Entry-level Full TimeMelbourne, Australia5d ago
-
Analytics Engineer - Personalisation AUD 110K-140KDBT | Data Modeling | Data Pipelines | Data Warehousing | ELTEquity packages | Flexible leave options | Flexible remote work | Inclusive parental leave | Wellbeing allowanceMid-level Full TimeSydney, Australia R5d ago
-
AWS Glue | AWS Step Functions | Amazon EMR | Amazon Kinesis | Amazon RedshiftFlexible working | Hybrid work | Job-sharing | Part-time arrangementsSenior-level Contract Full Time TemporarySydney, NSW - CBP North, 1 … R5d ago
-
ML / AI Software Engineer, Electronic Warfare AUD 130K-142KC++ | CUDA | Data Preparation | Data Preprocessing | Data labelingSenior-level Full TimeHaymarket, NSW, Australia5d ago