Senior Data Engineer
Tasks
- Architect data lakehouse and real time processing
- Architect scalable data pipelines
- Build secure scalable data infrastructure
- Define data initiatives with stakeholders
- Design CDC and reconciliation workflows
- Develop data governance processes
- Implement monitoring, alerting, and logging
- Improve data platform reliability and performance
- Orchestrate data workflows
- Perform code reviews and mentor engineers
Perks/Benefits
- Barista coffee
- Breakfast
- EAP support
- Happy hour
- Learning platform courses
- Mentorship
- On-site massage
- Open pantry snacks
- Paid volunteer day
- Team lunches
- Training programs
- Work from home option
Skills/Tech-stack
AWS | AWS DMS | AWS Lambda | Access Control | Alerting | Amazon Glue | Amazon Kinesis | Amazon Redshift | Amazon S3 | Apache Airflow | Apache Spark | Change Data Capture | Compliance | Data Capture | Data Classification | Data Governance | Data Lineage | Data Reconciliation | Data Security | Data masking | Encryption | GDPR | Git | Hadoop | Infrastructure as Code | Logging | Machine Learning | Monitoring | Observability | PII | PySpark | Python | SQL | Terraform | “as-code”
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
APIs | AWS | Benchmarking | Cloudflare Workers | EvaluationEquity packages | Flexible leave options | Inclusive parental leave | Virtual interviews | Wellbeing allowanceSenior-level Full TimeMelbourne, VIC, Australia R10h ago
-
API Design | AWS | Cloudflare Workers | Evaluation | Language ModelsEquity packages | Flexible leave options | Inclusive parental leave | Office setup allowance | Social connection allowanceSenior-level Full TimeSydney, Australia R10h ago
-
API Design | AWS | Agent architecture | Benchmarking | Cloudflare WorkersEquity packages | Flexible leave | Flexible work arrangements | Parental leave | Wellbeing allowanceSenior-level Full TimeMelbourne, VIC, Australia R10h ago
-
API Design | AWS | Agent architecture | Benchmarking | Cloudflare WorkersEquity packages | Flexible leave options | Inclusive parental leave | Wellbeing allowanceSenior-level Full TimeSydney, Australia R10h ago
-
AI Engineer - Data Intelligence - AI Platform AUD 137K-186KAWS | Batch Processing | Data Governance | Data Lakes | Data ProcessingCoaching Budgets | Employee share options | Extended year-end breaks | Medical insurance | Mental wellbeing supportSenior-level Full TimeMelbourne11h ago
-
AI Engineer - Data Intelligence - AI Platform AUD 137K-186KAWS | Batch Processing | Data Compliance | Data Lakes | EmbeddingsCoaching and budgets | Employee share options | Extended year-end breaks | MacBook provided | Medical insurance coverageSenior-level Full TimeSydney11h ago
-
Data Engineer (SAP BODS) AUD 80K-100KAWS | Apache Spark | Business Intelligence | BusinessObjects Data Services | Crystal ReportsAccess to discounts via Cuscal Advantage | Hybrid work model | IGNITE recognition program | Wellbeing initiativesMid-level Full TimeSydney, NSW, Australia11h ago
-
Chief Engineer, Treasury Trading & Analytics AUD 60K-180KAWS | Automated Pipeline | Automated pipeline optimization | Automated testing | AzureAccessibility accommodations for recruitment process | Inclusive workplace supportExecutive-level Full TimeSydney, NSW, Australia13h ago
-
AWS | Agent Frameworks | Azure | CI/CD | Cost OptimizationEmployee share option plan | Flexible working | Hybrid working | National Police Check | Paid parental leaveMid-level Full TimeSydney13h ago
-
Clinical AI Engineer AUD 130K-150KAWS | Audio Processing | Automatic Speech Recognition | CI/CD | ContainersEquity | Flexible hybrid working | Flexible office schedule | Personal development budgetSenior-level Full TimeSydney14h ago
-
.NET | AWS | AWS Athena | AWS Glue | Amazon RedshiftFlexible working | Hybrid workingSenior-level Full TimeSydney Office, Australia16h ago
-
Staff Software Engineer - Embedded (AU) AUD 118K-142KC++ | CI/CD | Continuous Testing | Embedded Linux | GitSenior-level Full TimeSydney, Australia16h ago
-
Data Engineer (Financial Analytics focus) AUD 110K-140KApache Airflow | CTE | DAG | Data Modeling | Data PipelinesFlexible benefits | Flexible working | Paid leave | Private medical insuranceMid-level Full TimeMelbourne, Victoria, Australia R23h ago
-
Automation | Distributed Systems | Incident Response | Machine Learning | MonitoringSenior-level Full TimeSydney, New South Wales, Australia1d ago
-
Senior DataOps Engineer AUD 120K-130KAWS | Access Control | Airflow | Amazon Kinesis | Automated alertingDaily breakfast | EAP access | Flexible career development | Hands-on learning | Happy hourSenior-level Full TimeMelbourne, Australia1d ago
-
Data Engineer AUD 120K-130KAWS | Airflow | CI/CD | DBT | Data ArchitectureAnniversary leave | Employee share options | End-of-trip facilities | Flexible working | Free lunchSenior-level Full TimeSydney, NSW1d ago
-
Senior Firmware / Embedded Systems Engineer AUD 112K-122KARM Cortex | ARM Cortex M7 | Bare Metal | Bare Metal Development | C#Annual flu vaccination | In-office lunch | Showers | Stocked kitchen | Wellbeing and tech allowanceSenior-level Full TimeBarangaroo, NSW, Australia1d ago
-
Bash | Coverage.py | Docker | GCC | GoFlexible schedule | Project-based collaboration | Remote workSenior-level Full TimeAustralia - Remote R1d ago
-
Data Engineering | Data Processing | Data Visualization | GenAI | LangchainFlexible schedule | Impact on AI development | Part-time | Professional development | Remote workMid-level FreelanceAustralia - Remote R1d ago
-
Senior-level Full TimeSydney, New South Wales, AUS1d ago
-
Senior-level Full TimeSydney2d ago
-
Database Engineer AUD 105K-115KDatabase Administration | Database Design | Disaster Recovery | NoSQL | OracleMid-level Full TimeSydney2d ago
-
Forward-Deployed Data Scientist II AUD 120K-171KCI/CD | CatBoost | Data Pipelines | Data integration | DevOpsCommunity engagement opportunities | Family benefits | Flexible paid time off | Health insurance | Professional developmentMid-level Full TimeSydney2d ago
-
AI Engineer AUD 120K-150KAPI Development | Docker | Kubernetes | LLMs | MicroservicesEmployee discounts | Flexible work options | Parental leave | Subscription benefitsSenior-level Full TimeNorth Sydney, NSW, Australia2d ago
-
AI | API Gateway | AWS | AgentCore) | AzureFlexible work arrangements | Market-leading parental leave | Paid volunteering days | Retirement plan | Wellbeing leaveMid-level Full TimeSydney, NSW, AU2d ago