Senior Data Engineer - Data Platform
Tasks
- Apply data modelling practices
- Architect cloud data platforms on AWS and Snowflake
- Build and maintain data pipelines
- Collaborate with data science and analytics teams
- Continuously improve data processes and reliability
- Design and build lakehouse data solutions
- Develop real-time streaming pipelines
- Implement lakehouse table formats
- Improve data quality and governance
- Integrate internal and external data sources
- Optimize SQL and Spark workloads
Perks/Benefits
Skills/Tech-stack
API Integration | AWS | AWS Glue | Apache Airflow | Apache Flink | Apache Iceberg | Apache Kafka | CDK | CloudFormation | DBT | Databricks | Infrastructure as Code | Python | SQL | Snowflake | Spark | Terraform | “as-code”
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Regions
Countries
States
Cities
Related jobs
-
APIs | Cloud platform | Debugging | Google Cloud | Google Cloud PlatformDirect access to engineering support | High travelMid-level Full TimeSydney NSW, Australia2h ago
-
Data Engineer AUD 113K-125KCloud Data | Cloud Data Platforms | Data Modeling | Data Pipelines | Data WarehousingFlexible work options | Hybrid workMid-level Full TimeMacquarie Park, NSW, AU, 211313h ago
-
Data Scientist, People Analytics AUD 129K-142KAWS | AWS Glue | AWS Lambda | Amazon Bedrock | Amazon S3Career development opportunities | TrainingSenior-level Full TimeSydney, NSW - CBP North, 1 …1d ago
-
AWS | Air handlers | Asset Management | Building monitoring | Building monitoring systemsFlexible work hours | Mentorship and career growth | Work-life balanceMid-level Full TimeMelbourne, Victoria, AUS1d ago
-
AWS | Air Handling | Building monitoring | Building monitoring systems | Capacity PlanningFlexible work hours | Work-life balanceMid-level Full TimeMelbourne, Victoria, AUS1d ago
-
AWS | Asset Management | Building monitoring | Building monitoring systems | CRAHFlexible work hoursMid-level Full TimeMelbourne, Victoria, AUS1d ago
-
Data Engineer - 12 Month Opportunity AUD 110K-140KAWS | Agile | Artificial Intelligence | Bash | Business IntelligenceAll-team events | Hybrid social events | Learning and development | Team discounts | Volunteer leaveMid-level Full TimeMelbourne, VIC, AU R1d ago
-
Senior Applied AI Engineer AUD 119K-161KAgent Orchestration | Agent systems | Bias Testing | Context engineering | Evaluation datasetsCoaching | Equity | Extended end of year break | Home workspace setup budget | Inclusive parental leaveSenior-level Full TimeMelbourne2d ago
-
Staff Machine Learning Engineer - Recommendations AUD 119K-136KData-Driven Decision Making | Data-driven | Decision Making | Machine Learning | Model EvaluationEquity packages | Flexible leave options | Parental leave | Virtual interviews | Wellbeing allowanceSenior-level Full TimeSydney, Australia2d ago
-
Mid-level Full TimeAU: Sydney (45 Clarence St)2d ago
-
Data pipeline | Debugging | Inference Optimization | Java | KubernetesFlexible leave options | Flexible work hours | Inclusive parental leave | Office setup allowance | Remote friendly within AustraliaSenior-level Full TimeSydney, Australia2d ago
-
Applied AI Engineer AUD 70K-97KAgent architecture | CI/CD | Data pipeline | Docker | Infrastructure as CodeFlexible work arrangements | Leadership programs | Learning programs | Paid parental leave | Paid volunteering daysSenior-level Full TimeMelbourne, VIC, AU2d ago
-
Applied AI Specialist AUD 90K-118KAPI Integration | Artificial Intelligence | Data Contracts | Data schemas | JSONFlexible work arrangements | Learning and leadership programs | Market-leading parental leave | Paid volunteering days | Retail discountsSenior-level Full TimeMelbourne, VIC, AU2d ago
-
Data Engineer AUD 113K-117KAzure Data | Azure Data Factory | Azure Databricks | Azure Synapse | Azure Synapse AnalyticsDiscounts | Flexible working | Growth opportunities | Inclusive culture | Paid leaveMid-level Full TimeVIC - Melbourne - 655 Collins …2d ago
-
Forward Deployed AI Engineer AUD 80K-91KAI Governance | APIs | Agent Frameworks | Cloud Computing | Data PrivacyAdditional leave types | Discounted health insurance | Flexible work arrangements | Lifestyle discounts | On going training and developmentEntry-level Full TimeGarvan / TKCC Sydney, Australia2d ago
-
Apache Spark | Azure Blob | Azure Blob Storage | Azure Data | Azure Data FactorySenior-level Full TimeSydney, International House, 3 Sussex St, …2d ago
-
Adtech | Distributed Systems | Docker | Embeddings | JavaAccess to technical leadership | Collaborative engineering culture | Exposure to cutting edge generative AI | High autonomy and flexibility | High ownership and real world production impactEntry-level Full TimeAustralia R3d ago
-
Bash | Cloud platform | Data Ingestion | Data Ingestion Pipeline | Data ProcessingAsynchronous culture | Friendly atmosphere | Portfolio link support | Remote or distributed workMid-level Full TimeBrisbane, Australia3d ago
-
Cyber Security Data Engineer AUD 135K-165KArtificial Intelligence | Automation | Compliance reporting | Control assessments | Control mappingEmployee discounts | Flexible work arrangements | Learning and development opportunities | Leave options | Volunteering opportunitiesMid-level Full TimeSydney, NSW, Australia3d ago
-
Data Engineer-Medicare Mental Health Check In AUD 96K-119KAutomated testing | Azure | Azure Data | Azure Data Factory | CI/CDCompetitive salary packaging benefits | Hybrid working | Inclusive and supportive culture | Professional development and learning opportunitiesMid-level Full TimeVIC Group Office - Melbourne, Australia3d ago
-
AI Engineer - Melbourne AUD 92K-125KAPI Development | AWS | Automated testing | CI/CD | Cloud platformMid-level Full TimeMelbourne - 727 Collins, Australia R3d ago
-
Mid-level Full TimeSydney - Barangaroo, Australia R3d ago
-
Azure Databricks | Azure Synapse | CI/CD | DAX | Data LakeSenior-level Full TimePerth, Exchange Tower, Australia3d ago
-
HR Data Engineer AUD 104K-121KAWS | Apache Spark | Automated testing | Azure | CI/CDCareer development and education assistance | Cultural leave | Employee discounts | Family friendly health and medical wellbeing support | Health insuranceSenior-level Full TimeBrisbane, Australia3d ago
-
AI Software Engineer AUD 111K-161KASP.NET Web | ASP.NET Web API | AWS ECS | AWS Lambda | AWS S3Additional time off | Flexible and hybrid working | Gym membership | Learning opportunities | Social eventsMid-level Full TimeSydney, New South Wales, Australia4d ago