Senior Data Engineer
Tasks
- Build data pipelines
- Collaborate with analytics engineers
- Collaborate with data scientists
- Design data models
- Design data pipelines
- Ensure pipeline reliability
- Extend data ingestion pipelines
- Implement CI/CD pipelines
- Implement acceptance testing
- Implement data lineage controls
- Implement data quality & governance
- Implement integration testing
- Implement unit testing
- Maintain data pipelines
- Maintain data warehouse
- Monitor data freshness
- Optimize compute usage
- Transform new data sources
Perks/Benefits
Skills/Tech-stack
Acceptance Testing | Amazon Web Services | Apache Airflow | Apache Spark | Automation Testing | CI/CD | Cloud platform | DBT | Data Governance | Data Lineage | Data Modeling | Data Quality | Data Warehouse | DataOps | Databricks | Delta Live Tables | Delta Live) | Freshness Monitoring | Git | Google Cloud | Google Cloud Platform | Integration Testing | Microsoft Azure | PySpark | Python | Relational databases | SQL | Schema Validation | Slowly Changing Dimensions | Snowflake | Snowflake Schema | Star Schema | Unit Testing | Web Services
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Regions
Countries
States
Related jobs
-
Mid-level Full TimeSydney15h ago
-
Data Engineer AUD 90K-150KAWS | Agile | Alerting | CI/CD | Code reviewEmployee discounts | Flexible working | Frequent events | Health and wellbeing programs | Income protection insuranceMid-level Full TimeCremorne, Victoria, Australia20h ago
-
Lead Data Engineer (Akira) AUD 125K-150KAutomation | Data Engineering | Data Governance | Data Integrity | Data ManagementSenior-level Full TimeSydney, Australia22h ago
-
Junior Machine Learning Engineer AUD 60K-65KAWS | Azure | CI/CD | Databricks | DockerFlexible schedule | Hybrid work | Retailer discounts | Wellbeing benefitsEntry-level Full TimeMelbourne, Victoria, Australia22h ago
-
TL Data and Analytics Legacy AUD 89K-110KAgile | Azure | Azure Data | Azure Data Factory | Azure Data LakeAdditional leave days | Career development via internal mobility | Flexible working arrangements | Health and wellbeing initiatives | Supportive and inclusive managersMid-level Full TimeMelbourne: 509 St Kilda Rd, Australia22h ago
-
Cloud Database Administrator AUD 113K-122KAzure | Cause analysis | Data Modeling | Database Administration | Database normalizationAnnual flu vaccinations | Career break | Digital wellbeing support | Employee share plan | Income protection insuranceMid-level Full TimeMelbourne Central Towers - Level 21, …22h ago
-
Enterprise Data Engineer USD 92K-120KAzure Data | Azure Data Factory | Azure DevOps | Azure Synapse | Azure Synapse Analytics401k match | Dependent Care Match | Employee referrals | Flexible work schedules | Health insuranceMid-level Full TimeAtwell1d ago
-
Amazon Redshift | DBT | Data Architecture | Data Modeling | Data QualityFully remote | Global team collaboration | Healthcare coverage | Home office equipment allowance | Learning and development budgetSenior-level Full TimeAustralia R1d ago
-
Senior Applied AI Engineer AUD 137K-181KAgentic Workflows | Applied AI | Automated testing | CI/CD | ClaudeBike storage | Equity stock options | Free snacks and drinks | Lockers | ShowersSenior-level Full TimeMelbourne, Australia1d ago
-
Azure AI Developer Consultant AUD 85K-95K.NET | API Management | App Service | Automated testing | Azure APIFlexible work environment | On site customer presence when required | Remote work option | Split time between home and officeSenior-level Full TimeBrisbane, QLD, AU2d ago
-
Evaluation Frameworks | Evaluation Pipelines | Function Calling | Java | LLM tool-useEquity packages | Flexible leave options | Inclusive parental leave | Virtual interviews | Wellbeing allowanceSenior-level Full TimeBrisbane, QLD, Australia R2d ago
-
Evaluation Pipelines | Function Calling | Governance | Java | LLM tool-useEquity packages | Flexible leave options | Flexible remote work within Australia | Inclusive parental leave | Wellbeing allowanceSenior-level Full TimeMelbourne, VIC, Australia R2d ago
-
Function Calling | Java | LLM tool-use | Langchain | LanggraphEquity packages | Flexible leave options | Inclusive parental leave | Virtual interviews | Wellbeing allowanceSenior-level Full TimeSydney, Australia R2d ago
-
Staff Algorithms Software Engineer (AU) AUD 113K-127KAlgorithm Development | C# | C++ | CI/CD | Continuous integrationSenior-level Full TimeAdelaide, Australia2d ago
-
Staff RF Algorithms Engineer (AU) AUD 117K-136K5G-NR | BER | CI/CD | Channel Decoding | CorrelationSenior-level Full TimeAdelaide, Australia2d ago
-
Data Engineer AUD 150K-155KApache Spark | Azure | Azure Data | Azure Data Factory | Azure Data LakeAdditional annual leave | Employee assistance program | Flexible location | Paid parental leave | Salary packagingSenior-level Full TimeWest Melbourne, VIC, AU, 30032d ago
-
Staff Data Engineer (AWS Cloud and AI) AUD 70K-80KAPI Gateway | AWS DataZone | AWS Glue | AWS IAM | AWS Lake FormationChanging start and finish times | Flexible working arrangements | Job share | Part-time optionsSenior-level Full TimeSydney, NSW - CBP South, 11 …2d ago
-
Next Frontier Quantum Associate AUD 115K-129KAWS Braket | Azure Quantum | Azure Quantum QDK | CI/CD | CirqCareer development | Comprehensive benefits package | Family-friendly policies | Flex leave | Flexible work arrangementsMid-level Full TimeSydney, NSW, AU, 20002d ago
-
Forward Deployed Engineer - Sydney AUD 115K-135KBackend Development | Code review | Frontend Development | Full Stack | Full-Stack DevelopmentHybrid work model | Relocation assistance | Travel requiredMid-level Full TimeSydney, Australia3d ago
-
Senior Software Engineer, Robotics Task Planning AUD 160K-190KAggregation | Autonomous Systems | Behavior planning | C++ | Data Analysis401k contribution | Dental insurance | Health insurance | Paid Holidays | Travel stipendSenior-level Full TimeCharlestown, MA3d ago
-
Azure Data Engineer AUD 110K-130KApache Spark | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure DatabricksAccess to physiotherapy | Background checks | Casual work attire | Fresh breakfast and lunch | Masseuse servicesMid-level Full TimeBrisbane, QLD3d ago
-
AI Engineer (Agentic) AUD 119K-132KDevOps | Human-in-the-loop | LLM Governance | Language Models | Large Language ModelsCoaching and training | Flexible working hours | Generous leave entitlements | Hybrid work environment | Learning and developmentSenior-level Full TimeMelbourne, Australia3d ago
-
Data Analyst AUD 90K-110KAzure SQL | DAX | Data Lakehouse | Delta Lake | Dimensional ModelingEmployee assistance program | Employee discounts | Hybrid working | Professional growth | Wellbeing initiativesMid-level Full TimeSouth Brisbane, QLD, Australia3d ago
-
Applied AI Engineer AUD 100K-160KAI Foundry | AI Search | API Development | AWS | Access ControlProfessional growthMid-level Full TimeSouthbank, Victoria 3006, Australia3d ago
-
Senior-level Full TimeSydney Olympic Park, New South Wales, …3d ago