Data Engineer - Senior
Tasks
- Build reusable data integration components
- Design APIs and data exchange processes
- Design and develop enterprise data pipelines
- Develop ETL and ELT processes
- Develop data extraction and transformation processes
- Develop data quality controls
- Develop integrations between operational platforms
- Enable operational dashboards and analytics
- Implement enhancements and investigate production data issues
- Implement validation and reconciliation processes
- Maintain scalable and secure data architectures
- Monitor data integrity
- Optimize data processing performance
- Prepare structured datasets for AI solutions
- Support ServiceNow integrations
- Support customer portal data services
- Support information governance
- Support reconciliation activities
- Validate migrated data completeness and accuracy
Perks/Benefits
- N/A
Skills/Tech-stack
API Design | Agile | Azure Data | Azure Data Factory | Data Factory | Data Modeling | Data Quality | Data Reconciliation | Data Warehousing | Data integration | Data pipeline | ELT | ETL | Information Governance | Metadata Management | Microsoft Fabric | Power BI | Python | SQL | ServiceNow
Education
N/A
Roles
Related jobs
-
Senior Machine Learning Engineer (Platform / MLOPs) AUD 132K-180KAPI Development | AWS | Amazon EKS | ArgoCD | Arize AIAnnual flu vaccinations | Gym access | Hybrid flexibility | In-office lunch | Nearmap subscriptionSenior-level Full TimeBarangaroo, NSW, Australia R5h ago
-
AWS | Apache Spark | DBT | Data Ingestion | Data LakesFlexible working options | Paid volunteering days | Parental leave | Retail discounts | Return to work support packageMid-level Full TimeSydney, NSW, AU11h ago
-
Robotics Software Engineer AUD 401KBenchmarking | C++ | CI/CD | Collision Avoidance | Machine Learning401k matching | Dental insurance | Health insurance | Paid Holidays | Travel supportMid-level Full TimeCharlestown, MA R21h ago
-
Data Platforms Engineer (Azure DataBricks) AUD 129K-138KApache Spark | Azure Data | Azure Data Factory | Azure DevOps | CI/CDAccess to professional memberships and industry networks | Discounted services | Employee assistance program | Flexible work arrangements | Parental leaveSenior-level Full TimeNorth Ryde, NSW, Australia1d ago
-
Senior LLMOps Engineer AUD 147K-180KAlerting | Dashboarding | Data Modeling | Data Pipelines | DatadogEquity | Fertility support | Health and wellness allowance | Home office budget | Learning and development budgetSenior-level Full TimeMelbourne R1d ago
-
Data Engineer AUD 130K-165KAgile | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageDiversity and inclusion | Hybrid working | Professional growthSenior-level Full TimeMelbourne, Australia1d ago
-
Staff Data Engineer (AWS Cloud and AI) AUD 135K-140KAPI Gateway | AWS | AWS API | AWS API Gateway | AWS DataZoneFlexible workingSenior-level Full TimeSydney, NSW - CBP South, 11 …1d ago
-
Senior-level Full TimeSydney, NSW - CBP South, 11 …1d ago
-
Senior Engineer, Database AUD 130K-150KAgile | Azure | Azure DevOps | Azure SQL | CI/CDAdditional rest day | Discounted health insurance | Flexible working | Hybrid working | Volunteer daySenior-level Full TimeSydney, Australia1d ago
-
Senior Engineer, Database AUD 130K-150KAgile | Azure DevOps | Azure SQL | CI/CD | DevOpsFlexible working | Health insurance discount | Hybrid working | Rest day | Volunteer daySenior-level Full TimeSydney, Australia1d ago
-
Forward Deployed Engineer GBP 25K-25K100GbE | C++ | Distributed Systems | Docker | File systemsOn-site work option | Travel up to 25 percentSenior-level Full TimeAustralia, AU R2d ago
-
AWS | Access Management | CI/CD | Data Engineering | Data platformFlexible working options | Market-leading parental leave | Paid volunteering days | Retail discounts | Return to work support packageSenior-level Full TimeSydney, NSW, AU2d ago
-
Bash | Data Processing | Docker | GCP | Infrastructure as CodeAsynchronous work culture | Friendly laid-back atmosphere | Hands-off management | Opportunity for high-impact workMid-level Full TimeMelbourne, Australia3d ago
-
Quantum Applications Architect AUD 120K-158KBenchmarking | C++ | Complexity Theory | Fault Tolerant Quantum | Fault-tolerantSenior-level Full TimeBrisbane, Queensland, Australia3d ago
-
Senior-level Full TimeAU-NSW-Sydney3d ago
-
Computer Vision | Deep learning | Diffusion Models | Docker | Generative AIEquity package | Flexible leave options | Flexible work arrangements | Parental leave | Professional growth opportunitiesSenior-level Full TimeAustralia R4d ago
-
AI Engineer EUR 49K-67KAPIs | Azure | CI/CD | Databricks | JavaScriptCollaborative team | Inclusive workplace | On-site work | Professional developmentMid-level Full TimeEssendon, Victoria 3040, Australia4d ago
-
AI and Automation Specialist - Risk AUD 129K-143KAnalytics | Automation | DAX | Data Governance | Data ModelingSenior-level Full TimeSYDNEY, NSW, AU, 20004d ago
-
Staff Software Development Engineer - Data Acquisition AUD 150K-185KAI Assisted Development | API Development | Agents | Amazon S3 | Amazon Web ServicesSenior-level Full TimeAustralia - Melbourne Office4d ago
-
Staff Data Engineer AUD 129K-140KBatch Processing | Big Data | CI/CD | Data Cleansing | Data EngineeringSenior-level Full TimeMelbourne, VIC - 435 Bourke Street, …4d ago
-
Senior Data Scientist, ML, NLP, GenAI, Agentic AI AUD 137K-147KAdversarial Testing | Agentic AI | CI/CD | Data Governance | Data QualitySenior-level Full TimeEveleigh, NSW - 1 Locomotive Street, …4d ago
-
AI Engineer AUD 132K-180KAWS | Agent Development | Amazon Bedrock | Artificial Intelligence | AutomationFlexible hours | Free food and snacks | Opportunity to drive projects | Socials and Community Groups | Training and developmentSenior-level Full TimeMelbourne, Victoria, Australia R4d ago
-
Senior-level Full TimeMelbourne, Victoria 3000, Australia4d ago
-
Junior Data Scientist AUD 80K-90KDAX | Machine Learning | Power BI | Power Pivot | Power QueryEmployee discounts | Hybrid work | Incentives | Onsite parking | Team learning and knowledge sharingEntry-level Full TimeMacquarie Park, NSW, AU4d ago
-
AWS | AWS CloudFormation | AWS Glue | AWS Lambda | AWS Step FunctionsFlexible work location | Fully remote | Ownership and leadership opportunities | Technical autonomySenior-level Contract Full TimeAustralia R4d ago