Senior Data Engineer — Integration & Pipelines
Bowen Hills, Queensland 4006, Australia
AUD 118K-120K (estimate) Senior-level Full Time
Tasks
- Build and maintain API integrations
- Build and maintain REST APIs
- Build scalable ingestion pipelines
- Develop Databricks pipelines
- Implement data quality and governance processes
- Implement dimensional data models
- Mentor junior engineers
- Monitor pipeline reliability and observability
Perks/Benefits
Skills/Tech-stack
API pagination | Anomaly Detection | CI/CD | Data Governance | Data Quality | Databricks | Delta Lake | Dimensional Modeling | OAuth2 | Pipeline observability | PySpark | Python | REST APIs | Rate Limiting | SQL | Streaming | Webhook
Education
Bachelor of Engineering | Bachelor of Science | Bachelor of Science in Computer Science | PhD
Roles
Related jobs
-
Staff Data Engineer AUD 140K-146KAPI Gateway | AWS DataZone | AWS Glue | AWS Lake | AWS Lake FormationChanging start and finish times | Flexible working arrangements | Hybrid work with office time | Job share | Part-time arrangementsSenior-level Full TimeSydney, NSW - CBP South, 11 …12h ago
-
AI Engineer - South Bank, QLD AUD 70K-138KAzure DevOps | Azure Machine Learning | Bicep | CI/CD | DatabricksEmployee assistance program | Employee discounts | Health and wellness discounts | Internal gym access | Learning and development budgetMid-level Full TimeAustralia, Queensland13h ago
-
Senior Data Engineer AUD 132K-140KAPI | Azure | Azure DevOps | CI/CD | Data LakehouseHybrid work flexibility | Learning and development opportunities | Max term contractSenior-level Full TimeMelbourne, VIC, AU21h ago
-
Automated Workflows | CI/CD | Cloud Native | Containerization | Data LineageCollaborative environment | Inclusive workplace | Professional growthSenior-level Full TimeAustralia23h ago
-
Senior Software Engineer (Data & Distributed Systems) AUD 155K-186KAgile | C# | Cloud | Databricks | Distributed SystemsSenior-level Full TimeSydney1d ago
-
Azure | Azure Data | Azure Data Factory | Azure DevOps | BashHands on Azure experience | Hands on Databricks experience | Professional growthMid-level Full TimeAustralia1d ago
-
Senior AI Engineer AUD 160K-200KAzure | C# | Databricks | Datadog | FastMCPAnnual leave | Flexible working environment | Generous leave | Karbon Days off | Parental leaveSenior-level Full TimeMelbourne, VIC, Australia1d ago
-
Computer Vision Engineer - VisionAI (AU) AUD 143K-161KC++ | CUDA | Control Theory | Edge Computing | Embedded SystemsSenior-level Full TimeSydney, Australia1d ago
-
Lead Data Engineer - Azure AUD 125K-140KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DatabricksEducation assistance program | Extra annual leave | Extra insurance | Flexible hybrid work model | Parental leaveSenior-level Full TimeSydney - Darling Park, Australia R1d ago
-
Agentic AI Engineer (AWS) AUD 100K-135KAWS | AWS CDK | Agent systems | Alembic | Amazon BedrockFlexible working options | Market-leading parental leave | Mentoring coaching programs | Paid volunteering days | Professional development reimbursementsMid-level Full TimeSydney, NSW, AU R1d ago
-
Senior-level Full TimeMelbourne, Victoria, Australia1d ago
-
Head of AI & Automation AUD 150K-170KAccess Management | Artificial Intelligence | Automation | Claude Enterprise | ConnectorsExecutive-level Full TimeSydney, New South Wales, Australia1d ago
-
Data Engineer AUD 65K-70KAWS Redshift | Apache Spark | Automation | CI/CD | DBTDiscounts to retailers | Fitness passport | Flexible working | Paid parental leave | Professional developmentMid-level Full TimeHead Office- Melbourne, Australia R1d ago
-
Access Management | Azure | Azure Data | Azure Data Factory | Azure DatabricksClear communication | Fair disclosed margins | Hybrid work | Professional respectful experienceSenior-level Full TimeCanberra, Australian Capital Territory, Australia R1d ago
-
Senior AI Engineer AUD 160K-180KAWS | Agent Orchestration | Agentic AI | Artificial Intelligence | AutogenCareer development | Collaborative team environment | Stable work environmentSenior-level Full TimeMelbourne, Victoria 3000, Australia2d ago
-
Senior AI Engineer AUD 102K-130KAWS | Amazon S3 | Bedrock | CI/CD | DockerConferences | Corporate discounts | Flexible hybrid workplace | Home office support | In-house trainingSenior-level Full TimeMelbourne, Australia R2d ago
-
Mid-level Full TimeSydney, NSW, Australia2d ago
-
Staff AI & Data Engineer AUD 160K-215KAgent systems | Agentic AI | Azure | Azure Event | Azure Event HubsSenior-level Full TimeAirTrunk HQ - North Sydney2d ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerAsynchronous work culture | Friendly laid-back atmosphere | Hands-off management | Opportunity for high impact productsMid-level Full TimeSydney, Australia2d ago
-
Apache Spark | Azure | CI/CD | Containerization | Data ModelingFlexible working options | Paid parental leave | Paid volunteering days | Wellbeing leaveMid-level Full TimeMelbourne, VIC, AU2d ago
-
Databricks Data Engineer Senior Analyst AUD 70K-120KAgile | Apache Spark | Azure Blob | Azure Blob Storage | Azure DataSenior-level Full TimeBrisbane, 10 Eagle Street, Australia2d ago
-
Principal Data Engineer (Apache Spark, dbt, Airflow) AUD 140K-146KAWS | Amazon Redshift | Apache Airflow | Apache Iceberg | Apache SparkFlexible working | Hybrid working optionsSenior-level Full TimeSydney Office, Australia2d ago
-
Solutions Engineer AUD 140K-180K.NET | Apache Flink | Apache Hadoop | Apache NiFi | Apache SparkCareer development | Employee resource groups | Flexible work from home | Paid time off | Paid volunteer timeSenior-level Full TimeAustralia-New South Wales-Sydney R2d ago
-
Artificial Intelligence Analyst AUD 110K-130KAI Agents | AI Foundry | Agentic AI | Azure | Azure AIMid-level Full TimeBrisbane, 10 Eagle Street, Australia2d ago
-
AI Agents | AI Foundry | AI Search | Agent Framework | AutogenSenior-level Full TimeSydney, International House, 3 Sussex St, …2d ago