Solution Designer / Lead Data Engineer
Sydney, NSW, Australia
AUD 135K-158K (estimate) Senior-level Full Time
Tasks
- Architect data ingestion framework
- Build high-throughput data pipelines
- Configure encryption and governance controls
- Create solution design documents
- Define data mapping specifications
- Design batch and streaming ingestion patterns
- Design secure standardized ingestion interfaces
- Enable data lineage tracking
- Ensure high system availability
- Implement data quality checks
- Integrate on premises databases and APIs
- Lead modernization of legacy ingestion systems
- Optimize multi cloud compute and storage costs
- Optimize pipeline latency
- Provide pipeline engineering technical leadership
Perks/Benefits
- AI Driven Learning Platform
- Career Development Programs
- Community and interest groups
- Discounted health insurance
- Paid parental leave
- Product and service discounts
- Recognition and rewards
- Training and development
- Well-being initiatives
Skills/Tech-stack
API Integration | Amazon Kinesis | Amazon Redshift | Apache Airflow | Apache Spark | Batch Processing | BigQuery | CI/CD | Change Data Capture | Cloud Architecture | DLP | Data Capture | Data Catalog | Data Governance | Data Ingestion | Data Lineage | Data Modeling | Data Partitioning | Data Quality | Data Vault | Encryption | Event Streaming | Google Pub/Sub | IAM | Java | Kafka | Multi-cloud | Pub/Sub | Python | SQL | Scala | Snowflake | Snowflake Schema | Star Schema | Streaming | Terraform
Education
N/A
Roles
Regions
Countries
States
Cities
Related jobs
-
Senior / Staff Applied Scientist - AI Products AUD 130K-160KCalculus | Computer Vision | Data Pipelines | Data Processing | Language ModelsCollaborative boost days | Hybrid working model | Office access | Remote work flexibilitySenior-level Full TimeAU: Melbourne: (260 Burwood Rd) R19h ago
-
Senior Data Engineer AUD 140K-155KCode review | Dimensional Modeling | ELT | ETL | JSONFlexible work hours | Free breakfast | Free snacks | Hybrid work | Live Sports EventsSenior-level Full TimeBrisbane, Queensland, Australia R22h ago
-
AI Agents | API Design | AWS | Agentic Workflows | Amazon BedrockSenior-level Full TimeMelbourne, VIC - 435 Bourke Street, …22h ago
-
Chief Engineer - Engineering Data Platform AUD 150K-200KAPIs | AWS | Artificial Intelligence | CI/CD | ContainersExecutive-level Full TimeEveleigh, NSW - 1 Locomotive Street, …22h ago
-
Senior Designated Support Engineer AUD 150K-186KAWS | Alerting | Amazon Redshift | Apache Spark | AzureSenior-level Full TimeSydney, Australia2d ago
-
Staff Designated Support Engineer AUD 150K-215KAWS | Alerting | Amazon Redshift | Apache Spark | AzureSenior-level Full TimeSydney, Australia2d ago
-
AI Foundry | AWS Bedrock | AWS GovCloud | AWS SageMaker | Agentic AI401k match | Career development resources | Dental and vision insurance | Flexible work arrangements | Medical planSenior-level Full TimeAustralia3d ago
-
APIs | Cloud platform | Debugging | Evaluation Pipelines | Google CloudDirect access to research and engineering experts | High travelMid-level Full TimeSydney NSW, Australia3d ago
-
Digital Analytics Specialist AUD 80K-95KBigQuery | Campaign Manager | Conversion API | Customer Match | Data ModelingMid-level Full TimeMelbourne R3d ago
-
Automation | Azure | Azure Data | Azure Data Explorer | CSVRemote work opportunityMid-level Full TimeAustralia R3d ago
-
Agentic Systems | C# | C++ | Cloud Architecture | Data EngineeringMid-level Full TimeSydney, New South Wales, AUS3d ago
-
Senior Data Engineer AUD 260K-340KAWS RDS | Azure | CDC | DAX | DBTAnnual short term incentive scheme | Hybrid work model | Paid parental leave | Restricted stock awards | Up to 5 weeks annual leaveSenior-level Full TimeSurry Hills, NSW, Australia R4d ago
-
AWS | Apache Spark | Audit Logging | Automated testing | CI/CDSenior-level Full TimeMelbourne, VIC, AU4d ago
-
AWS Glue | AWS IAM | AWS Lake | AWS Lake Formation | AlertingSenior-level Full TimeMelbourne, VIC, AU4d ago
-
Senior AI Engineer, AI Accelerator AUD 143K-180KAgent Design | Amazon Web Services | Artificial Intelligence | Azure OpenAI | CI/CDCareer development opportunities | Convenient location | Free OnePass membership | Hybrid working | Modern end of trip facilitiesSenior-level Full TimeMelbourne, VIC, AU4d ago
-
AI Evaluation | Agentic Workflows | Automation | CI/CD | Data GovernanceCollaborative environment | Contract engagement | Cutting-edge technology exposure | High-impact projects | Remote workSenior-level Full TimeAustralia R4d ago
-
Data Engineer – AI/ML | Google Cloud AUD 110K-140KAPI Integration | Backtesting | BigQuery | Cloud Functions | Cloud MonitoringEmployee discounts | On-site work | Parking providedMid-level Full TimeSydney Olympic Park, New South Wales …4d ago
-
Staff Data Engineer AUD 140K-146KAPI Gateway | AWS DataZone | AWS Glue | AWS Lake | AWS Lake FormationChanging start and finish times | Flexible working arrangements | Hybrid work with office time | Job share | Part-time arrangementsSenior-level Full TimeSydney, NSW - CBP South, 11 …4d ago
-
Embedded Software Engineer AUD 129K-142KBare Metal | C plus plus | CAN | Embedded Linux | I2CAdditional paid leave | Company supported professional development programs | Discounted private health insurance | Flexible working hours | Half day finish on FridaysSenior-level Full TimeBrisbane, Queensland4d ago
-
AI Engineer - South Bank, QLD AUD 70K-138KAzure DevOps | Azure Machine Learning | Bicep | CI/CD | DatabricksEmployee assistance program | Employee discounts | Health and wellness discounts | Internal gym access | Learning and development budgetMid-level Full TimeAustralia, Queensland4d ago
-
Senior Data Engineer AUD 132K-140KAPI | Azure | Azure DevOps | CI/CD | Data LakehouseHybrid work flexibility | Learning and development opportunities | Max term contractSenior-level Full TimeMelbourne, VIC, AU5d ago
-
Automated Workflows | CI/CD | Cloud Native | Containerization | Data LineageCollaborative environment | Inclusive workplace | Professional growthSenior-level Full TimeAustralia5d ago
-
Senior Software Engineer (Data & Distributed Systems) AUD 155K-186KAgile | C# | Cloud | Databricks | Distributed SystemsSenior-level Full TimeSydney5d ago
-
Azure | Azure Data | Azure Data Factory | Azure DevOps | BashHands on Azure experience | Hands on Databricks experience | Professional growthMid-level Full TimeAustralia5d ago
-
Senior AI Engineer AUD 160K-200KAzure | C# | Databricks | Datadog | FastMCPAnnual leave | Flexible working environment | Generous leave | Karbon Days off | Parental leaveSenior-level Full TimeMelbourne, VIC, Australia5d ago