Solution Designer / Lead Data Engineer
Sydney, NSW, Australia
AUD 135K-158K (estimate) Senior-level Full Time
Tasks
- Architect data ingestion framework
- Build high-throughput data pipelines
- Configure encryption and governance controls
- Create solution design documents
- Define data mapping specifications
- Design batch and streaming ingestion patterns
- Design secure standardized ingestion interfaces
- Enable data lineage tracking
- Ensure high system availability
- Implement data quality checks
- Integrate on premises databases and APIs
- Lead modernization of legacy ingestion systems
- Optimize multi cloud compute and storage costs
- Optimize pipeline latency
- Provide pipeline engineering technical leadership
Perks/Benefits
- AI Driven Learning Platform
- Career Development Programs
- Community and interest groups
- Discounted health insurance
- Paid parental leave
- Product and service discounts
- Recognition and rewards
- Training and development
- Well-being initiatives
Skills/Tech-stack
API Integration | Amazon Kinesis | Amazon Redshift | Apache Airflow | Apache Spark | Batch Processing | BigQuery | CI/CD | Change Data Capture | Cloud Architecture | DLP | Data Capture | Data Catalog | Data Governance | Data Ingestion | Data Lineage | Data Modeling | Data Partitioning | Data Quality | Data Vault | Encryption | Event Streaming | Google Pub/Sub | IAM | Java | Kafka | Multi-cloud | Pub/Sub | Python | SQL | Scala | Snowflake | Snowflake Schema | Star Schema | Streaming | Terraform
Education
N/A
Roles
Regions
Countries
States
Cities
Related jobs
-
Data Platforms Engineer (Azure DataBricks) AUD 129K-138KApache Spark | Azure Data | Azure Data Factory | Azure DevOps | CI/CDAccess to professional memberships and industry networks | Discounted services | Employee assistance program | Flexible work arrangements | Parental leaveSenior-level Full TimeNorth Ryde, NSW, Australia15h ago
-
Senior LLMOps Engineer AUD 147K-180KAlerting | Dashboarding | Data Modeling | Data Pipelines | DatadogEquity | Fertility support | Health and wellness allowance | Home office budget | Learning and development budgetSenior-level Full TimeMelbourne R20h ago
-
Data Engineer AUD 130K-165KAgile | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageDiversity and inclusion | Hybrid working | Professional growthSenior-level Full TimeMelbourne, Australia1d ago
-
Staff Data Engineer (AWS Cloud and AI) AUD 135K-140KAPI Gateway | AWS | AWS API | AWS API Gateway | AWS DataZoneFlexible workingSenior-level Full TimeSydney, NSW - CBP South, 11 …1d ago
-
Senior-level Full TimeSydney, NSW - CBP South, 11 …1d ago
-
Senior Engineer, Database AUD 130K-150KAgile | Azure | Azure DevOps | Azure SQL | CI/CDAdditional rest day | Discounted health insurance | Flexible working | Hybrid working | Volunteer daySenior-level Full TimeSydney, Australia1d ago
-
Forward Deployed Engineer GBP 25K-25K100GbE | C++ | Distributed Systems | Docker | File systemsOn-site work option | Travel up to 25 percentSenior-level Full TimeAustralia, AU R1d ago
-
AWS | Access Management | CI/CD | Data Engineering | Data platformFlexible working options | Market-leading parental leave | Paid volunteering days | Retail discounts | Return to work support packageSenior-level Full TimeSydney, NSW, AU2d ago
-
AI Solutions Architect AUD 180K-200KAI Enterprise | AWS | Architecture Documentation | Artificial Intelligence | AzureBereavement leave | Disability insurance | Employee assistance program | Health insurance | Life insuranceSenior-level Full TimeSydney, AUS-NSW, Australia2d ago
-
Bash | Data Processing | Docker | GCP | Infrastructure as CodeAsynchronous work culture | Friendly laid-back atmosphere | Hands-off management | Opportunity for high-impact workMid-level Full TimeMelbourne, Australia3d ago
-
Quantum Applications Architect AUD 120K-158KBenchmarking | C++ | Complexity Theory | Fault Tolerant Quantum | Fault-tolerantSenior-level Full TimeBrisbane, Queensland, Australia3d ago
-
Senior-level Full TimeAU-NSW-Sydney3d ago
-
Computer Vision | Deep learning | Diffusion Models | Docker | Generative AIEquity package | Flexible leave options | Flexible work arrangements | Parental leave | Professional growth opportunitiesSenior-level Full TimeAustralia R3d ago
-
AI Engineer EUR 49K-67KAPIs | Azure | CI/CD | Databricks | JavaScriptCollaborative team | Inclusive workplace | On-site work | Professional developmentMid-level Full TimeEssendon, Victoria 3040, Australia3d ago
-
AI and Automation Specialist - Risk AUD 129K-143KAnalytics | Automation | DAX | Data Governance | Data ModelingSenior-level Full TimeSYDNEY, NSW, AU, 20004d ago
-
Staff Software Development Engineer - Data Acquisition AUD 150K-185KAI Assisted Development | API Development | Agents | Amazon S3 | Amazon Web ServicesSenior-level Full TimeAustralia - Melbourne Office4d ago
-
Staff Data Engineer AUD 129K-140KBatch Processing | Big Data | CI/CD | Data Cleansing | Data EngineeringSenior-level Full TimeMelbourne, VIC - 435 Bourke Street, …4d ago
-
Senior Data Scientist, ML, NLP, GenAI, Agentic AI AUD 137K-147KAdversarial Testing | Agentic AI | CI/CD | Data Governance | Data QualitySenior-level Full TimeEveleigh, NSW - 1 Locomotive Street, …4d ago
-
AI Engineer AUD 132K-180KAWS | Agent Development | Amazon Bedrock | Artificial Intelligence | AutomationFlexible hours | Free food and snacks | Opportunity to drive projects | Socials and Community Groups | Training and developmentSenior-level Full TimeMelbourne, Victoria, Australia R4d ago
-
Senior-level Full TimeMelbourne, Victoria 3000, Australia4d ago
-
Junior Data Scientist AUD 80K-90KDAX | Machine Learning | Power BI | Power Pivot | Power QueryEmployee discounts | Hybrid work | Incentives | Onsite parking | Team learning and knowledge sharingEntry-level Full TimeMacquarie Park, NSW, AU4d ago
-
AWS | AWS CloudFormation | AWS Glue | AWS Lambda | AWS Step FunctionsFlexible work location | Fully remote | Ownership and leadership opportunities | Technical autonomySenior-level Contract Full TimeAustralia R4d ago
-
Forward Deployed Engineer, GenAI, Financial Services AUD 118K-135KAPI Integration | Agent systems | Cloud platform | Cost Optimization | CrewAIMid-level Full TimeSydney NSW, Australia; Melbourne VIC, Australia4d ago
-
Senior Machine Learning Engineer AUD 144K-180KAWS | Algorithms | Anomaly Detection | CI/CD | Cloud platformClassPass membership | Culture Swap Days | Employee resource groups | Extra annual leave | Flexible work hoursSenior-level Full TimeSydney, Australia R4d ago
-
Senior Machine Learning Engineer AUD 144K-180KAWS | Algorithms | Anomaly Detection | Azure | CI/CDClassPass membership | Employee resource groups | Extra annual leave | Flexible work | Learning and developmentSenior-level Full TimeMelbourne, Australia R4d ago