Solution Designer / Lead Data Engineer
Sydney, NSW, Australia
AUD 135K-158K (estimate) Senior-level Full Time
Tasks
- Architect data ingestion framework
- Build high-throughput data pipelines
- Configure encryption and governance controls
- Create solution design documents
- Define data mapping specifications
- Design batch and streaming ingestion patterns
- Design secure standardized ingestion interfaces
- Enable data lineage tracking
- Ensure high system availability
- Implement data quality checks
- Integrate on premises databases and APIs
- Lead modernization of legacy ingestion systems
- Optimize multi cloud compute and storage costs
- Optimize pipeline latency
- Provide pipeline engineering technical leadership
Perks/Benefits
- AI Driven Learning Platform
- Career Development Programs
- Community and interest groups
- Discounted health insurance
- Paid parental leave
- Product and service discounts
- Recognition and rewards
- Training and development
- Well-being initiatives
Skills/Tech-stack
API Integration | Amazon Kinesis | Amazon Redshift | Apache Airflow | Apache Spark | Batch Processing | BigQuery | CI/CD | Change Data Capture | Cloud Architecture | DLP | Data Capture | Data Catalog | Data Governance | Data Ingestion | Data Lineage | Data Modeling | Data Partitioning | Data Quality | Data Vault | Encryption | Event Streaming | Google Pub/Sub | IAM | Java | Kafka | Multi-cloud | Pub/Sub | Python | SQL | Scala | Snowflake | Snowflake Schema | Star Schema | Streaming | Terraform
Education
N/A
Roles
Regions
Countries
States
Cities
Related jobs
-
Staff Gen AI Engineer, Forward Deployed, Google Cloud AUD 152K-180KAgent systems | Cloud platform | Cost Optimization | Evaluation | Generative AISenior-level Full TimeSydney NSW, Australia6h ago
-
Senior Embedded Linux Software Engineer – Edge AI & IoT AUD 120K-150KAudio signal processing | C# | C++ | CSI | Cloud APIsSenior-level Full TimeRyde, NSW, Australia9h ago
-
Senior Machine Learning Engineer (Platform / MLOPs) AUD 129K-150KAPI Development | Amazon EKS | ArgoCD | Arize AI | Batch inferenceAnnual flu vaccinations | Cycling friendly | Hybrid flexibility | In-office lunch | Quarterly wellbeing day offSenior-level Full TimeBarangaroo, NSW, Australia14h ago
-
Advanced Analytics Analyst AUD 95K-100KAWS | Agile | Artificial Intelligence | Data Visualization | Machine LearningEntry-level Full TimeSydney, NSW - CBP South, 11 …17h ago
-
AI Solutions Architect AUD 180K-200KAI Enterprise | AI architecture | AI infrastructure | AWS | Artificial IntelligenceBereavement leave | Disability insurance | Employee assistance program | Health insurance | Life insuranceSenior-level Full TimeSydney, AUS-NSW, Australia1d ago
-
Machine Learning Engineer (Content Understanding) Intern, (TikTok Live Foundation Sydney) - 2027 start (PhD) AUD 65K-70KC++ | Computer Vision | Deep learning | Distributed Systems | GoEntry-level InternshipSydney, New South Wales, Australia1d ago
-
Senior Robotics Software Engineer, Payload Integration AUD 147K-196KAPI Design | ARINC | Bare Metal | C++ | DO-178CComprehensive benefits package | Health benefits | Paid travel opportunities | Recovery BenefitsSenior-level Full TimeSydney, New South Wales, Australia1d ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerAsynchronous culture | Competitive salary | Friendly laid-back atmosphere | Opportunities for impact on learningMid-level Full TimeSydney, Australia1d ago
-
Data Engineer, AI and Data, Technology Consulting AUD 89K-112KAWS | Apache Airflow | Apache Spark | Azure Data | Azure Data FactoryCareer development | Comprehensive benefits package | Flex leave | Flexible work arrangements | Paid parental leaveMid-level Full TimeMelbourne, VIC, AU, 30001d ago
-
Forward Deployed AI Engineer, Australia AUD 119K-161KAWS | Agentic Workflows | Apache Iceberg | Apache NiFi | Apache SparkContinued Career Development | Employee resource groups | Flexible WFH | Generous PTO | Mental and physical wellness programsSenior-level Full TimeAustralia-Sydney-Remote R1d ago
-
Data Engineer AUD 140K-140KAWS | AWS Glue | Airflow | Amazon Athena | Amazon DataZoneFlexible working | Hybrid working | Inclusion networks | Wellbeing supportSenior-level Full TimeSydney Office, Australia1d ago
-
Principal Data Engineer (AWS & Snowflake) AUD 146K-155KAWS | Agile | CI/CD | Data Lake | Data WarehouseFlexible start and finish times | Flexible work arrangements | Job share | Part-time optionsSenior-level Full TimeSydney, NSW - CBP North, 1 …1d ago
-
Data Platform Engineer AUD 100K-125KAggregation | Alteryx | Cloud platform | Continuous integration | CrosstabCareer growth opportunities | Free coffee | Hybrid work | Regular team events | Weekly lunchesMid-level Full TimeChippendale, New South Wales, Australia1d ago
-
Senior AI Engineer AUD 143K-165K.NET | AI Evaluation | AI Search | AI Security | Adversarial TestingHybrid work | Security clearance supportSenior-level Full TimeCanberra, Australian Capital Territory, Australia2d ago
-
Azure AI Developer Consultant AUD 130K-165K.NET | API Management | App Service | Azure API | Azure API ManagementFlexible work hours | Home and office split work | Hybrid work environment | Onsite customer presence as neededSenior-level Full TimeSydney, NSW, AU3d ago
-
Senior-level Full TimeSurry Hills, Australia3d ago
-
Data Scientist, Marketing AUD 106K-116KAWS | Apache Spark | Artificial Intelligence | Azure | Cloud platformCareer development | Flexible working | Health and wellbeing initiatives | On campus childcare | Paid parental leaveMid-level Full TimeSt Lucia Campus, Australia3d ago
-
Senior Data Engineers AUD 150K-190KData Factory | Data Modeling | Delta Lake | Dimensional data | Dimensional data modelingSenior-level Full TimeMelbourne, Victoria 3000, Australia4d ago
-
Senior AI Software Engineer - 12 month fixed term AUD 100K-120KAPI Integration | AWS Lambda | Amazon Web Services | CI/CD | Database MigrationHybrid work | Loyalty leave | Paid parental leave | Wellbeing programs | Wellness initiativesSenior-level Full Time TemporarySydney, NSW, Australia4d ago
-
Solution Designer / Lead Data Engineer (Google Cloud) AUD 130K-158KAPI Integration | Airflow | Apache Beam | BigQuery | CDCAI Driven Learning Platform | Career development training | Discounted health insurance | Paid parental leave | Performance recognition and rewardsSenior-level Full TimeSydney, NSW, Australia4d ago
-
Data Integration Developer AUD 113K-125KAzure Data | Azure Data Factory | CI/CD | Continuous Delivery | Continuous integration24 7 operating environment | Flexible work options | On-call supportMid-level Full TimeMacquarie Park, NSW, AU, 21134d ago
-
Applied AI Specialist AUD 152K-180KAPIs | Anomaly Detection | Cloud Architecture | Computer Vision | Data GovernanceContinued career development access | Employee resource groups | Flexible WFH policy | Generous PTO policy | Paid volunteer timeSenior-level Full TimeAustralia-New South Wales-Sydney4d ago
-
Lead Data Engineer AUD 135K-140KAI Tooling | Access Control | Analytics Platforms | Automation | Cloud DataAccess to employee share plan | Additional support leave | Challenger Day extra day off | Discretionary bonus scheme | Extra superannuation contributionsSenior-level Full TimeNSW - 5 Martin Place, Australia4d ago
-
Senior Data Engineer AUD 102K-114KAPI Development | AWS | AWS CDK | Apache Airflow | Apache KafkaCommunity grants | Community support programs | Flexible leave options | Flexible parental leave | HackdaysSenior-level Full TimeRichmond, Melbourne VIC, Australia4d ago
-
AI Engineer AUD 60K-60KAgile | Azure | C# | Cloud platform | Generative AIAnnual festive gifts | Career development support | Discounted food and drinks | Employee benefits program | Free OnePass membershipSenior-level Full TimeSupport Office VIC, Australia4d ago