Staff Software Development Engineer - Data Acquisition
Australia - Melbourne Office
AUD 150K-185K (estimate) Senior-level Full Time
Tasks
- Add audit logging and lineage
- Architect scalable software
- Build batch and streaming data pipelines
- Build reference data and hierarchies
- Build relationships and crosswalks
- Build validation components
- Create data contracts
- Create golden records
- Develop APIs
- Develop matching and survivorship
- Establish automated testing
- Implement identity resolution
- Implement retries and reconciliation
- Improve performance reliability observability and security
- Lead enterprise master data management
- Mentor engineers and lead architecture decisions
- Orchestrate pipelines
- Perform production troubleshooting and root cause analysis
- Set up CI CD practices
Perks/Benefits
- N/A
Skills/Tech-stack
AI Assisted Development | API Development | Agents | Amazon S3 | Amazon Web Services | Audit Logging | Automated testing | Batch Processing | CI/CD | Cloud services | DBT | Data Contracts | Data Lineage | Data Management | Data Matching | Data Pipelines | Data Quality | Data Reconciliation | Distributed Systems | Golden Records | Identity resolution | Infrastructure as Code | Java | Kafka | Master Data | Master Data Management | Model APIs | Observability | Orchestration | Python | Reltio | Retrieval-Augmented Generation | Schema evolution | Snowflake | Streaming Data | Survivorship | Web Services | “as-code”
Education
N/A
Roles
Related jobs
-
Senior-level Full TimeAU-NSW-Sydney7h ago
-
AI Engineer EUR 49K-67KAPIs | Azure | CI/CD | Databricks | JavaScriptCollaborative team | Inclusive workplace | On-site work | Professional developmentMid-level Full TimeEssendon, Victoria 3040, Australia13h ago
-
AI and Automation Specialist - Risk AUD 129K-143KAnalytics | Automation | DAX | Data Governance | Data ModelingSenior-level Full TimeSYDNEY, NSW, AU, 200020h ago
-
Senior Software Engineer AUD 165K-205KC plus plus | Cloud services | Database Internals | Distributed Systems | FailoverFertility assistance | Hybrid working model | Parental leaveSenior-level Full TimeSydney R20h ago
-
Senior-level Full TimeMelbourne, Victoria 3000, Australia1d ago
-
Junior Data Scientist AUD 80K-90KDAX | Machine Learning | Power BI | Power Pivot | Power QueryEmployee discounts | Hybrid work | Incentives | Onsite parking | Team learning and knowledge sharingEntry-level Full TimeMacquarie Park, NSW, AU1d ago
-
AWS | AWS CloudFormation | AWS Glue | AWS Lambda | AWS Step FunctionsFlexible work location | Fully remote | Ownership and leadership opportunities | Technical autonomySenior-level Contract Full TimeAustralia R1d ago
-
Forward Deployed Engineer, GenAI, Financial Services AUD 118K-135KAPI Integration | Agent systems | Cloud platform | Cost Optimization | CrewAIMid-level Full TimeSydney NSW, Australia; Melbourne VIC, Australia1d ago
-
Senior Machine Learning Engineer AUD 144K-180KAWS | Algorithms | Anomaly Detection | CI/CD | Cloud platformClassPass membership | Culture Swap Days | Employee resource groups | Extra annual leave | Flexible work hoursSenior-level Full TimeSydney, Australia R1d ago
-
Senior Machine Learning Engineer AUD 144K-180KAWS | Algorithms | Anomaly Detection | Azure | CI/CDClassPass membership | Employee resource groups | Extra annual leave | Flexible work | Learning and developmentSenior-level Full TimeMelbourne, Australia R1d ago
-
Agent workflows | Data | Deployment | Integration | JavaScriptCareer growth opportunities | Direct influence on customer success | Flexible working hours | Remote-friendly | Work with talented technical teamMid-level Full TimeAustralia1d ago
-
Principal Data Engineer AUD 150K-165KAWS CloudFormation | Amazon Kinesis | Apache Airflow | Apache Kafka | Apache SparkSenior-level Full TimeDOCKLANDS, VIC, AU, 30081d ago
-
Data Engineer AUD 100K-130KAWS | AWS CDK | AWS Glue | Apache Airflow | Apache FlinkExtra annual leave | Leadership development programs | LinkedIn Learning | Perkbox discountsMid-level Full TimeSydney, Australia1d ago
-
Senior Data Engineer - Data Platform AUD 120K-140KAPIs | AWS | AWS Cloud | AWS Cloud Development Kit | AWS GlueCollaborative work culture | Extra annual leave days | Innovation culture | Leadership development programs | LinkedIn LearningSenior-level Full TimeSydney, Australia1d ago
-
AI Engineering Lead AUD 137K-143KAgile | Amazon Web Services | Docker | IAM | LoggingDiscounted flights | Discounts on accommodation | Discounts on car hire | Discounts on experiences | Discounts on lounge membershipSenior-level Full TimeBrisbane, Sydney R2d ago
-
Applied AI Engineer - ANZ USD 180K-225KAgentic Workflows | DeepWiki | Developer Enablement | JavaScript | LLMSenior-level Full TimeSydney2d ago
-
Data Engineer - Data Platforms AUD 90K-120KAWS | Apache Flink | Automation | CI/CD | DBTHybrid work model | Office collaboration days | Remote work flexibilityMid-level Full TimeAU: Melbourne: (260 Burwood Rd)2d ago
-
Data Pipelines | Deep learning | Generative AI | Image Generation | Infrastructure EngineeringAnnual wellbeing allowance | Equity packages | Flexible leave options | Inclusive parental leaveSenior-level Full TimeSydney, Australia R2d ago
-
Senior Data Engineer AUD 121K-136KApache Airflow | Apache Spark | Cloud Computing | Data Modeling | Data WarehousingSenior-level Full TimeCity Campus, Australia2d ago
-
Staff Gen AI Engineer, Forward Deployed, Google Cloud AUD 152K-180KAgent systems | Cloud platform | Cost Optimization | Evaluation | Generative AISenior-level Full TimeSydney NSW, Australia3d ago
-
Senior Embedded Linux Software Engineer – Edge AI & IoT AUD 120K-150KAudio signal processing | C# | C++ | CSI | Cloud APIsSenior-level Full TimeRyde, NSW, Australia3d ago
-
API Integration | Access Control | Audit Logging | Automated Quality | Automated quality gatesAnnual company offsite gatherings | Annual professional development budget | Coworking allowance | Dependent coverage support | Employee equityMid-level Full TimeAustralia R3d ago
-
Data Engineer AUD 100K-110KAccess Control | Data Governance | Data Modeling | Data Quality | Data integrationBi-weekly breakfasts | Clothing allowance | Culture incentives | Employee discount | Flexible working arrangementsMid-level Full TimeMascot, New South Wales 2020, Australia3d ago
-
Solution Designer / Lead Data Engineer AUD 135K-158KAPI Integration | Amazon Kinesis | Amazon Redshift | Apache Airflow | Apache SparkAI Driven Learning Platform | Career Development Programs | Community and interest groups | Discounted health insurance | Paid parental leaveSenior-level Full TimeSydney, NSW, Australia3d ago
-
Senior Machine Learning Engineer (Platform / MLOPs) AUD 129K-150KAPI Development | Amazon EKS | ArgoCD | Arize AI | Batch inferenceAnnual flu vaccinations | Cycling friendly | Hybrid flexibility | In-office lunch | Quarterly wellbeing day offSenior-level Full TimeBarangaroo, NSW, Australia3d ago