Software Engineer, Data Infrastructure & Acquisition - Sydney, Australia
Tasks
- Build dataset roadmap for AI team
- Collaborate with scientists on dataset cost throughput quality
- Extend ingestion pipeline with Terraform
- Find new audio data sources
- Ingest audio data into ingestion pipeline
- Operate and extend cloud ingestion infrastructure
- Script data collection and processing in Linux
Perks/Benefits
- Asynchronous culture
- Competitive salary
- Entrepreneurial team
- Flexible remote work
- Friendly work environment
- Inclusive workplace
Skills/Tech-stack
Bash | Data Processing | Docker | GCP | Infrastructure as Code | Linux | Python | Terraform | Web Crawling | “as-code”
Education
Roles
Regions
Countries
States
Cities
Related jobs
-
Data Engineer AUD 110K-140KAPIs | Azure | Azure Data | Azure Data Factory | Azure DevOpsCareer progression opportunities | Community partnerships | Flexibility in work location | Volunteering opportunitiesMid-level Full TimeMelbourne, VIC, AU1d ago
-
Data Engineer AUD 100K-120KAsynchronous programming | Azure DevOps | CI/CD | Data Quality | Data ReconciliationCoaching and career development | Flexible work arrangements | Flexible working options | Flu vaccinations | Health and wellbeing programMid-level Full TimeSydney, NSW, AU1d ago
-
Principal Data Platform Engineer AUD 150K-185KAWS | Airflow | Amazon Kinesis | Apache Spark | ArgoCDAutonomy | High-impact projects | Influence | Room to grow | Senior mentorshipSenior-level Full TimeSydney, New South Wales, Australia1d ago
-
Data Engineer AUD 118K-127KAWS | AWS Data | AWS Data Factory | AWS Glue | AgileDiscounted health insurance | Paid parental leave | Paid training | Product and service discounts | Wellbeing initiativesMid-level Full TimeMelbourne, VIC, Australia1d ago
-
Data Engineer AUD 110K-140KAPI Integration | Azure Data | Azure Data Factory | Azure DevOps | Azure SynapseMid-level Full TimeMelbourne, VIC, AU2d ago
-
APIs | Cloud platform | Debugging | Google Cloud | Google Cloud PlatformDirect access to engineering support | High travelMid-level Full TimeSydney NSW, Australia2d ago
-
Data Engineer AUD 100K-126KAzure | Cloud Architecture | Data Architecture | Data Ingestion | Data ModelingAnnual training allowance | Career progression pathways | Corporate discounts | Employee assistance program | Employee recognition programsMid-level Full TimeMelbourne, Victoria 3000, Australia2d ago
-
GIS Data Engineer AUD 90K-112KAWS | Apache Spark | Azure | Azure Data | Azure Data FactoryCareer development | Flex leave | Flexible work arrangements | Paid parental leave | Wellness incentiveSenior-level Full TimePerth, WA, AU, 60002d ago
-
Data Engineer AUD 100K-126KAzure | Cloud Architecture | Data Ingestion | Data Modeling | Data integrationAnnual training allowance | Career progression pathways | Corporate discounts | Employee assistance program | Employee recognition programsMid-level Full TimeAdelaide, South Australia 5000, Australia2d ago
-
Senior Data Engineer - Data Platform AUD 135K-142KAPI Integration | AWS | AWS Glue | Apache Airflow | Apache FlinkExtra days of annual leave | Leadership development programs | LinkedIn Learning | Perkbox discountsSenior-level Full TimeSydney, Australia2d ago
-
Senior Data Engineer - Data Platform AUD 135K-142KAWS | AWS CDK | AWS Glue | Apache Airflow | Apache FlinkExtra days of annual leave | Leadership development programs | LinkedIn Learning | Performance-Based Incentives | Perkbox discountsSenior-level Full TimePyrmont, New South Wales, Australia2d ago
-
AI Agents | AWS CDK | AWS Cloud | AWS CloudFormation | Access ManagementSenior-level Full TimePerth, Western Australia, AUS2d ago
-
.NET | AWS CDK | AWS CloudFormation | Amazon CloudWatch | Amazon Web ServicesSenior-level Full TimePerth, Western Australia, AUS2d ago
-
Data Engineer AUD 146K-146KAnalytics | Automated testing | CI/CD | Data Governance | Data LineageAdditional paid volunteering | Annual leave | Certification support | Flexible work options | Membership supportSenior-level Full TimeAdelaide, AU2d ago
-
Data Platform Engineer AUD 100K-125KAlerting | Apache Airflow | Automation | Azure Data | Azure Data FactoryFlexible work arrangements | Paid parental leave | Paid volunteering days | Part-time options | Professional development reimbursementSenior-level Full TimeSydney, NSW, AU2d ago
-
Data Scientist, People Analytics AUD 129K-142KAWS | AWS Glue | AWS Lambda | Amazon Bedrock | Amazon S3Career development opportunities | TrainingSenior-level Full TimeSydney, NSW - CBP North, 1 …3d ago
-
Data Engineer - 12 Month Opportunity AUD 110K-140KAWS | Agile | Artificial Intelligence | Bash | Business IntelligenceAll-team events | Hybrid social events | Learning and development | Team discounts | Volunteer leaveMid-level Full TimeMelbourne, VIC, AU R4d ago
-
Senior Applied AI Engineer AUD 119K-161KAgent Orchestration | Agent systems | Bias Testing | Context engineering | Evaluation datasetsCoaching | Equity | Extended end of year break | Home workspace setup budget | Inclusive parental leaveSenior-level Full TimeMelbourne4d ago
-
Staff Machine Learning Engineer - Recommendations AUD 119K-136KData-Driven Decision Making | Data-driven | Decision Making | Machine Learning | Model EvaluationEquity packages | Flexible leave options | Parental leave | Virtual interviews | Wellbeing allowanceSenior-level Full TimeSydney, Australia4d ago
-
Mid-level Full TimeAU: Sydney (45 Clarence St)4d ago
-
Data pipeline | Debugging | Inference Optimization | Java | KubernetesFlexible leave options | Flexible work hours | Inclusive parental leave | Office setup allowance | Remote friendly within AustraliaSenior-level Full TimeSydney, Australia4d ago
-
Applied AI Engineer AUD 70K-97KAgent architecture | CI/CD | Data pipeline | Docker | Infrastructure as CodeFlexible work arrangements | Leadership programs | Learning programs | Paid parental leave | Paid volunteering daysSenior-level Full TimeMelbourne, VIC, AU4d ago
-
Data Engineer AUD 113K-117KAzure Data | Azure Data Factory | Azure Databricks | Azure Synapse | Azure Synapse AnalyticsDiscounts | Flexible working | Growth opportunities | Inclusive culture | Paid leaveMid-level Full TimeVIC - Melbourne - 655 Collins …4d ago
-
Forward Deployed AI Engineer AUD 80K-91KAI Governance | APIs | Agent Frameworks | Cloud Computing | Data PrivacyAdditional leave types | Discounted health insurance | Flexible work arrangements | Lifestyle discounts | On going training and developmentEntry-level Full TimeGarvan / TKCC Sydney, Australia4d ago
-
Apache Spark | Azure Blob | Azure Blob Storage | Azure Data | Azure Data FactorySenior-level Full TimeSydney, International House, 3 Sussex St, …4d ago