Software Engineer, Data Infrastructure & Acquisition - Auckland, New Zealand
Tasks
- Build data processing workflows for large scale datasets
- Collaborate on dataset roadmap
- Develop Linux scripting for data pipelines
- Find new audio data sources
- Ingest data into ingestion pipeline
- Manage infrastructure with Terraform
- Operate and extend GCP ingestion infrastructure
- Work with scientists to improve dataset cost throughput quality
Perks/Benefits
- N/A
Skills/Tech-stack
Bash | Cloud platform | Data Ingestion | Data Processing | Docker | GCP | Google Cloud | Google Cloud Platform | Infrastructure as Code | Large Scale Data | Large-scale | Large-scale Data Processing | Linux | Python | Terraform | Web Crawling | “as-code”
Education
Roles
Related jobs
-
Senior Data Engineer NZD 120K-143K.NET | Azure DevOps | Bitbucket | CI/CD | Data AnalysisCareer development | Flexible working | Generous leave offering | Learning opportunitiesSenior-level Full TimeBNZ Place Wellington, 1 Whitmore Street, …3d ago
-
Senior Data Engineer NZD 119K-141KAzure | Batch Processing | BigQuery | Cosmos DB | DBTConfidential counseling | Employee retirement contributions | Free flu shots | Health insurance | Learning & development platformSenior-level Full TimeAuckland, Auckland, New Zealand3d ago
-
Senior Software Engineer - Team Lead (Data Engineering) NZD 123K-150KAI orchestration | APIs | Access Control | Agents | Cloud PlatformsEnhanced paid parental leave | Hybrid working | Life insurance | Medical insurance | Mentoring and career developmentSenior-level Full TimeAuckland, Auckland, New Zealand5d ago
-
Software Engineer - Data Engineering NZD 95K-120KAPIs | Access Control | Automated testing | CI/CD | Cloud PlatformsCareer development | Hybrid working | Life insurance | Medical insurance | MentoringMid-level Full TimeAuckland, Auckland, New Zealand5d ago
-
Group IT Data Engineer – Data & AI NZD 80K-100KAzure | Azure DevOps | CI/CD | Confluence | Data ModelingEmployee discounts | KiwiSaver employer contributions | Life insurance | Medical insurance | Ongoing training and developmentMid-level Full TimeAUK Rockridge Avenue, New Zealand5d ago
-
Contract - Senior Consultant - Data NZD 119K-140KAWS | Amazon Redshift | Apache Spark | Azure | Azure DevOpsChill-out spaces | Flexi hours | Professional development courses | Remote Working | Social eventsSenior-level Contract Full TimeAuckland, Auckland, New Zealand5d ago
-
Data Engineer - Simply Energy NZD 145K-155KBigQuery | Cloud platform | Data Engineering | Data Modeling | Data PipelinesAccess to company shares | Flexible working | Free health insurance | Home setup payment | KiwiSaver boostSenior-level Full TimeWellington, Wellington, New Zealand5d ago
-
Data Engineer NZD 50K-50KApache Airflow | Azure | Azure DevOps | Bash | CI/CDBirthday off | Career development opportunities | EV charging | Employee discounts | Free car parkingEntry-level Full TimeAuckland, Auckland, New Zealand6d ago
-
AI Engineer NZD 97K-122KAmazon Web Services | Apache Airflow | Azure | Azure Data | Azure Data FactoryMid-level Full TimeAuckland, Auckland, New Zealand6d ago
-
Data Engineer NZD 142K-163KAzure | CI/CD | DBT | Data Modelling | Data WarehousingAdditional leave options | Fitness passport | Flexible working arrangements | Generous parental leave | Learning and development opportunitiesMid-level Full TimeWellington, New Zealand10d ago
-
Senior Data Engineer NZD 132K-145KAgile | Apache Airflow | CI/CD | DB2 | DevOpsBanking benefits | Employee recognition | Insurance discounts | Internal mobility | Paid holidaySenior-level Full TimeWestpac on Takutai Square, New Zealand17d ago
-
Senior AI & Data Engineer NZD 110K-136KAI Assistant | Azure Data | Azure Data Platform | Data Engineering | Data GovernanceSenior-level Full TimeAuckland, Auckland, New Zealand17d ago
-
CI/CD | Cloud services | Computer Vision | Containerization | Data PreprocessingMid-level Full TimeChristchurch, New Zealand18d ago
-
Braintrust | LLM Accuracy | Langfuse | NumPy | OntologyFamily-friendly benefits | Flexible schedule | Hybrid work schedule | Internal promotion opportunitiesSenior-level Contract Full TimeAuckland R18d ago
-
Principal AI Solution Engineer NZD 132K-152KAPI | Access Control | AgentOps | Agentic Workflows | AutomationEmployee discounts | Flexible hours | Lifestyle leave | Southern cross health insurance | Work from home flexibilitySenior-level Full TimeAuckland, NZ27d ago
-
Azure | CI/CD | Data Modeling | Data Quality | Data TestingCareer growth | Hybrid work | Professional development | Supportive teamSenior-level Full TimeAuckland, New Zealand28d ago
-
Data Engineer - SMARTLY NZD 120K-145KCI/CD | Cloud infrastructure | Data Modeling | Data Pipelines | Data QualityCompany events | Flexible working | Meals provided | Work from homeSenior-level Full TimeAuckland, Auckland, New Zealand1mo ago
-
Senior/Tech Lead - AI Development NZD 136K-155KAI Foundry | AI Search | AWS Bedrock | Amazon SageMaker | Artificial IntelligenceChill-out spaces | Flexi hours | Professional development courses | Remote Working | Social eventsSenior-level Full TimeAuckland, Auckland, New Zealand1mo ago