Software Engineer, Data Infrastructure & Acquisition - Johannesburg, South Africa
Johannesburg, South Africa
ZAR 480K-580K (estimate) Mid-level Full Time
Tasks
- Build dataset roadmap for AI team
- Collaborate with scientists on dataset quality cost throughput
- Find new audio data sources
- Ingest data into ingestion pipeline
- Manage ingestion pipeline with Terraform
- Operate and extend cloud infrastructure for ingestion pipeline
Perks/Benefits
- N/A
Skills/Tech-stack
Bash | Cloud platform | Data Processing | Docker | Google Cloud | Google Cloud Platform | Linux | Python | Terraform | Web Crawling
Education
Roles
Related jobs
-
Senior-level Full TimeCape Town1d ago
-
Entry-level Full TimeStellenbosch, ZA1d ago
-
Senior Specialist Machine Learning Engineer ZAR 700K-840KAWS EC2 | AWS IAM | AWS S3 | Access Control | Amazon CloudWatchMedical aid | Retirement benefits | Risk benefitsSenior-level Full TimeMidrand, ZA2d ago
-
Senior Machine Learning Engineer ZAR 745K-860KAWS SageMaker | AWS Sagemaker Endpoints | Agile | Amazon Web Services | Big DataBirthday leave | Confidential counselling | Financial guidance | Free parking | Legal supportSenior-level Full TimeSouth Africa3d ago
-
Senior Machine Learning Engineer ZAR 745K-860KAWS | Agile | Big Data | BigQuery | Cloud platformBirthday leave | Confidential counselling | Financial guidance | Free parking | Free subscription takealotMORESenior-level Full TimeSouth Africa3d ago
-
Apache Spark | Azure Data | Azure Data Factory | Azure Databricks | Azure EventMid-level ContractSandton, South Africa3d ago
-
API | AWS | AWS Lambda | Amazon RDS | Amazon S3Autonomy | Collaborative team | Continuous learning | High ownership | Professional growthSenior-level Full TimeSouth Africa3d ago
-
Senior Data Scientist (Azure Data Engineering & MLOps) ZAR 900K-1200KApache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Contract Full TimeCape Town, Western Cape, South Africa3d ago
-
Senior Data Scientist (Azure Data Engineering & MLOps) ZAR 900K-1200KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DatabricksSenior-level Contract Full TimeCape Town, Western Cape, South Africa3d ago
-
Specialist Support Engineer: DataOps ZAR 420K-464KApache Spark | Batch Processing | Cloud Migration | Data Modeling | Data StreamingMid-level Full Time15 Alice Lane, South Africa3d ago
-
AI readiness | AWS | Access Management | Architecture | AsanaCareer growth opportunities | Customer facing exposure | Remote workSenior-level Full TimeHonduras - Tegucigalpa4d ago
-
AWS | Access Control | Access Management | Azure | Cloud hybridRemote workSenior-level Full TimeArgentina - Buenos Aires4d ago
-
Agile | Amazon Redshift | Amazon Web Services | Apache Airflow | Apache IcebergRemote workMid-level Full TimeSouth Africa - Cape Town4d ago
-
Technology/Domain Specialist II - Kafka (OVA5718) ZAR 360K-420KACLs | Ansible | Apache Kafka | Azure | Azure MonitorMid-level Full TimeJohannesburg, South Africa4d ago
-
Azure Bot | Azure Bot Service | Azure Cognitive | Azure Cognitive Services | Azure Machine LearningMid-level Full TimeMidrand, South Africa5d ago
-
Alerting | Amazon Aurora | Amazon Aurora PostgreSQL | Amazon Redshift | Anomaly DetectionContinuous improvement opportunities | Cross-functional collaboration | Fully remote work | Ownership over data reliability strategySenior-level Full TimeSouth Africa R5d ago
-
AI Engineering - Master Specialist ZAR 780K-920KApache Kafka | Apache Spark | C++ | CUDA | Cloud ComputingSenior-level Full TimeJohannesburg, ZA5d ago
-
Senior Data Engineer ZAR 1100K-1200KAPI | Apache Flink | Apache Spark | Apache Spark Streaming | Azure DataSenior-level Full TimeSouth Africa8d ago
-
Data Engineer ZAR 300K-420KAWS | Apache Airflow | Azure | Azure Data | Azure Data LakeFlexible team culture | Inclusive and diverse workplace | Support for employment equityMid-level Full TimeCenturion, GP, South Africa8d ago
-
Specialist - Data Engineer.MTN Software Solutions ZAR 464K-480KApache Hadoop | Apache Kafka | Apache Spark | Data Modeling | Data PipelinesMid-level Full TimeRoodepoort, Gauteng, South Africa9d ago
-
Cloud Data Engineers (OVA5720) ZAR 348K-420KAPI Integration | Apache Spark | Azure Data | Azure Data Factory | Azure EventHybrid work modelMid-level Full TimeJohannesburg, South Africa9d ago
-
Senior-level Full TimeCape Town11d ago
-
Data Engineer ZAR 396K-456KAPI Development | AWS | Apache Spark | Automation | CI/CDCareer development opportunities | Employee discounts | Hybrid working | Paid sabbaticals | Paid time offSenior-level Full TimeCape Town, Western Cape, South Africa R11d ago
-
Data Engineer ZAR 780K-920K.NET | Analysis Services | Apache Storm | Azure Data Factory | BashHybrid workSenior-level Full TimeJohannesburg, South Africa11d ago
-
Apache Airflow | Apache Atlas | Apache NiFi | Azure Data | Azure Data FactoryMid-level Full TimeJohannesburg, South Africa13d ago