Software Engineer, Data Infrastructure & Acquisition
Tasks
- Build scalable data ingestion pipelines
- Collaborate on architecture and roadmap decisions
- Improve dataset quality with AI teams
- Integrate new external audio data sources
- Integrate new external web data sources
- Maintain data acquisition systems
- Optimize data pipelines for throughput and cost
- Scale cloud infrastructure for ingestion
Perks/Benefits
- Access to cutting-edge technology
- Autonomy
- Collaborative culture
- Distributed first
- Fully remote
- High-impact work
Skills/Tech-stack
Bash | Cloud platform | Cost Optimization | Data Pipelines | Distributed Systems | Docker | GCP | Google Cloud | Google Cloud Platform | Infrastructure as Code | Linux | Python | Reliability Engineering | System design | Terraform | Throughput Optimization | Web Crawling | “as-code”
Education
Roles
Related jobs
-
Senior Data Platform Consultant ZAR 600K-730KAWS | Azure | CI/CD | Classification | Data EngineeringHybrid workSenior-level Full TimeCape Town, South Africa R2h ago
-
Agile | Artificial Intelligence | Data Architecture | Data Engineering | Data GovernanceHybrid work environment | Mentorship | Training and development | Work from home daysEntry-level Full TimeMidrand, GP, South Africa R20h ago
-
Combinatorics | Graph theory | MATLAB | NumPy | Number theoryProject-based assignmentsSenior-level FreelanceSouth Africa - Remote R4d ago
-
Computer Vision | Deep learning | Diffusers | Diffusion Models | IP AdaptersAnnual vacation | Corporate discounts for English language learning programs | Fully remote | Health allowance | Professional development reimbursementSenior-level Full TimeSouth Africa R7d ago
-
Agentic pipelines | DPO | Deep learning | Direct Preference Optimization | Distributed TrainingContinuous learning opportunities | English language learning discounts | Fully remote | Health support budget | Home-office allowanceSenior-level Full TimeSouth Africa R7d ago
-
Database Engineer / Database Administrator ZAR 464K-504KAWS Aurora | AWS RDS | Agile | Automation | Database AdministrationAdvancement opportunities | Annual tutoring stipend for children | Employee development program stipend | Fertility/adoption assistance | Mentorship programMid-level Full TimeRemote, South Africa R12d ago
-
Azure / AWS Cloud Engineer for Data Science ZAR 840K-1100KAmazon EC2 | Amazon Web Services | Azure Data | Azure Data Factory | Azure DevOpsSenior-level Contract Full TimeJohannesburg, Gauteng, South Africa R17d ago
-
Azure / AWS Cloud Engineer for Data Science ZAR 840K-1100KARM | Amazon EC2 | Amazon Route 53 | Amazon Web Services | Azure Key VaultSenior-level Contract Full TimeJohannesburg, Gauteng, South Africa R17d ago
-
Airbyte | Amazon Redshift | BigQuery | CTEs | DBTFlexible schedule | Remote workMid-level Full TimeEgypt R20d ago
-
Access Control | Airflow | Amazon Redshift | Authentication | BigQueryFlexible working hours | Remote workSenior-level Full TimeSouth Africa - Remote R23d ago
-
Senior Full Stack Engineer (NLP) ZAR 600K-800KAPI Integration | CSS | Database Schema | Database Schema Design | DjangoAnnual leave | Education stipend | Employee assistance program | Internet benefits | Laptop providedSenior-level Full TimeRemote, South Africa R29d ago
-
Data Engineer ZAR 480K-540KAWS | Amazon Redshift | Apache Airflow | Apache Kafka | CI/CDCollaborative teams | Documentation and transparency | On-call rotation | Professional growth and learning | Remote-first environmentMid-level Full TimeNigeria or South Africa R1mo ago
-
AWS | Airbyte | Amazon Redshift | Apache Airflow | CI/CDHybrid work | On-call rotation | Remote-first workMid-level Full TimeCape Town, Western Cape, South Africa R1mo ago
-
Machine Learning Architect ZAR 840K-1200KAI Agents | AWS | Apache Airflow | Apache Spark | Automated retrainingSenior-level Full TimeSouth Africa - Remote R1mo ago
-
AWS | Azure | Embeddings | GCP | Hugging FaceFlexible work environment | Fully remote | Growth opportunities | Remote distributed team experienceSenior-level Full TimeSouth Africa - Remote R1mo ago
-
Junior Data Engineer ZAR 228K-264KAmazon Redshift | Amazon Web Services | Apache Airflow | Apache Flink | Apache KafkaAutonomy | Flexible work practices | Learning and development support | Remote-firstEntry-level Full TimePortugal; South Africa R1mo ago
-
Data Engineer ZAR 450K-500KAWS | Airflow | Amazon Redshift | Apache Flink | Apache SparkFlexible work practices | Learning and development | Mentorship | Remote workMid-level Full TimePortugal; South Africa R1mo ago