Senior Specialist: Cloud Data Engineer
Tasks
- Allocate compute resources
- Build real-time data processing
- Define data pipeline architecture
- Define microservices architecture
- Deploy microservices
- Design data pipelines
- Develop and manage APIs
- Develop data pipelines
- Develop edge applications
- Ensure security and compliance
- Establish data governance
- Integrate edge applications and cloud services
- Lead incident response
- Maintain data pipelines
- Monitor data pipeline performance
- Optimize system performance
- Recommend data engineering technologies
Perks/Benefits
- Cell phone benefits
- Data benefits
- Fibre connection discounts
- Medical aid benefits
- Retirement funds
- Risk benefits
- Staff discounts
Skills/Tech-stack
API Gateway | AWS | Agile | Apache Flink | Apache Hive | Apache Kafka | Apache NiFi | Apache Spark | Azure | Cassandra | Cloud platform | Data Governance | Data Security | Distributed Systems | Docker | ETL | Elasticsearch | Google Cloud | Google Cloud Platform | Java | Kanban | Kubernetes | Microservices | MongoDB | Nginx | OpenShift | Python | Scala | Scrum | Spark Streaming
Education
Bachelor of Engineering | Bachelor of Science | Bachelor of Technology
Roles
Related jobs
-
AI integration | AWS | Agentic Workflows | Azure | Best practicesAutonomy | Flexible contract engagement | Flexible time zone work | High-impact environment | Remote collaborationEntry-level Contract Full TimeSouth Africa1d ago
-
AI Platform Engineer (Cloud) ZAR 660K-780KAWS | AWS CDK | Access Control | Attribute-Based Access Control | Attribute-based accessSenior-level Full Time15 Alice Lane, South Africa1d ago
-
AI Evaluation | API Integration | AWS | Access Control | Agent OrchestrationFlexible work hours | Fully remoteSenior-level Full TimeEgypt R1d ago
-
Backpressure handling | Chunking | Cloud platform | Cloudflare Queues | Cloudflare WorkersCompetitive pay | Growth opportunities | Remote workSenior-level Full TimeSouth Africa - Cape Town R4d ago
-
Lead Data and AI Integration Specialist ZAR 540K-720KAWS | Anomaly Detection | Authentication | Automation | AzureEqual opportunity workplace | Hybrid working model | Travel to primary office as requiredSenior-level Full Time15 Alice Lane, South Africa R5d ago
-
AWS | AWS CloudFormation | AWS Glue | AWS Glue Catalog | AWS LakeAgile collaboration | Flexible work location | Fully remote | Technical autonomySenior-level Contract Full TimeSouth Africa R6d ago
-
Mid-level Full TimeJohannesburg, South Africa7d ago
-
Analytics Engineer (Data Platform) ZAR 464K-500KAgile | Algorithms | BI reporting | BigQuery | CI/CDBirthday leave | Confidential counselling | Financial guidance | Flexible total remuneration package | Free counsellingMid-level Full TimeCape Town8d ago
-
Analytics Engineer (Data Platform) ZAR 464K-500KAgile | Algorithms | BigQuery | CI/CD | Data CleansingBirthday leave | Confidential counselling | Financial guidance | Free parking | Hybrid working modelMid-level Full TimeCape Town8d ago
-
APIs | Access Control | Agentic AI | Audit Logging | CI/CDAnnual offsite gatherings | Coworking allowance | Dependent coverage support | Employee equity | Flexible, asynchronous workMid-level Full TimeSouth Africa R8d ago
-
API Management | AWS Lambda | Amazon Web Services | Git | Language ModelsAgile working model methodology | Flexible working hours | Global team collaboration | High work life balance | Modern officesMid-level Full TimePretoria, South Africa9d ago
-
AWS | Apache Spark | Azure | Business Intelligence | CI/CDSenior-level Full TimeCape Town, South Africa9d ago
-
Full Stack AI Developer ZAR 540K-540KAI workflow | AI workflow automation | Anthropic API | Cloud deployment | DockerFull-time remote work | US business hoursMid-level Full TimeSouth Africa - Remote R9d ago
-
Senior AI Engineer ZAR 900K-1200KAI Agents | API Development | AWS | Apache Spark | AzureHybrid work | Remote work | Sponsorship for technical events | Training and developmentSenior-level Contract Full TimeJohannesburg, Gauteng, South Africa13d ago
-
Senior AI Engineer ZAR 900K-1200KAI Agents | API Development | AWS | Apache Spark | AzureHybrid work | Remote work | Training sponsorship for technical eventsSenior-level Contract Full TimeJohannesburg, Gauteng, South Africa13d ago
-
Bash | Cloud platform | Data Processing | Docker | GCPAsynchronous culture | Entrepreneurial team | Flexible, hands-off management | Friendly laid-back atmosphere | Remote friendly distributed workMid-level Full TimeCape Town, South Africa14d ago
-
AI machine learning | AWS | Access Controls | Access Management | AsanaRemote workSenior-level Full TimeArgentina - Buenos Aires14d ago
-
API Connect | API Governance | API Security | AWS | Ab InitioRotational standby supportMid-level Full TimeJohannesburg, South Africa14d ago
-
Senior-level Full TimePretoria, South Africa16d ago
-
Agile | Apache Kafka | Avro | CI/CD | Confluent PlatformCollaborate with global engineering teams | Continuous learning and professional development | Exposure to large-scale distributed systems | Flexible hybrid working model | Modern Agile development environmentSenior-level Full TimePretoria, South Africa16d ago
-
Machine Learning Engineer UAH 1377K-1549KData Preparation | GPU Computing | JAX | Machine Learning | Machine Learning EngineeringSenior-level Full TimeEurope16d ago
-
AI Automation | API Integration | Agent Orchestration | Autogen | Claude CodeRemote work | Working on public holidays per BCEASenior-level Full TimeSouth Africa - Remote R16d ago
-
Senior-level Full TimeCape Town19d ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudMid-level Full TimeJohannesburg, South Africa19d ago
-
Entry-level Full TimeStellenbosch, ZA19d ago