Senior Integration & Streaming Engineer
Pretoria, South Africa
A ZAR 900K-1400K (estimate) Senior-level Full Time
Tasks
- Build event driven streaming solutions
- Collaborate in Agile delivery
- Create ETL and ELT processes
- Deploy cloud native integration platforms
- Design enterprise API integrations
- Design real time integration platforms
- Develop REST API integrations
- Develop event schemas with Avro
- Develop streaming pipelines
- Implement CI/CD pipelines
- Implement webhook integrations
- Maintain data quality frameworks
- Manage schemas with Schema Registry
- Model data for streaming systems
- Support production Kafka environments
Perks/Benefits
- Collaborate with global engineering teams
- Continuous learning and professional development
- Exposure to large-scale distributed systems
- Flexible hybrid working model
- Modern Agile development environment
Skills/Tech-stack
Agile | Apache Kafka | Avro | CI/CD | Confluent Platform | Data Modeling | Data Quality | Database performance | Database performance tuning | ELT | ETL | Event Driven | Event-driven architecture | Git | Java | Kafka Connect | Metadata Management | Performance Tuning | Protobuf | Python | REST API | Relational databases | SQL | Schema Registry | Streaming Pipelines | Webhook
Related jobs
-
Data pipeline | Deep learning | GPU | JAX | Latency optimizationCareer growth | Flexible working hours | Fully remote | High autonomy | Professional developmentSenior-level Full TimeSouth Africa R6h ago
-
Senior-level Full TimePretoria, South Africa20h ago
-
Machine Learning Engineer UAH 1377K-1549KData Preparation | GPU Computing | JAX | Machine Learning | Machine Learning EngineeringSenior-level Full TimeEurope21h ago
-
Intermediate Analytics Engineer ZAR 300K-420KData Architecture | Data Contracts | Data Governance | Data Lineage | Data ModelingMid-level Full TimeJohannesburg, ZA1d ago
-
Junior Analytics Engineer ZAR 216K-240KAPIs | Compliance | Data Architecture | Data Contracts | Data GovernanceEntry-level Full TimeJohannesburg, ZA1d ago
-
Data Engineer ZAR 745K-900KADLS Gen 2 | API Development | Anonymization | Apache Airflow | Apache SparkSenior-level Full TimeJohannesburg, ZA1d ago
-
Attention Mechanisms | Batching | CUDA | Compute Graphs | Distributed SystemsEquity participation | Remote workSenior-level Full TimeSouth Africa3d ago
-
Senior-level Full TimeCape Town3d ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudMid-level Full TimeJohannesburg, South Africa4d ago
-
Entry-level Full TimeStellenbosch, ZA4d ago
-
Data Analytics Technical Specialist ZAR 780K-900KAccess Management | Analysis Services | Azure DevOps | Azure SQL | Azure SQL DatabaseFlexible working | Hybrid workingSenior-level Full TimeCape Town, South Africa5d ago
-
AI Solutions Engineer ZAR 400K-464KAI Agents | API Integration | Azure AI | Chatbots | Data AnalysisMid-level Full TimeCape Town, South Africa Office5d ago
-
Senior Specialist Machine Learning Engineer ZAR 700K-840KAWS EC2 | AWS IAM | AWS S3 | Access Control | Amazon CloudWatchMedical aid | Retirement benefits | Risk benefitsSenior-level Full TimeMidrand, ZA5d ago
-
Senior Machine Learning Engineer ZAR 745K-860KAWS SageMaker | AWS Sagemaker Endpoints | Agile | Amazon Web Services | Big DataBirthday leave | Confidential counselling | Financial guidance | Free parking | Legal supportSenior-level Full TimeSouth Africa5d ago
-
Senior Machine Learning Engineer ZAR 745K-860KAWS | Agile | Big Data | BigQuery | Cloud platformBirthday leave | Confidential counselling | Financial guidance | Free parking | Free subscription takealotMORESenior-level Full TimeSouth Africa5d ago
-
Apache Spark | Azure Data | Azure Data Factory | Azure Databricks | Azure EventMid-level ContractSandton, South Africa5d ago
-
API | AWS | AWS Lambda | Amazon RDS | Amazon S3Autonomy | Collaborative team | Continuous learning | High ownership | Professional growthSenior-level Full TimeSouth Africa6d ago
-
Senior Data Scientist (Azure Data Engineering & MLOps) ZAR 900K-1200KApache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Contract Full TimeCape Town, Western Cape, South Africa6d ago
-
Senior Data Scientist (Azure Data Engineering & MLOps) ZAR 900K-1200KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DatabricksSenior-level Contract Full TimeCape Town, Western Cape, South Africa6d ago
-
Specialist Support Engineer: DataOps ZAR 420K-464KApache Spark | Batch Processing | Cloud Migration | Data Modeling | Data StreamingMid-level Full Time15 Alice Lane, South Africa6d ago
-
AI readiness | AWS | Access Management | Architecture | AsanaCareer growth opportunities | Customer facing exposure | Remote workSenior-level Full TimeHonduras - Tegucigalpa6d ago
-
AWS | Access Control | Access Management | Azure | Cloud hybridRemote workSenior-level Full TimeArgentina - Buenos Aires6d ago
-
Agile | Amazon Redshift | Amazon Web Services | Apache Airflow | Apache IcebergRemote workMid-level Full TimeSouth Africa - Cape Town6d ago
-
Technology/Domain Specialist II - Kafka (OVA5718) ZAR 360K-420KACLs | Ansible | Apache Kafka | Azure | Azure MonitorMid-level Full TimeJohannesburg, South Africa6d ago
-
Azure Bot | Azure Bot Service | Azure Cognitive | Azure Cognitive Services | Azure Machine LearningMid-level Full TimeMidrand, South Africa8d ago