Intermediate Data Engineer
Cape Town, Western Cape, South Africa
A ZAR 360K-660K (estimate) Mid-level Full Time
Tasks
- Automate system life cycle management
- Build and scale real time data processing pipelines
- Build machine learning inference pipelines
- Build scalable data ingestion pipelines
- Develop general purpose APIs for data science outputs
- Monitor data platform health and data lineage
- Optimize cloud costs
- Scale production data systems
Perks/Benefits
- N/A
Skills/Tech-stack
API Development | Amazon Neptune | Amazon Web Services | Apache Hadoop | Apache Kafka | Apache Spark | Cloud platform | Data Modeling | Docker | Elasticsearch | Google Cloud | Google Cloud Platform | Graph Databases | Java | Kubernetes | Machine Learning | Machine learning deployment | Microsoft Azure | Neo4j | NoSQL Databases | OpenSearch | PostgreSQL | Relational databases | Scala | Web Services
Education
Roles
Related jobs
-
Mid-level Full TimeFNB Building, 1 Enterprise Road, Fairland, …1d ago
-
Senior-level Full TimeJohannesburg, South Africa1d ago
-
Algorithm Development | Computer Vision | Language Processing | Machine Learning | Machine learning researchMid-level ContractCape Town, South Africa1d ago
-
Automation & AI Engineer ZAR 480K-540KAWS | DBT | GPT | Node.js | PostgreSQLAgency and optionality | Birthday leave | Exclusive shopping discount | Paid holiday | Startup securitySenior-level Full TimeCape Town1d ago
-
Lead Engineer: Business AI and Data Engineering ZAR 660K-780KAPI | Artificial Intelligence | CI/CD | Cloud Computing | Cost OptimizationSenior-level Full TimeAbsa 270 Republic Road, South Africa2d ago
-
Data Scientist III ZAR 480K-650KData Mining | Data Modeling | MATLAB | Machine Learning | PowerBIChallenging work | Innovation opportunities | Networking opportunitiesSenior-level Full TimeFNB Building, 1 Enterprise Road, Fairland, …2d ago
-
Mid-level Full TimeMidrand, Gauteng, ZA3d ago
-
Quantitative Data Engineer ZAR 600K-730KAzure DevOps | Cloud Data | Cloud Data Services | Continuous Deployment | Continuous integrationSenior-level Full TimeSandton, Gauteng, ZA4d ago
-
Lead Engineer: AI ZAR 660K-720KAI Builder | AI Services | API Integration | Access Management | Audio ProcessingSenior-level Full TimeJohannesburg, ZA5d ago
-
Analytics SME ZAR 420K-456KAgile | Analytics | Business Analysis | Data Governance | Data ManagementExecutive-level Full TimeJohannesburg, South Africa5d ago
-
ARM | Active Directory | Agile | Apache Spark | AuthenticationSenior-level Full TimeJohannesburg, South Africa5d ago
-
Senior Data Engineer ZAR 700K-840KAWS | Agile | Apache Spark | Azure | CI/CD25 days annual leave | 30 days annual leave after each year | Cycle to work scheme | Discounted gym membership | Employee-led clubs and eventsSenior-level Full TimeNewcastle5d ago
-
Data Engineer III ZAR 504K-609KAWS Lambda | Agent2Agent Protocols | Amazon RDS | Amazon Redshift | Amazon S3Adoption benefits | Family benefits | Flexible working hours | Medical aid | Retirement planSenior-level Full TimeSouth Africa - Cape Town6d ago
-
Data Engineer III ZAR 504K-609KAWS Lambda | Agentic AI | Amazon RDS | Amazon Redshift | Amazon S3Flexible hours | Medical aid | Modern family benefits | Retirement plan | SabbaticalSenior-level Full TimeSouth Africa - Cape Town6d ago
-
AWS Data Engineer – Consultant ZAR 360K-420KAWS | AWS Athena | AWS DMS | AWS Glue | Amazon DynamoDBMid-level Full TimeJohannesburg, Gauteng, South Africa6d ago
-
AIX | AWS | Azure | Brocade SAN | Brocade SAN SwitchesMid-level Full TimeJohannesburg, SA (Hybrid), South Africa R7d ago
-
Mid-level Full TimeSandton, South Africa7d ago
-
AWS | Access Control | Azure | Bash | BigQueryHybrid work model | On-call rotationSenior-level Full TimeCape Town, Western Cape, South Africa8d ago
-
Staff Engineer (Data Analyst) ZAR 700K-920KAI/ML | Data Analysis | Data Modeling | Data Pipelines | Data VisualizationSenior-level Full TimeJohannesburg, SA (Hybrid), South Africa R8d ago
-
Deep learning | Distributed Systems | Distributed Training | Hugging Face | Language ProcessingCollaborative research environment | Exposure to State of the Art AI Models | High autonomy | High-performance computing access | Professional growthSenior-level Full TimeSouth Africa11d ago
-
Airflow | Amazon Redshift | Amazon SageMaker | BigQuery | CI/CDFlexible hours | Remote workSenior-level Full TimeSouth Africa - Remote R13d ago
-
SD Engineer (Data & BI) ZAR 900K-1000KCube | Data Governance | Data Management | Data Mart | Data ModelingDedicated account manager | Team get-togethers | Up-skilling | Workation tripsMid-level Full TimeGauteng, Johannesburg, South Africa13d ago
-
Data Engineer ZAR 700K-860KApache Storm | Azure Data Factory | Bash | Cassandra | Data FactoryDiversity and inclusion | Hybrid workingSenior-level Full TimeJohannesburg, South Africa14d ago
-
Data Warehouse Developer Mr Price Group ZAR 360K-600KAutomation | Data Modeling | Data Transformation | Data Vault | Data Vault 2.0Senior-level Full TimeDurban, Kwazulu Natal, South Africa14d ago
-
Senior-level Full TimeCape Town, Western Cape, South Africa15d ago