Intermediate Data Engineer
Tasks
- Automate system and platform lifecycle
- Build data infrastructure for real time streaming
- Build machine learning inference pipelines
- Build scalable data ingestion pipelines
- Develop data APIs for business units
- Monitor data platform health and optimize cloud costs
- Scale production data systems
Perks/Benefits
- N/A
Skills/Tech-stack
API Development | Amazon Neptune | Amazon Web Services | Apache Hadoop | Apache Kafka | Apache Spark | Cloud platform | Data Modeling | Docker | Elasticsearch | Google Cloud | Google Cloud Platform | Graph Databases | Java | Kubernetes | Machine Learning | Microsoft Azure | Neo4j | NoSQL Databases | OpenSearch | PostgreSQL | Relational databases | Scala | Web Services
Education
Bachelor of Science | Master of Engineering | Master of Science
Roles
Related jobs
-
Senior Data Engineer ZAR 840K-1170KAWS | Agile | Apache Beam | Apache Flink | Apache SparkCommunity initiatives | Connected team culture | Flexible ways of working | Generous parental leave | Long weekendsSenior-level Full TimeJohannesburg, South Africa14h ago
-
Mid-level Full TimeCape Town, South Africa R1d ago
-
API Security | Access Control | Airflow | Amazon Redshift | AuthenticationFlexible working hours | Remote workSenior-level Full TimeSouth Africa - Remote R1d ago
-
AWS | Airbyte | Amazon Redshift | Apache Airflow | CI/CDHybrid work | On-call rotation | Remote-first workMid-level Full TimeCape Town, Western Cape, South Africa R3d ago
-
Azure DevOps | BigQuery | CI/CD | CircleCI | Cloud RunContract 12 months | Hybrid work | Possible extensionSenior-level Full TimeCape Town, Western Cape, South Africa6d ago
-
Big Data Support Engineer ZAR 360K-480KApache Kafka | Apache Spark | Data Modeling | Database Design | HDFSMid-level Full Time15 Alice Lane, South Africa6d ago
-
Specialist Support Engineer: DataOps ZAR 360K-480KApache Spark | Data Modeling | Data Streaming | Database Design | HDFSMid-level Full Time15 Alice Lane, South Africa6d ago
-
Intermediate Analytics Engineer ZAR 384K-480KApache Airflow | Cloud Computing | DBT | Data Governance | Data LineageMid-level Full TimeJohannesburg, ZA6d ago
-
Senior Analytics Engineer ZAR 660K-840KAPI Development | Cloud Computing | Data Architecture | Data Governance | Data LineageMentorship | Performance feedback | Professional development | Training and upskillingSenior-level Full TimeJohannesburg, ZA6d ago
-
Data Engineer ZAR 840K-1020KApache Spark | Automation | Azure Data | Azure Data Factory | Azure EventSenior-level Full TimeJohannesburg, ZA6d ago
-
Full-Stack Data Engineer (Remote) ZAR 420K-480KApache Airflow | Apache Beam | Automl | Bash | BigQueryRemote workMid-level Full TimeSouth Africa, South Africa - Remote R6d ago
-
A/B | A/B Testing | API Design | AWS ECS | AWS EKSSenior-level Full TimeCape Town7d ago
-
SQL DBA (Senior) ZAR 840K-960KAPIs | Azure Data | Azure Data Factory | Azure DevOps | Azure SQLCareer development opportunities | Employee wellness benefits | Hybrid workSenior-level Full TimeCape Town, South Africa7d ago
-
Associate Staff Engineer (Data Engineer) ZAR 420K-480KAPI Development | AWS | Airflow | Apache Kafka | Apache SparkMid-level Full TimeJohannesburg, SA (Hybrid), South Africa R7d ago
-
Data Design and Engineering ZAR 840K-1080KBusiness Intelligence | Data Architecture | Data Cleansing | Data Governance | Data MiningSenior-level Full TimeSouth Africa7d ago
-
Data Engineer ZAR 840K-1080KBusiness Intelligence | Data Architecture | Data Cleansing | Data Governance | Data IntegritySenior-level Full TimeSouth Africa7d ago
-
API Integration | Automation | Claude | Data Modeling | IndexingCollaborative engineering culture | Flexible/remote location | Fully remote work | High-ownership environmentSenior-level Full TimeSouth Africa R7d ago
-
Machine Learning Architect ZAR 840K-1200KAI Agents | AWS | Apache Airflow | Apache Spark | Automated retrainingSenior-level Full TimeSouth Africa - Remote R7d ago
-
Senior Analytics Engineer ZAR 840K-1200KBigQuery | Data Modeling | GCP | JavaScript | Looker StudioSenior-level Full TimeSouth Africa - Remote R7d ago
-
Software Data Engineer ZAR 360K-420KAPIs | Apache Beam | Apache Flink | Big Data | CI/CDBirthday leave | Discounted subscription | Financial guidance | Free counseling | Free parkingMid-level Full TimeCape Town8d ago
-
Software Data Engineer ZAR 360K-420KAPIs | Apache Beam | Apache Flink | Apache Storm | Continuous DeliveryBirthday leave | Confidential counseling | Financial guidance | Free parking | Free subscriptionMid-level Full TimeCape Town8d ago
-
Data Engineer ZAR 420K-500KApache Airflow | Apache Spark | Data Governance | Data Modeling | DockerCredit and Criminal Record Check | Curro School Fees Benefit | Employee assistance programme | Financial Services Assistance | Free Sleep CoachingMid-level Full TimeCape Town, South Africa9d ago
-
AWS Lambda | Amazon CloudWatch | Amazon EKS | Amazon Redshift | Amazon SageMakerOn-call rotationSenior-level Full TimeCape Town, Western Cape, South Africa12d ago
-
Machine Learning Engineer ZAR 420K-600KAirflow | Amazon SageMaker | CI/CD | Docker | Feature EngineeringAgile environment | Collaborative culture | Feedback and empathy | Freedom and responsibility | Self-organizationMid-level Full TimeSouth Africa - Remote R13d ago
-
Senior-level Full TimePretoria, South Africa14d ago