Software Data Engineer
Tasks
- Aggregate clean and distribute data models
- Automate data ingestion tasks
- Build data products and tools
- Build stream data pipelines
- Collaborate with ML experts analysts and stakeholders
- Design data architectures
- Develop data architectures
- Ensure data integrity
- Implement continuous integration and delivery best practices
- Improve scalability, efficiency, reliability, and security
- Ingest data into lakehouse
- Maintain data architectures
- Operate and manage production systems
- Optimize data delivery for downstream applications
- Prepare data for modeling
- Respond to production incidents
- Test data architectures
Perks/Benefits
- Birthday leave
- Confidential counseling
- Financial guidance
- Free parking
- Free subscription
- Hybrid working model
- Legal support
- Mentorship programme
- Remote Working
- Social events
- Staff discount
- Upskilling courses access
Skills/Tech-stack
APIs | Apache Beam | Apache Flink | Apache Storm | Continuous Delivery | Continuous integration | Data Lake | Data Marts | Data Modeling | Data Warehousing | Data mesh | Databricks | Datastream | Docker | GCP | GitHub Actions | GitLab | Google Cloud | Java | Jenkins | Kafka | Kappa Architecture | Kubernetes | Lambda Architecture | MySQL | OLAP | PostgreSQL | PubSub | Python | Redis | SQL | Schema Design | Snowflake | Star Schema | Terraform | Webhooks
Education
N/A
Roles
Related jobs
-
SQL DBA (Senior) ZAR 840K-960KAPIs | Azure Data | Azure Data Factory | Azure DevOps | Azure SQLCareer development opportunities | Employee wellness benefits | Hybrid workSenior-level Full TimeCape Town, South Africa8h ago
-
Machine Learning Architect ZAR 840K-1200KAI Agents | AWS | Apache Airflow | Apache Spark | Automated retrainingSenior-level Full TimeSouth Africa - Remote R22h ago
-
Software Data Engineer ZAR 360K-420KAPIs | Apache Beam | Apache Flink | Big Data | CI/CDBirthday leave | Discounted subscription | Financial guidance | Free counseling | Free parkingMid-level Full TimeCape Town1d ago
-
Anomaly Detection | Data Modeling | Data Pipelines | Docker | JavaScriptCareer growth opportunities | Flexible work environment | Remote workMid-level Full TimeSouth Africa R1d ago
-
API Gateway | AWS Lambda | Access Control | Agent systems | Amazon APISenior-level ContractJohannesburg, South Africa2d ago
-
Accelerate | Deep learning | Diffusers | Generative AI | Hugging FaceAutonomy and ownership | Career growth opportunities | Flexible globally distributed work environment | Fully remote work | Global collaborationMid-level Full TimeSouth Africa R2d ago
-
Data Curation | Deep learning | Distributed Training | GPU Training | JAXAccess to high performance GPU clusters | Collaborative global culture | Flexible work schedule | Fully remote | Professional growth opportunitiesSenior-level Full TimeSouth Africa R2d ago
-
AWS | Azure | Embeddings | GCP | Hugging FaceFlexible work environment | Fully remote | Growth opportunities | Remote distributed team experienceSenior-level Full TimeSouth Africa - Remote R2d ago
-
Data Engineer ZAR 420K-500KApache Airflow | Apache Spark | Data Governance | Data Modeling | DockerCredit and Criminal Record Check | Curro School Fees Benefit | Employee assistance programme | Financial Services Assistance | Free Sleep CoachingMid-level Full TimeCape Town, South Africa2d ago
-
AWS Lambda | Amazon CloudWatch | Amazon EKS | Amazon Redshift | Amazon SageMakerOn-call rotationSenior-level Full TimeCape Town, Western Cape, South Africa5d ago
-
API Security | Access Control | Airflow | Amazon Redshift | AuthenticationFlexible schedule | Remote workSenior-level Full TimeSouth Africa - Remote R5d ago
-
Application Support Engineer ZAR 300K-420KAgile | Ataccama | Cause analysis | Change Management | CollibraMid-level Full Time15 Alice Lane, South Africa5d ago
-
Principal Specialist VodaPay Insights and Analytics ZAR 540K-720KA/B | A/B Testing | B testing | CVM Analytics | Customer SegmentationCell phone benefits | Data benefits | Fibre connection discounts | Medical aid | Retirement benefitsSenior-level Full TimeMidrand, ZA5d ago
-
AWS | AWS Bedrock | AWS SageMaker | Cloud Computing | Computer VisionFlexible scheduling | Fully remote | Paid training | Stable internet freedomMid-level Full TimeSouth Africa R6d ago
-
Machine Learning Engineer ZAR 420K-600KAirflow | Amazon SageMaker | CI/CD | Docker | Feature EngineeringAgile environment | Collaborative culture | Feedback and empathy | Freedom and responsibility | Self-organizationMid-level Full TimeSouth Africa - Remote R6d ago
-
Data Engineer ZAR 420K-480KAPI | Amazon Redshift | Amazon Web Services | Amazon Web Services (AWS) | Apache SparkMid-level Full TimePinelands, South Africa6d ago
-
Senior-level Full TimePretoria, South Africa7d ago
-
Senior Cloud Data Engineer ZAR 780K-920KApache Airflow | Apache Beam | Apache Spark | Cloud platform | Data GovernanceIn-office workSenior-level Full TimeCape Town, Western Cape, South Africa7d ago
-
Apache Flink | Apache Spark | Data Analysis | Exploratory Data Analysis | Feature EngineeringCross-functional collaboration | Knowledge sharing | MentorshipSenior-level Full TimeJohannesburg, GP, South Africa7d ago
-
Intermediate Data Engineer ZAR 396K-480KApache Airflow | Azure Data | Azure Data Factory | Azure DevOps | Azure FunctionsHybrid work modelMid-level Full TimeSandton, GP, South Africa7d ago
-
AI Lead (SAMY backbone) ZAR 500K-600KAPIs | Agent systems | Data Governance | Data Modeling | Data integrationCareer growth opportunities | Cool Gadgets Provided | Entrepreneurial Ecosystem | Flexible working hours | Global Referral ProgramSenior-level Full TimeCape Town, Western Cape, South Africa8d ago
-
Embedded Software Development Engineer ZAR 300K-420KARM | C# | Debugging | Embedded Systems | Embedded firmwareDisability programs | Hybrid work | Life insurance | Private medical care | Tailored financial programsMid-level Full TimeZA-Century City-Cape Town-The Matrix 2G and …8d ago
-
Mid-level Full TimeJohannesburg, South Africa8d ago
-
AI Engineer-2 ZAR 396K-480KAWS | Agentic Systems | Cloud platform | Conversational AI | Copilot StudioChallenging work | Culture of innovation and continuous learning | Ethical AI focus | Inclusive development culture | Opportunities to network and collaborateMid-level Full TimeFNB Building, 1 Enterprise Road, Fairland, …8d ago
-
Senior Data Engineer I ZAR 500K-600KAWS | Airflow | Apache Spark | Azure | C#Flexible working hours | Medical aid | Modern family benefits | Retirement plan | SabbaticalSenior-level Full TimeSouth Africa - Durban8d ago