Data Engineer: Ingestions (Group Data Platform)
Bellville, Western Cape, ZA
ZAR 400K-480K (estimate) Mid-level Full Time
Tasks
- Apply infrastructure as code for data service automation
- Automate infrastructure management and deployment pipelines
- Build configurable data ingestion platforms
- Build systems for insights and ML model deployments
- Define and manage SLIs and SLOs
- Develop data transformation and orchestration workflows
- Implement encryption firewalls VPCs RBAC and IAM integrations
- Implement observability for logs metrics traces
- Ingest and protect data from multiple sources
- Integrate security and privacy by design
- Schedule and orchestrate complex data transformations
- Use containerization for scalable deployments
Perks/Benefits
Skills/Tech-stack
Access Control | Access Management | Active Directory | Containerization | Data Ingestion | Data Transformation | Data orchestration | Directed Acyclic Graph | Distributed tracing | Docker | Encryption | Firewalls | Identity and Access Management | Identity and access | Infrastructure as Code | Logging | Metrics | Observability | Private Cloud | Role-Based Access | Role-Based Access Control | SQL | Service Level | Service level indicators | Service-Level Objectives | Terraform | Virtual Private Cloud | “as-code”
Education
Bachelor of Engineering | Bachelor of Science | National Diploma
Roles
Related jobs
-
Data Modeling | Microsoft Excel | PostgreSQL | Power BI | PythonBig data analytics industry exposure | Collaborative small team culture | Full-time permanent positionEntry-level Full TimeKnysna, South Africa10h ago
-
Data Engineer ZAR 420K-500KAWS | Agile | Azure | Integration Testing | PythonEmployee Share Purchase Plan ESPP | Employee Stock Options Grant | Flexible working hours | Growth and development opportunities | Health benefits planMid-level Full TimeJohannesburg or Cape Town, South Africa1d ago
-
Senior Data Engineer ZAR 540K-675KAWS | Airflow | Amazon Redshift | Apache Flink | Apache SparkFlexible work practices | Remote-firstSenior-level Full TimePortugal; South Africa R1d ago
-
Mid-level Full TimeBrackenfell, ZA1d ago
-
Data Engineer III ZAR 504K-609KAWS | Amazon Redshift | Automated testing | Azure | Cloud servicesFlexible working hours | Sabbatical | Shared parental leave | Study assistance | Wellbeing initiativesSenior-level Full TimeSouth Africa - Johannesburg1d ago
-
Data Engineer-3 ZAR 530K-670KAbinitio | Abinitio architecture | Abinitio graph development | Agile | Code reviewMid-level Full TimeFNB Building, 1 Enterprise Road, Fairland, …1d ago
-
C# | MATLAB | NumPy | Pandas | PythonPart-time project workSenior-level Full TimeSouth Africa - Remote R1d ago
-
Data Engineer III ZAR 504K-609KAWS | Amazon Redshift | Azure | Cloud Computing | Data ModelingFlexible working hours | Sabbatical | Shared parental leave | Study assistance | Wellbeing initiativesSenior-level Full TimeSouth Africa - Johannesburg1d ago
-
AWS | Amazon Redshift | BigQuery | CI/CD | Cloud PlatformsSenior-level Full TimeJohannesburg, South Africa2d ago
-
Data Testing | Data Warehousing | Data integration | Data pipeline | Database DesignMid-level Full TimeRandburg, GP, South Africa3d ago
-
Senior-level Full TimeSandton, South Africa3d ago
-
AWS | Cloud Computing | Data Architecture | Data Transformation | Data WarehousingMid-level Full TimeStellenbosch, WC, South Africa3d ago
-
Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure SQLMid-level Full TimePretoria, GP, South Africa3d ago
-
Entry-level Full TimeJohannesburg, GP, South Africa3d ago
-
Ab Initio | Change Management | Data APIs | Data Governance | Data ModelingSenior-level Full TimeSandton, South Africa3d ago
-
AWS | Apache Spark | Data Governance | Data Lake | Data PrivacyContract employment | Remote workMid-level Full TimeCape Town, WC, South Africa3d ago
-
Senior-level Full TimeJohannesburg, GP, South Africa3d ago
-
API Integration | Big Data | Cause analysis | Data Governance | Data ModelingSenior-level Full TimeJohannesburg, GP, South Africa3d ago
-
Canonical Data Modelling | Data Management | Data Modelling | Data Normalization | Data QualityMid-level Full TimeStellenbosch, WC, South Africa5d ago
-
Ab Initio | Azure | Data Governance | Data Modeling | Data SecuritySenior-level Full TimeSandton, South Africa5d ago
-
Advanced Excel | Azure Synapse | Azure Synapse Analytics | Data Analysis | Data GovernanceSenior-level Full TimeJohannesburg, GP, South Africa5d ago
-
API Design | Application Support | Design Patterns | DevOps | ElasticsearchSenior-level Full TimeJohannesburg, GP, South Africa5d ago
-
AWS Glue | AWS Lambda | Amazon Athena | Amazon EC2 | Amazon S3Senior-level Full TimeCape Town, Western Cape, South Africa5d ago
-
APIs | Data Engineering | Data Pipelines | Data Streams | JSONSenior-level Full TimeCape Town, WC, South Africa5d ago
-
A/B | A/B Testing | AWS | Amazon SageMaker | AutomlSenior-level Full TimeJohannesburg, South Africa5d ago