(1728) Data Engineer - BSTD
Pretoria, South Africa
ZAR 745K-900K (estimate) Senior-level Full Time
Tasks
- Design and build modular scalable deployable versioned pipelines
- Design and develop data pipeline architectures
- Design integration patterns and interoperability standards
- Develop and maintain data pipelines
- Enable analytics enablement
- Implement data governance and data quality capabilities
- Maintain documentation for pipelines and integration processes
- Manage data life cycle and retention management
- Manage metadata management data cataloguing and lineage
- Manage stakeholder relationships for data management
- Monitor and optimize data pipelines
- Perform data security and privacy management
- Plan infrastructure for data growth and retention
- Quality assure pipeline implementations
- Recommend improvements to data reliability efficiency and quality
- Support master and reference data management
Perks/Benefits
- N/A
Skills/Tech-stack
Analytics enablement | Apache Spark | Application Programming | Application Programming Interfaces | C Sharp | Data Cataloging | Data Engineering | Data Governance | Data Lineage | Data Management | Data Modeling | Data Pipelines | Data Privacy | Data Quality | Data Quality Management | Data Security | Data Warehousing | Dimensional Modeling | Hadoop | IBM DB2 | Java | Master Data | Master Data Management | Metadata Management | MySQL | NoSQL | OLAP | Oracle | Programming interfaces | Quality management | Reference Data | Reference Data Management | Relational databases | SQL | SQL Server
Education
Bachelor of Computer Science | Bachelor of Engineering | Bachelor of Science | Bachelor of Technology
Roles
Related jobs
-
AWS S3 | Azure | Cloud Integration | Data Governance | Data LineageSenior-level Full TimeCape Town, South Africa4h ago
-
Application Monitoring | Data Analysis | Data Quality | Data pipeline | ETLSenior-level Full TimePretoria, South Africa4h ago
-
Benchmarking | Big Data | Cloud Computing | Databases | Distributed SystemsSenior-level Full TimeJohannesburg, South Africa4h ago
-
Analytics tools | Cloud Computing | Data platforms | Incident Management | LoggingSenior-level Full TimeJohannesburg, South Africa4h ago
-
AWS Architect | AWS Architect Associate | AWS Architect Professional | AWS Cloud | AWS Cloud PractitionerSenior-level ContractPretoria, South Africa4h ago
-
Mid-level Full TimePretoria, South Africa4h ago
-
Mid-level Full TimeJohannesburg, South Africa4h ago
-
(1731) Data Scientist and AI Engineer - BSTD ZAR 720K-780KAPI Development | Amazon Web Services | Apache Hadoop | Apache Spark | DB2Senior-level Full TimePretoria, South Africa9h ago
-
Full Stack AI Engineers ZAR 540K-540KAI Foundry | API Design | Azure AI | Azure AI Foundry | Azure DevOpsHybrid workMid-level Full TimeJohannesburg, South Africa1d ago
-
Senior Machine Learning Engineer ZAR 540K-720KAWS | AWS CodePipeline | Azure | CI/CD | Cloud platformSenior-level Full TimeBrackenfell, ZA1d ago
-
Product Engineer – Data Quality ZAR 396K-420KAgile | Ataccama | Business Analysis | Business Rules | CRMMid-level Full TimeAbsa Towers East, South Africa1d ago
-
GenAI Engineer - Product Marketing & Adoption ZAR 456K-540KAdapter-Tuning | Apache Spark | Function Calling | Generative AI | Google CloudCasual work environment | Flexible work hours | Internet allowance | Medical aid | Provident fundEntry-level Full TimeCapetown2d ago
-
Senior-level Full TimeAbsa Towers North, South Africa2d ago
-
Apache Airflow | BigQuery | Cloud platform | DBT | DataflowAnnual off-site events | Co-working space allowance | Equity participation | Flexible asynchronous schedule | Fully remoteSenior-level Full TimeSouth Africa R3d ago
-
Mid-level Full TimeJohannesburg, South Africa3d ago
-
Mid-level Full TimeJohannesburg,Gauteng,South Africa3d ago
-
Alerting | Batch Processing | BigQuery | CI/CD | Cloud RunCollaborative supportive international team | Continuous learning | Flexible working arrangements | Fully remote | High autonomy and ownershipSenior-level Full TimeSouth Africa R3d ago
-
AWS | Airflow | Data Architecture | Data Governance | Data PipelinesSenior-level Full TimeSandton, South Africa4d ago
-
Data Engineer (OVA5687) ZAR 360K-420KAb Initio | Data Modeling | Data Pipelines | Metadata governance | Quality AssuranceContract employmentMid-level Full TimeJohannesburg, South Africa4d ago
-
Strong Intermediate Data Engineer ZAR 420K-480KCloud | Data Pipelines | Data Quality | Data integration | ETLOn site visit during go live | Remote work optionMid-level ContractJohannesburg, South Africa5d ago
-
AWS | Access Management | Azure | Cloud platform | Data ClassificationRemote workSenior-level Full TimeHonduras - Tegucigalpa5d ago
-
Junior - Intermediate Data Engineer ZAR 240K-360KData Transformation | Database Views | Grafana | Microsoft Excel | Microsoft SQLRolling contractEntry-level ContractJohannesburg, South Africa6d ago
-
Analytics Engineer (Data Platform) ZAR 400K-420KAgile | Algorithms | BigQuery | CI/CD | Cube designBirthday leave | Confidential counseling | Financial guidance | Flexible equipment setup | Free parkingMid-level Full TimeCape Town6d ago
-
Analytics Engineer (Data Platform) ZAR 400K-420KAgile | Algorithms | BigQuery | CI/CD | Data ModelingBirthday leave | Confidential counselling | Financial guidance | Free parking | Hybrid work modelMid-level Full TimeCape Town6d ago
-
Entry-level Full TimeSandton - 1 Discovery Place, GP, …6d ago