Lead Data Engineer
Absa Towers North, South Africa
ZAR 600K-720K (estimate) Senior-level Full Time
Tasks
- Assemble large datasets
- Automate high-volume data delivery
- Automate tasks with configuration management
- Build data pipelines
- Coach and mentor engineers
- Conduct peer reviews and testing
- Create CI/CD pipelines
- Create data tools for analytics and data science
- Debug and optimize source code
- Define quality assurance routines
- Design data architecture
- Develop analytics tools and algorithms
- Develop relational and NoSQL data solutions
- Ensure data security separation and quality
- Identify and mitigate technical risks
- Integrate and manage streaming platforms
- Lead data solution design and implementation
- Monitor data product performance
- Participate in incident management
Perks/Benefits
- N/A
Skills/Tech-stack
Ansible | Automation | CI/CD | Chef | Data Architecture | Data Engineering | Data Governance | Data Security | Data pipeline | Disaster Recovery | Domain-Driven Design | Incident Management | Infrastructure as Code | Jenkins | NoSQL | Quality Assurance | Relational databases | Streaming Platforms | Test-Driven | Test-Driven Development | “as-code”
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Apache Airflow | BigQuery | Cloud platform | DBT | DataflowAnnual off-site events | Co-working space allowance | Equity participation | Flexible asynchronous schedule | Fully remoteSenior-level Full TimeSouth Africa R1d ago
-
AI Personalisation Product Lead ZAR 660K-780KA/B | A/B Testing | API Integration | AUC | Amazon SageMakerSenior-level Full TimeJohannesburg, South Africa2d ago
-
Executive Head: VSA Big Data, AI & IA ZAR 450K-660KAI Governance | AWS | Amazon SageMaker | Apache Superset | Azure Machine LearningExecutive-level Full TimeMidrand, ZA2d ago
-
Alerting | Batch Processing | BigQuery | CI/CD | Cloud RunCollaborative supportive international team | Continuous learning | Flexible working arrangements | Fully remote | High autonomy and ownershipSenior-level Full TimeSouth Africa R2d ago
-
AWS | Airflow | Data Architecture | Data Governance | Data PipelinesSenior-level Full TimeSandton, South Africa2d ago
-
Data Engineer (OVA5687) ZAR 360K-420KAb Initio | Data Modeling | Data Pipelines | Metadata governance | Quality AssuranceContract employmentMid-level Full TimeJohannesburg, South Africa3d ago
-
Strong Intermediate Data Engineer ZAR 420K-480KCloud | Data Pipelines | Data Quality | Data integration | ETLOn site visit during go live | Remote work optionMid-level ContractJohannesburg, South Africa3d ago
-
AI readiness | AI workflows | AWS | Access Control | AutomationGrowth opportunities | Remote work | US time zone collaborationSenior-level Full TimeArgentina - Buenos Aires4d ago
-
AWS | Access Management | Azure | Cloud platform | Data ClassificationRemote workSenior-level Full TimeHonduras - Tegucigalpa4d ago
-
Analytics Engineer (Data Platform) ZAR 400K-420KAgile | Algorithms | BigQuery | CI/CD | Cube designBirthday leave | Confidential counseling | Financial guidance | Flexible equipment setup | Free parkingMid-level Full TimeCape Town5d ago
-
Analytics Engineer (Data Platform) ZAR 400K-420KAgile | Algorithms | BigQuery | CI/CD | Data ModelingBirthday leave | Confidential counselling | Financial guidance | Free parking | Hybrid work modelMid-level Full TimeCape Town5d ago
-
Entry-level Full TimeSandton - 1 Discovery Place, GP, …5d ago
-
Senior-level Full TimeSouth Africa5d ago
-
Senior-level Full TimePretoria, South Africa5d ago
-
Principal Data Engineer ZAR 400K-464KData Engineering | Data Modeling | Database Design | Databricks | Declarative PipelinesMid-level Full TimeCape Town, Western Cape, South Africa6d ago
-
Senior-level Full TimeJohannesburg, South Africa6d ago
-
Senior-level Full TimeJohannesburg, South Africa6d ago
-
Data Engineer (D) ZAR 464K-720KAnomaly Detection | Azure | Batch Processing | By Design | Data DriftMid-level Full TimeJohannesburg, South Africa6d ago
-
Data Governance and Data Management (D) ZAR 560K-720KBy Design | Cloud Data | Cloud Data Pipelines | DAMA-DMBOK | DCAMSenior-level Full TimeJohannesburg, South Africa6d ago
-
Artificial Intelligence | Azure | Azure Data | Azure Data Factory | Batch ProcessingMid-level Full TimeCape Town, South Africa7d ago
-
Access Control | Compliance | Data Governance | Data Lineage | Data ModelingAgile team collaborationMid-level Full TimeCape Town, South Africa8d ago
-
Bash | Cloud platform | Data Pipelines | Data Processing | DockerAsynchronous culture | Friendly atmosphere | Hands-off management | Remote distributed settingMid-level Full TimeCape Town, South Africa9d ago
-
Tupande AI Engineering Lead EUR 66K-85KAPI Integration | Analytics | Artificial Intelligence | Automation | Data platformsCareer Reviews | Comprehensive benefits | Health insurance | Housing | MentorshipSenior-level Full TimeFlexible: Poland, Spain, Portugal, Estonia, Romania, …9d ago
-
BI Data Analyst II ZAR 660K-720KAPI Development | Acceptance criteria | Cloud Computing | Cost Optimization | Data Acceptance CriteriaSenior-level Full TimeJohannesburg, ZA9d ago
-
Senior-level Full TimeStellenbosch, ZA9d ago