Data Engineer
Johannesburg, South Africa
ZAR 464K-540K (estimate) Mid-level Full Time
Tasks
- Aggregate data
- Apply data anonymization
- Apply least privileged access
- Build data pipelines
- Clean and wrangle data
- Collaborate with product teams
- Create conceptual models
- Create logical models
- Design data models
- Design database storage
- Develop data endpoints
- Encrypt data at rest
- Encrypt data in transit
- Enrich data
- Ensure definition of done peer review
- Follow change and release processes
- Format data for reporting
- Implement data validation
- Implement secure coding practices
- Integrate data from multiple sources
- Maintain data pipelines
- Maintain technical documentation
- Map data flow using data flow diagrams
- Monitor data quality
- Normalize data formats
- Provide technical designs and timelines
- Provide technical mentorship
- Support data governance
- Transform raw data
- Translate logical to physical models
- Troubleshoot and optimize data processes
Perks/Benefits
- N/A
Skills/Tech-stack
API Development | Azure Data | Azure Data Lake | Azure SQL | Azure Synapse | Containerization | Data Aggregation | Data Enrichment | Data Governance | Data Lake | Data Modeling | Data Normalization | Data Quality | Data Transformation | Data anonymization | Data encryption | Data integration | Data pipeline | Data quality monitoring | Database Design | Database monitoring | Database security | Database tuning | Databricks | Graph | JSON | Least Privilege | Pipelines | Power BI | PySpark | Python | Quality monitoring | SOAP | SQL | SSAS | SSIS | Secure Coding | Stress Testing | T-SQL | Task automation
Education
N/A
Related jobs
-
Azure Data Engineer ZAR 396K-420KApache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageHybrid workingMid-level ContractJohannesburg, South Africa11h ago
-
Mid-level Full TimeCape Town, Western Cape, South Africa1d ago
-
Data Scientist: AI Engineer ZAR 360K-444KAPIs | CI/CD | Cloud Computing | Data Engineering | DockerMid-level Full TimeJohannesburg, South Africa1d ago
-
Data Engineer ZAR 420K-464KAPI | Artificial Intelligence | DBT | Data Compliance | Data GovernanceCollaborative culture | Employee wellness programs | Hybrid work | Modern tooling | Professional developmentMid-level Full TimeCape Town, South Africa R1d ago
-
Senior-level ContractJohannesburg, South Africa1d ago
-
Access Control | Access Control Lists | Ansible | Apache Kafka | AutomationSenior-level ContractJohannesburg, South Africa1d ago
-
Data Engineer ZAR 745K-860K.NET | Apache Storm | Automation | Azure Data | Azure Data FactoryHybrid workingSenior-level Full TimeJohannesburg, South Africa2d ago
-
AWS | Autogen | Azure | Claude | Cloud platformBackup power required | Fixed internet required | Public holiday compensation | Remote workSenior-level Full TimeSouth Africa - Remote R2d ago
-
Analytics Engineer II ZAR 576K-720KApache Airflow | CI/CD | Cloud Data | Cloud Data Platforms | Data GovernanceSenior-level Full TimeStellenbosch, ZA2d ago
-
AI Platform Engineer (Cloud) ZAR 660K-780KAWS | AWS CDK | Access Control | Attribute-Based Access Control | Attribute-based accessSenior-level Full Time15 Alice Lane, South Africa3d ago
-
Senior Specialist: Cloud Data Engineer ZAR 660K-720KAPI Gateway | AWS | Agile | Apache Flink | Apache HiveCell phone benefits | Data benefits | Fibre connection discounts | Medical aid benefits | Retirement fundsSenior-level Full TimeMidrand, ZA3d ago
-
Staff Embedded Software Engineer ZAR 450K-576KC# | C++ | Containerization | Cryptography | EclipseAnnual leave | Career development opportunities | Inclusive culture | Work-life balanceSenior-level Full TimeDurban, ZA, 3630 R3d ago
-
Senior AI Platform Engineer (Cloud) ZAR 700K-780KABAC | AWS | Azure | Cost Allocation | Cost monitoringSenior-level Full Time15 Alice Lane, South Africa3d ago
-
AI Evaluation | API Integration | AWS | Access Control | Agent OrchestrationFlexible work hours | Fully remoteSenior-level Full TimeEgypt R3d ago
-
Lead Data and AI Integration Specialist ZAR 540K-720KAWS | Anomaly Detection | Authentication | Automation | AzureEqual opportunity workplace | Hybrid working model | Travel to primary office as requiredSenior-level Full Time15 Alice Lane, South Africa R7d ago
-
AWS | AWS CloudFormation | AWS Glue | AWS Glue Catalog | AWS LakeAgile collaboration | Flexible work location | Fully remote | Technical autonomySenior-level Contract Full TimeSouth Africa R7d ago
-
Mid-level Full TimeJohannesburg, South Africa8d ago
-
Analytics Engineer (Data Platform) ZAR 464K-500KAgile | Algorithms | BI reporting | BigQuery | CI/CDBirthday leave | Confidential counselling | Financial guidance | Flexible total remuneration package | Free counsellingMid-level Full TimeCape Town9d ago
-
Analytics Engineer (Data Platform) ZAR 464K-500KAgile | Algorithms | BigQuery | CI/CD | Data CleansingBirthday leave | Confidential counselling | Financial guidance | Free parking | Hybrid working modelMid-level Full TimeCape Town9d ago
-
AI Solution Engineer ZAR 600K-720KAutomation workflows | Azure AI | Copilot Studio | Data Processing | GitHub CopilotMid-level Full TimeCape Town, South Africa Office10d ago
-
API Integrations | Automation | CRM | JSON | LLMFlexible schedule | Remote workMid-level Part TimeEgypt R10d ago
-
API Management | AWS Lambda | Amazon Web Services | Git | Language ModelsAgile working model methodology | Flexible working hours | Global team collaboration | High work life balance | Modern officesMid-level Full TimePretoria, South Africa10d ago
-
AWS | Apache Spark | Azure | Business Intelligence | CI/CDSenior-level Full TimeCape Town, South Africa10d ago
-
Senior AI Engineer ZAR 900K-1200KAI Agents | API Development | AWS | Apache Spark | AzureHybrid work | Remote work | Sponsorship for technical events | Training and developmentSenior-level Contract Full TimeJohannesburg, Gauteng, South Africa14d ago
-
Senior AI Engineer ZAR 900K-1200KAI Agents | API Development | AWS | Apache Spark | AzureHybrid work | Remote work | Training sponsorship for technical eventsSenior-level Contract Full TimeJohannesburg, Gauteng, South Africa14d ago