Data Engineer II
2 First Place, Cnr Simmonds & Pritchard Streets, Johannesburg, 2001, South Africa
ZAR 300K-420K (estimate) Mid-level Full Time
Tasks
- Automate data pipelines
- Build data marts
- Collaborate with stakeholders on requirements
- Conduct data gap analysis
- Design data pipelines
- Develop data warehouses
- Develop unit tests
- Implement data quality monitoring
- Integrate multiple data sources
- Manage UAT through change control
- Model enterprise data
- Perform cost effort assessment
- Prepare business case
- Present technology solutions to leadership
- Provide analytic infrastructure support
- Recommend data solutions
- Research emerging technologies
- Schedule data tasks
- Set up data quality alerts
- Support Big Data systems
- Transform data using ETL
Perks/Benefits
- N/A
Skills/Tech-stack
Analysis Services | Apache Hive | Apache Kafka | Apache Spark | Control-M | Data Modeling | Data Pipelines | Data Quality | Data Warehousing | ETL | Hadoop | Integration Services | Linux | Microsoft SQL | Microsoft SQL Server | Power BI | Python | SAS | SQL | SQL Server | SQL Server Analysis | SQL Server Analysis Services | SQL Server Integration Services | SQL Server integration | Server Integration Services | Teradata | Unit Testing
Education
Bachelor of Commerce | Bachelor of Engineering | Bachelor of Science
Related jobs
-
CRM Integration | Claude API | Docker | Event Driven | Event-driven architectureSenior-level Full TimeCape Town, South Africa7h ago
-
Access Control | Compliance | Data Governance | Data Lineage | Data ModelingAgile team collaborationMid-level Full TimeCape Town, South Africa7h ago
-
Senior Data Engineer (Azure) ZAR 875K-1170KAzure Data | Azure Data Factory | Azure Synapse | Azure Synapse Analytics | Data FactoryIndependent work environment | Remote work | Stakeholder engagementSenior-level ContractJohannesburg, South Africa8h ago
-
Head: Data & Analytics ZAR 750K-900KArtificial Intelligence | Azure Purview | Business Intelligence | Data Classification | Data GovernanceExecutive-level Full TimeCape Town, Western Cape, ZA2d ago
-
Process Automation Engineer (AI/ML) ZAR 450K-580KAPI Integration | Anomaly Detection | Classification | Lean Six Sigma | Machine LearningMid-level Full TimeJohannesburg, South Africa3d ago
-
Senior-level Full TimeEgypt R4d ago
-
Senior Data Scientist (OVA5666) ZAR 780K-1200KApache Spark | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure KubernetesSenior-level Full TimeJohannesburg, South Africa4d ago
-
Data Engineer ZAR 660K-780KAPI Development | Ab Initio | Agile delivery | Azure Data | Azure Data FactorySenior-level Full TimeJohannesburg, ZA4d ago
-
Senior Machine Learning Engineer ZAR 660K-840KAWS EC2 | AWS IAM | AWS KMS | AWS S3 | Amazon CloudWatchCell phone allowance | Data benefits | Fibre connection discount | Health insurance | Retirement benefitsSenior-level Full TimeMidrand, ZA4d ago
-
Manager, Business Intelligence & Insights (TCF) ZAR 348K-420KAI integration | Automation | Cause analysis | Code Development | DMAICMid-level Full TimeZAF Cape Town - 10 Rua, …4d ago
-
Bash | Data Ingestion | Data Processing | Docker | GCPMid-level Full TimeJohannesburg, South Africa5d ago
-
DevOps Engineer ZAR 360K-384KApplication Gateway | Application Insights | Azure DevOps | Azure Monitor | Azure NetworkingCollaborative team environment | Global fast paced environment | Learning and development opportunitiesMid-level Full TimeMidrand, South Africa5d ago
-
Machine Learning Engineer ZAR 780K-860KAI Agents | AI Services | Azure AI | Azure AI Services | Azure OpenAISenior-level Full TimeSandton - 1 Discovery Place, GP, …5d ago
-
Embedded Software Development Engineer ZAR 420K-504KARM | C# | Electronic schematics | Embedded System | Embedded System ArchitectureDisability programs | Hybrid work | Life insurance | Private medical care | Tailored financial programsMid-level Full TimeZA-Century City-Cape Town-The Matrix 2G and …5d ago
-
Senior Data Engineer - Agents Systems GBP 97K-136KApache Flink | Data Contracts | Data Processing | Data Quality | Feature StoreSenior-level Full TimeUnited Kingdom6d ago
-
Senior Data Engineer - AI Infrastructure GBP 101K-136KApache Flink | Data Contracts | Data Pipelines | Data Quality | Feature StoreSenior-level Full TimeUnited Kingdom6d ago
-
Senior Data Platform Consultant ZAR 600K-730KAWS | Azure | CI/CD | Classification | Data EngineeringHybrid workSenior-level Full TimeCape Town, South Africa R6d ago
-
AWS | Amazon Redshift | Apache Airflow | Azure | BigQueryCareer growth opportunities | Collaborative culture | Continuous learning | Flexible working arrangements | Fully remoteSenior-level Full TimeSouth Africa - Remote R6d ago
-
Senior-level Full TimeCape Town, South Africa7d ago
-
Agile | Artificial Intelligence | Data Architecture | Data Engineering | Data GovernanceHybrid work environment | Mentorship | Training and development | Work from home daysEntry-level Full TimeMidrand, GP, South Africa R7d ago
-
Bash | Cloud platform | Cost Optimization | Data Pipelines | Distributed SystemsAccess to cutting-edge technology | Autonomy | Collaborative culture | Distributed first | Fully remoteSenior-level Full TimeSouth Africa R7d ago
-
AI Development Specialist (Azure) OVA5342 ZAR 840K-1080K.NET | AI Search | AI Studio | AKS | API ManagementSenior-level Full TimeJohannesburg, South Africa7d ago
-
Mid-level Full TimeJohannesburg, ZA7d ago
-
AI Data | AI data pipelines | AWS | Access Management | AzureCompetitive pay | Growth opportunities | Remote work flexibilitySenior-level Full TimeHonduras - Tegucigalpa10d ago
-
AI readiness | AI workflows | AWS | Access Control | Access ManagementRemote work | US time zone collaboration | Video interview requirementSenior-level Full TimeArgentina - Buenos Aires10d ago