Data Engineer
Tasks
- Automate regulatory reporting data preparation
- Build data lake and data warehouse solutions
- Collaborate on solution design documentation
- Create scalable data platform infrastructure
- Design data pipelines
- Develop ETL processes with error handling
- Develop backend applications with APIs
- Implement CI/CD, automated testing, and version control
- Implement data quality and governance
- Use Infrastructure as Code for deployments
- Validate and submit regulator returns data outputs
Perks/Benefits
- N/A
Skills/Tech-stack
API Development | AWS Data | AWS Data Services | Amazon Web Services | Automated testing | Batch Processing | CI/CD | Containerization | Data Governance | Data Lake | Data Quality | Data Services | Data Warehouse | Django | ETL | Infrastructure as Code | Kubernetes | Python | SQL | Snowflake | Stream processing | Version control | Web Services | Workflow Orchestration | “as-code”
Education
Bachelor of Engineering | Bachelor of Science | Bachelor of Technology | High School Diploma | Master of Science | PhD
Roles
Related jobs
-
Software Engineer (Machine Learning) ZAR 576K-650KAPIs | AWS | Alerting | Auto Scaling | Cloud ComputingSenior-level Full TimeCape Town, Western Cape, ZA17h ago
-
Automation | Azure Data | Azure Data Explorer | CSV | Data ExplorerCross-functional collaboration | Exposure to large scale security telemetry | Professional growth | Remote workMid-level Full TimeSouth Africa R20h ago
-
AI-assisted coding | Assisted coding | Bash | Build Automation | C#Driver LicenseSenior-level Full TimePretoria, South Africa1d ago
-
AI Agents | AI Observability | APIs | AWS Bedrock | Access ControlAsynchronous collaborative model | Distributed international working environment | Flexible parental leave | Fully Remote Working Environment | Mental health and wellbeing supportSenior-level Full TimeSouth Africa R2d ago
-
Mid-level Full Time15 Alice Lane, South Africa2d ago
-
Data Engineer ZAR 700K-840KAmazon Web Services | Batch Processing | CI/CD | Data Governance | Data LakeSenior-level Full TimeStellenbosch, ZA2d ago
-
Senior-level Full TimeJohannesburg, South Africa2d ago
-
Automated Workflows | CI_CD | Cloud Computing | Containerization | Data LineageProfessional growthSenior-level Full TimeSouth Africa2d ago
-
.NET MAUI | AI Agents | Agent systems | Amazon Web Services | Application ProgrammingSenior-level Full TimeRivonia, South Africa2d ago
-
.NET MAUI | APIs | Agent systems | Amazon Web Services | AzureFlexible innovation time | Hands-on technical leadership | Mentorship opportunitiesSenior-level ContractJohannesburg, South Africa2d ago
-
Mid-level Full TimeSouth Africa2d ago
-
AI Solutions Lead - Marketing & Content ZAR 600K-720KAI platforms | API Development | AWS | Data Privacy | Enterprise AIRemote work opportunity | Work-life balanceSenior-level Full TimeJohannesburg, Gauteng R2d ago
-
AI architecture | AWS | Cloud platform | Data Governance | Data PrivacyRemote work | Work-life balanceSenior-level Full TimeJohannesburg, Gauteng R2d ago
-
Senior Analytics Engineer ZAR 660K-720KAPI Development | Analytics engineering | Azure | Cloud Computing | Data ArchitectureSenior-level Full TimeJohannesburg, ZA3d ago
-
API | Authentication | Automated testing | Data Pipelines | GitMid-level Full TimeSouth Africa - Remote R3d ago
-
ARM | Agile | Apache Spark | Azure Data | Azure Data FactorySenior-level ContractJohannesburg, South Africa3d ago
-
Senior Cloud Data Engineer ZAR 745K-900KAirflow | Apache Beam | Apache Spark | BigQuery | Cloud platformContinuous learning opportunities | Medical aid | Paid volunteering leave | Retirement funding options | Tech events and exposSenior-level Full TimeJohannesburg, South Africa3d ago
-
Senior Ai Engineer ZAR 600K-720KAWS | AWS SageMaker | Automated testing | Azure | Azure MLCareer growth opportunities | Collaborative work environment | Conference support | Courses support | Medical Aid OptionalSenior-level Full TimeJohannesburg, South Africa3d ago
-
Senior-level Full TimeHQ Sandton, South Africa4d ago
-
Staff Embedded Software Engineer ZAR 504K-576KC plus plus | C# | Communication Protocols | Containerization | CryptographyAnnual leave | Career development opportunities | Inclusive culture | Work-life balanceSenior-level Full TimeDurban, ZA, 3630 R4d ago
-
Mid-level Full TimeJohannesburg, ZA R4d ago
-
AI Agents | APIs | Access Control | Claude | Data handlingFully remote work | Work during U S business hours supportMid-level Full TimeEgypt R4d ago
-
Mid-level Full TimeEgypt R4d ago
-
Senior Specialist Analytics & Enablement ZAR 540K-650KAnomaly Detection | Azure Data | Azure Data Factory | Azure Synapse | DAXSenior-level Full TimeSandton, South Africa5d ago
-
Senior Analytics Engineer ZAR 600K-600KAI analytics | DBT | Dagster | Data Governance | Data ModelingFlexible work schedule | Hybrid work | Life insurance | Matched pension scheme | Paid parental leaveSenior-level Full TimeCape Town, South Africa R7d ago