Senior Data Engineer (AWS to GCP)
Tasks
- Build maintain and enhance data transformations
- Collaborate with cross-functional teams
- Create and manage orchestration workflows
- Design, build, and maintain scalable data pipelines
- Develop optimize ETL/ELT workflows
- Implement and improve data quality frameworks
- Monitor document and improve platform reliability
- Participate in code reviews and technical discussions
- Support migration from AWS to GCP
Perks/Benefits
- Career growth
- Collaborative Agile environment
- Flexible working arrangements
- International large scale projects
- Ongoing training and mentoring
- Remote or hybrid work
Skills/Tech-stack
AWS | AWS S3 | Agile | Apache Airflow | Apache Dataproc | Apache Kafka | BigQuery | Cloud Composer | Cloud Migration | Cloud platform | Data Modeling | Data Quality | Databricks | ELT | ETL | Git | Google Cloud | Google Cloud Platform | PySpark | Python | SQL
Education
N/A
Roles
Related jobs
-
Senior-level Full TimeJohannesburg, South Africa1d ago
-
Senior-level Full TimeCape Town, South Africa1d ago
-
Senior-level Full TimeDurban, South Africa1d ago
-
Computer Vision | Deep learning | Diffusers | Diffusion Models | IP AdaptersAnnual vacation | Corporate discounts for English language learning programs | Fully remote | Health allowance | Professional development reimbursementSenior-level Full TimeSouth Africa R1d ago
-
Agentic pipelines | DPO | Deep learning | Direct Preference Optimization | Distributed TrainingContinuous learning opportunities | English language learning discounts | Fully remote | Health support budget | Home-office allowanceSenior-level Full TimeSouth Africa R1d ago
-
Senior-level Full TimeStellenbosch, ZA2d ago
-
AI readiness | AI workflows | AWS | Access Control | Access ManagementCustomer facing technical role | Real growth opportunities | Remote work opportunities | Vetted employersSenior-level Full TimeArgentina - Buenos Aires4d ago
-
AI Data | AI data pipelines | AWS | Access Management | AzureHybrid work with customer travel | Remote workSenior-level Full TimeHonduras - Tegucigalpa4d ago
-
AWS Glue | AWS Lake Formation | AWS Lambda | AWS S3 | AWS Step FunctionsCareer growth | Flexible work culture | Fully remote workSenior-level Full TimeSouth Africa R5d ago
-
Agentic Workflows | Conversational AI | Dialogue Management | Error Handling | Function CallingCareer growth opportunities | Flexible work location | Fully remote | High technical autonomy | Startup-like environmentSenior-level Full TimeSouth Africa R5d ago
-
Senior-level Full TimeStellenbosch, ZA5d ago
-
Machine Learning Engineer ZAR 700K-1200KAgent systems | Language Processing | MLOps | Machine Learning | Model TrainingSenior-level Full TimeDurban, South Africa6d ago
-
Machine Learning Engineer ZAR 700K-1200KComputer Vision | Docker | Git | Kubernetes | Language ProcessingDirect founder collaboration | End-to-end ownership | Fast-paced environment | High autonomySenior-level Full TimeCape Town, South Africa6d ago
-
Machine Learning Engineer ZAR 700K-1200KComputer Vision | Continuous integration | Deep learning | Docker | KubernetesSenior-level Full TimeJohannesburg, South Africa6d ago
-
Mid-level Full TimeCape Town, South Africa6d ago
-
Mid-level Full TimeCape Town, South Africa6d ago
-
Data Engineer (Senior) ZAR 745K-840KAWS Glue | AWS Lambda | Azure | CI/CD | Data ModelingHybrid workSenior-level Full TimeCenturion, South Africa6d ago
-
AI Applications | AI Automation | AI workflows | APIs | Artificial IntelligenceClient facing travel | Technical mentorship | Training workshops facilitationEntry-level Full TimeRosebank, Johannesburg, Gauteng6d ago
-
Disaster Recovery Automation Engineer ZAR 450K-480KAPIs | Automation | Bash | Disaster Recovery | PythonMid-level Full TimeAbsa 270 Republic Road, South Africa6d ago
-
Database Engineer / Database Administrator ZAR 464K-504KAWS Aurora | AWS RDS | Agile | Automation | Database AdministrationAdvancement opportunities | Annual tutoring stipend for children | Employee development program stipend | Fertility/adoption assistance | Mentorship programMid-level Full TimeRemote, South Africa R7d ago
-
AWS | AWS DMS | AWS Glue | Amazon Athena | Amazon RDSHybrid work modelSenior-level Full TimeJohannesburg, South Africa7d ago
-
C# | MATLAB | NumPy | Pandas | PythonFlexible hours | Part-time project work | Project-based assignmentsSenior-level Full TimeSouth Africa - Remote R7d ago
-
AWS Lambda | Agent Frameworks | Amazon Bedrock | CI/CD | DockerSenior-level ContractPretoria, South Africa8d ago
-
Senior-level ContractJohannesburg, South Africa8d ago
-
Specialist Data Scientist ZAR 736K-840KAlteryx | Azure Machine Learning | Clustering | DataRobot | Decision TreesSenior-level Full TimePinelands, South Africa8d ago