Senior Data Platform Engineer
Cape Town, Western Cape, South Africa
ZAR 700K-860K (estimate) Senior-level Full Time
Tasks
- Apply data governance and access controls
- Build scalable data lake architectures
- Design database schemas
- Develop ETL/ELT pipelines
- Ensure data integrity and consistency
- Handle sensitive data securely
- Implement and maintain data infrastructure
- Implement data quality checks
- Implement data validation and constraints
- Instrument pipelines with observability and error handling
- Integrate data systems with applications
- Manage data retention and lineage tracking
- Select data technologies
- Set up monitoring and alerting
Perks/Benefits
Skills/Tech-stack
AI Search | Apache Airflow | BigQuery | Cloud Composer | Cloud Dataflow | Cloud platform | Conflict Resolution | DBT | Data Clustering | Data Consistency | Data Governance | Data Integrity | Data Lineage | Data Modeling | Data Partitioning | Data Quality | Data Validation | Database Design | ELT | ETL | Error Handling | Google Cloud | Google Cloud Platform | Google Dataflow | Graph Databases | Idempotency | Indexing | Looker | Neo4j | Observability | PGVector | Pinecone | PubSub | Query Optimization | Retry logic | SQL | Schema Design | Spanner Graph | Vector Databases | Vector Search | Vertex AI | Vertex AI Search | Weaviate
Education
N/A
Related jobs
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Entrepreneurial environment | Laid-back atmosphere | Remote workMid-level Full TimeJohannesburg, South Africa2d ago
-
Senior-level Full TimeSouth Africa - Remote R2d ago
-
Senior Data Engineer ZAR 505K-510KAWS | Airflow | Amazon EC2 | Amazon EKS | Amazon RDSCompany wide festive season break | Employee assistance program | Sports leave | Study leave | Time off for non profit volunteeringSenior-level Full TimeCape Town, South Africa; Remote - … R3d ago
-
Intermediate Data Scientist ZAR 360K-444KCredit Risk | Data Preparation | Data Quality | Data Validation | Model GovernanceMid-level Full Time1 Enterprise Road, Fairland, Randburg, 2170, …3d ago
-
Analytics Engineer II ZAR 780K-920KAggregation | Airflow | CI/CD | Cloud Data | Cloud Data PlatformsSenior-level Full TimeStellenbosch, ZA3d ago
-
Analytics Engineer ZAR 300K-420KCTEs | DBT | Data Modeling | Data Pipelines | ELTCollaborative cross time zone team | Mentorship opportunitiesMid-level Full TimeJohannesburg4d ago
-
DevOps Engineer (Senior) ZAR 700K-840KAutomation | Cloud Architecture | Cloud platform | Database Administration | DevOpsHybrid work | Renewable contractSenior-level ContractJohannesburg, South Africa5d ago
-
Agile | Azure Data | Azure Data Factory | Azure DevOps | CI/CDHybrid workMid-level Full TimeCape Town, South Africa5d ago
-
Lead Solution Engineer (Data & BI) ZAR 660K-780KData Cube | Data Governance | Data Management MDM | Data Mart | Data ModellingDedicated account manager | Team get-togethers | Upskilling and reskilling | Workation tripsSenior-level Contract Full TimeJohannesburg, GP, South Africa5d ago
-
C# | MATLAB | NumPy | Pandas | PythonFlexible scheduleSenior-level FreelanceSouth Africa - Remote R5d ago
-
Data Scientist (Data Visualization Specialist) ZAR 420K-480KAgile | Batch Processing | D3.js | Data Architecture | Data ModelingMid-level Full TimeCape Town, Western Cape, South Africa6d ago
-
Principal Data Engineer ZAR 700K-840KAWS | Airflow | Azure | BigQuery | CI/CDLoyalty reward | Medical benefits | Paid sick leave | Parental leave | Wellbeing daysSenior-level Full TimeCape Town, South Africa6d ago
-
Automation & AI Engineer ZAR 480K-540KAWS | DBT | GPT | Node.js | PostgreSQLAgency and optionality | Birthday leave | Exclusive shopping discount | Paid holiday | Startup securitySenior-level Full TimeCape Town7d ago
-
Data Scientist III ZAR 480K-650KData Mining | Data Modeling | MATLAB | Machine Learning | PowerBIChallenging work | Innovation opportunities | Networking opportunitiesSenior-level Full TimeFNB Building, 1 Enterprise Road, Fairland, …7d ago
-
Quantitative Data Engineer ZAR 600K-730KAzure DevOps | Cloud Data | Cloud Data Services | Continuous Deployment | Continuous integrationSenior-level Full TimeSandton, Gauteng, ZA10d ago
-
ARM | Active Directory | Agile | Apache Spark | AuthenticationSenior-level Full TimeJohannesburg, South Africa11d ago
-
Senior Data Engineer ZAR 700K-840KAWS | Agile | Apache Spark | Azure | CI/CD25 days annual leave | 30 days annual leave after each year | Cycle to work scheme | Discounted gym membership | Employee-led clubs and eventsSenior-level Full TimeNewcastle11d ago
-
Senior Data Engineer ZAR 745K-860KAWS | Agile | Azure | Python | SQLEmployee Share Purchase Plan ESPP | Employee Stock Options Grant | Flexible working hours | Growth and development opportunities | Health benefits planSenior-level Full TimeJohannesburg or Cape Town, South Africa12d ago
-
AWS Data Engineer – Consultant ZAR 360K-420KAWS | AWS Athena | AWS DMS | AWS Glue | Amazon DynamoDBMid-level Full TimeJohannesburg, Gauteng, South Africa12d ago
-
AIX | AWS | Azure | Brocade SAN | Brocade SAN SwitchesMid-level Full TimeJohannesburg, SA (Hybrid), South Africa R13d ago
-
Mid-level Full TimeSandton, South Africa13d ago
-
Data Engineer (OVA5509) ZAR 900K-1000KAPI Integration | Big Data | Cloud infrastructure | Data Ingestion | Data ProvisioningMid-level Full TimeJohannesburg, South Africa14d ago
-
Staff Engineer (Data Analyst) ZAR 700K-920KAI/ML | Data Analysis | Data Modeling | Data Pipelines | Data VisualizationSenior-level Full TimeJohannesburg, SA (Hybrid), South Africa R14d ago
-
Data Engineer II ZAR 406K-480KAutomated Deployment | Change Management | Data Pipelines | Data Quality | Data WarehousingFlexible work arrangements | Generous leave policy | Health and wellbeing focus | Preferential employee banking rates | Professional development resourcesMid-level Full Time1 Enterprise Road, Fairland, Randburg, 2170, …14d ago
-
Data Engineer ZAR 360K-480KAPI Integration | Cloud Computing | Data Ingestion | Data Integrity | Data PipelinesFamily first | Growth and success | Integrity mattersMid-level Full TimeCape Town, South Africa17d ago