Senior Data Platform Engineer
Cape Town, Western Cape, South Africa
ZAR 700K-860K (estimate) Senior-level Full Time
Tasks
- Apply data governance and access controls
- Build scalable data lake architectures
- Design database schemas
- Develop ETL/ELT pipelines
- Ensure data integrity and consistency
- Handle sensitive data securely
- Implement and maintain data infrastructure
- Implement data quality checks
- Implement data validation and constraints
- Instrument pipelines with observability and error handling
- Integrate data systems with applications
- Manage data retention and lineage tracking
- Select data technologies
- Set up monitoring and alerting
Perks/Benefits
Skills/Tech-stack
AI Search | Apache Airflow | BigQuery | Cloud Composer | Cloud Dataflow | Cloud platform | Conflict Resolution | DBT | Data Clustering | Data Consistency | Data Governance | Data Integrity | Data Lineage | Data Modeling | Data Partitioning | Data Quality | Data Validation | Database Design | ELT | ETL | Error Handling | Google Cloud | Google Cloud Platform | Google Dataflow | Graph Databases | Idempotency | Indexing | Looker | Neo4j | Observability | PGVector | Pinecone | PubSub | Query Optimization | Retry logic | SQL | Schema Design | Spanner Graph | Vector Databases | Vector Search | Vertex AI | Vertex AI Search | Weaviate
Education
N/A
Related jobs
-
Automated data quality | Batch Processing | Big Data | CI/CD | Cloud StorageCross training | Hybrid work | Mentorship | Standby rotation participationSenior-level Full TimeCape Town, Western Cape, South Africa1d ago
-
Azure / AWS Cloud Engineer for Data Science ZAR 840K-1100KAmazon EC2 | Amazon Web Services | Azure Data | Azure Data Factory | Azure DevOpsSenior-level Contract Full TimeJohannesburg, Gauteng, South Africa R3d ago
-
Data Scientist (Senior) ZAR 840K-960KAWS Redshift | Amazon S3 | Apache Airflow | Azure Data | Azure Data FactorySenior-level Full TimeBellville, South Africa5d ago
-
Senior-level Full TimeBellville, South Africa5d ago
-
AI Technology and Innovation Engineer ZAR 840K-1100KAPI Development | Amazon Web Services | Artificial Intelligence | Azure | Cloud ComputingHybrid workSenior-level Full TimeJohannesburg, South Africa6d ago
-
Junior Database Engineer ZAR 216K-264KAmazon Web Services | Apache Airflow | Cloud platform | ETL | Google CloudDiscounted groceries | Financial wellness support | Gym or wellness benefits | Health insurance | Mental health counselingEntry-level Full TimeUmhlanga, KwaZulu-Natal, South Africa6d ago
-
Airbyte | Amazon Redshift | BigQuery | CTEs | DBTFlexible schedule | Remote workMid-level Full TimeEgypt R6d ago
-
Senior Data Engineer (Azure) ZAR 840K-1200KAzure Data | Azure Data Factory | Azure Synapse | Azure Synapse Analytics | Cloud ArchitectureRemote work | Stakeholder engagementSenior-level ContractJohannesburg, South Africa6d ago
-
CI/CD | Cloud Storage | Data Pipelines | Data orchestration | Distributed SystemsAsynchronous collaboration | Career growth | Conference stipend | Hardware stipend | Professional learning stipendSenior-level Full TimeSouth Africa R6d ago
-
Senior Data Engineer ZAR 550K-675KAWS | Data Architecture | Data Compliance | Data Engineering | Data GovernanceBirthday leave | Community initiatives | Generous paid annual leave | Group risk insurance | Healthy breakfastSenior-level Full TimeCape Town6d ago
-
Optimization Engineer ZAR 480K-540K5G-NR | Actix | Air interface | Atoll | Drive testGlobal team collaboration | Knowledge sharing | Mentorship | On-call supportMid-level Full TimeJohannesburg,Gauteng,South Africa7d ago
-
Data Engineer ZAR 840K-1170KAzure Synapse | Azure Synapse Analytics | CDC | CI/CD | Change Data CaptureSenior-level Full TimeSandton - 1 Discovery Place, GP, …8d ago
-
Machine Learning Engineer ZAR 264K-360KAutocomplete | Classification | Cloud platform | Embeddings | Google CloudMid-level Full TimeJohannesburg, Gauteng, South Africa8d ago
-
Access Control | Airflow | Amazon Redshift | Authentication | BigQueryFlexible working hours | Remote workSenior-level Full TimeSouth Africa - Remote R9d ago
-
Data Architect Engineer ZAR 840K-1100KAWS Glue | AWS Lake Formation | Amazon Redshift | Amazon S3 | AtScaleSenior-level Full TimeRoodepoort, GP, South Africa10d ago
-
Senior-level Full TimeSandton, South Africa10d ago
-
AI Implementation Expert ZAR 745K-860KAPI Integration | Azure Machine Learning | Azure OpenAI | ChatGPT | Copilot StudioSenior-level Full TimeSouth Africa10d ago
-
AI Implementation Expert ZAR 745K-860KAPI Integration | Azure AI | Azure Machine Learning | Azure OpenAI | ChatGPTSenior-level Full TimeSouth Africa10d ago
-
AI/ML | AWS | Access Control | Asana | AzureRemote work | Video interview requirementSenior-level Full TimeArgentina - Buenos Aires11d ago
-
Senior Quantitative Analyst ZAR 745K-840KAgile | Azure Databricks | CDC | Data Governance | Data LineageSenior-level Full TimeJohannesburg, ZA12d ago
-
AWS | Apache Spark | BigQuery | C++ | CI/CDSenior-level Full TimePretoria, South Africa12d ago
-
Amazon Web Services | Artificial Intelligence | Automation | Cloud Computing | Cloud platformLearning and development | Mentorship | Practical project experience | Rotational programEntry-level Contract Full TimeJohannesburg, GP, South Africa12d ago
-
AWS | Amazon Redshift | Amazon S3 | Bitbucket | ConfluenceRotational training programEntry-level Contract Full TimeJohannesburg, GP, South Africa12d ago
-
Senior Data Engineer (Databricks & Cloud Data Platforms) ZAR 875K-1100KAWS Glue | Amazon Redshift | Amazon S3 | Apache Spark | AzureMentorship | Professional development | Sponsored events | Technical communitySenior-level Contract Full TimeJohannesburg, Gauteng, South Africa13d ago
-
Senior Data Engineer (Databricks & Cloud Data Platforms) ZAR 875K-1100KAWS Glue | Airflow | Amazon Redshift | Amazon S3 | AzureMentorship | Ongoing professional development | Sponsored events | Technical communitiesSenior-level Contract Full TimeJohannesburg, Gauteng, South Africa13d ago