Senior Data Engineer/Analyst
A ZAR 700K-920K (estimate) Senior-level Full Time
Tasks
- Build big data processing pipelines
- Build real-time streaming solutions
- Collaborate cross-functionally on data requirements
- Conduct data exploration and statistical analysis
- Design ETL pipelines
- Design cloud-based data solutions
- Develop automated data pipelines with orchestration
- Develop dashboards and reports
- Develop data warehouses and data lakes
- Drive continuous improvement in data architecture and automation
- Ensure data quality, integrity, and security
- Implement data governance and lineage tracking
- Mentor junior team members
- Optimize query performance
- Translate business KPIs into insights
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | AWS Glue | Airflow | Apache Spark | Azure | Azure Data | Azure Data Factory | BigQuery | CI/CD | Cloud Computing | Data Factory | Data Governance | Data Lakes | Data Lineage | Data Modeling | Data Quality | Data Security | Data Visualization | Data Warehousing | Databricks | ELT | ETL | GCP | Hadoop | Infrastructure as Code | Infrastructure automation | Kafka | Looker | Power BI | Python | Real Time | Real-time Streaming | SQL | Snowflake | Statistical Analysis | Tableau | “as-code”
Education
Roles
Analyst | Data Analyst | Data Engineer | Engineer | Senior Data Analyst | Senior Data Engineer
Related jobs
-
Mid-level Full TimeMidrand, Gauteng, ZA9h ago
-
NumPy | Pandas | Python | SciPy | SymPyPart-time work | Project based workSenior-level FreelanceSouth Africa - Remote R17h ago
-
API Integration | Generative AI | Language Models | Large Language Models | Machine LearningAutonomy | Rapid iteration culture | Remote workSenior-level Full TimeCape Town, Western Cape, South Africa1d ago
-
Data Cleansing | Data Enrichment | Data Modeling | Data Visualization | Descriptive AnalyticsMid-level Full TimeSandton, GP, South Africa1d ago
-
Mid-level Full TimeJohannesburg, GP, South Africa1d ago
-
Canonical Data Modelling | Data Management | Data Modelling | Data Normalization | Data QualityMid-level Full TimeStellenbosch, WC, South Africa1d ago
-
Ab Initio | Azure | Data Governance | Data Modeling | Data SecuritySenior-level Full TimeSandton, South Africa1d ago
-
Data Modeling | Data Warehouse | ETL | Excel | Financial ModelingMid-level Full TimeJohannesburg, GP, South Africa1d ago
-
Dashboards | Data Analysis | Data Engineering | Data Infrastructure | Data MiningMid-level Full TimeJohannesburg, South Africa1d ago
-
Advanced Excel | Azure Synapse | Azure Synapse Analytics | Data Analysis | Data GovernanceSenior-level Full TimeJohannesburg, GP, South Africa1d ago
-
API Design | Application Support | Design Patterns | DevOps | ElasticsearchSenior-level Full TimeJohannesburg, GP, South Africa1d ago
-
AWS Glue | AWS Lambda | Amazon Athena | Amazon EC2 | Amazon S3Senior-level Full TimeCape Town, Western Cape, South Africa1d ago
-
APIs | Data Engineering | Data Pipelines | Data Streams | JSONSenior-level Full TimeCape Town, WC, South Africa1d ago
-
Azure | Data Analysis | Data Governance | Data Lake | Data ModelingContract role 12 months | On-site workSenior-level Full TimeJohannesburg, GP, South Africa1d ago
-
Business Process | Business process modeling | Credit Risk | Curve Stripping | Data FlowsSenior-level Full TimeSandton, GP, South Africa1d ago
-
Automation | Credit Risk | Credit Scoring | Credit Underwriting | Credit risk modelingSenior-level Full TimeJohannesburg, GP, South Africa1d ago
-
A/B | A/B Testing | AWS | Amazon SageMaker | AutomlSenior-level Full TimeJohannesburg, South Africa1d ago
-
Analytics | Apache Kafka | Big Data | Cluster tuning | ContainerizationRemote workSenior-level Full TimeJohannesburg, GP, South Africa R1d ago
-
Senior-level Full TimeDurban North, KZN, South Africa1d ago
-
API Development | AWS | Amazon SageMaker | Apache Spark | AzureSenior-level Full TimeJohannesburg, South Africa1d ago
-
API Development | AWS | Amazon SageMaker | Apache Spark | CI/CDSenior-level Full TimeCape Town, Western Cape, South Africa1d ago
-
Azure Data | Azure Data Factory | Azure DevOps | Azure Synapse | Azure Synapse AnalyticsSenior-level Full TimeJohannesburg, GP, South Africa1d ago
-
Azure | Data Engineering | Data Lake | Data Lineage | Data ModelingSenior-level Full TimeRandburg, GP, South Africa1d ago
-
Apache Airflow | Apache Spark | Cloud infrastructure | Data Architecture | Data GovernanceSenior-level Full TimeCape Town, WC, South Africa1d ago
-
AWS | Apache Spark | Azure Synapse | Azure Synapse Analytics | Cloud ComputingSenior-level Full TimeJohannesburg, GP, South Africa1d ago