DataOps Engineer

When it comes to putting people first, we're number 1. 
 
The number 1 Top Employer in South Africa. 

Certified by the Top Employer Institute 2025.

Role Purpose/Business Unit:

• A cross-functional person responsible for designing, building, deploying, and maintaining data infrastructure. The person will be required to adopt the well architecture framework to ensure that solutions are sustainable, supportable, secure, reliable, performant, and optimised. This includes effective data quality and operational controls that are inherently part of the solution to serve quality and trusted data to our consumers.
• This includes automation of data pipelines, data monitoring, alerting, and checking across various stages of the pipeline. Continuously support, maintain & optimise production data infrastructure.
  In addition, assist in driving out the Data Engineering Practices such as establishing & implementing design principles, storing and partitioning data strategies, and mentoring other Data Engineers

Your responsibilities will include:

• Collaborate with the broader team such as the Data Scientists, Machine Learning Engineers, and Architects to ensure that the data infrastructure supports the solution and enable us as a collective team to produce accurate actionable insights.
• Design, implement and maintain data infrastructure, ensuring that is scalable, reliable, performant, and efficient.
• Perform and prepare multiple data pipelines to integrate data, be responsible for data quality control, and formulate data integrity solutions.
• Implement proactive monitoring, alerting, trend analysis, and robust applications.
• Implement and comply with the data governance policy and related controls across multiple data platforms. 
• Integrate the data pipelines and infrastructure into our overall deployment processes and meet security and compliance standards.
• Implement automation tools and practises to streamline data pipeline management and reduce manual effort.
• Monitor data pipelines and infrastructure to ensure that they are performing optimally and proactively identify and resolve issues.
• Continuously evaluate and recommend new tools and technologies that can improve our data infrastructure and pipeline management.
• Work effectively as part of an Agile team and collaborate well with your other team members.
• Provide support to other teams if any optimization or the troubleshooting on the performance of the application to avoid errors.
• Assist in driving out the Data Engineering practices and standards to establish a high confident Data Engineering team.

The ideal candidate for this role will have:

• Must have technical / professional qualifications: 
• Bachelor’s degree in computer science, Engineering, or related field.
• 5+ years of overall IT experience with Big Data, data engineering, data operations.
• 3+ Experience with Cloud based data technologies such as AWS, Azure or GCP.
• Strong programming skills in Python and SQL. Essential.
• Experience with DevOps practices, including automated deployment, CI and CD.
• Relevant cloud certification at professional or associate level would be advantageous. 
• Strong communication and collaboration skills.
• Agile exposure, Kanban, or Scrum

Core competencies, knowledge, and experience:

• In-depth knowledge of data as a product & Information best practices.
• Intermediate to advanced level experience in designing, building, and managing data pipelines for batch and streaming applications.
• Experience in using a wide range for data tools such as AWS services – S3, SFTP, Glue, EMR (Spark), Step Functions, Athena, CloudWatch, CouldTrail, KMS, Kinesis, OpenSearch, etc. 
• Exposure to additional tools such as Hadoop, Spark, Hive, Cassandra, Airflow, Kafka and Flink would be advantageous.
• Experience with performance tuning of data applications.
• Experience with performance tuning streaming-based applications for real-time data processing using AWS Kinesis, AWS Kinesys Data Firehose, OpenSearch or similar tools.
• Working experience within the ML and Analytics lifecycle capabilities such as Data Pipelines, Data Processing, Data Storing, Model Lifecycle, Data Operations, Data Management & Data Governance.
• Working experience with Cloud platforms such as AWS and GCP.
• Working experience with Kubernetes and Docker containers.
• Working experience with CI/CD, IAC and DevOps tools such as CDK, Code Repos, etc.
• Strong programming skills in Python and SQL.

We make an impact by offering:

• Enticing incentive programs, competitive benefit packages, and an exclusive 13th cheque
• Retirement funds, risk benefits, and medical aid benefits
• Cell phone and data benefits, advantages fiber connection discounts, and exclusive staff discounts offered in collaboration with partner companies

Closing date for Applications: 07 May 2025

The base location for this role is Midrand Vodacom, Campus

The company's approved Employment Equity Plan and Targets will be considered as part of the recruitment process. As an Equal Opportunities employer, we actively encourage and welcome people with various disabilities to apply.
Vodacom is committed to an organizational culture that recognizes, appreciates, and values diversity & inclusion.