Sr. DevOps Data Hadoop Engineer

UAE - Dubai, United Arab Emirates

Synechron

Synechron is an innovative global consulting firm delivering industry-leading digital solutions to transform and empower businesses.

View all jobs at Synechron

Apply now Apply later

Job Purpose (Why does the job exist? What is the unique contribution made by the job holder?)

Group IT has a matrix management structure. The Technology Engineer role will have line management and reporting into the VP Technology Chapter, but will be assigned to a Platform squad for task management and prioritisation. The engineer will implement the design and build of the platform along with all associated components from inception to maturity of the running environment over time. The role will be responsible for driving change and delivering new technology into the Bank by onboarding customers and applications to the Platform via self-service and automation.

The engineer will work closely with other Platforms and Product teams in educating them on the new Platform, services and features to ensure any transition and consumption is optimal. Teams work using Agile + DevOps + Product Management methodologies, delivering work packages based on the priority in the backlog.

Job Content (Describe the key results delivered by the job holder, how they are measured and the tasks performed to achieve the results?)

Key Results

Performance Measures

Main Tasks

 

Technology Engineering

  • Hands on Tier – 2 production experience with Cloudera:
    • Installing and maintenance
    • Optimizing cluster performance
    • Working with data engineers to optimize Spark job performance
    • Automation – Ansible, data/analytics jobs CI/CD
    • Observability
  • Automated pipelines/workflows (GitHub Actions, Jenkins, ArgoCD etc.) for data projects. Python based preferred.
  • Shell, Groovy scripting experience
  • Automating security/regulatory checks
  • Automated patching
  • Containerization – Podman, Docker
  • Container Management – Kubernetes/OpenShift
  • Linux OS & Networking basics
  • Source control (git)
  • Agile engineering and practices
  • Some Python programming experience

 

Relationship Management

  • Trustful and professional relationships with key stakeholders
  • Has developed synergies across services, optimizing re-use, promoting simplification and demonstrating speed-to-market benefits
  • Commercial and business focused to improve IT services
  • Trustful and pragmatic approach to problem solving
  • Ability to adopt the Group’s values and drive adoption of the values across the team

Delivery Experience

  • Ability to work on projects from inception to delivery
  • Decision making to decide on best solution based on cost, time and quality of options
  • Cross skills in delivery but also operational support as per the new DevOps model
  • Implementing robust solutions to minimize operational effort

Internal / External Relationships and Committee Memberships ( Internal relationships cover other units within the organization; External relationships relate customers, government bodies, suppliers etc; Committees include formal forums where membership is nominated)

Interface (Int/Ext)

Reason

Committee

Reason

Technical Platforms

Work with the wider infrastructure team to ensure consistency of the deliverables.

Security Chapter

Align with Security standards and collaborate on different design forums

Architecture Chapter

Align with Architecture standards and collaborate on different design forums

Business Platforms

Work with the wider application and product teams to ensure consistency of the deliverables.

Data Chapter

Align with Data standards and collaborate on different design forums

Agile Chapter

Align with Agile standards and collaborate on different design forums

Problems & Decisions ( State problems solved and decisions made on a regular basis by the job holder and the desired outcomes of actions)

Problems and Decision

Desired Outcome

Non-Standardized stack or product

Establish an updated stack of standard products

High TCO of the products

Look for improvements and automate where possible

Platform Strategy is not well defined

Drive Product Roadmaps and backlog

Person Specifications (required to carry out the job, not what the current or recommended incumbent possesses)

Specifications

Description of Knowledge / Skill etc.

Desirable or Essential

Education

  • General
  • Professional
  • IT or similar bachelor’s degree or higher
  • Equivalent work experience

Experiences

(Years & Type)

  • Industry
  • Regional
  • Functional
  • At least 4 years production Hadoop experience
  • 8+ years hands on Technology experience
  • Experience with large and complex global enterprises defined by high availability, broad observability, and high level of reliability.
  • At least 1 project experience in Data Science project/products
  • Excellent communication and articulation skills

Knowledge & Skills

  • Technical
  • Managerial

Technical/Functional:

  • Hands on Tier – 2 production experience with Cloudera:
    • Installing and maintenance
    • Optimizing cluster performance
    • Working with data engineers to optimize Spark job performance
    • Automation – Ansible, data/analytics jobs CI/CD
    • Observability
  • Automated pipelines/workflows (GitHub Actions, Jenkins, ArgoCD etc.) for data projects. Python based preferred.
  • Some Python programming experience
  • Shell, Groovy scripting experience
  • Automating security/regulatory checks
  • Automated patching
  • Containerization – Podman, Docker
  • Container Management – Kubernetes/OpenShift
  • Linux OS & Networking basics
  • Source control (git)

Agile engineering and practices

Nice to have:

  • Public cloud exposure
  • Data Science projects/products

Behavioral Competencies

  • Collaboration
  • Self-starter with strong initiative
  • Innovative and experimental mindset
  • Calm under pressure
  • Pragmatic and focused

S​YNECHRON’S DIVERSITY & INCLUSION STATEMENT
 

Diversity & Inclusion are fundamental to our culture, and Synechron is proud to be an equal opportunity workplace and is an affirmative action employer. Our Diversity, Equity, and Inclusion (DEI) initiative ‘Same Difference’ is committed to fostering an inclusive culture – promoting equality, diversity and an environment that is respectful to all. We strongly believe that a diverse workforce helps build stronger, successful businesses as a global company. We encourage applicants from across diverse backgrounds, race, ethnicities, religion, age, marital status, gender, sexual orientations, or disabilities to apply. We empower our global workforce by offering flexible workplace arrangements, mentoring, internal mobility, learning and development programs, and more.


All employment decisions at Synechron are based on business needs, job requirements and individual qualifications, without regard to the applicant’s gender, gender identity, sexual orientation, race, ethnicity, disabled or veteran status, or any other characteristic protected by law.

Candidate Application Notice

Apply now Apply later

* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰

Job stats:  0  0  0
Category: Engineering Jobs

Tags: Agile Ansible Architecture CI/CD DevOps Docker Engineering Git GitHub Hadoop Jenkins Kubernetes Linux Pipelines Python Security Spark

Perks/benefits: Career development Flex hours

Region: Middle East

More jobs like this