Senior Data Engineer - Pune based

The Role: 

We are looking for a Senior Data Engineer to join our data engineering team and lead the design and implementation of scalable, high-performance data solutions. The ideal candidate will have extensive experience with Databricks, SQL/Oracle databases, MarkLogic or other NoSQL platforms, and strong hands-on skills in Python, Shell scripting, and Unix/Linux environments. You will play a key role in shaping our data pipelines and platforms, ensuring reliability, security, and efficiency in data processing and analytics.

• Target start date: June 2025
• Hybrid model - 3 days at Pune Office, India
• Salary range: 25,00,000 to 35,00,000 INR

Key Responsibilities:

• Design and implement scalable ETL/ELT pipelines using Databricks and Apache Spark.
• Develop, maintain, and optimise SQL and PL/SQL scripts for data extraction, transformation, and loading from Oracle and other relational databases.
• Build and maintain NoSQL data flows using MarkLogic or equivalent NoSQL databases.
• Write robust, reusable, and optimised Python and Shell scripts for data automation and workflow orchestration.
• Manage data ingestion and integration processes across structured and unstructured sources.
• Deploy and manage code using GitHub for version control and collaboration.
• Monitor, troubleshoot, and improve performance of data pipelines and jobs.
• Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and deliver clean, high-quality data products.
• Ensure data governance, security, and compliance across the pipeline.

Required Skills & Experience:

• 6+ years of experience in data engineering with large-scale data systems.
• Strong proficiency in Databricks, Apache Spark, and cloud-based data engineering (Azure, AWS, or GCP).
• Solid experience with SQL, PL/SQL, and Oracle Database.
• Proficient in working with MarkLogic or similar NoSQL technologies (e.g., MongoDB, Cassandra).
• Expertise in Unix/Linux systems and scripting using Bash or Shell.
• Advanced programming in Python for data transformation and automation.
• Hands-on experience with GitHub for code versioning, branching, and collaboration.
• Familiar with data quality frameworks and best practices in data architecture.
• Lake house architecture implementation experience

Preferred Certifications:

• Databricks Certified Data Engineer Associate / Professional
• Oracle Database SQL Certified Associate
• MarkLogic Data Hub Developer Certification
• Microsoft Certified: Azure Data Engineer Associate (DP-203)
• Cloudera Certified Associate (CCA) Data Analyst / Spark and Hadoop Developer
• Linux Foundation Certified System Administrator (LFCS)

Nice to Have:

• Experience with workflow orchestration tools such as Airflow, Azure Data Factory, or similar.
• Familiarity with CI/CD for data pipelines.
• Knowledge of data security, encryption, and data privacy practices.

Why Keyrus?

Joining Keyrus means joining a market leader in the Data Intelligence field and an (inter)national player in Management Consultancy and Digital Experience.

You will be part of a young and ever learning enterprise with an established international network of thought leading professionals driven by bridging the gap between innovation and business. You get the opportunity to meet specialised and professional consultants in a multicultural ecosystem.

Keyrus gives you the opportunity to showcase your talents and potential, to build up experience through working with our clients, with the opportunity to grow depending on your capabilities and affinities, in a great working and dynamic atmosphere. 

Keyrus UK Benefits:

• Competitive holiday allowance
• Very comprehensive Private Medical Plan
• Flexible working patterns
• Workplace Pension Scheme
• Sodexo Lifestyle Benefits
• Discretionary Bonus Scheme 
• Referral Bonus Scheme
• Training & Development via KLX (Keyrus Learning Experience)