Principal Consultant-Sr. Databricks Developer

India-Bangalore

Genpact

Artificial Intelligence. Real Outcomes. AI is changing big businesses, and so are we. Discover how cutting-edge AI drives unparalleled value.

View all jobs at Genpact

Apply now Apply later

Principal Consultant-Sr. Databricks Developer-ANA015801

Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose – the relentless pursuit of a world that works better for people – we serve and transform leading enterprises, including the Fortune Global 500, with our deep business and industry knowledge, digital operations services, and expertise in data, technology, and AI. 
Inviting applications for the role of Principal Consultant, Sr. Databricks Developer! 
In this role, the Sr. Databricks developer is responsible for solving real world cutting edge problem  and mentor a team of one or more junior developer to address the goal. 
 
Responsibilities 
•    Closely work with Architect and lead to design solutions to meet functional and non-functional requirements.
•    Participate to understand architecture and solution design artifacts.
•    Evangelize re-use through the implementation of shared assets.  
•    Proactively implement engineering methodologies, standards, and leading practices.  
•    Provide insight and direction on roles and responsibilities required for solution operations.
•    Identify, communicate and mitigate Risks, Assumptions, Issues, and Decisions throughout the full lifecycle.
•    Considers the art of the possible, compares various solution options based on feasibility and impact, and proposes actionable plans.
•    Demonstrate strong analytical and technical problem-solving skills.
•    Ability to analyze and operate at various levels of abstraction.  
•    Ability to balance what is strategically right with what is practically realistic. 
Qualifications we seek in you! 
Minimum qualifications 
•    Excellent technical skills to enabling the creation of future-proof, complex global solutions  
•    Bachelor’s Degree or equivalency (CS, CE, CIS, IS, MIS, or engineering discipline) or equivalent work experience.   
•    Maintains close awareness of new and emerging technologies and their potential application for service offerings and products.
•    Work with architect and leads for solutioning to meet functional and non-functional requirements.
•    Demonstrated knowledge of relevant industry trends and standards.
•    Demonstrate strong analytical and technical problem-solving skills.
•    Must have excellent coding skills either Python or Scala, preferably Python.
•    Must have experience in Data Engineering domain.
•    Must have implemented at least 2 project end-to-end in Databricks.
•    Must have experience on databricks which consists of various components as below
o    Delta lake
o    dbConnect
o    db API 2.0
o    Databricks workflows orchestration
•    Must be well versed with Databricks Lakehouse concept and its implementation in enterprise environments.
•    Must have strong understanding of Data warehousing and various governance and security standards around Databricks.
•    Must have knowledge of cluster optimization and its integration with various cloud services.
•    Must have good understanding to create complex data pipeline.
•    Must have good knowledge of Data structure & algorithms.
•    Must be strong in SQL and sprak-sql.
•    Must have strong performance optimization skills to improve efficiency and reduce cost.
•    Must have worked on both Batch and streaming data pipeline.
•    Must have extensive knowledge of Spark and Hive data processing framework.  
•    Must have worked on any cloud (Azure, AWS, GCP) and most common services like ADLS/S3, ADF/Lambda, CosmosDB/DynamoDB, ASB/SQS, Cloud databases.
•    Must be strong in writing unit test case and integration test.
•    Must have strong communication skills and have worked on the team of size 5 plus.
•    Must have great attitude towards learning new skills and upskilling the existing skills.
 Preferred Qualifications/Skills
 
•    Good to have Rest API knowledge.
•    Good to have understanding around cost distribution.
•    Good to have knowledge of Databricks platform design.
•    Good to have Unity catalog and basic governance knowledge.
•    Good to have Databricks SQL Endpoint understanding.
•    Good To have CI/CD experience to build the pipeline for Databricks jobs.
•    Good to have if worked on migration project to build Unified data platform.
•    Good to have knowledge of DBT.
•    Good to have knowledge of docker and Kubernetes.

Genpact is an Equal Opportunity Employer and considers applicants for all positions without regard to race, color, religion or belief, sex, age, national origin, citizenship status, marital status, military/veteran status, genetic information, sexual orientation, gender identity, physical or mental disability or any other characteristic protected by applicable laws. Genpact is committed to creating a dynamic work environment that values diversity and inclusion, respect and integrity, customer focus, and innovation. For more information, visit www.genpact.com . Follow us on Twitter, Facebook, LinkedIn, and YouTube.
Furthermore, please do note that Genpact does not charge fees to process job applications and applicants are not required to pay to participate in our hiring process in any other way. Examples of such scams include purchasing a 'starter kit,' paying to apply, or purchasing equipment or training.

 

Job

 Principal Consultant

Primary Location

 India-Bangalore

Schedule

 Full-time

Education Level

 Bachelor's / Graduation / Equivalent

Job Posting

 Dec 30, 2024, 7:28:48 AM

Unposting Date

 OngoingMaster Skills List DigitalJob Category Full Time
Apply now Apply later

* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰

Job stats:  0  0  0

Tags: APIs Architecture AWS Azure CI/CD Databricks Data Warehousing dbt Docker DynamoDB Engineering GCP Kubernetes Lambda Python REST API Scala Security Spark SQL Streaming

Region: Asia/Pacific
Country: India

More jobs like this