Technical Architect
Pune, IN
Atos
We design digital solutions from the everyday to the mission critical — in artificial intelligence, hybrid cloud, infrastructure management, decarbonization and employee experience.Eviden, part of the Atos Group, with an annual revenue of circa € 5 billion is a global leader in data-driven, trusted and sustainable digital transformation. As a next generation digital business with worldwide leading positions in digital, cloud, data, advanced computing and security, it brings deep expertise for all industries in more than 47 countries. By uniting unique high-end technologies across the full digital continuum with 47,000 world-class talents, Eviden expands the possibilities of data and technology, now and for generations to come.
Roles and Responsibility :
The Senior Tech Lead - Databricks leads the design, development, and implementation of advanced data solutions. Has To have extensive experience in Databricks, cloud platforms, and data engineering, with a proven ability to lead teams and deliver complex projects.
Responsibilities:
- Lead the design and implementation of Databricks-based data solutions.
- Architect and optimize data pipelines for batch and streaming data.
- Provide technical leadership and mentorship to a team of data engineers.
- Collaborate with stakeholders to define project requirements and deliverables.
- Ensure best practices in data security, governance, and compliance.
- Troubleshoot and resolve complex technical issues in Databricks environments.
- Stay updated on the latest Databricks features and industry trends.
Key Technical Skills & Responsibilities
- Experience in data engineering using Databricks or Apache Spark-based platforms.
- Proven track record of building and optimizing ETL/ELT pipelines for batch and streaming data ingestion.
- Hands-on experience with Azure services such as Azure Data Factory, Azure Data Lake Storage, Azure Databricks, Azure Synapse Analytics, or Azure SQL Data Warehouse.
- Proficiency in programming languages such as Python, Scala, SQL for data processing and transformation.
- Expertise in Spark (PySpark, Spark SQL, or Scala) and Databricks notebooks for large-scale data processing.
- Familiarity with Delta Lake, Delta Live Tables, and medallion architecture for data lakehouse implementations.
- Experience with orchestration tools like Azure Data Factory or Databricks Jobs for scheduling and automation.
- Design and implement the Azure key vault and scoped credentials.
- Knowledge of Git for source control and CI/CD integration for Databricks workflows, cost optimization, performance tuning.
- Familiarity with Unity Catalog, RBAC, or enterprise-level Databricks setups.
- Ability to create reusable components, templates, and documentation to standardize data engineering workflows is a plus.
- Ability to define best practices, support multiple projects, and sometimes mentor junior engineers is a plus.
- Must have experience of working with streaming data sources and Kafka (preferred)
Eligibility Criteria:
- Bachelor’s degree in Computer Science, Data Engineering, or a related field
- Extensive experience with Databricks, Delta Lake, PySpark, and SQL
- Databricks certification (e.g., Certified Data Engineer Professional)
- Experience with machine learning and AI integration in Databricks
- Strong understanding of cloud platforms (AWS, Azure, or GCP)
- Proven leadership experience in managing technical teams
- Excellent problem-solving and communication skills
Our Offering
- Global cutting-edge IT projects that shape the future of digital and have a positive impact on environment.
- Wellbeing programs & work-life balance - integration and passion sharing events.
- Attractive Salary and Company Initiative Benefits
- Courses and conferences
- Attractive Salary
- Hybrid work culture
Let’s grow together.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Architecture AWS Azure CI/CD Computer Science Databricks Data pipelines Data warehouse ELT Engineering ETL GCP Git Kafka Machine Learning Pipelines PySpark Python Scala Security Spark SQL Streaming
Perks/benefits: Career development Conferences Team events
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.