Lead Data Engineer-Digital Banking Kotak 811-Regional Sales
Bengaluru, Karnataka, India
Kotak Mahindra Bank
Kotak Mahindra Bank offers high interest rate savings account, low interest rate personal loan and credit cards with attractive offers. Experience the new age Personal Banking and Net Banking with Kotak Bank.Job Title: Lead Data Engineer
Job Description:
As a Lead Data Engineer, you will be responsible for overseeing the design, development, and maintenance of data infrastructure and solutions within @Kotak811.
- You will lead a team of data engineers, collaborate with stakeholders, and provide technical leadership to drive the success of our data initiatives.
- Your deep understanding of data engineering principles, advanced technical skills, and strategic mindset will be critical in shaping our data strategy and driving innovation.
Responsibilities:
- Data Strategy and Architecture:
- Define and drive the data engineering strategy, aligning it with the organization's goals and objectives.
- Design and architect scalable, secure, and performant data solutions
- Evaluate emerging technologies, tools, and frameworks to enhance the data engineering ecosystem.
- Collaborate with stakeholders to identify data requirements and translate them into technical solutions.
- Team Leadership and Management:
- Lead and manage a team of data engineers, providing technical guidance and mentorship.
- Set clear goals, monitor progress, and provide regular feedback to team members.
- Foster a collaborative and inclusive team culture, promoting knowledge sharing and professional development.
- Drive recruitment efforts to attract and retain top data engineering talent.
- Data Engineering Project Management:
- Lead end-to-end data engineering projects, from requirements gathering to solution delivery.
- Collaborate with cross-functional teams, including data scientists, business analysts, and software engineers, to ensure successful project outcomes.
- Define project scope, timelines, and resource allocation, and manage project risks and issues.
- Monitor project progress and ensure adherence to quality standards and best practices.
- Data Infrastructure and Governance:
- Oversee the development and maintenance of scalable data infrastructure, including databases, data warehouses, and data lakes.
- Implement and enforce data governance policies, standards, and best practices.
- Collaborate with data governance teams to ensure compliance with data privacy and security regulations.
- Continuously assess and optimise data infrastructure for performance, scalability, and cost efficiency.
- MLOps[1]
- Lead and manage a team of data engineers to design, develop, and maintain MLOps infrastructure and processes for real-time consumer applications.
- Collaborate with data scientists and software engineers to define requirements and translate them into scalable MLOps pipelines.
- Architect and develop infrastructure for model training, deployment, and monitoring.
- Implement efficient and reliable model deployment strategies using containerization and orchestration technologies like Docker and Kubernetes.
- Design and implement scalable data pipelines for real-time data ingestion, preprocessing, and feature engineering.
- Optimise model performance, latency, and scalability for real-time inference in consumer applications
- Technical Leadership and Innovation:
- Stay abreast of emerging trends, technologies, and best practices in data engineering.
- Provide technical expertise and guidance to solve complex data engineering challenges.
- Drive innovation by identifying opportunities to leverage advanced analytics, machine learning, or AI techniques in data engineering solutions.
- Foster a culture of continuous improvement and drive process efficiencies within the data engineering team.
Qualifications:
- 8-10 years of experience in data engineering(including designing and implementing data solutions), model deployment, and MLOps with Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
- Experience with Enterprise Business Intelligence Platform/Data platform sizing, tuning, optimization and system landscape integration in large-scale, enterprise deployments.
- Deep understanding of data engineering principles, data architecture, and data integration patterns.
- Experience with big data technologies and frameworks such as Apache Spark, Hadoop, or similar.
- Candidate who understands the security frameworks, best practices, treat data as assets in EDW ecosystem
- Experience working extensively in multi-petabyte DW environment
- Experience in engineering large-scale systems in a product environment
- Strong leadership and people management skills, with the ability to lead and inspire a team.
- Excellent communication and stakeholder management skills.
- Strategic mindset and ability to align data engineering initiatives with business objectives.
- Demonstrated ability to drive innovation and foster a culture of continuous improvement.
@anshulpahwa25@gmail.com - Going too far. ?
_Assigned to Anshul Pahwa_
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Architecture Banking Big Data Business Intelligence Computer Science Data governance Data pipelines Data strategy Docker Engineering Feature engineering Hadoop Kubernetes Machine Learning MLOps Model deployment Model training Pipelines Privacy Security Spark
Perks/benefits: Career development
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open Data Manager jobs
- Open Marketing Data Analyst jobs
- Open Principal Data Engineer jobs
- Open Power BI Developer jobs
- Open Data Science Manager jobs
- Open Lead Data Analyst jobs
- Open MLOps Engineer jobs
- Open Senior Business Intelligence Analyst jobs
- Open Business Data Analyst jobs
- Open Data Analytics Engineer jobs
- Open Data Scientist II jobs
- Open Business Intelligence Developer jobs
- Open Product Data Analyst jobs
- Open Sr Data Engineer jobs
- Open Junior Data Scientist jobs
- Open Data Analyst Intern jobs
- Open Senior Data Architect jobs
- Open Sr. Data Scientist jobs
- Open Big Data Engineer jobs
- Open Research Scientist jobs
- Open Principal Data Scientist jobs
- Open Data Quality Analyst jobs
- Open Azure Data Engineer jobs
- Open Manager, Data Engineering jobs
- Open Data Product Manager jobs
- Open GCP-related jobs
- Open Data quality-related jobs
- Open Java-related jobs
- Open ML models-related jobs
- Open Business Intelligence-related jobs
- Open Data management-related jobs
- Open Privacy-related jobs
- Open Data visualization-related jobs
- Open PhD-related jobs
- Open Deep Learning-related jobs
- Open NLP-related jobs
- Open PyTorch-related jobs
- Open Finance-related jobs
- Open TensorFlow-related jobs
- Open APIs-related jobs
- Open LLMs-related jobs
- Open Consulting-related jobs
- Open Generative AI-related jobs
- Open CI/CD-related jobs
- Open Snowflake-related jobs
- Open Hadoop-related jobs
- Open Kubernetes-related jobs
- Open Data governance-related jobs
- Open Databricks-related jobs
- Open Data warehouse-related jobs