Data Lead
Chennai (OMR Road)
Important Information
Data Engineer
Location: Chennai
Experience: 8-10 years
Job Mode: Full-time
Work Mode: Hybrid
Job Summary
Data Engineer/Lead role
Responsibilities and Duties
- Design and Implement scalable solutions for ever-increasing data volumes, using big data/cloud technologies like Pyspark, Kafka, etc.Collaborate with cross-functional teams to understand data requirements and provide effective solutions.
- Implement real-time data ingestion and processing solutions
- Develop and maintain ETL/ELT processes to support data analytics and reporting.
- Implement best practices for data security, integrity, and quality.
- Developing data integration and migration strategies to move data from legacy systems to Cloud
- Monitoring and troubleshooting the performance and availability of the data systems and implementing strategies to improve their reliability and scalability
- Managing security and access controls for the data systems, including managing roles and permissions, implementing encryption, and complying with regulatory requirements.
Qualifications and Skills
- Bachelor’s in Engineering / Master’s degree in Computer Science, Information Systems or related field
- Minimum of 8-10 years of experience in data engineering.
- Experience with databases and data warehouse implementations (Preferred – MS SQL server, PostGreSQL, Snowflake)
- Strong SQL skills with experience in writing and optimising complex queries
- Working knowledge of Data warehousing, Data Governance, Data Quality and Data Architecture
- Experience in Data Modelling
- Ability to handle large scale structured and unstructured data from internal and third-party sources
- Hands On Experience in Python, Pyspark, Kafka
- Experience with data engineering tools/technologies in GCP Cloud environment
- Proficiency in designing and maintaining scalable data architectures
- Experience with CICD Tools like GitHub
About Encora
Encora is the preferred digital engineering and modernization partner of some of the world’s leading enterprises and digital native companies. With over 9,000 experts in 47+ offices and innovation labs worldwide, Encora’s technology practices include Product Engineering & Development, Cloud Services, Quality Engineering, DevSecOps, Data & Analytics, Digital Experience, Cybersecurity, and AI & LLM Engineering.
At Encora, we hire professionals based solely on their skills and qualifications, and do not discriminate based on age, disability, religion, gender, sexual orientation, socioeconomic status, or nationality.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Architecture Big Data Computer Science Data Analytics Data governance Data quality Data warehouse Data Warehousing ELT Engineering ETL GCP GitHub Kafka LLMs MS SQL PostgreSQL PySpark Python Security Snowflake SQL Unstructured data
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.