Data Engineer

Data Engineer

Location: Bengaluru

Experience: 12+ years

Job Mode: Full-time OR Part-time

Work Mode: Work from home, On-site or Hybrid 

Job Summary

As a Data Engineer, you will be a key member of our data engineering team, responsible for designing, developing, and maintaining data pipelines and infrastructure. You will collaborate with cross-functional teams to support data-driven decision-making and contribute to the growth and success of our data-driven initiatives.

Responsibilities and Duties

• Design, develop, and maintain scalable and efficient data pipelines
• Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and translate them into robust data solutions
• Implement data integration processes to ingest, transform, and load data from various sources into data warehouses or data lakes
• Optimize data pipelines for performance, reliability, and scalability
• Monitor and troubleshoot data pipelines to ensure data quality and reliability
• Work with cloud-based data platforms and technologies to support data engineering operation
• Acquire data from primary and secondary sources and maintain databases/systems
• Interpret data, analyze results using statistical techniques, and provide ongoing reports
• Develop and implement databases, data collection systems, data analysis, and other strategies that optimize data quality and statistical efficiency
• Utilize data to answer key business questions promptly and effectively
• Own and maintain dashboards, reports, and ad-hoc requests for the organization
• Collaborate with management to prioritize business needs and insights
• Serve as the go-to person for any ad-hoc data-related inquiries

Qualifications and Skills

• Bachelor's degree or equivalent in computer science, systems engineering, or related fields
• Experience in data management involving the design, construction, and maintenance of operational and analytical data models
• Experience with programming languages and environments for data analysis
• Proactive problem detection and resolution

Role-specific Requirements

• Technologies:

• Responsibilities and Duties         :

  • 7-10 years of strong development experience performing ETL and/or data pipeline implementations.
  • Expert in programming languages, preferably Python.
  • Expert in delivering end-to-end analytic solutions using AWS services (EMR, Airflow, S3, Athena, Kinesis, Redshift).
  • Experience in batch technologies like Hadoop, Hive, Athena, Presto.
  • Strong SQL skills, including query optimization, schema design, complex analytics.
  • Expert in data modeling and metadata management like Glue Catalog etc.
  • Experience in deployment tools like GitHub actions, Jenkins, AWS Code Pipeline etc.
  • Experience in data quality tools like Deque or Great Expectations is Nice To Have.

About Encora

Encora is the preferred digital engineering and modernization partner of some of the world’s leading enterprises and digital native companies. With over 9,000 experts in 47+ offices and innovation labs worldwide, Encora’s technology practices include Product Engineering & Development, Cloud Services, Quality Engineering, DevSecOps, Data & Analytics, Digital Experience, Cybersecurity, and AI & LLM Engineering. 

At Encora, we hire professionals based solely on their skills and qualifications, and do not discriminate based on age, disability, religion, gender, sexual orientation, socioeconomic status, or nationality.