Data Engineer
Pune, India
MSCI
MSCI is a leading provider of critical decision support tools and services for the global investment community. With over 50 years of expertise in research, data and technology, we enable clients to understand and analyze key drivers of risk...Your Team Responsibilities
- Design, develop, and maintain data pipelines and ETL/ELT processes using PySpark/Databricks.
- Collaborate with cross-functional teams to resolve technical issues and gather requirements.
Your Key Responsibilities
- Optimize performance for large datasets through techniques such as partitioning, indexing, and Spark optimization.
- Ensure data quality and integrity through data validation and cleansing processes.
- Analyze existing SQL queries, functions, and stored procedures for performance improvements.
- Develop database routines like procedures, functions, and views.
- Participate in data migration projects and understand technologies like Delta Lake/warehouse.
- Debug and solve complex problems in data pipelines and processes.
Your skills and experience that will help you excel
- Bachelor’s degree in computer science, Engineering, or a related field.
- Strong understanding of distributed data processing platforms like Databricks and BigQuery.
- Proficiency in Python, PySpark, and SQL programming languages.
- Experience with performance optimization for large datasets.
- Strong debugging and problem-solving skills.
- Fundamental knowledge of cloud services, preferably Azure or GCP.
- Excellent communication and teamwork skills.
Nice to Have:
- Experience in data migration projects.
- Understanding of technologies like Delta Lake/warehouse.
About MSCI
What we offer you
- Transparent compensation schemes and comprehensive employee benefits, tailored to your location, ensuring your financial security, health, and overall wellbeing.
- Flexible working arrangements, advanced technology, and collaborative workspaces.
- A culture of high performance and innovation where we experiment with new ideas and take responsibility for achieving results.
- A global network of talented colleagues, who inspire, support, and share their expertise to innovate and deliver for our clients.
- Global Orientation program to kickstart your journey, followed by access to our Learning@MSCI platform, LinkedIn Learning Pro and tailored learning opportunities for ongoing skills development.
- Multi-directional career paths that offer professional growth and development through new challenges, internal mobility and expanded roles.
- We actively nurture an environment that builds a sense of inclusion belonging and connection, including eight Employee Resource Groups. All Abilities, Asian Support Network, Black Leadership Network, Climate Action Network, Hola! MSCI, Pride & Allies, Women in Tech, and Women’s Leadership Forum.
At MSCI we are passionate about what we do, and we are inspired by our purpose – to power better investment decisions. You’ll be part of an industry-leading network of creative, curious, and entrepreneurial pioneers. This is a space where you can challenge yourself, set new standards and perform beyond expectations for yourself, our clients, and our industry.
MSCI is a leading provider of critical decision support tools and services for the global investment community. With over 50 years of expertise in research, data, and technology, we power better investment decisions by enabling clients to understand and analyze key drivers of risk and return and confidently build more effective portfolios. We create industry-leading research-enhanced solutions that clients use to gain insight into and improve transparency across the investment process.
MSCI Inc. is an equal opportunity employer committed to diversifying its workforce. It is the policy of the firm to ensure equal employment opportunity without discrimination or harassment on the basis of race, color, religion, creed, age, sex, gender, gender identity, sexual orientation, national origin, citizenship, disability, marital and civil partnership/union status, pregnancy (including unlawful discrimination on the basis of a legally protected parental leave), veteran status, or any other characteristic protected by law. MSCI is also committed to working with and providing reasonable accommodations to individuals with disabilities. If you are an individual with a disability and would like to request a reasonable accommodation for any part of the application process, please email Disability.Assistance@msci.com and indicate the specifics of the assistance needed. Please note, this e-mail is intended only for individuals who are requesting a reasonable workplace accommodation; it is not intended for other inquiries.
To all recruitment agencies
MSCI does not accept unsolicited CVs/Resumes. Please do not forward CVs/Resumes to any MSCI employee, location, or website. MSCI is not responsible for any fees related to unsolicited CVs/Resumes.
Note on recruitment scams
We are aware of recruitment scams where fraudsters impersonating MSCI personnel may try and elicit personal information from job seekers. Read our full note on careers.msci.com
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Azure BigQuery Computer Science Databricks Data pipelines Data quality ELT Engineering ETL Excel GCP Pipelines PySpark Python Research Security Spark SQL
Perks/benefits: Career development Flex hours Health care Parental leave
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.