Data Engineer - GDC
Aguascalientes, AGU, MX
Capgemini
A global leader in consulting, technology services and digital transformation, we offer an array of integrated services combining technology with deep sector expertise.Position: Data Engineer
Location: any state of Mexico
Key Responsibilities:
- Design, develop, and maintain scalable ETL pipelines to ingest and transform data from multiple sources.
- Implement data integration strategies using Python, Spark, and Databricks to enable seamless data ingestion and transformation.
- Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and translate them into technical solutions.
- Develop and optimize data workflows to improve data quality, consistency, and performan
- Ensure data security, governance, and compliance best practices are followed.
- Conduct performance tuning of Spark jobs and optimize data queries to minimize latency and improve efficiency.
- Automate data pipelines using CI/CD tools and ensure continuous data delivery.
- Troubleshoot data issues, identify root causes, and implement effective solutions.
Required Qualifications:
- Strong proficiency in Python, with experience in data manipulation libraries like Pandas and PySpark.
- Extensive experience with Apache Spark for data processing and analysis.
- Hands-on experience with Databricks for building scalable data pipelines.
- Experience with data lakes, data warehouses, and cloud platforms like AWS, Azure, or GCP.
- Strong SQL skills for data extraction, transformation, and querying.
- Familiarity with version control systems (e.g., Git) and CI/CD processes.
- Excellent problem-solving skills, attention to detail, and ability to work collaboratively.
Preferred Skills:
- Experience with workflow orchestration tools like Apache Airflow, Dagster, or Prefect.
- Knowledge of data modeling techniques and best practices.
- Familiarity with data visualization tools such as Power BI, Tableau.
- Understanding of data privacy regulations and security protocols.
What can YOU expect in a career with Capgemini?
· Working in a team environment, Consultants will focus on the analysis, design and development of technology-based solutions for Capgemini’s clients.
· You will work alongside technical, functional and industry specialists to assist with the development, implementation and integration of innovative system solutions including methods, techniques and tools.
· You will contribute to client satisfaction by providing timely and responsive value-added services and work products.
· Capgemini offers a competitive compensation and benefits package.
· Headquartered in Paris, France, Capgemini has a presence of more than 340 thousand professionals in Mexico distributed among 3 sites located in Mexico City, Monterrey and Aguascalientes. A deeply multicultural organization.
· Capgemini has developed its own way of working, the Collaborative Business ExperienceTM, and draws on Rightshore, its worldwide delivery model.
You will love this job because
· Capgemini focuses on giving each new hire a YOU-nique experience through our recruitment process and on-boarding program, as well as by helping you to build your own career and professional skills foundation.
· Capgemini provides a collaborative environment that embodies and holds the following stated values close to heart: Honesty, Boldness, Trust, Freedom, Team Spirit, Modesty, and Fun.
· Capgemini cultivates an atmosphere for development that enables YOU to be hands-on, planning for your growth, both horizontally and vertically.
“At Capgemini Mexico, we aim to attract the best talent and are committed to creating a diverse and inclusive work environment, so there is no discrimination based on race, sex, sexual orientation, gender identity or expression, or any other characteristic of a person. All applications welcome and will be considered based on merit against the job and/or experience for the position”
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Airflow AWS Azure CI/CD Dagster Databricks Data pipelines Data quality Data visualization ETL GCP Git Pandas Pipelines Power BI Privacy PySpark Python Security Spark SQL Tableau
Perks/benefits: Career development Competitive pay
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.