Senior Data & AI Engineer - Data Engineer

Senior Data & AI Engineer - Data Engineer-078454

Description

 

Location: Hybrid to the closest Capgemini office
Job description:
Our client is seeking a highly skilled Data Engineer to design, build, and maintain scalable data platforms that enable large-scale ingestion, storage, processing, and analysis of structured and unstructured data. This role will focus on constructing data products (data lake / data warehouse), optimizing data pipelines, and implementing robust ETL workflows to support analytics, machine learning, and operational reporting.
The ideal candidate will be proficient in distributed computing, cloud-based data architectures (GCP), and modern data processing frameworks. Experience with real-time data streaming (Kafka, Apache Beam), MLOps, and infrastructure automation (Terraform, Jenkins) is highly preferred.

Key Responsibilities:
•    Data Platform & Architecture Development
•    Design, implement, and maintain scalable data platforms for efficient data storage, processing, and retrieval.
•    Build cloud-native and distributed data systems that enable self-service analytics, real-time data processing, and AI-driven decision-making.
•    Develop data models, schemas, and transformation pipelines that support evolving business needs while ensuring operational stability.
•    Apply best practices in data modeling, indexing, and partitioning to optimize query performance, cost efficiency, considering best practices for Sustainability.

•    Build and maintain highly efficient ETL pipelines using SQL, Python, to process large-scale datasets. ETL, Data Pipelines & Streaming Processing
•    Implement real-time data streaming pipelines using Kafka, Apache Beam, or equivalent technologies.
•    Develop reusable internal data processing tools to streamline operations and empower teams across the organization.
•    Write advanced SQL queries for extracting, transforming, and loading (ETL) data with a focus on execution efficiency.
•    Ensure data validation, quality monitoring, and governance using automated processes and dashboards., MLOps & Cloud-Based Data Infrastructure.
•    Deploy machine learning pipelines with MLOps best practices to support AI and predictive analytics applications.
•    Optimize data pipelines for ML models, ensuring seamless integration between data engineering and machine learning workflows.
•    Work with cloud platforms (GCP) to manage data storage, processing, and security.
•    Utilize Terraform, Jenkins, CI/CD tools to automate data pipeline deployments and infrastructure management, Collaboration & Agile Development
•    Work in Agile/DevOps teams, collaborating closely with data scientists, software engineers, and business stakeholders.
•    Advocate for data-driven decision-making, educating teams on best practices in data architecture and engineering.

Required Skills:
•    5+ years of experience as a Data Engineer working with large-scale data processing.
•    Strong proficiency in SQL for data transformation, optimization, and analytics.
•    Expertise in programming languages (Python, Java, Scala, or Go) with an understanding of functional and object-oriented programming paradigms.
•    Experience with distributed computing frameworks.
•    Proficiency in cloud-based data engineering on AWS, GCP, or Azure.
•    Strong knowledge of data modeling, data governance, and schema design.
•    Experience with CI/CD tools (Jenkins, Terraform) for infrastructure automation.
•    Experience with real-time data streaming (Kafka, or equivalent).
•    Strong understanding of MLOps and integrating data engineering with ML pipelines.
•    Familiarity with knowledge graphs and GraphQL APIs for data relationships.
•    Background in retail, customer classification, and personalization systems.
•    Knowledge of business intelligence tools and visualization platforms.
•    Retail industry experience, specifically Production of Consumer Goods

Life at Capgemini
Capgemini supports all aspects of your well-being throughout the changing stages of your life and career. For eligible employees, we offer: 
•    Flexible work 
•    Healthcare including dental, vision, mental health, and well-being programs
•    Financial well-being programs such as 401(k) and Employee Share Ownership Plan
•    Paid time off and paid holidays 
•    Paid parental leave
•    Family building benefits like adoption assistance, surrogacy, and cryopreservation
•    Social well-being benefits like subsidized back-up child/elder care and tutoring
•    Mentoring, coaching and learning programs
•    Employee Resource Groups 
•    Disaster Relief 
About Capgemini Engineering
World leader in engineering and R&D services, Capgemini Engineering combines its broad industry knowledge and cutting-edge technologies in digital and software to support the convergence of the physical and digital worlds. Coupled with the capabilities of the rest of the Group, it helps clients to accelerate their journey towards Intelligent Industry. Capgemini Engineering has more than 55,000 engineer and scientist team members in over 30 countries across sectors including Aeronautics, Space, Defense, Naval, Automotive, Rail, Infrastructure & Transportation, Energy, Utilities & Chemicals, Life Sciences, Communications, Semiconductor & Electronics, Industrial & Consumer, Software & Internet. 
Capgemini Engineering is an integral part of the Capgemini Group, a global leader in partnering with companies to transform and manage their business by harnessing the power of technology. The Group is guided every day by its purpose of unleashing human energy through technology for an inclusive and sustainable future. It is a responsible and diverse group of 340,000 team members in more than 50 countries. With its strong over 55-year heritage, Capgemini is trusted by its clients to unlock the value of technology to address the entire breadth of their business needs. It delivers end-to-end services and solutions leveraging strengths from strategy and design to engineering, all fueled by its market leading capabilities in AI, cloud and data, combined with its deep industry expertise and partner ecosystem. The Group reported 2023 global revenues of €22.5 billion.
Get the Future You Want | www.capgemini.com
Disclaimer
Capgemini is an Equal Opportunity Employer encouraging diversity in the workplace. All qualified applicants will receive consideration for employment without regard to race, national origin, gender identity/expression, age, religion, disability, sexual orientation, genetics, veteran status, marital status or any other characteristic protected by law.
This is a general description of the Duties, Responsibilities and Qualifications required for this position. Physical, mental, sensory or environmental demands may be referenced in an attempt to communicate the manner in which this position traditionally is performed. Whenever necessary to provide individuals with disabilities an equal employment opportunity, Capgemini will consider reasonable accommodations that might involve varying job requirements and/or changing the way this job is performed, provided that such accommodations do not pose an undue hardship. 
Capgemini is committed to providing reasonable accommodations during our recruitment process. If you need assistance or accommodation, please reach out to your recruiting contact.
Click the following link for more information on your rights as an Applicant http://www.capgemini.com/resources/equal-employment-opportunity-is-the-law
Please be aware that Capgemini may capture your image (video or screenshot) during the interview process and that image may be used for verification, including during the hiring and onboarding process.
Applicants for employment in the US must have valid work authorization that does not now and/or will not in the future require sponsorship of a visa for employment authorization in the US by Capgemini.

    

Job

 : Developer

Schedule

 : Full-time

Primary Location

 : US-PA-Philadelphia

Organization

 : ERD PPL US