Senior/Lead Data Engineer (R&D AI Engineering)

Company Description

IFS is a billion-dollar revenue company with 6000+ employees on all continents. Our leading AI technology is the backbone of our award-winning enterprise software solutions, enabling our customers to be their best when it really matters–at the Moment of Service™. Our commitment to internal AI adoption has allowed us to stay at the forefront of technological advancements, ensuring our colleagues can unlock their creativity and productivity, and our solutions are always cutting-edge. 

At IFS, we’re flexible, we’re innovative, and we’re focused not only on how we can engage with our customers but on how we can make a real change and have a worldwide impact. We help solve some of society’s greatest challenges, fostering a better future through our agility, collaboration, and trust.

We celebrate diversity and understand our responsibility to reflect the diverse world we work in. We are committed to promoting an inclusive workforce that fully represents the many different cultures, backgrounds, and viewpoints of our customers, our partners, and our communities. As a truly international company serving people from around the globe, we realize that our success is tantamount to the respect we have for those different points of view.

By joining our team, you will have the opportunity to be part of a global, diverse environment; you will be joining a winning team with a commitment to sustainability; and a company where we get things done so that you can make a positive impact on the world.

We’re looking for innovative and original thinkers to work in an environment where you can #MakeYourMoment so that we can help others make theirs. With the power of our AI-driven solutions, we empower our team to change the status quo and make a real difference.

If you want to change the status quo, we’ll help you make your moment. Join Team Purple. Join IFS.

Job Description

This role is all about hands-on technical prowess. You'll be in the driver's seat, working with autonomy, accountability, and technical brilliance. Your mission includes:

• Identify High-Value Data Opportunities: Spot high-value data opportunities within our product offerings and translate raw data into powerful features and reusable data assets.
• Guide Data Technology Trends: Serve as our data whisperer, guiding us towards the latest and greatest data technology and platform trends. Provide expertise on data processing estimates and data platform evolution.
• Develop and Integrate Data Projects: Craft and integrate data projects from the ground up. From framing problems and experimenting with new data sources and tools to the grand finale of data pipeline implementation and deployment, ensuring scalability and top-tier performance.
• Collaborate with Cross-Functional Teams: Work closely with ML Engineers, Data Scientists, Software Engineers, Solution Architects, and Product/Program Managers to define, create, deploy, monitor, and document data pipelines to power advanced analytics and AI solutions.
• Evangelize Data Technology: Become a data technology evangelist. Shine on the conference stage, host webinars, and pen compelling white papers and blogs. Share your discoveries with clients and internal stakeholders, offering actionable insights that drive change.

Qualifications

• Experience: 3+ years in data engineering for Senior, 5+ years in data engineering for Lead, with a strong track record of delivering scalable data solutions.
• Data Solutions: Skilled in scalable solutions like Data Lakes, Graph and Vector Databases (e.g., ADLS, neo4j, Elasticsearch).
• Data Pipelines: Proficient in designing and managing data pipelines across cloud and on-premises environments, using Azure and other technologies.
• Data Workflow Orchestration: Proven ability in orchestrating data workflows and Kubernetes clusters on AKS using tools like Airflow, Kubeflow, Argo, and Dagster.
• Data Ingestion: Skilled with data ingestion tools such as Airbyte and Fivetran for diverse data sources.
• Large-Scale Data Processing: Expert in large-scale data processing with Spark or Dask.
• Programming Skills: Strong programming skills in Python, Scala, C#, or Java, with experience in cloud SDKs and APIs.
• AI/ML Expertise: Familiarity with AI/ML frameworks and tools, including TensorFlow, PyTorch, AutoML, and MLOps practices (e.g., MLflow, Kubeflow).
• DevOps and CI/CD: Solid experience in DevOps and CI/CD automation with tools like Bitbucket Pipelines, Azure DevOps, and GitHub.
• Automation: Proficient in automating the deployment of data pipelines and applications using Bash, PowerShell, Azure CLI, Terraform, and Helm Charts.
• Search Technologies: Proven ability to leverage advanced search technologies (e.g., Azure AI Search, Elasticsearch) for content analysis and indexing, with a focus on creating advanced RAG (Retrieval Augmented Generation) services using Langchain.
• IoT Data Pipelines: Proficiency in building IoT data pipelines, encompassing real-time data ingestion, transformation, security, scalability, and seamless integration with IoT platforms.
• Streaming Data Applications: Experience in designing, developing, and monitoring streaming data applications using Kafka and related technologies.
• Data Governance: Implement and enforce data governance policies and standards across the data platform.
• Soft Skills: A results-driven attitude, a passion for innovation, strategic thinking, and excellent organizational skills. Ability to juggle multiple tasks and a proactive, self-starting nature.

Additional Information

We embrace flexibility and hybrid work opportunities to support diverse needs and lifestyles, while also valuing inclusive workplace experiences. By fostering a sense of community, we drive innovation, strengthen connections, and nurture belonging. Our commitment ensures you can work in a way that suits you best, while also engaging with colleagues to share ideas and build meaningful relationships.