**AI/ML Engineer - VP (contractor conversion)

About Citi:

Citi, the leading global bank, has approximately 200 million customer accounts and does business in more than 160 countries and jurisdictions. Citi provides consumers, corporations, governments, and institutions with a broad range of financial products and services, including consumer banking and credit, corporate and investment banking, securities brokerage, transaction services, and wealth management.

As a bank with a brain and a soul, Citi creates economic value that is systemically responsible and in our clients’ best interests. As a financial institution that touches every region of the world and every sector that shapes your daily life, our Operations & Technology teams are charged with a mission that rivals any large tech company. Our technology solutions are the foundations of everything we do from keeping the bank safe, managing global resources, and providing the technical tools our workers need to be successful to designing our digital architecture and ensuring our platforms provide a first-class customer experience. We reimagine client and partner experiences to deliver excellence through secure, reliable, and efficient services

Citi’s Functions Technology is responsible for delivering Technology solutions to Citi's Functions organizations.  Functions Technology mission is to optimize Citi's Technology environment by delivering world class applications, driving standardization of the production environment, reducing complexity, optimizing management of systems supporting global functions such as Compliance, Controls, Internal Audit and Risk, and introducing innovative technologies that provide new business capabilities, reduce the technology total cost of ownership, and create a competitive advantage for Citi.

We are looking for experienced and proficient AI/ML Engineer who are passionate about solving business problems through innovation and engineering practices. This role will be responsible for writing code, pairing with other developers as appropriate, decomposing acceptance criteria to understand team backlog deliverables, complexities, and risk, while working as a strong contributor on an agile team.

The AI/ML Engineer - is a critical role with the objective of exploring, developing, testing, deploying, enhancing, and maintaining machine learning and artificial intelligence capabilities integrated with Sanctions Screening and Workflow management systems.

A broad understanding of AI/ML concepts and techniques, agile methodologies, cloud computing, intelligent chatbots, and related aspects is essential for the role. Additionally, a key aspect of this role involves the design and refinement of prompts to effectively communicate with generative AI models and to guide them, optimizing their output for a variety of technical applications and producing high-quality and contextually relevant content.

Another success factor for the role will be documentation of model performance and other metrics and communication/presentation of results to pertinent audiences, including senior leadership. Along with a strong technical foundation, a creative, imaginative, forward-looking attitude.  Furthermore, a total quality assurance orientation is indispensable in all activities and outputs.

Key Responsibilities:

• Design and Develop Machine Learning/Deep Learning models/LLM for Text Classification tasks for screening systems.
• Enhance existing AI/ML capabilities through ideation, exploration, testing, prioritization, and implementation
• Conduct training and evaluate different algorithms including RF, Decision Trees, SVM, XGBoost, Naive Bayes and Neural Networks like LSTM, CNN, RNN etc.
• Fine-tune pre trained LLMs on domain specific datasets to improve performance on targeted tasks.
• Perform analytics on AI/ML capabilities usage to understand trends, patterns, and pain points and implement a sustainable feedback loop to ensure positive, continually improving user experiences.
• Explain the analysis of results in a methodical, analytical, visually-appealing manner
• Collaborate with Innovation, technology, vendor, and information security teams on updates, enhancements, releases, and other procedural requirements
• Assess current capabilities and chart a path for continuous improvement of the AI/ML capabilities value and impact
• Prepare, manage, and maintain model risk management (MRM) documentation on model performance and accuracy
• Engage with MRM team on adhering to and fulfilling requirements for MRM process
• Engage with relevant stakeholders on use case ideation, planning, development, and deployment
• Apply strong project management skills to develop project plans, timelines, milestones, and demonstrate progress toward objectives
• Utilize excellent communication skills to ideate, educate, and present internally, often at senior levels (across functions); expected to communicate with external parties
• Help shape the direction of machine learning and artificial intelligence capabilities in Screening workflow process
• Drive tool innovations based on stakeholder needs, including adoption of new technologies and techniques
• Implement and evaluate different preprocessing, feature extraction, prepare text for model training.
• Perform and Automate Hyperparameter tuning for ML and DL models using techniques such as grid search, random search, Optuna.
• Implement Parameter Efficient Fine Tuning (PEFT) to optimize resource usage and improve fine tuning efficiency.

Qualifications:

• 6-10 years experience in AI, machine learning, and model development and deployment
• 5+ years experience in Designing and Developing Machine Learning/Deep Learning models/LLM for Text Classification tasks.
• 5+ years experience in implementing Large Language models such as BERT, Flan T5, Llama and Mistral for various NLP tasks, text generation and classification.
• 5+ years experience working with different algorithms including RF, Decision Trees, SVM, XGBoost, Naive Bayes and Neural Networks like LSTM, CNN, RNN etc
• Solid understanding of data structures and data models
• Experiment with multiple prompts to guide the behavior and output of LLMs of specific tasks.
• Experience in analytics, reporting, and visualization for the analysis and presentation of results.
• Analytics, AI, machine learning, natural language processing (NLP), natural language understanding (NLU), large language models (LLMs)
• Design of AI/ML model performance metrics and optimization
• Intermediate to Advanced level Python coding
• Advanced SQL

Preferences:

• Possess an innovative, forward-looking, and imaginative mindset to continually reach for new horizons in innovation.
• Demonstrable experience working with stakeholders and exceeding their expectations
• Take responsibility and accountability for planning, execution, and delivery
• Positive attitude and a change-driven and change-oriented outlook   
• Adept at developing new ideas and improving current processes
• Consider broad implications of decisions to different functions and units
• Ability to thrive in a fast-paced, results-oriented environment
• Familiarity with Financial Services industry and/or auditing a plus
• Excellent communication and interpersonal skills, with ability to develop strong working relationships and foster team collaboration
• Possess excellent writing skills to deliver clear and concise messages, able to articulate complex concepts
• Agile and waterfall project management methodologies; JIRA a plus

Education:

• Bachelor’s degree Information Technology or Computer Science /University degree or equivalent experience

------------------------------------------------------

Job Family Group:

Technology

------------------------------------------------------

Job Family:

Applications Development

------------------------------------------------------

Time Type:

Full time

------------------------------------------------------

Primary Location:

Tampa Florida United States

------------------------------------------------------

Primary Location Full Time Salary Range:

$113,840.00 - $170,760.00

In addition to salary, Citi’s offerings may also include, for eligible employees, discretionary and formulaic incentive and retention awards. Citi offers competitive employee benefits, including: medical, dental & vision coverage; 401(k); life, accident, and disability insurance; and wellness programs. Citi also offers paid time off packages, including planned time off (vacation), unplanned time off (sick leave), and paid holidays. For additional information regarding Citi employee benefits, please visit citibenefits.com. Available offerings may vary by jurisdiction, job level, and date of hire.

------------------------------------------------------

Anticipated Posting Close Date:

Sep 24, 2024

------------------------------------------------------

Citi is an equal opportunity and affirmative action employer.

Qualified applicants will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.

Citigroup Inc. and its subsidiaries ("Citi”) invite all qualified interested applicants to apply for career opportunities. If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review Accessibility at Citi.

View the "EEO is the Law" poster. View the EEO is the Law Supplement.

View the EEO Policy Statement.

View the Pay Transparency Posting