Multimodal AI Engineer

We are looking for a passionate and autonomous Multimodal AI Engineer to contribute to our innovative projects in the field of the multimodal foundation models for LLM, image, and clinical data analysis. The Multimodal AI Engineer will work with a dynamic team who is pushing the boundaries of AI machine learning in the healthcare domain and building real-world products for electronic health record (EHR) system.  You will research best practices for data curation, preparation and training of our state-of-the-art foundation models and address some of the hardest problems in computer science.

Requirements

• Important: This role does require you to be located in San Diego, CA.
• PhD degree in Computer Science with a focus on LLM and image multimodal foundation models. Will also consider Master’s degree with excellent academics and extensive relevant research experience.
• Excellent programming skills in Python and C/C++.
• Proficiency in PyTorch framework and the common NLP libraries (NLTK, spaCy, scikit-learn, etc.)
• Experience with state-of-the-art deep learning architectures (ViT/SWIN transformer, GPT, CLIP, etc.).
• Experience with model compression and large-scale distributed model training (data-parallel and model-parallel) techniques.
• An outstanding track record of publications (NeurIPS, CVPR, ICML, AAAI, etc.) and contributions to the machine learning communities (kaggle, Hugging Face, etc.).
• Hands-on experience with parameter-efficient tuning (QLoRA) techniques and the LangChain framework is a plus.
• Experience with prompt engineering and fine-tuning Llama 2 or PaLM 2 with domain specific data is a plus.
• Experience with CUDA programming is a plus.
• Experience with imaging processing (opencv2, VTK, ITK, DCMTK, Albumentations) is a plus.
• Experience with vector databases (Chroma, Pinecone, Milvus, redis, etc.) is a plus.
• Experience with human-in-the-loop, Reinforcement Learning from Human Feedback (RLHF), and continuous online training is a plus.
• Knowledge for Stable Diffusion, OpenJourney, or DeepFloyd IF is a plus.

The base salary range for this full-time position is $185,000 - $230,000.

Benefits

CliniComp's salary ranges are benchmarked and determined by role and level. The range displayed on each job posting reflects the minimum and maximum target for new hire salaries for the position across all US locations and could be higher or lower based on a multitude of factors, including job-related skills, experience, location, and relevant education or training.

• 100% covered Medical and Dental coverage option for you and your family.
• Generous 401(k) plan and contribution.
• Events and biweekly lunches.
• Engaging wellness activities including an onsite nutritionist and personal trainer-led group fitness.
• ...and more!

CCI complies with the Americans with Disabilities Act and considers reasonable accommodation measures that may be necessary for eligible applicants/employees to perform primary responsibilities. EEO/AA/M/F/Veteran/Disabled.