Solutions Architect - Deep Neural Network Evaluation

Tasks

• Analyze system failures and develop mitigation strategies
• Benchmark AI systems across use cases
• Design agentic AI evaluation pipelines
• Drive adoption of NVIDIA evaluation tools
• Evaluate LLM and VLM systems
• Evaluate neural networks and security risks
• Extend and build evaluation benchmarks
• Integrate NVIDIA and open source LLM technology into agentic pipelines
• Optimize retrieval pipeline performance
• Select and fine-tune models
• Support distributed training evaluation approaches

Perks/Benefits

• Comprehensive benefits package
• Technical presentations support

Skills/Tech-stack

Agentic pipelines | Benchmarking | Deep learning | Distributed Training | Embedding Model | Embedding Model Fine Tuning | Embeddings | Evaluation Harness | Fine Tuning | LLM Fine-tuning | Language Models | Large Language Models | Machine Learning | Model Fine-tuning | NEMO | Network evaluation | Neural Network | Neural network evaluation | Pipeline Optimization | Reinforcement Learning | Retrieval Pipeline | Retrieval pipeline optimization | Retrieval-Augmented Generation | Vision Language Models | Vision-language