IN_Senior Associate_LLM Observability Engineer_Application Technology_Advisory_Bangalore
Bengaluru Millenia, India
INR 2500K-4144K (estimate) Senior-level Full Time
Tasks
- Analyze metrics dashboards
- Capture prompts responses token usage latency and errors
- Collaborate with ML engineers and QA teams
- Design performance test plans
- Detect hallucinations
- Detect toxicity
- Develop test scripts
- Ensure data protection compliance
- Identify performance bottlenecks
- Instrument LLM applications for telemetry
- Monitor performance KPIs
- Monitor security risks prompt injection and sensitive data leakage
- Optimize token usage for cost
- Provide tuning and architecture recommendations
- Run automated evaluation and quality checks
- Score relevance
- Troubleshoot production issues with tracing and logging
Perks/Benefits
- N/A
Skills/Tech-stack
Arize AI | Cost Optimization | Datadog | Gatling | JMeter | Java | Langchain | Langfuse | Load Testing | LoadRunner | Logging | Observability | OpenTelemetry | Performance Testing | Prompt engineering | Python | Token Usage Monitoring | Token usage | Tracing | Usage monitoring
Related jobs
-
Senior Data Integration Engineer I INR 3264K-4401KAWS IAM | Airflow | Amazon VPC | Apache Flink | Apache SparkSenior-level Full TimeBengaluru6h ago
-
Data Engineer INR 1340K-1680KAWS | Azure | ClickHouse | DBT | Data ArchitectureDonation matching | Flexible PTO | Flexible schedule | Health insurance | Lunch stipendMid-level Full TimeBengaluru, Karnataka, India7h ago
-
IN_Associate_AI Engineer_GCC_Advisory_Hyderabad INR 2500K-4800KAPI Development | Anthropic API | Async Programming | Autogen | CI/CDFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeHyderabad - Salarpuria, India12h ago
-
Data Engineer (SQL + Python/Java) INR 700K-1500KAWS EMR | Agile Scrum | Amazon Web Services | Apache Spark | Continuous DeliveryHybrid work flexibility | Remote work supportMid-level Full TimeGurgaon - Cyber Park, India12h ago
-
Senior .NET AI Engineer- 3188 (Remote) INR 2500K-4500K.NET | Azure | C# | Distributed Systems | Event DrivenFlexible working hours | L and D programs | Remote work | Rewards and recognition | Work-life balanceSenior-level Full TimeChennai, India R22h ago
-
Senior-level Full TimeBangalore, India Office (BANGALORE)22h ago
-
AI Engineer - Bengaluru INR 2000K-3000KDocker | JavaScript | Kubernetes | LLM | Language ProcessingMid-level Full TimeBengaluru, Karnātaka, India23h ago
-
Mid-level Full TimeIN-KA-Bangalore23h ago
-
AI Engineer with RAG / MCP INR 1500K-2500KDocument processing | LLMs | Microservices | Prompt engineering | PythonMid-level Full TimeIN-AP-Hyderabad23h ago
-
Senior-level Full TimeIN-TN-Chennai23h ago
-
Data Engineer INR 1500K-2500KApache Hive | Apache Kafka | Apache Spark | Azure Data | Azure Data FactorySenior-level Full TimeIN-KA-Bangalore23h ago
-
Apache Beam | Apache Flink | Apache Kafka | Apache Spark | Google DataflowMid-level Full TimePune, Maharashtra, India23h ago
-
Applied AI Solution Architect INR 3000K-4500KAI/ML | API Development | AWS Bedrock | AWS SageMaker | Agent memoryContinuous improvement culture | Ownership | Remote workSenior-level Full TimeIndia-Remote R1d ago
-
Data Bricks Infra Engineer INR 1500K-2500KAccess Control | Caching | Data Governance | Databricks | Databricks SQLWork from office 5 days per weekSenior-level Full TimeGurugram, Haryana, India1d ago
-
Software Engineer INR 2000K-3300KAKS | Angular | App Service | Azure | Azure AppEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeChennai, TN, India1d ago
-
Amazon Web Services | Apache Airflow | Apache Kafka | Audit Readiness | CI/CDCareer growth | Continuous learning opportunities | Health insurance | Hybrid work | Remote workSenior-level Full TimeIndia1d ago
-
Semantic Data Engineer INR 2520K-3500KAmazon Redshift | Apache Airflow | Apache Superset | BigQuery | Cube.devSenior-level Full TimeNoida,Uttar Pradesh,India1d ago
-
Senior-level Full TimeIndia - Bengaluru; India - Pune1d ago
-
Principal Software Engineer - AI Platform INR 2515K-3500KAgile | Apache Airflow | CI/CD | Cloud Native | Data AnalysisFlexible medical benefits | Life insurance | Retirement options | Volunteer programsSenior-level Full TimeIndia1d ago
-
Principal AIML Architect INR 3000K-5000KAI Governance | AWS | Agentic AI | Azure | DockerFlexibility | Global collaboration | Healthy work-life balance | Professional growth | Remote-first work environmentSenior-level Full TimeIndia1d ago
-
Senior Software Engineer (Java/Python) INR 2200K-4000KAPI Gateway | AWS CLI | AWS Lambda | Amazon CloudWatch | Amazon DynamoDBSenior-level Full TimeHyderabad, India1d ago
-
Senior Data Engineer - GCP INR 1500K-2400KAI Embeddings | APIs | Airflow | Apache Airflow | Apache SparkSenior-level Full TimeHyderabad1d ago
-
Consultant - Python Developer with Gen AI and AI Foundry INR 2000K-4500KAWS | Autogen | Azure | Azure OpenAI | ClaudeSenior-level Full TimeBangalore, Karnataka, India1d ago
-
Lead Data Engineer – Python & GCP INR 1500K-2500KAirflow | Apache Airflow | Apache Spark | Azure Data | Azure Data FactorySenior-level Full TimeHyderabad1d ago
-
Azure | Azure AI | CI/CD | Kubernetes | LLMOpsCollaborative engineering culture | Flexible work arrangements | Inclusive and diverse work environment | Learning and growth opportunities | Remote-friendlySenior-level Full TimeIndia R1d ago