IN_Senior Associate_ LLM Observability Engineer_Application Technology_Advisory_PAN India
Bengaluru Millenia, India
INR 2520K-4500K (estimate) Senior-level Full Time
Tasks
- Analyze response time throughput accuracy cost utilization
- Capture prompts responses token usage latency errors
- Classify toxicity
- Collaborate with data scientists machine learning engineers QA teams
- Design performance test plans
- Detect hallucinations
- Ensure data protection compliance
- Identify performance bottlenecks
- Implement automated quality evaluations
- Implement performance test scripts
- Instrument LLM applications for telemetry
- Mitigate production performance issues
- Monitor for prompt injection risks
- Monitor key performance indicators
- Optimize token usage and compute costs
- Prevent sensitive data leaks
- Score relevance
- Track and alert on budget overruns
- Troubleshoot production issues with tracing and logging
Perks/Benefits
- N/A
Skills/Tech-stack
Arize AI | Cost Optimization | Data Protection | Data protection compliance | Datadog | Gatling | Hallucination detection | JMeter | Java | LLM Observability | Langchain | Langfuse | Load Testing | LoadRunner | Logging | OpenTelemetry | Performance Testing | Prompt injection | Protection compliance | Python | RAG | Relevance scoring | Token usage | Toxicity classification | Tracing
Related jobs
-
Senior Principal Consultant, Gen_AI Engineer INR 2500K-4000KAWS | Agentic AI | Azure OpenAI | Cloud Native | Cloud platformSenior-level Full TimeIndia-Bangalore3h ago
-
Consultant_ GCP Data Engineer INR 1200K-2000KAirflow | BigQuery | Cloud Composer | Cloud Functions | Cloud StorageAI certifications | Training and mentorshipEntry-level Full TimeIndia-Gurugram3h ago
-
Lead Consultant, Gen_AI Engineer with MCP server expertise! INR 2500K-4000KAWS | Agentic AI | Amazon SageMaker | Azure | Azure OpenAISenior-level Full TimeIndia-Bangalore3h ago
-
AI/ML Engineer INR 2500K-4000KAzure Cognitive | Azure Cognitive Search | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimeIN-HR-Gurgaon3h ago
-
AIML Engineer INR 2500K-4000KAzure Data | Azure Data Factory | Azure Data Lake | Cognitive Search | Data FactorySenior-level Full TimeIN-HR-Gurgaon3h ago
-
AI/ML-Data Scientist INR 2500K-3500KAzure Data | Azure Data Factory | Azure Data Lake | Azure OpenAI | Cognitive SearchSenior-level Full TimeIN-HR-Gurgaon3h ago
-
Software Engineer, AI Agents, Tools and Productivity INR 1300K-2000KAccessibility | Algorithms | Data Modeling | Data Structures | Distributed SystemsMid-level Full TimeBengaluru, Karnataka, India; Hyderabad, Telangana, India5h ago
-
Mid-level Full TimePune, Maharashtra, India5h ago
-
AWS Lead Data Engineer INR 2000K-2040KAWS | AWS Glue | AWS architecture | Agile methodology | Amazon AuroraSenior-level Full TimeGurugram, Haryana, India5h ago
-
Senior-level Full TimeNew Delhi, DL, India5h ago
-
DE&A - Core - Cloud Data Engineering - Azure Data Engineering INR 1500K-2000KAggregation pipelines | Azure Blob | Azure Blob Storage | Azure Cosmos | Azure Cosmos DBMid-level Full TimePune, Maharashtra, India6h ago
-
Lead Software Engineer - AWS, PySpark, BigData INR 2000K-2450KAWS | AWS CDK | AWS Lambda | Agile | AirflowSenior-level Full TimeHyderabad, Telangana, India6h ago
-
API Gateway | AWS Bedrock | AWS Lambda | AWS Step Functions | Amazon APIEntry-level Full TimeMumbai, MH, India6h ago
-
Software Engineer III - AWS, PySpark, ETL INR 2000K-2450KAWS EMR | Agile | Apache Spark | CI/CD | Data ModelingSenior-level Full TimeHyderabad, Telangana, India6h ago
-
Senior AI/ML Engineer I INR 2500K-4000KAgentic AI | Azure | BERT | Continuous integration | Distributed SystemsCertification programs | Education reimbursement | Employee Assistance Program (EAP) | Flexible work options | Health coverageSenior-level Full TimeHyderabad, Telangana, India6h ago
-
Consultant - Python Developer with Gen AI INR 1500K-2000KAI Search | Agile | Azure | Azure OpenAI | CSSMid-level Full TimeBangalore, Karnataka, India7h ago
-
Azure Data Engineer - Associate Consultant INR 1500K-2000KAzure Data | Azure Data Factory | Azure Data Flow | Azure Data Lake | Azure DatabricksMid-level Full TimeBangalore, Karnataka, India8h ago
-
Data Engineer- AWS+MS Fabric+ Purview INR 1628K-2040K.NET | AWS | AWS CloudFormation | AWS Lambda | Amazon EC2Senior-level Full TimeGurugram, Haryana, India8h ago
-
Data Engineer INR 960K-1400KADO | Automated testing | Azure Data | Azure Data Factory | Azure Data LakeMid-level Full TimeMumbai, Maharashtra, India9h ago
-
Mid-level Full TimePune, India9h ago
-
Senior-level Full TimeChennai, TN, India10h ago
-
Data Engineer II - Python, AWS, Spark INR 1500K-2000KAWS Cloud | Amazon Web Services | Apache Hadoop | Apache Spark | CI/CDMid-level Full TimeHyderabad, Telangana, India10h ago
-
Sr.Manager Software Engineer INR 2050K-3000KAWS EKS | Agent Development | Amazon ECS | Amazon EMR | Amazon Web ServicesSenior-level Full TimeBengaluru, Karnataka, India11h ago
-
Applied AI ML Sr Associate INR 2500K-3500KAWS Lambda | AWS S3 | AWS Step Functions | Agentic AI | Amazon AthenaSenior-level Full TimeHyderabad, Telangana, India11h ago
-
Machine Learning Data Engineer III INR 2500K-5000KAPI Development | AWS | Amazon Bedrock | Application development | DatabricksSenior-level Full TimeHyderabad, Telangana, India11h ago