IN_Senior Associate_LLM Observability Engineer_Application Technology_Advisory_Bangalore
Bengaluru Millenia, India
INR 2500K-4144K (estimate) Senior-level Full Time
Tasks
- Analyze metrics dashboards
- Capture prompts responses token usage latency and errors
- Collaborate with ML engineers and QA teams
- Design performance test plans
- Detect hallucinations
- Detect toxicity
- Develop test scripts
- Ensure data protection compliance
- Identify performance bottlenecks
- Instrument LLM applications for telemetry
- Monitor performance KPIs
- Monitor security risks prompt injection and sensitive data leakage
- Optimize token usage for cost
- Provide tuning and architecture recommendations
- Run automated evaluation and quality checks
- Score relevance
- Troubleshoot production issues with tracing and logging
Perks/Benefits
- N/A
Skills/Tech-stack
Arize AI | Cost Optimization | Datadog | Gatling | JMeter | Java | Langchain | Langfuse | Load Testing | LoadRunner | Logging | Observability | OpenTelemetry | Performance Testing | Prompt engineering | Python | Token Usage Monitoring | Token usage | Tracing | Usage monitoring
Related jobs
-
GenAI Engineer INR 1200K-2500KAWS | Artificial neural networks | Azure | Data Structures | DatabricksMid-level Full TimeIndia4h ago
-
Bootloader | C# | CAN | Configuration Management | DebuggingFlexi benefits | Health insurance | Hybrid working model | Internal job rotation | Life insuranceEntry-level Full TimeBangalore, IN5h ago
-
Assistant Manager INR 1200K-2000KAPI Integration | CI/CD | Data Engineering | Data Governance | Data QualityMid-level Full TimeGurugram, Haryana, India6h ago
-
Senior Data Integration Engineer I INR 3264K-4401KAWS IAM | Airflow | Amazon VPC | Apache Flink | Apache SparkSenior-level Full TimeBengaluru7h ago
-
Senior Data Engineer I INR 2500K-3380KAgile | Apache Airflow | Apache Hadoop | Apache Hive | Apache KafkaInclusive culture | Professional development time | Supportive team environment | Work-life balanceSenior-level Full TimeGurugram, HR, India8h ago
-
Data Engineer INR 1340K-1680KAWS | Azure | ClickHouse | DBT | Data ArchitectureDonation matching | Flexible PTO | Flexible schedule | Health insurance | Lunch stipendMid-level Full TimeBengaluru, Karnataka, India9h ago
-
Senior Analyst-Data Science INR 2500K-4400KA/B | A/B Testing | B testing | Causal Inference | Data PreparationSenior-level Full TimeGurugram, HR, India9h ago
-
IN_Associate_AI Engineer_GCC_Advisory_Hyderabad INR 2500K-4800KAPI Development | Anthropic API | Async Programming | Autogen | CI/CDFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeHyderabad - Salarpuria, India13h ago
-
Data Engineer (SQL + Python/Java) INR 700K-1500KAWS EMR | Agile Scrum | Amazon Web Services | Apache Spark | Continuous DeliveryHybrid work flexibility | Remote work supportMid-level Full TimeGurgaon - Cyber Park, India13h ago
-
Vice President - Principal Data Engineer INR 3584K-5500KAPI | AWS | Agile | Anomaly Detection | AzureComprehensive healthcare | Flexible time off | Hybrid work model | Retirement plan | Support for working parentsSenior-level Full TimeM11 - Commers III, 43, 44 … R13h ago
-
Mid-level Full TimeBangalore, KA, IN13h ago
-
EY - GDS Consulting - AIA - Gen AI - Senior INR 2000K-3300KAWS CloudFormation | Amazon Bedrock | Amazon Web Services | Apache Spark | AuthenticationCoaching | Continuous learning | Inclusive cultureSenior-level Full TimeChennai, TN, IN, 60003213h ago
-
Operations Sr. Assistant I INR 2500K-3500KAWS | Azure | Cloud Computing | Computer Vision | Data PipelinesSenior-level Full TimeIND - Ranjangaon - B200A, India13h ago
-
Senior .NET AI Engineer- 3188 (Remote) INR 2500K-4500K.NET | Azure | C# | Distributed Systems | Event DrivenFlexible working hours | L and D programs | Remote work | Rewards and recognition | Work-life balanceSenior-level Full TimeChennai, India R1d ago
-
Senior-level Full TimeBangalore, India Office (BANGALORE)1d ago
-
AI Engineer - Bengaluru INR 2000K-3000KDocker | JavaScript | Kubernetes | LLM | Language ProcessingMid-level Full TimeBengaluru, Karnātaka, India1d ago
-
Mid-level Full TimeIN-KA-Bangalore1d ago
-
AI Engineer with RAG / MCP INR 1500K-2500KDocument processing | LLMs | Microservices | Prompt engineering | PythonMid-level Full TimeIN-AP-Hyderabad1d ago
-
Senior-level Full TimeIN-TN-Chennai1d ago
-
Data Engineer INR 1500K-2500KApache Hive | Apache Kafka | Apache Spark | Azure Data | Azure Data FactorySenior-level Full TimeIN-KA-Bangalore1d ago
-
Apache Beam | Apache Flink | Apache Kafka | Apache Spark | Google DataflowMid-level Full TimePune, Maharashtra, India1d ago
-
Applied AI Solution Architect INR 3000K-4500KAI/ML | API Development | AWS Bedrock | AWS SageMaker | Agent memoryContinuous improvement culture | Ownership | Remote workSenior-level Full TimeIndia-Remote R1d ago
-
Data Bricks Infra Engineer INR 1500K-2500KAccess Control | Caching | Data Governance | Databricks | Databricks SQLWork from office 5 days per weekSenior-level Full TimeGurugram, Haryana, India1d ago
-
Software Engineer INR 2000K-3300KAKS | Angular | App Service | Azure | Azure AppEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeChennai, TN, India1d ago
-
Amazon Web Services | Apache Airflow | Apache Kafka | Audit Readiness | CI/CDCareer growth | Continuous learning opportunities | Health insurance | Hybrid work | Remote workSenior-level Full TimeIndia1d ago