Principal Engineer - Generative AI Infra Capabilities
INR 2000K-4600K (estimate) Senior-level Full Time
Tasks
- Advise leadership on enterprise technology solutions
- Automate CI CD for infra and model artifacts
- Benchmark disaggregated inferencing and publish tuning guidance
- Define GPU estate hygiene and change control baselines
- Deploy observability and evaluation tracing with SLOs and alerts
- Design GPU cluster topologies for high throughput inferencing
- Harden data center environments with AVI GSLB and DR failover
- Implement AI workload resource management and fair share policies
- Implement API gateway security rate limiting and SLAs
- Integrate Triton Inference Server for multi-model serving
- Lead long term large scale engineering strategy for complex problems
- Mentor engineers and present architecture updates to executives
- Operationalize GPU scheduling and preemption on OpenShift AI
- Publish deployment certify and promote runbooks
- Qualify LLM and SLM runtimes and publish performance recipes
- Tune CUDA kernels and optimize NCCL collectives
Perks/Benefits
- N/A
Skills/Tech-stack
Apigee | Arize | Avi | CI/CD | CUDA | CUDNN | Canary Releases | Disaster Recovery | FP8 | GPU Profiling | GSLB | GSLB patterns | GitLab CI | Helm | INT4) | INT8 | Inference Server | JFrog | KV cache | Kubernetes | Kustomize | MIG | NCCL | NUMA | NVLink | NVSwitch | OpenAI quantization | OpenAPI | OpenShift | OpenShift AI | Overwatch | PCIe | RHOAI | Rollback | SLO | TensorRT-LLM | Triton | Triton Inference | Triton Inference Server | VLLM
Education
N/A
Related jobs
-
Senior Data Engineer INR 1300K-2000KAPI Integration | API Security | Agile | Apigee | Asset ManagementSenior-level Full TimeChennai, Tamil Nadu, India1d ago
-
Senior Consultant INR 1800K-2200KAmazon Aurora | Amazon Aurora PostgreSQL | Amazon Relational Database Service | Amazon Web Services | Aurora PostgreSQLSenior-level Full TimeIN-AP-Hyderabad1d ago
-
Senior-level Full TimeHybrid, Hyderabad, Telangana, India R1d ago
-
AI Engineer INR 2000K-2600KAPI-driven | API-driven Development | Agent Development | Agent Development Framework | Agent Development KitMid-level Full TimePune, Maharashtra, India1d ago
-
Senior-level Full TimeBangalore1d ago
-
Manager Data Reliability Engineering INR 1500K-2000KAWS | Apache Airflow | Apache Kafka | Apache Spark | AzureMid-level Full TimeHyderabad1d ago
-
Lead, AI Engineer INR 2000K-4500KAI Assistants | API Integration | AWS | AWS Bedrock | AWS CDKBenefits | Bonus eligibility | Competitive pay | Equity | Hybrid work environmentSenior-level Full TimeAhmedabad, Gujarat1d ago
-
Abinitio | Agile | Autosys | Cloud platform | Code CoverageSenior-level Full Time110380-IND-BENGALURU-INTL BLR Twr-1&2 CARNATION, India1d ago
-
Data Engineer II - Decision Analytics INR 800K-1050KAWS Lambda | Agile | Amazon EC2 | Amazon EMR | Amazon KinesisAccess to learning courses | Adoption Assistance | Flexible benefits | Health and welfare insurance | Parental leaveMid-level Full TimeGurgaon, India1d ago
-
IN_Senior Associate_AWS_OC - D&A_Advisory_ Bhubaneshwar INR 2000K-2400KAWS Glue | AWS Lambda | AWS Step Functions | Amazon AppFlow | Amazon AthenaSenior-level Full TimeBhubaneswar - Ihub, India1d ago
-
Data Engineer INR 1500K-2000KApache Airflow | Apache Kafka | Azure DevOps | Azure DevOps Pipelines | CI/CDIndividual contributor | Shift workMid-level Full TimeMumbai, MDC2B, India1d ago
-
Data Engineer INR 1500K-2000KApache Airflow | CI/CD | Cloud Composer | Cloud Functions | Cloud StorageShift workMid-level Full TimeMumbai, MDC2B, India1d ago
-
Data Engineer INR 1500K-2000KApache Airflow | Azure DevOps | CI/CD | Cloud Composer | Cloud FunctionsMid-level Full TimeMumbai, MDC2B, India1d ago
-
Data Engineer INR 1500K-2000KApache Airflow | CI/CD | Cloud Composer | Cloud Functions | Cloud PubSubMid-level Full TimeMumbai, MDC2B, India1d ago
-
Data Engineer INR 1500K-2000KApache Airflow | BigQuery SQL | Cloud Composer | Cloud Functions | Cloud Pub/SubMid-level Full TimeMumbai, MDC2B, India1d ago
-
Data Engineer INR 1500K-2000KApache Airflow | Apache Kafka | Cloud Composer | Cloud Functions | Cloud PubSubMid-level Full TimeMumbai, MDC2B, India1d ago
-
Data Engineer INR 1500K-2000KAzure DevOps | CI/CD | Cloud Composer | Cloud Functions | Cloud StorageIndividual contributor | Shift workMid-level Full TimeMumbai, MDC2B, India1d ago
-
Data Engineer INR 1500K-2000KApache Airflow | Azure DevOps | CI/CD | Cloud Functions | Cloud StorageMid-level Full TimeMumbai, MDC2B, India1d ago
-
Data Engineer INR 2040K-2400KCI/CD | Cloud Composer | Cloud Function | Cloud Pub/Sub | Cloud StorageSenior-level Full TimeMumbai, MDC2B, India1d ago
-
Data Engineer INR 2040K-2400KApache Airflow | Azure DevOps | CI/CD | Cloud Composer | Cloud FunctionsSenior-level Full TimeMumbai, MDC2B, India1d ago
-
Data Engineer INR 1500K-2000KAirflow | Apache Kafka | CI/CD | Cloud Composer | Cloud FunctionsShift workMid-level Full TimeMumbai, MDC2B, India1d ago
-
Data Engineer INR 1500K-2000KCI/CD | Cloud Composer | Cloud Functions | Cloud Storage | Cloud platformShift workMid-level Full TimeMumbai, MDC2B, India1d ago
-
Mid-level Full TimeMumbai, MDC2B, India1d ago
-
Mid-level Full TimeMumbai, MDC2B, India1d ago
-
Mid-level Full TimeMumbai, MDC2B, India1d ago