ML Platform Engineer
Jersey City (India Square), NJ
R
USD 100K-160K Senior-level Full Time
Tasks
- Build autoscaling and capacity management
- Design model serving platforms
- Develop deployment workflows
- Document operational procedures and tuning guidance
- Drive end-to-end observability
- Implement caching and response reuse
- Implement multi tenant routing and rate limiting
- Implement serving layer security controls
- Integrate model serving with API gateways and observability
- Operate incident response for high availability
- Optimize inference performance
- Support new model releases and rollouts
- Tune GPU utilization and memory management
Perks/Benefits
- N/A
Skills/Tech-stack
API Gateway | Abuse detection | Automated rollback | Autoscaling | C++ | Caching | Canary Deployment | Content Filtering | Continuous batching | Distributed Systems | GPU Architecture | GPU Utilization | Go | Incident Response | Inference Optimization | KV cache | Kubernetes | Language Model | Large Language Model | Memory Management | Metrics | Observability | Python | Quality of Service | Rate Limiting | Request Routing | Request Signing | Rust | Security controls | Shadow testing | Structured Logging | TensorRT-LLM | Tracing
Education
Roles
Regions
Countries
States
Cities
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R7d ago
-
Assistant Director - Insights And Analytics INR 3000K-5199KCode reuse | Data Governance | Data Quality | Data Wrangling | Machine LearningExecutive-level Full TimeBangalore, Karnataka, India R9h ago
-
Senior-level Full TimeSunnyvale, CA | Remote, US | … R10h ago
-
Software Engineer, Machine Learning USD 213K-251KAlgorithms | Data Structures | Graph theory | Information Retrieval | Language ProcessingSenior-level Full TimeSunnyvale, CA | Los Angeles, CA … R10h ago
-
Senior-level Full TimeRemote, US | Bellevue, WA | … R10h ago
-
Senior-level Full TimeAhmedabad, Gujarat, India R13h ago
-
GCP, Bigquery, Airflow/Consultant Specialist INR 1500K-2500KApache Airflow | Apache Hadoop | Apache Kafka | Apache NiFi | BigQueryFlexible workingSenior-level Full TimeHyderabad, Telangana, India R14h ago
-
GCP Data Engineer/Associate Director, Data and Analytics INR 800K-2000KAgentic AI | Agile | Airflow | BigQuery | CI/CDMid-level Full TimeHyderabad, Telangana, India R14h ago
-
Staff Data Scientist - Digital Intelligence USD 191K-230KAdversarial Modeling | Anomaly Detection | Apache Spark | Data Processing | Distributed dataSenior-level Full TimeHybrid - US R16h ago
-
Data Scientist ll - Digital Intelligence USD 140K-170KDatabricks | Experiment analysis | Feature Engineering | Machine Learning | Model EvaluationMid-level Full TimeHybrid - US R18h ago
-
Apache Hadoop | Apache Spark | Azure Blob | Azure Blob Storage | Azure DataImmediate joinerMid-level Full TimeHyderabad, Telangana, India - Remote R21h ago
-
AVP, Data Engineer (L10) INR 4000K-5000KAPI | AWS | AWS Glue | Agile | Amazon EMRCareer advancement | Employee wellness programs | Flexible work hours | Upskilling opportunities | Work from homeExecutive-level Full TimeHyderabad IN, India R21h ago
-
Full Stack AI Developer INR 2500K-4500KAPI | Artificial Intelligence | C# | Cloud Computing | ContainersCareer growth opportunities | Collaborative culture | Purpose-driven work | Remote workSenior-level Full TimeIndia - Remote R21h ago
-
Senior Data Engineer, Platform USD 119K-149KAWS DMS | Access Control | Airflow | Amazon Web Services | CI/CDSenior-level Full TimeRemote - US, United States R21h ago
-
Edge AI Engineer USD 100K-155KC++ | Core ML | Cross Platform Inference | Cross-platform | Edge inferenceSenior-level Full TimeUnited States - Remote R21h ago
-
Full Stack AI Engineer USD 140K-170KAWS | Agent workflows | Anthropic | Azure | CI/CD401k matching | Birthday off | Employee assistance program | Medical/Dental/Vision insurance | Paid parental leaveSenior-level Full TimeRemote South Carolina, Remote South Carolina, … R21h ago
-
Senior-level Full TimeUnited States - Remote R21h ago
-
AI Research Engineer USD 100K-150KAccelerator hardware | Agentic Systems | Computer Vision | Data Quality | Data labelingCareer growth | Remote workSenior-level Full TimeUnited States - Remote R21h ago
-
Hadoop Big Data Developer USD 100K-150KAWS EMR | Airflow | Apache Atlas | Apache Flink | Apache HudiRemote workSenior-level Full TimeUnited States - Remote R21h ago
-
Hadoop Big Data Developer USD 100K-150KAirflow | Apache Flink | Apache Hive | Apache Pig | Apache SparkCareer growth | Remote workSenior-level Full TimeUnited States - Remote R21h ago
-
Senior-level Full TimeUnited States - Remote R21h ago
-
Backend AI-Forward Data Engineer USD 100K-125KAWS | Airflow | Anomaly Detection | Automated testing | Azure DataDental insurance | Disability insurance | Health insurance | Life insurance | Paid HolidaysSenior-level Full TimeRemote South Carolina, Remote South Carolina, … R21h ago
-
Senior Data Engineer USD 100K-150KAWS Glue | Agile | Airflow | Amazon Redshift | Apache SparkCareer growth potential | Full-time benefits | Remote workSenior-level Full TimeUnited States - Remote R21h ago
-
Batch Processing | Confluence | Data Pipelines | Data Quality | Data ValidationHybrid work schedule | Remote work considerationSenior-level Full TimeOhio - Columbus, Three Nationwide Plaza, … R21h ago
-
LLM Engineer USD 100K-150KAdapter-Tuning | DPO | Dataset curation | DeepSpeed ZeRO | Efficient AttentionCareer growth | Remote workMid-level Full TimeUnited States - Remote R21h ago