ML Platform Engineer
Jersey City, NJ
R
USD 100K-150K Senior-level Full Time
Tasks
- Build autoscaling capacity management
- Create deployment workflows for canary and rollback
- Design model serving platforms
- Document operational procedures and performance tuning
- Enable end to end observability
- Implement caching and response reuse
- Implement multi tenant routing and rate limiting
- Implement request signing and abuse detection
- Integrate model serving with API gateways and identity systems
- Optimize inference performance
- Perform incident response and reliability improvements
- Support new model releases and rollouts
- Tune GPU utilization and memory management
Perks/Benefits
Skills/Tech-stack
API Gateway | Abuse detection | Automated rollback | Autoscaling | C++ | Caching | Canary Releases | Capacity Planning | Content Filtering | Distributed Systems | GPU Utilization | Go | KV cache | Kubernetes | LLM Inference | Memory Management | Metrics | Observability | Performance Engineering | Python | Quality of Service | Rate Limiting | Request Signing | Rust | Shadow testing | Structured Logging | TensorRT | Tracing
Education
Roles
Regions
Countries
States
Cities
Language: en
Views: 4
Clicks: 2
Saves: 0
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R9d ago
-
Senior Electrical Engineer, Data Centers - Remote (U.S.) USD 150K-175KBIM | Backup Power | Backup power systems | Bill of Materials | Building Information ModelingRemote workSenior-level Full TimeColumbus, OH, United States R1d ago
-
Senior Electrical Engineer, Data Centers - Remote (U.S.) USD 150K-175KACC Cloud | BIM | Backup Power | Bills of materials | Building Information ModelingOccasional travel for client meetings | Paid time off | Relocation not available | Remote work | Sponsorship availableSenior-level Full TimeArlington, VA, United States R1d ago
-
Senior Electrical Engineer, Data Centers - Remote (U.S.) USD 150K-175KAC Cloud | BIM | Backup Power | Backup power systems | Bills of materialsOccasional travel | Paid time off | Remote work | Sponsorship availableSenior-level Full TimePhoenix, AZ, United States R1d ago
-
Senior Electrical Engineer, Data Centers - Remote (U.S.) USD 150K-175KBIM | Backup Power | Backup power systems | Bill of Materials | Building Information ModelingRemote workSenior-level Full TimeChicago, IL, United States R1d ago
-
Senior Electrical Engineer, Data Centers - Remote (U.S.) USD 150K-175KAC Cloud | BIM | Backup Power | Backup power systems | Bills of materialsOccasional travel | Paid time off | Remote work | SponsorshipSenior-level Full TimeDallas, TX, United States R1d ago
-
Senior Electrical Engineer, Data Centers - Remote (U.S.) USD 150K-175KACCA Cloud | BIM | Backup Power | Backup power systems | Bills of materialsEmployee assistance program | Flexible work options | Occasional travel | Paid time off | Remote workSenior-level Full TimeLos Angeles, CA, United States R1d ago
-
AWS | AWS SageMaker | Data 360 | Data Federation | Data ModelingFully remote | Opportunity for Greenfield Work | Supportive collaborative cultureMid-level Full TimeCanada R1d ago
-
Associate Director, Data Strategy & Analytics USD 103K-120KAttribution Modeling | BigQuery | Cohort Analysis | DBT | Data Modeling401k match | Dental insurance | Flexible parental leave | Health insurance | Hybrid work optionsMid-level Full TimeNew York R1d ago
-
Chemical Data Scientist USD 120K-135KData Deduplication | Data Matching | Data Normalization | Data Pipelines | Data cleaningSenior-level Full TimeRemote, San Francisco, CA R1d ago
-
Principal Engineer - Data Infrastructure USD 300K-400KAWS DMS | Airflow | Amazon Kinesis | Amazon Redshift | Apache Iceberg401k match | Dental insurance | Health insurance | LifeTime gym membership discount | SabbaticalSenior-level Full TimeUnited States, Remote R1d ago
-
Chemical Data Scientist USD 120K-135KCAS Number | Classification | Data Matching | Data Normalization | Data QualityGenerous benefits | Remote workSenior-level Full TimeRemote, San Francisco, CA R1d ago
-
AI Automation Engineer USD 140K-160KAPIs | AWS | Agent systems | Azure | Decision enginesDental insurance | Medical insuranceMid-level Full TimeRemote, USA R1d ago
-
Senior Analytics Engineer USD 136K-204KDBT | DBT macros | Data Modeling | Data Transformation | Dbt testingSenior-level Full TimeRemote - USA R1d ago
-
Staff Machine Learning Engineer USD 159K-233KApache Airflow | Artificial Intelligence | Cloud Data | Cloud Data Warehouse | DBT401k | Dental insurance | Disability insurance | Life insurance | Medical insuranceSenior-level Full TimeRemote US R1d ago
-
Data Engineer USD 85KAgile | CI/CD | Cloud | DBT | Data ModelingBackground check required | Hybrid remote option | Paid time off | Visa sponsorship availableMid-level Full TimeMoscow, Off Campus Location - Possible … R1d ago
-
Senior Data Engineer USD 101K-154K.NET | AWS | AWS Glue | AWS Glue Data Catalog | Airflow401-K matching | Auto insurance discounts | Employee assistance program | Fitness club membership contribution | Flexible spending accountsSenior-level Full TimeAll, Maryland, United States R1d ago
-
Data and Cloud Engineer USD 190K-193KAgile | Amazon Web Services | Apache Airflow | Apache Hadoop | Apache KafkaFlexible worksite locations | TelecommutingMid-level Full TimeNew York, United States R1d ago
-
Senior Manager USD 143K-145KAgile | Cost Optimization | Data Modeling | Data Performance Optimization | Data ProcessingTelecommuting permittedSenior-level Full TimeNew York, United States R1d ago
-
Associate Director, AI Architect - US (Remote) USD 140K-160KAPI Development | Agentic Workflows | Cloud Architecture | Document Databases | GCP401k | Health insurance | Paid time off | Remote workMid-level Full TimeVirtual, United States R1d ago
-
Sr. Data Engineer USD 108K-180KAWS IAM | AWS MSK | AWS S3 | Apache Kafka | CI/CD401k match | Dental insurance | Health insurance | PTO | Paid parental leaveSenior-level Full TimeRemote, US R1d ago
-
AWS Glue | Apache Airflow | BI tools | CI/CD | DBTHybrid work | No visa sponsorshipSenior-level Full TimeSan Francisco, California, United States R1d ago
-
AWS | Hadoop | Java | Machine Learning | PyTorchRemote workSenior-level Full TimeSan Francisco, California, United States R1d ago
-
Engineering - Internal AI Transformation USD 74K-110KAPIs | Agentic Workflows | Auditability | Authentication | DockerAnnual company offsite | Co-working stipend | Learning and development stipend | Social travel stipendEntry-level Full TimeUnited States R2d ago
-
AI Forward Deployed Engineer | $120K-$150K + Hybrid + Equity | AI-Based Outage Intelligence Company A USD 120K-150KAI workflows | API Development | Automation | Backend Development | PythonDirect impact on company growth | Equity | Fast moving startup environment with significant ownership | Hybrid work environment | Opportunity to define internal systems and customer experienceMid-level Full TimeKing of Prussia, PA, United States R2d ago