Senior/Staff Software Engineer - Machine Learning & System Optimization
Tasks
- Allocate system resources for inference
- Apply model pruning
- Apply model quantization
- Build model conversion and compilation pipelines
- Compile models for edge deployment with TensorRT
- Distribute CPU GPU and interconnect
- Enable mixed precision inference
- Implement concurrent real time deterministic inference
- Implement parameter efficient fine tuning
- Optimize compute utilization through model sharing and fusion
- Optimize large scale models for edge deployment
- Schedule inference for improved compute utilization
- Write custom CUDA kernels for inference
- Write low latency memory safe C++ inference code
Perks/Benefits
- N/A
Skills/Tech-stack
BF16 | Bandwidth Optimization | C++ | CPU GPU | CPU/GPU Optimization | CUDA | CUDA kernels | Concurrent programming | Custom CUDA Kernels | Edge Deployment | FP16 | FP8 | GPU Optimization | INT8 | LoRA | Low Latency | Low latency programming | Memory bandwidth | Memory bandwidth optimization | Mixed Precision | Model Conversion | Model compilation | Performance optimization | Post-training | Post-training Quantization | Python | QLoRA | Quantization | Quantization aware training | Real Time | Real-time Systems | Structured pruning | System Performance | System Performance Optimization | TensorRT | TensorRT Plugins | Time Systems
Education
N/A
Regions
Countries
States
Cities
Related jobs
-
Software Engineer, Research Acceleration USD 350K-475KDistributed Systems | Evaluation Frameworks | Experiment tracking | JAX | Machine LearningDental insurance | Health insurance | Paid parental leave | Relocation support | Unlimited PTOSenior-level Full TimeSan Francisco5h ago
-
Engineer II, Embedded, Sensors, and Safety Software USD 120K-135KC# | C++ | CAN | CI/CD | Computer Vision401k retirement | Dental insurance | Flexible spending account | Flexible time off | Health insuranceSenior-level Full TimeHenderson, CO7h ago
-
Staff Software Engineer - AI/ML USD 192K-260KChurn modeling | Fine Tuning | Generative AI | Language Models | Large Language ModelsSenior-level Full TimeNew York City, New York10h ago
-
Mid-level Full TimeUnited States10h ago
-
ML/AI Engineer - Vehicle Intelligence USD 189K-261KData Privacy | Digital Twins | Digital modeling | Edge Computing | Foundation ModelsMid-level Full TimeSunnyvale, United States11h ago
-
Software Engineer - Data Platform USD 162K-216KAPI Development | Data Ingestion | Data Modeling | Data Pipelines | Data Streaming401k matching | Collaborative work environment | Comprehensive health coverage | Employee stock purchase program | Hybrid work scheduleMid-level Full TimeSan Francisco, California, United States11h ago
-
Software Engineer II - Data Platform USD 116K-162KAirflow | BigQuery | DBT | Docker | GoFlexible time off | In-office workspace | LinkedIn Learning access | Medical insurance | Paid HolidaysMid-level Full TimeUnited States (Remote) R11h ago
-
Senior Software Engineer, Computational Engineering USD 141K-194KC++ | CAD | CAM | CI/CD | Cloud NativeCompany holidays | Company-sponsored life insurance | Health insurance | Long-term disability | Paid parental leaveSenior-level Full TimeTorrance, California, United States12h ago
-
AUTOSAR | Board Bring-up | Bring-up | C# | C++401k retirement plan | Dental insurance | Disability insurance | Discretionary Annual Cash Incentive | Equity programSenior-level Full TimeNewark, CA12h ago
-
Forward Deployed AI Engineer USD 150K-180KAPI | Agent Orchestration | Conversational AI | Hugging Face | LLM401k matching | Community involvement | Dental insurance | Disability benefits | Flexible paid time offMid-level Full TimeItasca, Illinois, United States13h ago
-
Staff Machine Learning Engineer, Vision Models USD 370K-407K3D Scene | 3D Scene Understanding | Autonomous Vehicles | Camera | Computer VisionEquity package | Hybrid work policy | Work from home flexibilitySenior-level Full TimeSunnyvale13h ago
-
Applied Scientist / Machine Learning Engineer USD 311K-370KAction models | Active Learning | Data Curation | Data Deduplication | Data ProcessingHybrid work policyMid-level Full TimeSunnyvale13h ago
-
Data Engineer USD 91K-146KAPI Integration | Data Governance | Data Migration | Data Validation | Data integration401k plan | Dental insurance | Long-term disability insurance | Medical insurance | Paid leaveMid-level Full TimeHanover, MD13h ago
-
Senior Research Engineer, Computer Vision (LFV/WFM) USD 180K-258K3D Reconstruction | 4D reconstruction | AWS EC2 | AWS SageMaker | DDP401k eligibility | Annual cash bonus | Dental insurance | Medical insurance | Paid time offSenior-level Full TimeLos Altos, CA13h ago
-
APIs | AWS Glue | AWS Redshift | Amazon Web Services | Apache AirflowFully remote | Health insurance | On call production support | Paid time off | Retirement plansSenior-level Full TimeOrlando, FL, United States R13h ago
-
AI Engineer, Generative AI Agents USD 192K-220KAWS Bedrock | Context engineering | Databricks | Error Handling | FastAPI401k match | Employer paid medical/dental/vision | Flexible time off | Life insurance | Paid parental leaveSenior-level Full TimeDenver, CO13h ago
-
Staff Data Engineer USD 24K-24KAWS | Apache Airflow | Apache Spark | Argo Workflows | Containerization401k match | Flexible time off | Health insurance | Health savings account | MacBook providedSenior-level Full TimeBeavercreek, OH13h ago
-
Binary Data Formats | Binary data | C++ | Camera Calibration | Cloud processingMid-level Full TimeMountain View, CA13h ago
-
Senior Software Engineer, Data Products USD 190K-250KAPI Development | ClickHouse | Cloud platform | Data Export | Go401k | Co-working stipend | Dental insurance | Employer pension contribution | Family planning benefitsSenior-level Full TimeSan Francisco14h ago
-
Senior Software Engineer, Data Platform USD 190K-250KApache Flink | Apache Kafka | Apache Spark | Batch Processing | Change Data Capture401k | Coworking stipend | Dental insurance | Employer pension contribution | Family planning benefitsSenior-level Full TimeSan Francisco14h ago
-
Embedded Controls Engineer, Spacecraft USD 100K-160KAutomated testing | Autonomous Systems | C# | C++ | CANDental insurance | Employee stock options | Long-term incentives | Medical insurance | Relocation bonusMid-level Full TimeBroomfield, Colorado, United States14h ago
-
Software Engineer, Data Products USD 130K-220KAPI | ClickHouse | Go | Python | React401k contribution | Co-working stipend | Dental insurance | Employer pension contribution | Family planning benefitsMid-level Full TimeSan Francisco14h ago
-
Software Engineer, Data Platform USD 130K-220KApache Flink | Apache Iceberg | Apache Kafka | Apache Spark | Batch Processing401k | Co-working stipend | Dental insurance | Employer pension contribution | Medical insuranceMid-level Full TimeSan Francisco14h ago
-
Machine Learning / Data Science Engineer USD 90K-200KAgent Frameworks | Agent Orchestration | Agentic AI | Amazon RDS | Automation1 1 care | 401k matching | Carrot Fertility | Company paid stipend program | Disability insuranceSenior-level Full TimeReston, VA, United States R15h ago
-
Machine Learning / Data Science Engineer USD 90K-200KAgent Orchestration | Agentic AI | Amazon RDS | Apache Spark | AutomationDisability insurance | Employer 401K matching | Fertility coverage | Flexible work environment | Generous PTOSenior-level Full TimeRichmond, VA, United States R15h ago