Senior ML Engineer - Kimchi (LLM Inference Optimization)
Tasks
- Implement quantization strategies
- Lead technical direction for inference optimization
- Minimize cold start and memory footprint
- Optimize LLM inference throughput
- Profile and fix inference bottlenecks
- Reduce LLM latency
- Scale distributed inference across nodes
- Tune KV cache utilization
Perks/Benefits
- Conference access
- Equipment budget
- Equity options
- Extra days off
- Flexible work schedule
- Hackathon
- Learning budget
- Remote-first
- Team-building budget
Skills/Tech-stack
AWS | ArgoCD | CUDA | Cache eviction | Checkpointing | ClickHouse | Cloud Computing | Cloud PubSub | Collective communication | Continuous batching | Distributed Systems | FP8 | GCP | GCP PubSub | GitLab CI | Google Cloud | Google Cloud PubSub | Grafana | INT4) | INT8 | Kernel tuning | Kubernetes | Loki | Microsoft Azure | PagedAttention | PostgreSQL | Prometheus | PyTorch | Python | Quantization | SGLang | Sharding | Speculative decoding | Tempo | TensorRT-LLM | VLLM
Education
N/A
Related jobs
-
AI Engineer (F/M) - Remote EUR 26K-30KArtificial Intelligence | Data Pipelines | Data handling | Data integration | DockerOpportunity for VIE program | Professional mentorship | Remote work | Work with global teamsEntry-level Full TimeValència, VC, Spain R1d ago
-
Data labeling | Direct Preference Optimization | Fine Tuning | Huggingface | Human FeedbackAI tools access | Co-working budget | Equipment provided | Fully remote | Health and wellness supportSenior-level Full TimeEurope R1d ago
-
Data Engineer (Madrid, Spain) EUR 54K-67KAWS | Apache Airflow | Apache Spark | Azure Data | Azure Data FactoryAfter-work activities | Flexible working hours | Hybrid work | International team | Remote workMid-level Full TimeMadrid, Community of Madrid, Spain R2d ago
-
Deep learning | Langchain | MLOps | Machine Learning | NumPyProject based workMid-level FreelanceSpain - Remote R2d ago
-
Principal AI Engineer EUR 56K-79KAgentic Frameworks | Agile | Azure | Azure DevOps | CI/CDBenefits | Remote work flexibility | Stock optionsSenior-level Full TimeSpain - Remote R3d ago
-
AI Platform Engineer EUR 56K-80KAWS | Agent Orchestration | Agentic Systems | Amazon EKS | CI/CDCertification support | Continuous learning | English training | Flexible working hours | Remote work optionsSenior-level Full TimeRemote, Spain R4d ago
-
Freelance Data Science Engineer (Python & SQL) USD 68K-68KFeature Engineering | LLM | Langchain | MLOps | MatplotlibEnglish communication requirements | Part-time project workMid-level FreelanceSpain - Remote R4d ago
-
Autoregressive models | Deep learning | Diffusion Models | Distributed Training | Machine LearningAccess To Large Scale Experimentation Infrastructure | Fully remote | Global First Work Environment | Innovation autonomy | Research publication supportMid-level Full TimeSpain R5d ago
-
AWS Lambda | AWS Secrets | AWS Secrets Manager | AWS Systems Manager | AWS Systems Manager Parameter StoreCollaborative ownership driven culture | Continuous learning and professional development opportunities | Flexible working hours | Fully remote | Work-life balanceMid-level Full TimeSpain R5d ago
-
AWS | Azure | Cloud platform | Data Preprocessing | DockerContinuous learning | Hybrid workSenior-level Full TimeMalaga, ES, 29590 R5d ago
-
API Integration | Banking integrations | CRM | CrewAI | DATEVDeutschland-Ticket subsidy | Employer pension contribution | Fitness and wellness benefits | Free snacks and beverages | Hardware allowanceMid-level Part TimeOffice Stuttgart, Office Berlin, Homeoffice Berlin, … R5d ago
-
Senior Data Engineer Databricks (m/f/d) EUR 36K-45KAgile | Amazon Web Services | Apache Spark | Azure | CI/CDChildcare support | Coursera access | Experience days | Flexible schedule | Free access to health and wellness specialistsSenior-level Full TimeGranada, AN, Spain R6d ago
-
API Keys | Apache Airflow | Authentication | CI/CD | DBTAutonomy | Flexible collaboration hours | Fully remote work | High ownership | Work-life balanceSenior-level Full TimeSpain R6d ago
-
Benchmarking | C++ | CUDA | Docker | Inference OptimizationAutonomy | Continuous learning | Flexible location | Fully remote | Professional developmentMid-level Full TimeSpain R6d ago
-
Cloud Computing | Data Pipelines | Debugging | ETL | Google ColabCareer growth opportunities | Flexible work schedule | Fully remote | Inclusive culture | Optional coworking accessMid-level Full TimeSpain R6d ago
-
AWS | Advanced Excel | Artificial Intelligence | Data Mining | Data ModelingHybrid work model | International collaboration | Lunch providedEntry-level Full TimeES - Central Priégola - Pozuelo … R6d ago
-
AI Data Platform Engineer (MLOps) EUR 35K-41KAWS | AWS Bedrock | Aurora PostgreSQL | Azure | CI/CDBenefit bonus | Life insurance | Nature activities | Paid training | Private medical insuranceMid-level Full TimeMADRID, Spain R6d ago
-
Cloud | Distributed Systems | Go | Infrastructure as Code | KubernetesAnnual leave | Bonus | Equity | On-call support | Remote workSenior-level Full TimeSpain (Remote) R7d ago
-
Amazon Redshift | DBT | Data Ingestion | Data Modeling | Data ObservabilityCareer development opportunities | Charitable contribution allocations | Family health insurance | Fitness reimbursement | Private pension contributionsMid-level Full TimeSpain R7d ago
-
Analytics Engineer I - AI & Data Enablement EUR 55K-72KAutomation | Data Documentation | Data Modeling | Data Quality | Data ValidationDiscounts on transportation and food | Enhanced parental leave | External coaching or therapy | Flexible time off | Learning budgetMid-level Full TimeBarcelona, Spain R7d ago
-
ES- Data Engineer + INGLÉS EUR 28K-35KAnalytics | Data Lake | Data Modeling | Data pipeline | ETLFlexible schedule | Intensive Fridays | Remote workEntry-level Full TimeMadrid, MD, Spain R7d ago
-
Junior Data Engineer (Python/Spark) (m/f/d) EUR 28K-35KApache Spark | Data Modeling | Databricks | ETL | PySparkAccident insurance | Childcare support | Coursera access | Experience days | Flexible scheduleEntry-level Full TimeReus, CT, Spain R7d ago
-
Senior AI & Computer Vision Software engineer EUR 56K-84K3D Vision | AWS | Agile | Azure | Code reviewBirthday day off | Dental insurance | Discount Portal | English lessons | Flexible scheduleSenior-level Full TimeSpain - Remote R7d ago
-
Data Engineer - EY GDS Spain - Hybrid EUR 65K-65KAWS | Apache Airflow | Apache Parquet | Avro | AzureContinuous learning programs | Flexible work-life integration | Hybrid work model | Volunteering opportunities | Well-being programsMid-level Full TimeMalaga, ES, 29590 R8d ago
-
AI Architect / Senior AI Engineer EUR 56K-81KAzure | CI/CD | Computer Vision | Docker | GRPCBirthday day off | Childcare support | Conference and Events Attendance | Dental insurance | Discount portal for employeesSenior-level Full TimeSpain - Remote R8d ago