Senior/Principal Local LLM & Generative AI Platform Engineer
Tasks
- Build CI CD and model registries
- Build modular inference model gateway layer
- Create versioned evaluation datasets
- Deploy containerized services on Kubernetes
- Design RAG and enterprise search pipelines
- Design safe tool calling workflows
- Develop reusable APIs and tools
- Enforce source permissions and access controls
- Establish release gates and regression tests
- Implement model and agent observability
- Implement permission-aware retrieval
- Implement security network isolation encryption and retention
- Integrate platform with employee tools via SDKs and reference implementations
- Integrate with engineering workflows
- Optimize inference performance with batching and caching
- Own local LLM platform architecture
- Run offline and online evaluation
- Select and optimize open weight models
Perks/Benefits
- N/A
Skills/Tech-stack
Access Control | Audit Logging | Automated testing | Batching | C plus plus | CI/CD | Capacity Planning | Citations | Context Management | Data poisoning | Data poisoning defense | Disaster Recovery | Docker | Embeddings | Encryption | Enterprise Search | Git | Go | Hybrid retrieval | Incident Response | Infrastructure as Code | Injection Defense | Java | KV caching | Kubernetes | Lexical search | Linux | Linux systems | Metadata filtering | Monitoring | Network isolation | Observability | Parallelism | Permission Aware Retrieval | Prompt Safety | Prompt engineering | Prompt injection | Prompt injection defense | Python | Quantization | RAG | Reranking | Retrieval-Augmented Generation | Role-Based Access | Role-Based Access Control | SSO | Secrets management | Structured Output | Tokenization | Tool-Calling | Transformer Models | Vector Search | Vulnerability Management | “as-code”
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Regions
Countries
States
Related jobs
-
Backend Team Leader-Data Platform ILS 338K-473KAmazon MSK | Amazon Web Services | Apache Flink | Apache Kafka | Data ModelingHybrid work modelSenior-level Full TimeTel Aviv-Yafo, Tel Aviv District, Israel R2d ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerMid-level Full TimeTel Aviv, Israel2d ago
-
Ansible | BMC | CI/CD | CRUSH | CephExecutive-level Full TimeKfar Saba, Center District, Israel2d ago
-
Senior Data Engineer ILS 338K-473KApache Airflow | Apache Beam | Apache Spark | BigQuery | Cloud ComputingHealth and wellness benefits | Hybrid work model | Inclusive work environmentSenior-level Full TimeRamat Gan, Tel Aviv District, IL R3d ago
-
3D Geometry | C++ | Computer Vision | Embedded Systems | Machine LearningTeamwork collaborationMid-level Full TimeRosh Ha'Ayin, Israel, IL3d ago
-
Backend Team Leader-Data Platform ILS 338K-473KAmazon MSK | Amazon Web Services | Apache Flink | Apache Kafka | Data ModelingHybrid workSenior-level Full TimeTel Aviv-Yafo, Tel Aviv District, Israel R3d ago
-
Senior Algorithm Engineer ILS 362K-504KA/B | A/B Testing | B testing | Deep learning | High ThroughputComprehensive benefits | Fully stocked kitchen | Hybrid work schedule | Location-specific perks | Mentorship opportunitiesSenior-level Full TimeTel Aviv, Israel R3d ago
-
AI Governance | AI Security | API Development | Agent systems | Agentic AIContract engagement | Fully remote workSenior-level Full TimeIsrael R3d ago
-
Mid-level Full TimeTel Aviv, Israel R3d ago
-
M.Sc Student Deep Learning Algorithm Developer ILS 336K-504KAlgorithms | Computer Vision | Data Structures | Deep learning | Machine LearningNone Full TimeRamat Gan, Israel3d ago
-
Mid-level Full TimeJerusalem, Israel3d ago
-
Senior-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL R4d ago
-
Access Control | C# | Debugging | Diagnostic Testing | Driver DevelopmentMid-level Full TimeHaifa; Herzliya4d ago
-
Senior-level Full TimeRa'anana, Center District, IL R4d ago
-
Senior Software Engineer- Data Engineering ILS 360K-504KAWS | Apache Airflow | Apache Iceberg | Apache Kafka | Artificial IntelligenceSenior-level Full TimeTel Aviv, Israel4d ago
-
Machine Learning Engineer student for AI Solutions Group ILS 170K-230KArgo | Docker | Elastic | Generative AI | GitHybrid work model | Student internship arrangementNone Part TimeISR - Haifa, Israel R4d ago
-
Senior/Principal Backend AI Engineer (Cortex XSIAM) ILS 384K-504KAI | AWS | Cloud Computing | Cloud platform | ContainerizationSenior-level Full TimeTel Aviv, Tel Aviv4d ago
-
AI Engineer ILS 321K-400KAnthropic Claude | Asynchronous pipelines | Authentication | Credential Handling | Error HandlingDinners provided | Dog-friendly office | Fully stocked kitchen | Global teams | Happy hoursSenior-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL5d ago
-
Senior-level Full TimeNetanya, Center District, IL R5d ago
-
Algorithms | CI/CD | Data Structures | Development Principles | LinuxMid-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL5d ago
-
Data Engineer (Agentic Search) ILS 174K-222KAWS | Airflow | BigQuery | DBT | Data Freshness MonitoringCareer growth and learning opportunities | Collaborative culture | Flexibility | International environment | Opportunity to work on impactful AI projectsMid-level Full TimeIsrael5d ago
-
Senior Software Engineer - Big Data Platform ILS 504K-630KAI machine learning | Angular | Distributed Systems | JavaScript | KubernetesSenior-level Full TimeTel Aviv5d ago
-
Data Ingestion | Data Modeling | Data Quality | Data Transformation | Data pipelineMid-level Full TimeTel Aviv, Israel5d ago
-
Principal Computer Vision Engineer ILS 420K-540KC++ | CUDA | Deep learning | Feature Matching | HomographyFlex first work arrangement | In-person eventsSenior-level Full TimeIsrael - Hybrid (3 days/week in … R5d ago
-
Mid-level Full TimeRamat Gan, Israel, IL R6d ago