Senior/Principal Local LLM & Generative AI Platform Engineer
Tasks
- Build CI CD and model registries
- Build modular inference model gateway layer
- Create versioned evaluation datasets
- Deploy containerized services on Kubernetes
- Design RAG and enterprise search pipelines
- Design safe tool calling workflows
- Develop reusable APIs and tools
- Enforce source permissions and access controls
- Establish release gates and regression tests
- Implement model and agent observability
- Implement permission-aware retrieval
- Implement security network isolation encryption and retention
- Integrate platform with employee tools via SDKs and reference implementations
- Integrate with engineering workflows
- Optimize inference performance with batching and caching
- Own local LLM platform architecture
- Run offline and online evaluation
- Select and optimize open weight models
Perks/Benefits
- N/A
Skills/Tech-stack
Access Control | Audit Logging | Automated testing | Batching | C plus plus | CI/CD | Capacity Planning | Citations | Context Management | Data poisoning | Data poisoning defense | Disaster Recovery | Docker | Embeddings | Encryption | Enterprise Search | Git | Go | Hybrid retrieval | Incident Response | Infrastructure as Code | Injection Defense | Java | KV caching | Kubernetes | Lexical search | Linux | Linux systems | Metadata filtering | Monitoring | Network isolation | Observability | Parallelism | Permission Aware Retrieval | Prompt Safety | Prompt engineering | Prompt injection | Prompt injection defense | Python | Quantization | RAG | Reranking | Retrieval-Augmented Generation | Role-Based Access | Role-Based Access Control | SSO | Secrets management | Structured Output | Tokenization | Tool-Calling | Transformer Models | Vector Search | Vulnerability Management | “as-code”
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Regions
Countries
States
Related jobs
-
Senior Software Engineer - Data Pipelines ILS 341K-504KAWS | Apache Airflow | CI/CD | Databricks | Distributed tracingFlexible-hybrid work | On-call supportSenior-level Full TimeIsrael - Office - Tel Aviv5h ago
-
APIs | Data Pipelines | Data integration | LLM Evaluation | Machine LearningEquity compensation | Real ownership | Remote-friendlyMid-level Full TimeTel Aviv-Yafo, Tel Aviv District, Israel1d ago
-
Senior-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL3d ago
-
Senior Backend AI Engineer ILS 362K-504KAgentic AI | Alembic | Autogen | Azure | Azure OpenAIEmployee assistance program | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeYokneam Illit, Israel3d ago
-
Software Engineer (Mid) - Backend AI Engineer ILS 283K-366KAI | AI Services | Agent Framework | Agent Frameworks | Agentic AIEmployee assistance program | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeYokneam Illit, Israel3d ago
-
Lead AI Engineer USD 160K-213KAgentic Workflows | Artificial Intelligence | CI/CD | Data Engineering | LLM ApplicationsHybrid work model | In-office collaboration | Remote flexibilitySenior-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL R3d ago
-
AI Engineer, Agentic Systems & AI Infrastructure USD 120K-150KBigQuery | Evaluation Frameworks | GCP | Human-in-the-loop | LLM AgentsMid-level Full TimeTel Aviv-Jaffa, Tel Aviv District, IL3d ago
-
Data Engineer USD 125K-160KCloud Architecture | Cloud infrastructure | Data Modeling | Data Monitoring | Data QualitySenior-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL R3d ago
-
Mid-level Full TimePetah Tikva, Center District, IL R4d ago
-
AI Engineer for Marketing USD 96K-125KAPI Security | Chroma | CrewAI | Data Governance | Data ModelingMid-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL R4d ago
-
Senior DevOps Engineer ILS 283K-366KAWS | Argo CD | BigQuery | CI/CD | ClearMLHybrid work environment | Inclusive workplaceSenior-level Full TimeRamat Gan, Tel Aviv District, IL R4d ago
-
Senior-level Full TimeHaifa, Haifa District, IL4d ago
-
Mid-level Full TimeIsrael, Raanana4d ago
-
Data Engineer (Data & AI solutions) ILS 139K-180KAWS | AWS Glue | Amazon Athena | Amazon EMR | Amazon SageMakerMid-level Full TimePetah Tikva, Central District4d ago
-
AI Engineer ILS 384K-504KAngular | Azure DevOps | Django | JSON | JiraGlobal team collaboration | Hybrid work locationSenior-level Full TimeTel Aviv, Tel Aviv District, IL4d ago
-
BizOps Engineer (AI-native) USD 200K-220KAPI Integration | Agentic Workflows | Artificial Intelligence | Compliance Management | Data PipelinesExecutive-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL5d ago
-
Senior-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL5d ago
-
Staff Algorithm Engineer USD 150K-250KAWS EC2 | AWS S3 | AWS SageMaker | Active Learning | Amazon Web ServicesHigh autonomy | Mentorship and knowledge-sharing | Startup environmentSenior-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL5d ago
-
Customer Success Physicist- Tel Aviv USD 136K-211KAutomation | English | Python | Quantum Physics | Software developmentTravel opportunitiesMid-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL5d ago
-
Agentic Systems | Benchmarking | Data Analysis | Experimentation | Fine TuningMid-level Full TimeTel Aviv-Yafo, Tel Aviv District, Israel5d ago
-
Agentic Workflows | Automated testing | CI/CD | Cloud infrastructure | DevOpsSenior-level TemporaryJerusalem, Israel6d ago
-
C# | C++ | CAN bus | Candump | Code reviewEntry-level Full Time TemporaryYizre'el, North District, IL6d ago
-
Senior Automation Engineer (Backend & AI) ILS 420K-510KAI Evaluation | AWS | Allure | CI/CD | Cloud platformSenior-level Full TimeNess Ziona, Center District, IL6d ago
-
Senior-level Full TimeYizre'el, North District, IL6d ago
-
ML Ops Engineer ILS 384K-504KCloud Computing | Data-intensive | Data-intensive applications | Docker | KubernetesSenior-level Full TimeHerzliya, Tel Aviv, Israel6d ago