Founding AI Engineer @ Embedded AI Efficiency Layer, Berlin
Tasks
- Build model routing and caching systems
- Build secure enterprise infrastructure with tenant isolation
- Create cost quality evaluations and regression tests
- Develop APIs and OpenAI compatible gateway
- Ensure production reliability and incident response
- Implement access controls and secrets management
- Implement quality gates and monitoring
- Integrate model providers and enterprise AI applications
- Manage deployments capacity and latency
- Optimize context selection and token reduction
- Optimize distributed system performance
- Reduce tool call usage and control retries
- Research AI cost efficiency systems
- Set output budgets and inference constraints
Perks/Benefits
Skills/Tech-stack
API Development | Access Control | Caching | Context Management | Distributed Systems | Docker | Evaluation Frameworks | Experiment design | Kubernetes | LLM APIs | Latency optimization | Litellm | Model Evaluation | Monitoring | OpenAI | PostgreSQL | Python | Rate Limiting | Regression testing | SGLang | Secrets management | Throughput Optimization | Tokenization | TypeScript | VLLM
Education
N/A
Roles
AI | AI Engineer | Engineer | Learning Engineer | Machine Learning Engineer
Related jobs
-
Angular | Data Mining | Data Pipelines | Database Design | DocumentationMentoringEntry-level Full TimeAbstatt, BW, Germany7h ago
-
Senior Applied AI Scientist EUR 56K-62KCloud Computing | Data Science | Docker | Foundation Models | GenAIFlexible work | Health benefits | Job ticket | Job-Rad | Mobile workSenior-level Full TimeBerlin, BE, DE, 1011710h ago
-
Spezialist AI DevOps (m/w/d) EUR 60K-76KAmazon Web Services | CI/CD | Cloud platform | Confluence | DevOpsMid-level Full TimeLeverkusen, DE11h ago
-
ABAP | AI Evaluation | AWS | Agentic AI | AndroidFlexible working models | Health and wellbeing support | Inclusion culture | Learning opportunities | Skill growthSenior-level Full TimeWalldorf, DE, 69190 R14h ago
-
Ansible | Debian | HCI | Linux | Networking conceptsMid-level Full TimeAachen1d ago
-
Linux Infrastructure Engineer - NeuraGym (human) EUR 38K-62KAnsible | Data pipeline | Debian | Infrastructure Monitoring | LinuxMid-level Full TimeAachen1d ago
-
DevOps Cloud Engineer (Azure & Databricks) EUR 66K-80KActive Directory | Angular | App Services | Azure | Azure Active DirectoryFlexibility to work from home | Great work atmosphere | Work-life balanceSenior-level Full TimeBerlin, BE, Germany R1d ago
-
Applied AI Engineer (m/w/d) EUR 36K-37KAPI Development | Cloud Platforms | Containerization | Deep learning | DeploymentEmployee discounts | Fitness studio | Flexible working hours | Hybrid work model | Paid time offMid-level Full TimeMunich, BY, Germany1d ago
-
Applied AI Engineer (m/f/d) EUR 19K-19KAPI Development | APIs | Cloud Platforms | Deep learning | DockerCapital-forming benefits | Employee discounts | Employee gym | Employee restaurant | Monthly mobility allowanceEntry-level Full TimeMunich, BY, Germany1d ago
-
AWS | Agile | Airflow | Amazon SageMaker | AzureBike leasing | Company pension plan | Discounts | Emergency childcare services | Flexible working hoursSenior-level Full TimeHannover, NDS, Germany R1d ago
-
(Senior) MLOps Engineer (m/f/d) - REF97172N EUR 70K-75KAWS | Agile | Airflow | Amazon SageMaker | AzureCompany pension plan | Discounted bike leasing | Diversity and inclusion support | Employee discounts | Flexible working hoursSenior-level Full TimeHannover, NDS, Germany R1d ago
-
Junior Data Engineer (m/f/d) - Martech EUR 40K-44KA/B | A/B Testing | AWS | Apache Spark | B testingBike leasing | Employee Discounts Partner Organizations | Employee discounts | Hybrid work model | MentorshipEntry-level Full TimeBerlin, Berlin, Deutschland R1d ago
-
C plus plus | CMake | Git | Lint | PythonEntry-level Part TimeErlangen - - Germany1d ago
-
Big Data DevOps Engineer (m/w/d) | DSIDMG GBP 55K-58KAmazon S3 | Apache Spark | Big Data | CI/CD | ContainerizationBike leasing | Company pension plan | Family budget | Flexible working hours | Health managementSenior-level Full TimeKarlsruhe, Deutschland R1d ago
-
(Junior) Data Engineer (d/f/m) EUR 32K-34KAirbyte | Airflow | Amazon Web Services | BigQuery | CI/CDCoaching | Company pension scheme | Employee assistance program | Enhanced parental leave | Hybrid workEntry-level Full TimeBerlin R1d ago
-
Physical AI Trainer - RoboGym (human) EUR 49K-76KAWS | Azure | Cloud platform | Data Annotation | Google CloudMid-level Full TimeAachen1d ago
-
LLM Engineer bei der JUST ADD AI (all genders) EUR 53K-59KAgent workflows | Fine Tuning | Hosting | LLM Fine-tuning | Language ModelsCoffee Included | E-learning reimbursement | Employee discounts | Fitness allowance | Flexible work optionsMid-level Full TimeBremen // Hamburg // Hybrid R1d ago
-
Senior Agentic AI Engineer EUR 54K-75KAWS | Azure | Docker | FastAPI | FirebaseEvents | Gym | Hybrid work | Rooftop pool | SaunaSenior-level Full TimeBerlin R1d ago
-
AWS | Apache Spark | Automated testing | CI/CD | ComplianceInclusion and Belonging Culture | International team environment | Occasional travel within EuropeSenior-level Part TimeWeiterstadt, Hessen, DE, 643311d ago
-
C plus plus | C# | Data Preprocessing | Data cleaning | Deep learningHybrid work | Innovation cultureEntry-level Full TimeRenningen, BW, Germany1d ago
-
BPMN | Data Analysis | Industrial PC | JavaScript | PythonEntry-level Part TimeOberkochen, Germany1d ago
-
Information Operations Data Engineer USD 77K-176KAWS EMR | Agent Orchestration | Agentic AI | Agile | Data ModelingDependent care | Paid leave | Professional development | Tuition assistance | Work-life programsMid-level Full TimeDEU, Stuttgart (Kurmaecker St), Germany R1d ago
-
Senior Software & Data Engineer d/w/m EUR 73K-80KAPI Integration | Agile Development | Azure | CI/CD | Data GovernanceSenior-level Full TimeHamburg, HH, DE, 203541d ago
-
Senior-level Full TimeHamburg, HH, DE, 203541d ago
-
Software & Data Engineer d/w/m EUR 63K-69KAgile Development | Automated testing | Azure | CI/CD | DatabricksMid-level Full TimeHamburg, HH, DE, 203541d ago