Principal AI Engineer
Tasks
- Architect evaluation platform
- Automate LLM evaluation lifecycle
- Build scalable infrastructure for AI evaluations
- Define AI quality metrics
- Design tools and workflows to reduce iteration time
- Establish observability feedback loop for evaluation datasets
- Guide agent design and failure analysis
- Implement production monitoring for AI systems
- Mentor engineers on LLM and agent system design
- Serve as AI technical lead for product squads
Perks/Benefits
- Health insurance
- Learning budget
- Paid parental leave
- Paid sick leave
- Paid transportation reimbursement
- Remote work
- Workstation equipment
Skills/Tech-stack
AI Agents | API Integration | Distributed Systems | Evaluation Frameworks | Event Driven | Event-driven architecture | Kafka | LLM | Observability | Orchestration | Prompt engineering | Pub/Sub | Python | RAG | Semantic Caching | State management | System Performance | System monitoring | Vector Databases
Education
N/A
Related jobs
-
AI Technology Specialist AUD 87K-127KAI Agents | Artificial Intelligence | Compliance | Copilot | Enterprise ArchitectureMid-level Full TimeBelgrade, Serbia3d ago
-
Bash | Data Ingestion | Data Processing | Docker | GCPAsynchronous culture | Remote-friendly environmentMid-level Full TimeBelgrade, Serbia3d ago
-
Senior Data Engineer USD 120K-150KAutomated testing | Cloud platform | Data Modeling | Data Privacy | Data WarehousingSenior-level ContractPoland; Brazil; Serbia; Romania9d ago
-
Expert Embedded Software Engineer EUR 48K-68KAgile | Bare Metal | C# | C++ | DevOpsCertified course participation | Conference budget | Flexible working hours | Technical camp | Work from homeSenior-level Full TimeBelgrade, Serbia11d ago
-
Senior AI & Machine Learning Security Engineer EUR 55K-75KART | AWS SageMaker | Adversarial Robustness | Azure AI | Azure AI/MLComprehensive benefits | Flexible work model | Growth opportunities | Hybrid work model | In-office optionSenior-level Full TimeSpain; Portugal; Poland; Romania; Serbia; Czechia12d ago
-
Senior-level Full TimeWarsaw, PL / Serbia / Romania12d ago
-
Bash | Cloud platform | Data Pipelines | Data Processing | DockerMid-level Full TimeNovi Sad, Serbia17d ago
-
Mid-level Full TimeBelgrade, RS18d ago
-
Serbia- Algorithm Engineer USD 168K-293KAgile | Algorithm Development | Clustering | Code Analysis | Graph theoryMid-level Full TimeBeograd, Serbia, RS20d ago
-
Senior Software Engineer - AI Interaction Evaluator (Codex / Claude Code, up to $200/hr) USD 100K-400KAI Assisted Development | Claude Code | Cursor | JavaScript | OpenAI CodexSenior-level Full TimeMiami23d ago
-
(Senior) Data Engineer USD 94K-152KAWS | AWS Glue | AWS Step Functions | Adobe Analytics | AgileFlexible schedule | Home office options | Hybrid work model | Mentorship | Training opportunitiesSenior-level Full TimeBelgrade - Bulevar kralja Aleksandra 28, …23d ago
-
Senior AI Engineer USD 129K-174KAPI Integration | AWS | Adobe Firefly | Agent architecture | Amazon BedrockFlexible working hours | Inclusive workplace | Overtime compensation | Vacation time | Work from home optionSenior-level Full TimeBelgrade, SE25d ago
-
Principal AI/ML Engineer USD 160K-226KAWS SageMaker | Azure Machine Learning | CI/CD | Computer Vision | Continuous TrainingSenior-level Full TimeBosnia & Herzegovina, Serbia, North Macedonia25d ago
-
SD Solutions CAD 110K-146KLangchain | Langgraph | Language Models | Large Language Models | Nest.jsMid-level Full TimeWarsaw, PL / Serbia / Romania25d ago
-
Senior Data Engineer USD 155K-200KAPI Gateway | AWS Lambda | Airflow | Amazon ECS | Amazon EKSAnnual leave | Bank holidays | Equipment provided | Flexible hours | Hybrid workSenior-level Full TimeSerbia, Serbia25d ago
-
Senior Data Engineer USD 139K-215KAnomaly Detection | Apache Spark | Data Engineering | Databricks | MLflowAnnual leave | Fitpass membership | Hybrid work | Private health insurance | Recognition programSenior-level Full TimeBeograd, Serbia26d ago
-
Data Engineer, Data Platform & Integration USD 75K-95KAPI Integration | Azure Data | Azure Data Factory | Azure Synapse | Change Data CaptureMid-level Full TimeBOULEVARD VOJVODE BOJOVICA NO 6-8,21434434,BELGRADE,RS, Serbia26d ago
-
Senior Data Engineer @Tamedia PLN 206K-328KAWS Glue | Amazon Athena | Amazon Redshift | Amazon S3 | Argo WorkflowsSenior-level Full TimeBeograd, Serbia27d ago
-
Senior Data Engineer @Tamedia PLN 206K-328KAWS | Amazon Athena | Amazon Redshift | Amazon S3 | Argo WorkflowsSenior-level Full TimeBeograd, Serbia27d ago
-
AWS | Docker | Golang | JavaScript | NoSQLClear growth path | Employment contract 1099 | Fully remote work environment | Work with global teamMid-level Full TimeBelgrade R28d ago
-
AI Solutions Builder EUR 67K-90KAWS | Agentic AI | CRM data | Command Line | Data integrationDirect collaboration with executive team | Fast paced collaborative team | Fully remote work | Growth opportunities | High ownership autonomySenior-level Full TimeEurope; Portugal - Remote; Serbia - … R30d ago
-
Sr AI Engineer | Remote - Europe | TS/Vue/NodeJS GBP 80K-120KAPI Design | Agent architecture | Anthropic | Chat completion | Chunking401k match | Course budget | Dental coverage | Equity | HackathonsSenior-level Full TimeBerlin Office R30d ago
-
Senior-level Full TimeBelgrade, Serbia1mo ago
-
Senior Data Engineer CAD 120K-145KAWS | Apache Airflow | Apache Flink | Apache Iceberg | Apache SparkEmployee recognition program | Employee wellness programs | Lifestyle spending account | Professional development budget | Wellness daysSenior-level Full TimeBelgrade1mo ago
-
Machine Learning Engineer USD 145K-200KComputer Vision | Data Preprocessing | Deep learning | Edge AI | Image ProcessingMid-level Full TimeSerbia1mo ago