Prompt Engineer (LLMs & AI Evaluation)
Tasks
- Analyze model LLM outputs
- Automate prompt evaluations with scripts
- Collaborate with international teams in English
- Compare model behaviors
- Define prompt evaluation methodologies
- Design prompts for business use cases
- Document findings and best practices
- Evaluate LLMs with shared prompt sets
- Measure prompt quality
- Optimize prompts for accuracy and relevance
- Refine existing prompts
- Run A B prompt tests
- Translate business needs into generative AI solutions
Perks/Benefits
- Career development plan
- Flexible compensation
- Flexible hours
- Hybrid work model
- International collaboration
- Training in technical skills
Skills/Tech-stack
A/B | A/B Testing | Agile | B testing | Chain-of-Thought | Few-Shot Learning | Few-shot | Generative AI | Language Models | Language Processing | Large Language Models | Natural Language | Natural Language Processing | Prompt engineering | Python | Structured prompting
Education
Related jobs
-
Senior Full Stack & AI Engineer USD 100K-135K.NET | AI Foundry | Agile | Angular | Azure AIContinuous learning | Flexible schedule | Hybrid work modelSenior-level Full TimeMadrid, MD, Spain R13h ago
-
Churn modeling | Customer churn | Customer churn modeling | Data Modeling | Data analyticsHybrid work | International travel | Work-life balanceSenior-level Full TimeMadrid - Castellana, Spain R23h ago
-
Data Engineer EUR 24K-26KApache Spark | Big Data | Data Architecture | Data Modeling | Data ProcessingContinuous training | Flexible schedule | Hybrid work | Life and accident insuranceMid-level Full TimeSpain R1d ago
-
Senior-level Full TimeMadrid, Spain1d ago
-
Machine Learning | PythonClient collaboration | Internship experience | Thought leadership opportunitiesEntry-level InternshipMadrid, Spain1d ago
-
AI ethics | API Integration | AWS | Azure | Bias MitigationAccess to AI tools | Remote work | Training opportunitiesEntry-level Full TimeMadrid, Spain R1d ago
-
Senior Machine Learning Engineer EUR 36K-45KAIOps | AWS SageMaker | Airflow | Azure Databricks | Azure MLConference and course access | Hybrid work option | Intensive schedule in summer | Paid training and certifications | Remote work optionSenior-level Full TimeValència, Spain R1d ago
-
Staff AI Software Engineer EUR 80K-120KAI Agents | AWS | Agentic AI | Amazon EKS | AutogenWork-life balanceSenior-level Full TimeMadrid Office1d ago
-
AI Engineer - Agentic Systems EUR 50K-60KAPI Integration | Agentic Systems | CI/CD | Database Integration | DockerAnnual leave | Commuting allowance | Home working allowance | Life insurance | Medical insuranceEntry-level Full TimeBarcelona, Spain3d ago
-
AI Engineer - AWS Bedrock - Generative AI EUR 40K-60KAPI Gateway | AWS Bedrock | AWS CDK | AWS Lambda | Amazon APICertification support | Emotional support | Family support | Flexible time off | Gym discountsMid-level Full TimeMadrid, Spain3d ago
-
Automation | Bash | Block Storage | CSI | Distributed File SystemCareer growth potential | Flexible work model | Inclusive environment committed to equal opportunity | International diverse working environment | Remote friendly work modelSenior-level Full TimeSpain R3d ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Friendly work environment | Remote workMid-level Full TimeValencia, Spain3d ago
-
Bash | Data Ingestion | Data Processing | Docker | GCPAsynchronous work culture | Flexible management approach | Impactful product mission | Supportive team environmentMid-level Full TimeMalaga, Spain3d ago
-
Lead AI Engineer EUR 64K-78K.NET | AIOps | Agentic AI | BMC CMDB | DockerBe Well programs | Certification support | Coaching | Continuous feedback | Flexible work environmentSenior-level Full TimeMadrid HQ (KES51610), Spain R3d ago
-
Data Engineer II EUR 50K-74KAWS | Amazon Athena | Amazon Redshift | Apache Airflow | Apache IcebergMid-level Full TimeSpain3d ago
-
Data Engineer III EUR 799KAWS | Airflow | Amazon Athena | Amazon Redshift | Data ModelingFlexible work environment | MentorshipSenior-level Full TimeSpain3d ago
-
Senior AI Engineer EUR 46K-75KAPI Development | AWS | Agentic Workflows | Azure | CI/CDFlexible working conditions | Gym membership discounts | Health insurance | Learning and development investment | Life and accident insuranceSenior-level Full TimeSant Cugat del Vallès, Spain, Barcelona3d ago
-
Mid-level Full TimeMadrid, Community of Madrid, Spain - … R3d ago
-
Azure Data Engineer - Ingles – Remoto EUR 35K-40KABAC | Azure | Azure Data | Azure Data Factory | Azure Data Lake23 days vacation | Employee benefits discounts | Flexible compensation | Indefinite contract | Remote workMid-level Full TimeSpain - Remote R3d ago
-
Senior Engineer - Embedded software EUR 56K-86KARM Cortex | ARM Cortex-M | Abstraction layer | Agile methodology | Automated testingTravel up to 10 percentSenior-level Full TimeSpain, Valencia, Cortes Valencianas3d ago
-
AWS Lambda | Alerting | Amazon Athena | Amazon Redshift | Amazon S3Mid-level Full TimeMadrid, Community of Madrid, ESP3d ago
-
Amazon Web Services | CI/CD | Data Modeling | Data Transformation | Data orchestrationCybersecurity Protection | Education benefits | Employee referral program | Family care benefits | Financial health programsSenior-level Full TimeSpain - Barcelona3d ago
-
Senior AI Engineer – Notebooks EUR 56K-85KBackend Services | Evaluation | Go | LLM | Machine LearningCommunity guilds | Employee stock purchase plan | Hybrid workplace | Inclusion talks | Mentor programSenior-level Full TimeBordeaux, France; Dublin, Ireland; France, Remote; … R4d ago
-
Data Engineer (Madrid based) EUR 43K-52KApache Airflow | CloudFormation | Continuous Delivery | Continuous integration | DBTFlexible work arrangements | Free learning resources | Generous paid time off | Gym or fitness allowance | Hybrid workMid-level Full TimeMadrid, ES4d ago
-
AI Engineer EUR 50K-80KArtificial Intelligence | Data Engineering | Language Processing | MLOps | Machine LearningErgonomic setup | Full remote from Europe | Hybrid work model | Inclusive work environment | Learning opportunitiesMid-level Full TimeVillafranca del Castillo, Spain R4d ago