Prompt Evaluation Associate

Who We Are

At CloudFactory, we are a mission-driven team passionate about unlocking the disruptive potential of AI for the world. By combining advanced technology with a global network of talented experts, we make unusable data usable and inference reliable and trustworthy, driving real-world business value at scale. 

More than just a workplace, we’re a global community founded on strong relationships and the belief that meaningful work transforms lives. Our commitment to earning, learning, and serving fuels everything we do, as we strive to connect one million people to meaningful work and build leaders worth following.

Our Culture

At CloudFactory, we believe in building a workplace where everyone feels empowered, valued, and inspired to bring their authentic selves to work. We are:

• Mission-Driven: We focus on creating economic and social impact.
• People-Centric: We care deeply about our team’s growth, well-being, and sense of belonging.
• Innovative: We embrace change and find better ways to do things, together.
• Globally Connected: We foster collaboration between diverse cultures and perspectives.

If you’re ready to earn, learn, serve, and be part of a vibrant global community, CloudFactory is your place!

About the role:

We are seeking a Prompt Evaluation Associate to join our team and contribute to the development and optimization of high-impact AI features. In this role, you'll help optimize AI-driven products and search features by working with large language models (LLMs), improving production prompts, and conducting quality analysis. If you're eager to grow in the AI and tech space and have a strong attention to detail, this is the perfect opportunity to build your skills and contribute to innovative projects. You'll work alongside a talented team, learning and growing while directly impacting the performance and user experience of our products.

What you’ll do:

• Craft, test, and improve AI prompts for data generation, automated evaluations, and Google production features.
• Serve as a product evaluator to assess and improve product performance.
• Conduct data analysis and contribute to algorithm improvements.
• Collaborate with engineering teams to refine and develop advanced algorithms.
• Identify, diagnose, and report software issues, providing actionable results.
• Support UI and product improvements to ensure interfaces meet local language requirements.
• Document configurations and provide detailed explanations for team reference.

Requirements

What we’re looking for:

• A strong interest in AI, machine learning, and technology.
• A keen attention to detail and ability to work effectively in a fast-paced, evolving environment.
• Analytical thinking and the ability to approach challenges with logical problem-solving.
• Effective communication skills to collaborate with team members and stakeholders.
• A desire to learn and grow in the field of AI, prompt engineering, and localization.
• A positive, can-do attitude and a passion for improving products and processes.

What you’ll need:

• Fluency in English (both verbal and written) is required.
• 2 years of experience with prompt engineering and an understanding of Generative AI tools (ChatGPT, Gemini, Claude, etc.).
• Basic proficiency in Python (reading and modifying code).
• Prior experience in localization, working with classifiers, or search quality rating is a plus.
• Familiarity with annotation or QA platforms is an advantage.
• A strong background in data analysis and algorithm development.
• A passion for working on cutting-edge AI technologies and improving product quality.

Additional information:

• We are only accepting resumes and applications in English.
• The role is open to candidates based in Mexico.