Gen AI Test Lead
Mountain View, United States
Full Time Senior-level / Expert USD 100K - 154K
WorldLink US
WorldLink is a leading provider of Data & Analytics services with a global reach and 25 years of experience.POSITION TYPE: Full Time (W2)
LOCATION: Mountain View, CA
ABOUT WorldLink:
WorldLink is a rapidly growing information technology company at the forefront of the tech transformation. From custom software development to cloud hosting, from big data to cognitive computing, we help companies harness and leverage today’s most cutting-edge digital technologies to create value and grow.
Collaborative. Respectful. Work hard Play hard. A place to dream and do. These are just a few words that describe what life is like at WorldLink. We embrace a culture of experimentation and constantly strive for improvement and learning.
We take pride in our employees and their future with continued growth and career advancement. We put TEAM first. We are a competitive group that like to win. We're grounded by humility and driven by ambition. We're passionate, and we love tough problems and new challenges. You don't hear a lot of "I don't know how" or "I can't" at WorldLink. If you are passionate about what you do and having fun while doing it; tired of rigid and strict work environments and would like to work in a non-bureaucratic startup cultural environment, WorldLink may be the place for you.
For more information about our craft, visit https://worldlink-us.com .
WHO we’re looking for:
We are looking for a Gen AI Test Lead who will be responsible for leading the design, execution, and oversight of testing strategies specifically focused on Generative AI applications, collaborating with cross-functional teams to ensure the quality, functionality, and reliability of AI-powered features across various platforms, while staying up-to-date with emerging GenAI technologies and testing methodologies. Your key responsibilities include developing comprehensive test plans, designing test cases, identifying potential issues, managing a team of testers, and working closely with developers to resolve defects related to Generative AI implementations. You will collaborate with cross-functional teams, including researchers, engineers, designers, health coaches, physicians and product managers, to ensure the efficient execution of GenAI initiatives. This is a unique opportunity to work on cutting-edge projects that will shape the future of Health AI.
You will be a core part of a passionate team charged with developing, incubating, and launching a portfolio of digital health product concepts that will disrupt the healthcare paradigm. By leveraging smart phones, wearables, embedded devices and the IoT in the health/wellness domain, your work will significantly benefit real-world patients, seniors, physicians and care givers. With a unique advantage in the consumer electronics market and growing focus on digital health, this will provide you with exciting technical challenges and a rewarding career experience.
The Digital Health Team (DHT) is an interdisciplinary
team with an aim to empower providers, consumers, and clinical researchers. Creating hyper-personalized health applications leveraging GenAI/LLM
technologies, develop prognostic biomarkers by applying clinically explainable
AI on advanced sensing technology, explore use cases by co-innovating with our partners,
and design services through pilots that eventually turn into groundbreaking
commercial, consumer-grade products that are used every day.
Role and Responsibilities:
- Lead and drive overall test design, planning, execution, and oversight of testers internally and externally.
- Manage vendors that offer internal user testing, external user testing, and large-scale human testing services.
- Build strategic GenAI evaluation capabilities (e.g., data-driven processes, evaluation frameworks, analytical tools) to identify and prioritize opportunities to accelerate GenAI product development cycles.
- Collaborate closely with GenAI research, engineering, UI/UX, health experts and product teams to align program objectives with broader organizational goals.
- Proactively identify program risks, develop and execute mitigation plans, and communicate rationale and updates clearly.
- Guide the work of onshore and offshore workers to complete data annotation/evaluation projects.
- 5+ years of proven experience with a track record of successfully delivering complex projects.
- 1+ years working on GenAI/LLM application evaluation related work
- Bachelor's degree required.
- Hands-on experience working with vendors offering AI testing services.
- Experience prioritizing and ensuring key initiatives move forward, managing multiple cross-functional stakeholders, and working with urgency.
- Expertise in software testing methodologies and best practices.
- (Preferred) Experience with automated testing frameworks and tools.
- (Preferred) Proficiency in programming languages relevant to AI development (e.g., Python).
- (Preferred) Strong understanding of Generative AI concepts, including natural language processing, machine learning, and deep learning.
-
Self-motivated
individual with the ability to thrive in a team-based or
independent environment.
- Detail-oriented with strong
organization skills.
- Ability to work in a
fast-paced environment.
- Limited supervision
and the exercise of discretion.
- Critical thinking and analytical skills.
- Executive presence and effective communications skills.
- Track record of embracing ambiguity and operating effectively.
- Ability to analyze complex data and identify patterns to evaluate GenAI model performance.
- (Preferred) Proven track record of successfully delivering large-scale programs on time and within budget.
- (Preferred) Excellent problem-solving and decision-making skills.
The physical demands described here are representative of those that must be met by contract employee to successfully perform the essential functions of this job. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions.
While performing the duties of this job, the contract employee is occasionally required to stand, clean, crawl, kneel, sit, sort, hold, squat, stoop, stand, twist the body, walk, use hands to finger, handle, or feel objects, tools or controls, reach with hands and arms, climb stairs or ladders and scaffolding, talk or hear, and lift up to 20 pounds. Specific vision abilities required by the job include ability to distinguish the nature of objects by using the eye. Operate a computer keyboard and view a video display terminal between 50% - 95% of work time, including prolonged periods of time. Requires considerable (90%+) work utilizing high visual acuity/detail, numeric/character distinction, and moderate hand/finger dexterity.
Performs work under time schedules and stress which are normally periodic or cyclical, including time sensitive deadlines, intellectual challenge, some language barriers, and project management deadlines. May require working additional time beyond normal schedule and periodic travel.
WHAT we’ll bring:
During your interview process, our team can fill you in on all the details of our industry-competitive benefits and career development opportunities. A few highlights include:
-
Medical
Plans
- Dental
Plans
- Vision Plan
- Life &
Accidental Death & Dismemberment
- Short-Term
Disability
- Long-Term Disability
- Critical Illness/ Accident/ Hospital Indemnity/ Identity
Theft Protection
- 401(k)
Our success begins and ends with our people. We embrace diverse perspectives and value unique human experiences. WorldLink is an Equal Employment Opportunity and Affirmative Action employer. All employment at WorldLink is decided on the basis of qualifications, merit, and business need. We endeavor to continue our footprint as a diverse organization by highlighting opportunities for all people. WorldLink considers applicants for all positions without regard to race, color, religion or belief, sex, (including pregnancy and gender identity), age, national origin, political affiliation, citizenship status, marital status, military/veteran status, genetic information, sexual orientation, gender identity, physical or mental disability or any other characteristic protected by applicable laws. People with disabilities who need assistance with any part of the application process should contact us.
This job description is designed to cover the main responsibilities and duties of the role but is not designed to be a comprehensive list of all.
Salary/Pay Range: $50.00-$77.00/hr (Depending on experience)
Tags: Big Data Deep Learning Engineering Generative AI LLMs Machine Learning NLP Python Research Testing UX
Perks/benefits: Career development Competitive pay Health care Startup environment Travel Wellness
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.