LLM Model Response Evaluation Job at Lifted, an Upwork Company™, Maryland

RTg1TjNsdHRNMUh4d0NFRmhBY1JnZUJxNWc9PQ==
  • Lifted, an Upwork Company™
  • Maryland

Job Description



Our client, a global technology company that helps businesses build, train, and manage AI systems is looking for experts to evaluate model-generated content against defined quality rubrics such as factuality, consistency, aesthetics, and other evaluation criteria.

Job Description

  • Evaluating UI widgets, infographics, image factuality, side-by-side comparisons, and similar AI evaluation activities.
  • The work may involve text, images, audio, video, HTML widgets, PDFs, or combinations of these modalities.
  • The work is domain-agnostic and may cover topics across arts, culture, history, science, engineering, and more.
  • Resources will be expected to independently research unfamiliar topics using trusted sources before making evaluation decisions.
  • Each task will include detailed project guidelines within the evaluation platform.

Qualifications

  • 3+ years of hands-on experience in LLM / GenAI data evaluation.
  • Bachelor's Degree required 
  • Ability to research unfamiliar topics using trusted sources and make well-supported judgments.
  • Comfortable evaluating content across multiple modalities 

Additional Information



Flexible and remote work
Variable workload: Accept or decline tasks based on your availability
No guaranteed hours:  Workload may vary weekly

Job Tags

Contract work, Remote work, Flexible hours

Similar Jobs

Localcoin

Government Relations Professional Job at Localcoin

 ...innovation, transparency, and team connectivity, we look forward to hearing from you! THE ROLE Hourly Range: $45 - $80 The Government Relations Professional will be responsible for supporting Localcoins engagement with federal and provincial and international... 

Valve Corporation

3D Character Artist Job at Valve Corporation

 ...actively seeking people with any specific qualifications, were always looking to add talented individuals to our team.Character artists at Valve work with a world-class group of software engineers, artists, writers, animators, and designers who are continually building... 

livingHR

Remote HR Technology Consultant (Contract) Job at livingHR

 ...partners, and communities. Position Overview Lead HR technology selection, implementation, and optimization efforts to enable...  ...advisor throughout the engagement lifecycle ~ Apply consulting, project management, and communication best practices... 

General Dynamics Information Technology

DevSecOps Security Engineer Job at General Dynamics Information Technology

 ...services that help the government ensure the well being and support of U.S. citizens. Job Description DevSecOps Security Engineer Help us simplify the complex as a DevSecOps Security Engineer at GDIT, where we tailor advanced cloud security solutions to critical... 

Smart IMS Inc

Technical Support Specialist Job at Smart IMS Inc

 ...Job Title: Technical Support Specialist Duration (Contract): 8-9 Months Client Location: Mechanicsburg, PA 17050 Location Preference: Onsite Job Description: Required Skills, Experiences, Education and Competencies: This position...