Content Reviewer - Columbus

Only for registered members Columbus, United States

1 day ago

Default job background
About The Job · Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey. · Position: · AI Model Evaluator · Typ ...
Job description
About The Job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.


Position:
AI Model Evaluator


Type:
Full-time or Part-time Contract Work


Compensation:
$41/hour


Location:
Geography restricted to Israel, USA

Role Responsibilities

Evaluate LLM-generated responses for effectiveness in answering user queries.
Conduct fact-checking using trusted public sources and external tools.
Generate high-quality human evaluation data by annotating response strengths, areas for improvement, and factual inaccuracies.
Assess reasoning quality, clarity, tone, and completeness of responses.
Ensure model responses align with expected conversational behavior and system guidelines.
Apply consistent annotations by following clear taxonomies, benchmarks, and detailed evaluation guidelines.

Qualifications

Must-Have

Bachelor's degree
Native speaker or ILR 5/primary fluency (C2 on the CEFR scale) in Hebrew
Significant experience using large language models (LLMs)
Excellent writing skills
Strong attention to detail
Adaptable across topics, domains, and customer requirements
Background in domains requiring structured analytical thinking
Excellent college-level mathematics skills

Preferred

Experience with RLHF, model evaluation, or data annotation work
Experience writing or editing high-quality written content
Experience comparing multiple outputs and making fine-grained qualitative judgments
Familiarity with evaluation rubrics, benchmarks, or quality scoring systems

Compensation & Legal

Hourly contractor
Paid weekly via Stripe Connect

Application Process (Takes 20–30 mins to complete)

Upload resume
AI interview based on your resume
Submit form

Resources & Support

For details about the interview process and platform information, please check:
For any help or support, reach out to:

PS:
Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

,


Similar jobs

  • Work in company

    Associate Web Director

    Only for registered members

    +Associate Web DirectorResponsible for creating and implementing Fisher's data-driven digital strategy, informed by analytics, that cultivates an engaged digital community. · +Pedir experiencia en marketing web · Experiencia con Drupal CMS · ...

    Columbus Full time

    3 weeks ago

  • Work in company

    Content Designer Senior Associate

    Only for registered members

    We are seeking a strategic and detail-oriented Content Writer to help shape the future of employee-facing digital content. · This role is expected to last around 10 months.Candidates must be able to work onsite 5 days a week in Jersey City, Newark, DE or Columbus OH (40 hrs/week) ...

    Columbus

    1 month ago

  • Work in company

    Social Content Planner

    Only for registered members

    We are seeking a Social Content Planner to help our team at our well-known healthcare client. · This role involves working on social strategy and overseeing creative for two well-known CPG brands. ...

    Columbus

    1 week ago

  • Work in company

    Social Content Planner

    Only for registered members

    The Social Content Planner role plays a key leadership role within the Social Experience Team within the internal creative agency. The Social Content Planner is responsible for developing and executing strategic content plans across social media platforms to drive brand awareness ...

    Columbus

    1 week ago

  • Work in company

    Social Media Manager

    Only for registered members

    The Social Media Manager will be responsible for developing and publishing engaging content across social platforms to drive brand awareness. · Collaborate with the Head of Content and Creative. · Maintain brand integrity across all social content. · Schedule and publish content ...

    Columbus

    1 month ago

  • Work in company

    Marketing Manager

    Only for registered members

    The Marketing Manager owns our brand voice, storytelling engine, and content strategy.This role ensures that every customer touchpoint — from Instagram reels to in-store signage to live breaks — feels unmistakably Midwest Cards. · ...

    Columbus

    5 days ago

  • Work in company

    Social Media Manager

    Only for registered members

    This is a fully remote role for someone who is organized, creative, · and comfortable working independently as Social Media Manager.Manage social media accounts across multiple industries · Plan and execute social media strategies, · including paid campaigns · ...

    Columbus

    1 month ago

  • Work in company

    Communications and Marketing Associate

    Only for registered members

    The Department of Animal Sciences at The Ohio State University College of Food, · Agricultural and Environmental Sciences is seeking a dynamic and creative Marketing · and Communications Specialist.This position plays a key role in shaping and executing strategies to promote · an ...

    Columbus $51,500 - $67,250 (USD) Full time

    1 month ago

  • Work in company

    Associate Web Director

    Only for registered members

    Create and implement Fisher's data-driven digital strategy, informed by analytics, that cultivates an engaged digital community. Identify the digital needs of various stakeholders and create the ideal personalized digital experience for various audiences. · ...

    Columbus, OH

    3 weeks ago

  • Work in company

    Content Specialist

    Only for registered members

    +Job summary · Assist the local IFI Columbus team in capturing and publishing stories via video, photographs and interviews that engage constituents. · +ResponsibilitiesInterview individuals to gather content · Compile notes from interviews into written articles. · ...

    Columbus

    1 month ago

  • Work in company

    Senior Manager, Content

    Only for registered members

    We are seeking a Senior Manager Content & Creative to serve as the day-to-day storytelling and design engine for Corporate Marketing—bringing our brand and priority narratives to life across channels through high-quality reusable content creative. · This role translates corporate ...

    Columbus

    1 month ago

  • Work in company

    Marketing Coordinator

    Only for registered members

    As a Marketing Coordinator at the school, you will shape its online presence and digital footprint by posting content creation strategic planning analysis to engage internal external audiences increase student enrollment. · ...

    Columbus Full time

    1 month ago

  • Work in company

    Morning Edition Host/Producer

    Only for registered members

    Screen reader users may encounter difficulty with this site. For assistance with applying, please contact hr- If you have questions while submitting an application, please review these frequently asked questions. · Current Employees And Students · If you are currently employed or ...

    Columbus $58,700 - $70,000 (USD)

    1 day ago

  • Work in company

    Special Projects Coordinator

    Only for registered members

    The Special Projects Coordinator will help with the execution of contests, community/station events. · This position will coordinate and execute special projects such as community awareness, disaster relief, contests, · and other duties as assigned. This role will assist with cal ...

    Columbus

    4 weeks ago

  • Work in company

    Social Media and Content Manager

    Only for registered members

    +The Social Media Content Manager plays a key role in shaping the voice, personality, and digital presence of Charleys across multiple social platforms. · +Manage daily social media planning and content execution to support brand goals, key initiatives, and campaigns. · Plan, pro ...

    Columbus

    2 weeks ago

  • Work in company

    DAS-Mobile Specialist 2/ MB2/Remote

    Only for registered members

    Serves as an architect/designer/developer/engineer on web development projects for reactive desktop/mobile development effort. · ...

    Columbus

    1 week ago

  • Work in company

    Senior Brand

    Only for registered members

    We're looking for a Senior Brand & Content Marketing Manager to build and scale a modern content and brand function at Loop. · This isn't a role for someone who wants to follow yesterday's marketing playbook. · It's for a builder:someone who wants to rethink how a SaaS company sh ...

    Columbus $98,800 - $148,200 (USD)

    1 month ago

  • Work in company

    Director, Digital Media

    Only for registered members

    ++The Director of Digital Media serves as a key leader within the Ohio State Athletics Marketing & Fan Experience unit,+ · ++Directing social media strategy,+overseeing website and app content,+and guiding the development of emerging digital platforms.+ +The position ensures alig ...

    Columbus Full time

    2 weeks ago

  • Work in company

    High School Math Teacher-26-27

    Only for registered members

    Teach high school math to students in a classroom setting. · Craft lesson plans using provided curriculum resources · ...

    Columbus

    4 weeks ago

  • Work in company

    2nd Grade Teacher

    Only for registered members

    +Create a responsive and inclusive environment for parents and families · Build a classroom culture that empowers students, · Affirm their identities, · Create a sense of belonging for all students. · +Implement the school-wide and classroom management policies/practices · Create ...

    Columbus

    1 month ago