Content Reviewer - Columbus
1 day ago

Job description
About The JobMercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.
Position:
AI Model Evaluator
Type:
Full-time or Part-time Contract Work
Compensation:
$41/hour
Location:
Geography restricted to Israel, USA
Role Responsibilities
Evaluate LLM-generated responses for effectiveness in answering user queries.
Conduct fact-checking using trusted public sources and external tools.
Generate high-quality human evaluation data by annotating response strengths, areas for improvement, and factual inaccuracies.
Assess reasoning quality, clarity, tone, and completeness of responses.
Ensure model responses align with expected conversational behavior and system guidelines.
Apply consistent annotations by following clear taxonomies, benchmarks, and detailed evaluation guidelines.
Qualifications
Must-Have
Bachelor's degree
Native speaker or ILR 5/primary fluency (C2 on the CEFR scale) in Hebrew
Significant experience using large language models (LLMs)
Excellent writing skills
Strong attention to detail
Adaptable across topics, domains, and customer requirements
Background in domains requiring structured analytical thinking
Excellent college-level mathematics skills
Preferred
Experience with RLHF, model evaluation, or data annotation work
Experience writing or editing high-quality written content
Experience comparing multiple outputs and making fine-grained qualitative judgments
Familiarity with evaluation rubrics, benchmarks, or quality scoring systems
Compensation & Legal
Hourly contractor
Paid weekly via Stripe Connect
Application Process (Takes 20–30 mins to complete)
Upload resume
AI interview based on your resume
Submit form
Resources & Support
For details about the interview process and platform information, please check:
For any help or support, reach out to:
PS:
Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
,
Similar jobs
+Associate Web DirectorResponsible for creating and implementing Fisher's data-driven digital strategy, informed by analytics, that cultivates an engaged digital community. · +Pedir experiencia en marketing web · Experiencia con Drupal CMS · ...
3 weeks ago
We are seeking a strategic and detail-oriented Content Writer to help shape the future of employee-facing digital content. · This role is expected to last around 10 months.Candidates must be able to work onsite 5 days a week in Jersey City, Newark, DE or Columbus OH (40 hrs/week) ...
1 month ago
We are seeking a Social Content Planner to help our team at our well-known healthcare client. · This role involves working on social strategy and overseeing creative for two well-known CPG brands. ...
1 week ago
The Social Content Planner role plays a key leadership role within the Social Experience Team within the internal creative agency. The Social Content Planner is responsible for developing and executing strategic content plans across social media platforms to drive brand awareness ...
1 week ago
The Social Media Manager will be responsible for developing and publishing engaging content across social platforms to drive brand awareness. · Collaborate with the Head of Content and Creative. · Maintain brand integrity across all social content. · Schedule and publish content ...
1 month ago
The Marketing Manager owns our brand voice, storytelling engine, and content strategy.This role ensures that every customer touchpoint — from Instagram reels to in-store signage to live breaks — feels unmistakably Midwest Cards. · ...
5 days ago
This is a fully remote role for someone who is organized, creative, · and comfortable working independently as Social Media Manager.Manage social media accounts across multiple industries · Plan and execute social media strategies, · including paid campaigns · ...
1 month ago
The Department of Animal Sciences at The Ohio State University College of Food, · Agricultural and Environmental Sciences is seeking a dynamic and creative Marketing · and Communications Specialist.This position plays a key role in shaping and executing strategies to promote · an ...
1 month ago
Create and implement Fisher's data-driven digital strategy, informed by analytics, that cultivates an engaged digital community. Identify the digital needs of various stakeholders and create the ideal personalized digital experience for various audiences. · ...
3 weeks ago
+Job summary · Assist the local IFI Columbus team in capturing and publishing stories via video, photographs and interviews that engage constituents. · +ResponsibilitiesInterview individuals to gather content · Compile notes from interviews into written articles. · ...
1 month ago
We are seeking a Senior Manager Content & Creative to serve as the day-to-day storytelling and design engine for Corporate Marketing—bringing our brand and priority narratives to life across channels through high-quality reusable content creative. · This role translates corporate ...
1 month ago
As a Marketing Coordinator at the school, you will shape its online presence and digital footprint by posting content creation strategic planning analysis to engage internal external audiences increase student enrollment. · ...
1 month ago
Screen reader users may encounter difficulty with this site. For assistance with applying, please contact hr- If you have questions while submitting an application, please review these frequently asked questions. · Current Employees And Students · If you are currently employed or ...
1 day ago
The Special Projects Coordinator will help with the execution of contests, community/station events. · This position will coordinate and execute special projects such as community awareness, disaster relief, contests, · and other duties as assigned. This role will assist with cal ...
4 weeks ago
+The Social Media Content Manager plays a key role in shaping the voice, personality, and digital presence of Charleys across multiple social platforms. · +Manage daily social media planning and content execution to support brand goals, key initiatives, and campaigns. · Plan, pro ...
2 weeks ago
Serves as an architect/designer/developer/engineer on web development projects for reactive desktop/mobile development effort. · ...
1 week ago
We're looking for a Senior Brand & Content Marketing Manager to build and scale a modern content and brand function at Loop. · This isn't a role for someone who wants to follow yesterday's marketing playbook. · It's for a builder:someone who wants to rethink how a SaaS company sh ...
1 month ago
++The Director of Digital Media serves as a key leader within the Ohio State Athletics Marketing & Fan Experience unit,+ · ++Directing social media strategy,+overseeing website and app content,+and guiding the development of emerging digital platforms.+ +The position ensures alig ...
2 weeks ago
Teach high school math to students in a classroom setting. · Craft lesson plans using provided curriculum resources · ...
4 weeks ago
+Create a responsive and inclusive environment for parents and families · Build a classroom culture that empowers students, · Affirm their identities, · Create a sense of belonging for all students. · +Implement the school-wide and classroom management policies/practices · Create ...
1 month ago