- Ability to leverage creative writing skills to craft engaging and informative responses that resonate with the target audience and maintain a consistent tone.
- Experience working with language data (research, analysis, translation, review).
- Aptitude for acquiring advanced technical skills, an eagerness to learn and take on new challenges.
- Strong understanding of natural language processing and machine learning concepts.
- Proven skills in researching and analyzing content to ensure accuracy.
- Proven expertise in the English language with excellent comprehension and grammar skills.
- Expertise with navigating systems, tools and changing workflows.
- Attention to detail and critical thinking skills in evaluation of language context, tone and intent.
- Ability to analyze and provide accurate reporting; with the ability to identify and communicate errors and inconsistencies in responses.
- Familiarity with AI safety concerns, and the ability to recognize and mitigate harmful content.
- Demonstrates flexibility and adaptability to changing workflows and responsibilities.
- Ability to conduct root cause analysis on key error trends, summarize findings, recommend solutions, and coach and mentor junior specialists to improve data quality.
- Minimum 1 year of experience in evaluating AI-generated content and working with large language models.
- Successful completion of a pre-employment assessment and background check
- Successful completion of initial training and certification testing
-
Senior Procurement Specialist
1 week ago
Tarvos Talent Austin, United StatesTarvos Talent is seeking a contract Senior Procurement Specialist for a client located in Austin, TX. This is an onsite opportunity, and our client is looking to hire ASAP. An analytical candidate with superb communication skills will be successful in this role. · The ideal candi ...
-
Senior Procurement Specialist
3 weeks ago
Tarvos Talent Austin, United StatesTarvos Talent is seeking a contract Senior Procurement Specialist for a client located in Austin, TX. This is an onsite opportunity, and our client is looking to hire ASAP. An analytical candidate with superb communication skills will be successful in this role. · The ideal cand ...
-
Senior Research Specialist
1 week ago
Texas Health & Human Services Commission Austin, United StatesThe Fraud Analytics (FA) unit within the Data Reviews Division of the Office of Inspector General (OIG) is seeking a Senior Research Specialist (Research Specialist IV) to expand the team's research capacity. The Fraud Analytics unit is responsible for performing innovative data ...
-
Senior Procurement Specialist
1 week ago
Amherst Group Austin, United StatesSenior Procurement Specialist page is loaded · Senior Procurement Specialist · Apply · remote type · Onsite · locations · Austin, TX (East Side) · time type · Full time · posted on · Posted 3 Days Ago · job requisition id · R8936 · Open the door to your dream job and ...
-
Senior Communications Specialist
2 weeks ago
Texas Association of School Boards Austin, United StatesJob Description · Job DescriptionWhy Texas Association of School Boards (TASB) · We come from humble beginnings — picture a one-person organization created in 1949 to advocate for excellence in public education on behalf of Texas school board members. Flash forward to today, and ...
-
Senior Proposal Specialist
1 week ago
CDM Smith Austin, United States**37889BR** · **Requisition ID:** · 37889BR · **Business Unit:** · NAU · **Job Description:** · CDM Smith is expanding our marketing team in our Transportation Group. Were seeking a Senior Proposal Specialist with strong writing/editing, organizational, and time-management ...
-
Senior Marketing Specialist
3 weeks ago
Quisitive Austin, United StatesHigh performing team members. Challenging projects. And a great place to work This is what you can expect if you join the Quisitive team. Founded in 2016, Quisitive is a publicly traded, global Microsoft partner specializing in Microsoft platform and complementary technologies, c ...
-
Senior Communications Specialist
2 weeks ago
Texas Department of Aging & Disability Services Austin, United StatesJob Description: · The Texas Department of State Health Services (DSHS) Communications Team is looking for an experienced marketing professional to fill the Senior Communications Specialist position. This is a hybrid role with opportunities to work remotely and in-person at our o ...
-
Senior Payroll Specialist
3 days ago
Wise PLC Austin, United StatesCompany Description · Wise is a global technology company, building the best way to move and manage the world's money. Min fees. Max ease. Full speed. · Whether people and businesses are sending money to another country, spending abroad, or making and receiving international paym ...
-
Senior Marketing Specialist
2 weeks ago
Greater Austin YMCA Austin, United StatesJob Description · How you Will Power our Purpose (Job Summary · ): · As a Senior Marketing Specialist at the Greater Austin YMCA, you'll be at the forefront of driving growth and engagement in key program areas such as Childcare (Afterschool, Preschool, Camp), Aquatics, Recrui ...
-
Senior Marketing Specialist
3 weeks ago
Austinymca Austin, United StatesHow you Will Power our Purpose (Job Summary · ): · As a Senior Marketing Specialist at the Greater Austin YMCA, you'll be at the forefront of driving growth and engagement in key program areas such as Childcare (Afterschool, Preschool, Camp), Aquatics, Recruitment Hiring, and Yo ...
-
Senior Procurement Specialist
1 week ago
Amherst Holdings LLC Austin, United StatesOpen the door to your dream job and join #TeamMainStreet. With more than 40,000 homes in 30 markets, Main Street Renewal is one of the largest providers of single-family rental homes across the country. We understand that our employees are the invaluable drivers of our success. T ...
-
Senior Research Specialist
2 weeks ago
Texas Department of Aging & Disability Services Austin, United StatesJob Description: · The Fraud Analytics (FA) unit within the Data Reviews Division of the Office of Inspector General (OIG) is seeking a Senior Research Specialist (Research Specialist IV) to expand the team's research capacity. The Fraud Analytics unit is responsible for performi ...
-
Senior Marketing Specialist
3 weeks ago
Greater Austin YMCA Austin, United StatesJob DescriptionHow you Will Power our Purpose (Job Summary):As a Senior Marketing Specialist at the Greater Austin YMCA, you'll be at the forefront of driving growth and engagement in key program areas such as Childcare (Afterschool, Preschool, Camp), Aquatics, Recruitment Hiring ...
-
Senior Marketing Specialist
2 weeks ago
Greater Austin YMCA Austin, United StatesJob Description · How you Will Power our Purpose (Job Summary): · As a Senior Marketing Specialist at the Greater Austin YMCA, you'll be at the forefront of driving growth and engagement in key program areas such as Childcare (Afterschool, Preschool, Camp), Aquatics, Recruitment ...
-
IT Support Specialist Senior
4 weeks ago
City of Austin Austin, United StatesInfrastructure and Operations Minimum Qualifications Education and/or Equivalent Experience: Three (3) years of education related to the job. Experience may substitute for education for up to (3) years. Licenses or Certifications:Valid Texas Drivers Support Specialist, IT, Techni ...
-
Benefits Senior Specialist
1 week ago
Samsung Austin Semiconductor Austin, United StatesSamsung Austin Semiconductor is one of the most advanced semiconductor manufacturing facilities in the world and an integral part of Central Texas for more than 28 years, driving job generation, economic impact and engagement with the surrounding community. · Samsung Austin Semi ...
-
Senior Payroll Specialist
3 days ago
WISE Austin, United States Full timeCompany Description · Wise is a global technology company, building the best way to move and manage the world's money. Min fees. Max ease. Full speed. · Whether people and businesses are sending money to another country, spending abroad, or making and receiving international paym ...
-
Senior RFx Specialist
3 weeks ago
Cloudflare Austin, United States Full timeAbout Us · At Cloudflare, we are on a mission to help build a better Internet. Today the company runs one of the world's largest networks that powers millions of websites and other Internet properties for customers ranging from individual bloggers to SMBs to Fortune 500 companies ...
-
Evaluation & Response Senior Specialist
1 week ago
Apple Austin, United StatesEvaluation & Response Senior Specialist · Austin,Texas,United States · Machine Learning and AI · Imagine what you could do here. At Apple, new ideas have a way of becoming extraordinary products, services, and customer experiences very quickly. The people here at Apple don't just ...
Evaluation & Response Senior Specialist - Austin, United States - Apple Inc.
Description
Imagine what you could do here. At Apple, new ideas have a way of becoming extraordinary products, services, and customer experiences very quickly.The people here at Apple don't just craft products - they build the kind of wonder that's revolutionized entire industries.
It's the diversity of those people and their ideas that inspires the innovation that runs through everything we do, from amazing technology to industry-leading environmental efforts.
Join Apple, and help us leave the world better than we found it.Siri offers a faster, easier way to get things done on your Apple devices, even before you ask. Millions of people now use Siri to send messages, play their favorite song or even take a selfie. The AIML Data Operations team is passionate about technology with a focus on enriching the customer experience. We are looking for an Evaluation and Response Senior Specialist that has high attention to quality and accuracy. You are creative and have a passion for detail with proven expertise in English language analysis.
Key Qualifications
As part of the team, you play a central role in enhancing data quality.
As an Evaluation and Response Senior Specialist, you'll evaluate and analyze responses generated by our language models for accuracy, relevance, coherence, and appropriateness across various contexts and topics.
In addition to achieving your production goals, you will collaborate with our AI research and engineering teams to provide insights and recommendations on improving model performance, including refining responses and addressing common shortcomings.
You will assess responses for potential biases, harmful content, or inappropriate language, and implement measures to ensure the model's outputs align with safety and ethical guidelines.
You'll provide ongoing evaluation feedback to guide model development and fine-tuning to improve user experience and model behavior. You will maintain high-quality standards for annotated data and ensure consistent evaluation metrics are applied. Your flexibility and the ability to prioritize tasks is essential. We focus on data quality, thinking creatively on how customers use our products and use this knowledge for improvements.Education & Experience
Bachelor's degree English Literature or Journalism specialization preferred
Additional Requirements
Evaluation & Response Senior Specialist professionals in Austin
-
Kathleen Bily
Fashion Designer and Event Coordinator