Scaled Testing Specialist, Responsible AI, Trust and Safety - Washington
5 hours ago
Job description
Minimum qualifications:
- Bachelor's degree or equivalent practical experience.
- 7 years of experience in data analytics, Trust & Safety, policy, cybersecurity, or related fields.
Preferred qualifications:
- Master's degree or PhD in relevant field.
- Education in, or experience with, machine learning.
- Experience in SQL, building dashboards, data collection/transformation, visualization/dashboards, or experience in a scripting/programming language (e.g. Python).
- Strong understanding of AI systems, machine learning, and their potential risks or experience working with Google's products and services, particularly GenAI products.
- Excellent communication and presentation skills (written and verbal) and the ability to influence cross-functionally at various levels.
- Excellent problem-solving and critical thinking skills with attention to detail in an ever-changing environment.
About the job:
Trust & Safety team members are tasked with identifying and taking on the biggest problems that challenge the safety and integrity of our products. They use technical know-how, excellent problem-solving skills, user insights, and proactive communication to protect users and our partners from abuse across Google products like Search, Maps, Gmail, and Google Ads. On this team, you're a big-picture thinker and strategic team-player with a passion for doing what's right. You work globally and cross-functionally with Google engineers and product managers to identify and fight abuse and fraud cases at Google speed - with urgency. And you take pride in knowing that every day you are working hard to promote trust in Google and ensuring the highest levels of user safety.
In this role, you will be an expert in structured and unstructured safety pre-launch testing for Google's GenAI models and products, with a particular focus on the under-18 experience. You will partner closely with the technical abuse-fighting experts in trust and safety to understand launch requirements, and develop and implement testing protocols. You will leverage robust data analysis to provide quantitative and qualitative actionable insights on potential risks for mitigation by T&S and product teams. You will manage many stakeholders through effective relationship building, bringing an ordered and structured approach. You'll demonstrate analytical thinking through data-driven decision making and technical know-how, to collaborate across teams and execute quickly. This will be instrumental in shaping the future of AI development, ensuring that Google's AI products are safe for all users.
This role may be exposed to graphic, controversial, and/or upsetting content.At Google we work hard to earn our users' trust every day. Trust & Safety is Google's team of abuse fighting and user trust experts working daily to make the internet a safer place. We partner with teams across Google to deliver bold solutions in abuse areas such as malware, spam and account hijacking. A team of Analysts, Policy Specialists, Engineers, and Program Managers, we work to reduce risk and fight abuse across all of Google's products, protecting our users, advertisers, and publishers across the globe in over 40 languages.
The US base salary range for this full-time position is $132,000-$194,000 + bonus + equity + benefits. Our salary ranges are determined by role, level, and location. Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training. Your recruiter can share more about the specific salary range for your preferred location during the hiring process.
Please note that the compensation details listed in US role postings reflect the base salary only, and do not include bonus, equity, or benefits. Learn more about benefits at Google.
Responsibilities:
- Own the pre-launch U18 testing lifecycle for prominent GenAI products, from aligning on compliance standards and safety guidelines to final execution, ensuring consistency across all product areas.
- Define prompt generation and scraping strategies using LLM tools and vendor teams to rigorously test model boundaries, compliance, and potential risks.
- Conduct deep-dive qualitative and quantitative analyses of test results to identify edge cases and provide actionable mitigation strategies that inform critical pre- and post-launch decision-making.
- Build reusable frameworks, operational norms, and best practices for red teaming and AI safety to scale Responsible AI (RAI) testing efficiency and impact cross-functionally.
Similar jobs
Minimum qualifications: · Bachelor's degree or equivalent practical experience. · 2 years of experience in data analysis, including identifying trends, generating summary statistics, and drawing insights from quantitative and qualitative data. · Experience with one or more of the ...
19 hours ago
In accordance with Washington state law, we are highlighting our comprehensive benefits package, which is available to all eligible US based employees. Benefits for this role include: · Health, dental, vision, life, disability insurance · Retirement Benefits: 401(k) with company ...
15 hours ago
A problem isn't truly solved until it's solved for all. That's why Googlers build products that help create opportunities for everyone, whether down the street or across the globe. · ...
1 week ago
A problem isn't truly solved until it's solved for all. That's why Googlers build products that help create opportunities for everyone, whether down the street or across the globe. As a Program Manager at Google, you'll lead complex, multi-disciplinary projects from start to fini ...
6 days ago
Trust & Safety team members are tasked with identifying and taking on the biggest problems that challenge the safety and integrity of our products. · ...
1 day ago
Scaled Testing Specialist, Responsible AI, Trust and Safety
Only for registered members
Minimum qualifications: · Bachelor's degree or equivalent practical experience. · 7 years of experience in data analytics, Trust & Safety, policy, cybersecurity, or related fields. · Preferred qualifications: · Master's degree or PhD in relevant field. · Education in, or experien ...
3 hours ago
Senior Product Policy Advisor, Global Policy and Standards
Only for registered members
Trust & Safety team members are tasked with identifying and taking on the biggest problems that challenge the safety and integrity of our products. · ...
2 weeks ago
Trust & Safety team members are tasked with identifying and taking on the biggest problems that challenge the safety and integrity of our products. They use technical know-how, excellent problem-solving skills, user insights, and proactive communication to protect users and our p ...
2 weeks ago
Trust and Safety team members are tasked with identifying and taking on the biggest problems that challenge the safety and integrity of our products. · ...
4 weeks ago
Senior Policy Specialist, Workspace and User-Generated Content Policy
Only for registered members
This role works with sensitive content or situations and may be exposed to graphic, controversial, · or upsetting content.About the jobTrust and Safety team members are tasked with identifying and taking on the biggest problems of safety · and integrity of our products. · You wor ...
1 month ago
+ Anticipate policy issues facing product and technology platforms · Lead develop and implement policies for Google products with a view towards user safety product quality privacy · Drive awareness understanding of our product policies within Google across our user base throug ...
2 weeks ago
Senior Product Policy Advisor, Global Policy and Standards
Only for registered members
In this role you will advise internal Google teams on core principles design policies and standards to address abuse risks enabling responsible growth. · Anticipate policy issues facing product and technology platforms develop policies and enforcement recommendations on how to ad ...
2 weeks ago
We're looking for innovative professionals who thrive in mission-critical environments and are passionate about shaping the future of air traffic management. · Lead safety testing, evaluation, and validation efforts on NAS programs. · Develop and maintain comprehensive safety doc ...
2 weeks ago
We're looking for innovative professionals who thrive in mission-critical environments and are passionate about shaping the future of air traffic management. · Lead safety risk management and compliance efforts for FAA surveillance and radar systems. · ...
1 month ago
We are seeking a Alaska Workstream Safety Lead to join our team of qualified, diverse individuals. The ideal candidate will lead hazard analysis, risk mitigation, compliance reviews and assurance activities to ensure that projects deployed in Alaska maintain the highest levels of ...
1 month ago
The Global Operations Integrity Team protects Meta's communities by building fast scalable support systems to address safety-related incidents on our products. · We focus on improving the health of our platforms and preventing both online and real-world harm. · We're looking for ...
3 weeks ago
We are seeking an Alaska Workstream Safety Lead to join our team of qualified, diverse individuals. · The ideal candidate will lead hazard analysis, risk mitigation, compliance reviews, · and assurance activities to ensure that projects deployed in Alaska maintain the highest lev ...
1 month ago
Our client has an opening for System Safety Certification Advisor who will work directly with safety engineering certification authorities to define assess verify safety performance across complex systems of systems ensuring that safety remains a foundational element in every pro ...
1 week ago
Senior Policy Specialist, Workspace and User-Generated Content Policy
Only for registered members
This role works with sensitive content or situations and may be exposed to graphic, controversial, or upsetting content. · Drive policy strategy creation and execution across Google Workspace and User-Generated Content (UGC) products to continuously identify needs and improve pro ...
4 weeks ago
WeareseekingaVoiceCommunicationsWorkstreamSafetyLeadjoinourteamofqualified,diverseindividuals. · LeadsafetyriskmanagementactivitiesforFAAvoicecommunicationsystems. · ...
1 month ago