Assessment Specialist III - Princeton, United States - Educational Testing Service

Description

About ETS:

For more than 75 years, we have amplified products and services based rigorous research and our belief in the power of learning.

Driven by our mission to advance quality and equity in education, ETS provides learning solutions, pioneering research and trusted assessments that help guide learners around the world on their path to new possibilities.

Our portfolio of trusted measures include TOEFL, TOEIC, GRE and Praxis.

Along with research, development and innovation that explores new frontiers in learning and measurement our educational measurement solutions and research contribute to the development of new methods and tools, inform important dialogue with education policymakers, and shed light on critical issues and potential solutions - all with the aim of creating a world where all learners can improve their lives through education.

With new senior leadership at the helm, ETS aims to continue changing the lives of all learners as we expand our organization's global footprint.

Our goal is to remain at the forefront of assessment and measurement efficacy within the education and ed tech space as it continues to grow and evolve.

Position Summary

The Assessment Specialist III develops items, tests, and related products that are closely aligned to the current subject-area standards and student-learning objectives and Ieads discussions with clients and stakeholders on the assessment of subject-related constructs.

This role applies strong content knowledge to add significant value to item writing, item review, test assembly, and discussions at committee meetings and is knowledgeable about current standards and trends.

The Assessment Specialist III may serve as a corporate and/or division expert in testing, specifically in the development of assessment instruments, practical measurement, and test design.

The Assessment Specialist III acts independently to provide leadership and perform test development work for complex testing programs and projects.

The incumbent has full knowledge of and capacity to perform all phases of the test creation process and may perform a lead external role, representing ETS to the public and media on issues related to test development.

Additional duties may consist of providing guidance and direction to other assessment professionals and serving as a mentor to Assessment Specialists I and II.

Basic functions and responsibilities

• Write and review items, gather and resolve feedback from multiple sources on items, and evaluate item acceptability after testing
• Participate in and manage constructed-response scoring activities, including work with faculty consultants or state department staff
• Approve items for use on tests, evaluating both content and psychometric properties
• Devise strategies for improving outside item writer results; develop item writer training materials; plan and lead item writer training meetings; monitor work with outside item writers
• Provide leadership in the design and development of new assessments and innovative products and services; negotiate with content groups and communicate on program issues; provide expertise for developing new blueprints and item types
• Write rules for test creation system, assemble pretests, tests, and/or Computer-Adaptive Testing (CAT) pools; review tests and participate in CAT simulation activities; assist in preparation of Special Test Additions
• Review and make recommendations for security cases
• Work with client committees, to include organizing meetings, recruiting and training committee members, recommending committee members, organizing review materials, developing training materials and agendas, explaining and summarizing analysis results, and advising on measurement issues
• Work directly with client content representatives to obtain signoff on items and tests; may attend client launch meetings, planning meetings, and update meetings
• Plan and develop program publications and interpretive test preparation materials
• Participate in teacher training activities
• Plan and conduct reliability, validity or comparability studies
• Train others in the application of item statistics and assembly of tests
• Work with Statistics staff during the test assembly process to obtain signoff on statistical parameters of forms
• Plan, manage and direct test development activities as a lead for one or more program teams, possibly as a member or leader of a test creation team
• Serve as a resource on staff development, including mentoring of other assessment specialists
• Serve on policy and planning committees with increasing responsibility
• Serve as senior test development and measurement advisor and mentor to the division and corporation
• Lead proposal development and complex and integrated research activities
• Act as liaison between ETS and advisory boards and committees
• May serve as an ETS spokesperson with media representatives on matters of assessment and usage of assessments
• Direct projects, delegate work and monitor progress
• Create, implement and monitor item development plans
• Undertake and oversee major special development projects
• Adhere to ethical standards and comply with the laws and regulations applicable to your job function

Leadership, Teamwork and Flexibility

Has a track record of adding value to official or unofficial teams by actively participating in them and seeking to understand the various interests of team members.

Is customer-focused and fosters respectful relationships with internal and external colleagues. Acts with the customer or internal stakeholders in mind and considers downstream implications. Is knowledgeable and up-to-date on industry trends and standard practices.

Has the ability to succeed at working on new assessments, on developing innovative task types, on doing the work in new ways, and on dealing successfully with ambiguity.

Demonstrates a strong learning orientation to willingly develop new skills and competencies that will improve personal and business performance. Assists in project direction; helps implement item development plans; works on special development projects.

Able to problem-solve and possesses flexibility to adjust project plans to meet deliverables on time and with the expected quality.

Demonstrates a high level of productivity and exhibits accountability for assigned work.


EDUCATION

Master's Degree in a field of specialty or an equivalent combination of education and experience from which comparable knowledge and abilities can be acquired.

EXPERIENCE

• A minimum of 7+ years of increasingly responsible professional experience (including educational measurement, applied statistics or teaching), 5 of which must be in test development and educational measurement or applied statistics, are required.
• Strong writing skills, well-developed organizational skills, and a willingness/adeptness with regard to learning new technology are required.
• Comprehensive knowledge of field of specialty in order to develop tests in subject area and to serve as a resource person for peers, committees, and clients is also required. Ability to work effectively and collaboratively with clients and external committees is required.
• Mastery of field of specialty, plus extensive knowledge of testing and measurements in order to provide expert advice to the corporation, serve in a leadership capacity and represent ETS in professional organizations and the educational community.

#LI-MM1

#LI-HYBRID

#LI-REMOTE

ETS believes in a Total Rewards philosophy for our employees, and they include:

• Health, Vision, Dental insurance plans to choose from
• Generous continuous learning support, from individual learning grants to up to 6 classes a year for tuition reimbursement as well as on-line learning access
• Generous PTO and vacation time to balance your work and life
• Additional 8 hours of PTO for volunteer work
• Retirement plan (401(a)) and traditional Roth (403b) with company contribution
• Commuter Benefits, Pet Insurance, 1 year subscription to Calm App

ETS is mission driven and action oriented

• Diversity, equity, inclusion, and belonging is at the forefront of the ETS employee's daily work. To further foster an inclusive environment ETS is home to a wide variety of Affinity groups that celebrate the diversity of our talented employees.
• How about cultivating growth, innovation, and continuous transformation for the next generation of rising professionals as leaders? ETS offers multiple Business Resource Groups (BRG) for you
• Are you passionate about volunteering and being active in your career and community? ETS offers our Center for Advocacy & Philanthropy (CAAP) where we encourage ETS employees to become active volunteers in their communities and schools through the ETS Cares Giving Campaign. Our employees can support any 501c3 or eligible charity of their choice.

ETS is an Equal Opportunity Employer comprised of people with different experiences, strengths, and backgrounds who share a passion for advancing quality and equity in education.

We are dedicated to building teams that reflect the various backgrounds, experiences, and identities of those we serve. The Talent Acquisition team strives to ensure candidates enjoy a fair and equitable hiring process. We believe our differences empower us to be a better team, making better decisions and delivering better results.