AI Test, Evaluation, Validation, and Verification Specialist with Security Clearance - San Francisco, United States - Bright Star Solutions LLC

Bright Star Solutions LLC San Francisco, United States

1 week ago

Permanent Technology / Internet

Description

Bright Star Solutions is seeking an AI TEVV Specialist to support the Department of State in ensuring the reliability, security, and performance of AI technologies.

The specialist will be instrumental in executing comprehensive testing procedures, evaluating the effectiveness and trustworthiness of AI systems, and providing expert recommendations to enhance functionality and mitigate risks.

Key Responsibilities:

Lead the planning, execution, and documentation of comprehensive test, evaluation, validation, and verification activities for AI systems, algorithms, and models to assess their reliability, security, and compliance with regulatory standards and best practices.

Develop and execute detailed test plans, test cases, and test scenarios to validate the functionality, performance, and robustness of AI technologies.

Collaborate with AI developers, data scientists, and subject matter experts to identify potential vulnerabilities, biases, and ethical considerations in AI systems and implement appropriate risk mitigation strategies.

Utilize advanced testing methodologies and tools, such as adversarial testing, penetration testing, and vulnerability scanning, to assess the resilience and security posture of AI solutions against emerging threats and attack vectors.

Generate reports with actionable insights

Qualifications:
Experience in AI testing, evaluation, validation, verification, cybersecurity, or related roles.

Proficiency in AI development frameworks, database design, understanding of structured query language (SQL), and familiarity with database management systems, programming languages (e.g., Python, TensorFlow, PyTorch, R, MLFlow), and cybersecurity tools, such as Splunk.

Knowledge of development, testing, and deployment of LLMs.
Knowledge of regulatory frameworks, standards, and guidelines related to AI trustworthiness, security, and validation is desirable

Salary Range:
$150,000-$190,000

Security Engineer with Security Clearance

1 week ago

NAIS San Francisco, United States Permanent

Contract/Location: National Capital Region / Pensacola, FL Overview: · NAIS LLC is seeking an experienced Security Engineer to provide services on a contract supporting a U.S. Government agency. The ideal candidate will have excellent problem-solving and communications skills as ...
Security Specialist with Security Clearance

3 weeks ago

IntePros Federal Washington, United States

The Opportunity: IntePros Federal is seeking a Security Specialist in support of our federal government customer. The IT Systems Security Specialist supports our customer to provide technical, analytical, and liaison support for implementing systems and network engineering functi ...
ISSO with Security Clearance

1 week ago

Anonymous Employer San Francisco, United States Permanent

Senior ISSO · Washington, DC - Hybrid $140k + bonus My client is looking for a Senior ISSO to be on site in a hybrid role. This position requires someone with an active top secret clearance, to be considered for this role you need experience with the following: Required: TS Clear ...
Security Architect with Security Clearance

5 days ago

Experis San Francisco, United States Permanent

Experis is looking for a Security Architect. This will be an onsite role in Washington DC and will have travel, 25% of the time. Role Description: - Plan, Design, and Implement secure cloud strategies and policies that meet client, program, and federal guidelines. · - Interface w ...
IT Manager with Security Clearance

3 weeks ago

Peraton Washington, United States

About Peraton Peraton is a next-generation national security company that drives missions of consequence spanning the globe and extending to the farthest reaches of the galaxy. As the world's leading mission capability integrator and transformative enterprise IT provider, we deli ...
Security Engineer with Security Clearance

5 days ago

Experis San Francisco, United States Permanent

As a Security Engineer specializing in Vulnerability Mitigation and Intelligence, you will be responsible for devising and implementing effective strategies to mitigate vulnerabilities, enhance cybersecurity defenses, and provide actionable intelligence. Your expertise will be cr ...
Planner with Security Clearance

3 weeks ago

MELE Associates, Inc. Washington, United States

MELE Associates maintains a contract with the National Nuclear Security Administration (NNSA) Office of Infrastructure (NA-90), which works to maintain, operate, and modernize NNSA infrastructure to enable program results. NNSA's infrastructure protects global security through un ...
Interdisciplinary with Security Clearance

3 weeks ago

Department of the Army Washington, United States

Duties * Serves as senior staff advisor, consultant, and technical expert in the formulation, implementation, and evaluation of policies related to the execution of design, solicitation, and construction as performed by U.S. Army Corps of Engineers (USACE). * Serves as a senior d ...
Logistician with Security Clearance

3 weeks ago

VTG Washington, United States

Overview VTG is staffing a Logistician for professional support services contract related to the planning, design, construction, delivery, and testing of ships overseen by the Guided Missile Frigate (FFG) Program Office (PMS 515). VTG is tasked with providing these services to PM ...
ISSO with Security Clearance

3 weeks ago

Powder River Industries Washington, United States

: · Powder River Industries, LLC provides technical services across the entire system development life cycle (SDLC). As a prime we are responsible for complete end to end system management for a customer's mission system. This includes a data center, integrated logistics support, ...
Tester - Security Clearance Required

2 weeks ago

ManTech Washington, United States Full time

Secure our Nation, Ignite your Future · Become an integral part of a diverse team while working at an Industry Leading Organization, where our employees come first. At ManTech, you'll help protect our national security while working on innovative projects that offer opportunities ...
Cartographer - Security Clearance Required

1 week ago

Booz Allen Hamilton Washington, United States

CartographerThe Opportunity: · With a thorough understanding of cartographic standardization principles, best practices, and procedures, a skilled cartographer can turn map data into valuable information. If that sounds like you, we have an opportunity for you to use your geospa ...
FMS Lead with Security Clearance

3 weeks ago

CACI Washington, United States

FMS Lead Job Category: Project and Program Management Time Type: Full time Minimum Clearance Required to Start: Secret Employee Type: Regular Percentage of Travel Required: Up to 10% Type of Travel: Local * * * CACI is seeking a Foreign Military Sales (FMS) Lead to manage a team ...
Electrician - Security Clearance Required

2 weeks ago

Amentum Washington, United States

Amentum is looking for an Electrician to join our team in Washington, DC. You will inspect, repair, replace, install, adjust, maintain, and make necessary tests on all medium and low voltage utility systems, equipment, motors, MCC panels, generators, transformers, switch-gears, s ...
Security Analyst with Security Clearance

3 weeks ago

The Tatitlek Corporation Arlington, United States

Overview This Security Analyst works with the current Security team to support program activities and processes. The Personnel Security & Suitability Security Analyst should be familiar with all aspects of industrial, information, insider threat, communication, personnel, operati ...
Security Engineer with Security Clearance

6 days ago

Gridiron IT Solutions Arlington, United States

GridironIT is seeking a Security Engineer local to the Arlington, VA area. · 100% onsite. · TS/SCI is required. The Challenge: · Everyone knows security needs to be "baked in" to a system architecture, but you actually know how to bake it in. You can identify and implement ways t ...
Information Security Manager with Security Clearance

3 weeks ago

Peraton Washington, United States

About Peraton Peraton is a next-generation national security company that drives missions of consequence spanning the globe and extending to the farthest reaches of the galaxy. As the world's leading mission capability integrator and transformative enterprise IT provider, we deli ...
Senior Security Engineer with Security Clearance

3 weeks ago

Agile Defense, Inc. Washington, United States

At Agile Defense we know that action defines the outcome and new challenges require new solutions. That's why we always look to the future and embrace change with an unmovable spirit and the courage to build for what comes next. Our vision is to bring adaptive innovation to suppo ...
Security Engineer II with Security Clearance

3 weeks ago

Agile Defense, Inc. Washington, United States

At Agile Defense we know that action defines the outcome and new challenges require new solutions. That's why we always look to the future and embrace change with an unmovable spirit and the courage to build for what comes next. Our vision is to bring adaptive innovation to suppo ...
Analyst with Security Clearance

3 weeks ago

WWC Global Arlington, United States

WWC Global is seeking multiple Analysts to serve on a potential contract supporting the Office of the Undersecretary of Defense for Research and Engineering (OUSD R&E). Responsibilities may include, but are not limited to: * Assisting with planning and executing meetings and even ...