Jobs
>
San Francisco

    Senior Data Engineer - San Francisco, United States - Nightfall AI

    Nightfall AI
    Nightfall AI San Francisco, United States

    4 weeks ago

    Default job background
    Full time
    Description

    Nightfall makes safeguarding sensitive data for every application simple and seamless. Organizations, from startups to global brands, trust Nightfall's software platform and APIs to discover, classify, and protect sensitive data.


    We're looking for a Senior Data Engineer to enhance Nightfall's core data models and infrastructure supporting our real-time and data annotation pipelines, analytics warehouse, MLOps, real-time monitoring, and business intelligence reporting.

    At Nightfall, we use ML/NLP to detect and protect sensitive personal, health, financial, and credential information in real time. You will contribute directly to the core product. Working with Engineers, Data Scientists, and Data Analysts, you will ensure high technical standards for data management and drive Nightfall's short and long-term data strategies.

    This is a hybrid role based out of our San Francisco office.

    Responsibilities

    • Design, build, and own the core data models and infrastructure to manage data across Nightfall's analytics stack - AWS, Kafka, Glue, S3, Snowflake, Cassandra, Cockroach DB, Tableau, and Datadog.
    • Collaborate closely with Data Analysts to unlock the data needed to power dashboards, ad-hoc analyses, monitoring, and high-quality decision-making across the company.
    • Collaborate closely with ML Engineering and Data Science to scale our data pipelines for machine learning, analytics, and data annotation.
    • Design and implement a data quality monitoring system with source-to-target data validations and anomaly detection.
    • Collaborate with Security and Engineering to meet data governance requirements.

    Qualifications

    • SQL Expert. Solid experience in Python or similar.
    • Experience (3+ years) with analytical data warehouses/lakes. AWS/Snowflake preferred.
    • Experience (3+ years) developing data pipelines supporting ML/NLP projects. Experience with popular MLOps and data annotation platforms is a plus.
    • Experience (3+ years) analyzing complex datasets using SQL, optimizing queries, working with Data Analysts to automate dashboards (Tableau preferred), and performing ad-hoc analyses that lead to actionable business insights.
    • Bachelor's degree in Computer Science or related field. MS/PhD a plus.
    • Experience with source code repositories and cloud monitoring tools (Datadog preferred).
    • Possess excellent communication skills, strong analytical skills, and the ability to work independently and as part of a team.
    • The ability to thrive in a dynamic environment, being flexible and willing to jump in and do whatever it takes to be successful.
    About Nightfall:

    Nightfall is a cybersecurity startup dedicated to helping organizations secure and manage their sensitive data. As a leading enterprise technology company, our product affects the personal data that people entrust businesses to store & process with care every day. Critical data in modern organizations is often sprayed across a broad set of cloud data silos, and it's a herculean task for security & compliance teams to monitor, manage, and protect this highly sensitive data. Via machine learning, our product makes it easy for organizations to discover, classify, and protect this sensitive data across their cloud footprint - such as their corporate SaaS, data infrastructure, and even their own apps. In doing so, we prevent data leakage, provide unprecedented data visibility & protection across the cloud, and enable compliance. We're a technology startup founded in San Francisco, well-funded by leading institutional investors like Bain and Venrock, and a cadre of security & IT leaders from Okta, Salesforce, Atlassian, Splunk, FireEye, and more. Learn more on our website or by reaching out via email at

  • WPRO TALENTS

    Data Engineer

    4 days ago

    WPRO TALENTS San Francisco, United States

    This is a remote position. · Our client is at the forefront of web3 innovation. Our mission is to establish The Graph as the unbreakable foundation of open data. Our pioneering sub graphs set the industry standard and solidify The Graph as the premier solution for organizing and ...

  • WPRO TALENTS

    Data Engineer

    1 day ago

    WPRO TALENTS San Francisco, United States

    This is a remote position. · Our client is at the forefront of web3 innovation. Our mission is to establish The Graph as the unbreakable foundation of open data. Our pioneering sub graphs set the industry standard and solidify The Graph as the premier solution for organizing and ...

  • Nexus Solutions

    Data Engineer

    1 week ago

    Nexus Solutions Emeryville, United States

    Soda is teaming up with a leading E-commerce platform based in Germany that specializes in creating lottery platforms. With 20 years of experience, they have continuously grown and innovated across Europe. In 2022, they raised an impressive €286 million for social projects and ch ...

  • Infinity Ventures

    Data Engineer

    1 week ago

    Infinity Ventures Oakland, United States

    Oakland Infomotion GmbH is looking for a Data Engineer (m/w/d) to join our team. We are passionate about extracting the maximum value from data and are looking for someone who shares our enthusiasm and has a strong understanding of digital technology. · As a Data Engineer, you wi ...

  • Triune Infomatics Inc

    Data Engineer

    3 days ago

    Triune Infomatics Inc San Francisco, United States

    Role: Data Engineer · Location: Hybrid in Pleasanton, CA · Duration: 6 months · Areas of Responsibility Include: · • Build test and implement Data Engineering - ETL, Data Integrations, Data Governance, Data Quality. · • Build reusable Data Engineering assets and frameworks. ...

  • Psychic Services

    Data Engineer

    2 weeks ago

    Psychic Services San Francisco, United States

    [Full Time] Data Engineer at Psychic (United States) | BEAMSTART Jobs · Data Engineer · Psychic United States · Date Posted · 19 May, 2023 · Work Location · San Francisco, United States · Salary Offered · $120000 — $200000 yearly · Job Type · Full Time · Experience Required · 3 ...

  • Tekfortune Inc

    Data Engineer

    5 days ago

    Tekfortune Inc San Francisco, United States

    Tekfortune is a fast-growing consulting firm specialized in permanent, contract & project-based staffing services for world's leading organizations in a broad range of industries. In this quickly changing economic landscape, virtual recruiting and remote work are critical for the ...

  • VRChat Inc

    Data Engineer

    3 days ago

    VRChat Inc San Francisco, United States

    Join the VRChat team · VRChat offers a first-of-its kind, game-changing platform that provides an endless collection of social immersive experiences and gives the power of creation to its robust community. With over 250,000 worlds and growing, VRChat's vision is to allow users t ...

  • Asana

    Data Engineer

    3 days ago

    Asana San Francisco, United States

    As part of our dynamic Data Engineering team, you will play a pivotal role in aiding company-wide, data-informed decision making. Product and Business teams leverage our data assets to optimize user adoption, growth, and experience. We partner with other Data Infrastructure teams ...

  • FocusKPI Inc.

    Data Engineer

    1 day ago

    FocusKPI Inc. San Francisco, United States

    Job Description · Job DescriptionFocusKPI is looking for a Data Engineer to join one of our client's team and to support them. As a member of the Data Engineering, you own the ETL/ELT pipelines and data warehouse that are used to analyze trends and activity in our client's produc ...

  • Rigil Corporation

    Data Engineer

    6 days ago

    Rigil Corporation San Francisco, United States

    Job Description · Job DescriptionRole: Data Engineer · About Rigil: · Rigil is an award-winning, woman-owned, small business that specializes in technology consulting, strategy consulting and product development. We value teamwork and strive to build strong leaders. · Location: S ...

  • BayOne Solutions

    Data Engineer

    5 days ago

    BayOne Solutions San Francisco, United States Full time

    Senior Data Engineer · Location: (100% Remote) · Duration: Full time · The Opportunity: · Technology · Our technology team works fast and smart. With San Francisco as our home, we take bringing new tech to market seriously, developing the latest in mobile technologies, scalable a ...

  • Speak LLC

    Data Engineer

    4 days ago

    Speak LLC San Francisco, United States

    About us · Our mission is to become the de facto way people learn foreign languages. We begin by teaching the next billion people English and Spanish. · English is the global language of business, culture, and communication, and over 1.5 billion people around the world are activ ...

  • Hazel Health, Inc.

    Data Engineer

    1 week ago

    Hazel Health, Inc. San Francisco, United States

    Hazel Health, the national leader in school-based telehealth, was founded in 2015 to address systemic inequities in healthcare access, and ensure all children can get the quality care they need and deserve. We leverage digital health technology to provide on-demand physical and m ...

  • Bayone

    Data Engineer

    4 days ago

    Bayone San Francisco, United States

    Your role at Sephora: · As a Sr. Software Engineer you will design and implement innovative analytical solutions and work alongside the product engineering team, evaluating new features and architecture. Reporting to the Engineering Manager, Data Platform, you will work closely ...

  • Speak

    Data Engineer

    15 hours ago

    Speak San Francisco, United States

    Job Description · Job DescriptionAbout usOur mission is to become the de facto way people learn foreign languages. We begin by teaching the next billion people English and Spanish. · English is the global language of business, culture, and communication, and over 1.5 billion peop ...

  • Legalist

    Data Engineer

    15 hours ago

    Legalist San Francisco, United States

    Job Description · Job DescriptionIntro description:Legalist is an institutional alternative asset management firm. Founded in 2016 and incubated at Y Combinator, the firm uses data-driven technology to invest in credit assets at scale. We are always looking for talented people to ...

  • TEKsystems

    Data Engineer

    1 week ago

    TEKsystems San Francisco, United States

    : · The data engineer will collaborate closely with the growth and data foundation teams to define and create foundational data tables, migrate test tables while adhering to EDW standards, and build self-serve ETL frameworks capable of handling streaming and batch processing. Th ...

  • University of California

    Data Engineer

    2 weeks ago

    University of California San Francisco, United States

    Data Engineer · Neuro-Memory and Aging · Full Time · 77338BR · Job Summary · **This is an onsite position @ Mission Bay; Local SF · The Brain Aging Network for Cognitive Health (BRANCH) study aims to understand the complex biological, genetic, and lifestyle factors that unde ...

  • Saxon Global

    Data Engineer

    1 week ago

    Saxon Global San Francisco, United States

    Client: T he County of Sacramento · Position: Data Engineer - ETL, Spark, Airflow Specialist · Location: Sacramento, Ca ONLY CANDIDATES LOCAL TO SACRAMENTO WILL BE CONSIDERED. 100% ONSITE WORK · Rate:$65/hr. on C2C (Some Flex) · Visa: Open · Duration: 12+ Months · Looking f ...