Jobs
>
San Francisco

    Senior Data Engineer - San Francisco, United States - Nightfall AI

    Default job background
    Description

    Nightfall makes safeguarding sensitive data for every application simple and seamless. Organizations, from startups to global brands, trust Nightfall's software platform and APIs to discover, classify, and protect sensitive data.

    We're looking for a Senior Data Engineer to enhance Nightfall's core data models and infrastructure supporting our real-time and data annotation pipelines, analytics warehouse, MLOps, real-time monitoring, and business intelligence reporting.

    At Nightfall, we use ML/NLP to detect and protect sensitive personal, health, financial, and credential information in real time. You will contribute directly to the core product. Working with Engineers, Data Scientists, and Data Analysts, you will ensure high technical standards for data management and drive Nightfall's short and long-term data strategies.

    This is a hybrid role based out of our San Francisco office.
    Responsibilities

    • Design, build, and own the core data models and infrastructure to manage data across Nightfall's analytics stack - AWS, Kafka, Glue, S3, Snowflake, Cassandra, Cockroach DB, Tableau, and Datadog.
    • Collaborate closely with Data Analysts to unlock the data needed to power dashboards, ad-hoc analyses, monitoring, and high-quality decision-making across the company.
    • Collaborate closely with ML Engineering and Data Science to scale our data pipelines for machine learning, analytics, and data annotation.
    • Design and implement a data quality monitoring system with source-to-target data validations and anomaly detection.
    • Collaborate with Security and Engineering to meet data governance requirements.
    Qualifications
    • SQL Expert. Solid experience in Python or similar.
    • Experience (5+ years) with analytical data warehouses/lakes. AWS/Snowflake preferred.
    • Experience (5+ years) developing data pipelines supporting ML/NLP projects. Experience with popular MLOps and data annotation platforms is a plus.
    • Experience (5+ years) analyzing complex datasets using SQL, optimizing queries, working with Data Analysts to automate dashboards (Tableau preferred), and performing ad-hoc analyses that lead to actionable business insights.
    • Bachelor's degree in Computer Science or related field. MS/PhD a plus.
    • Experience with source code repositories and cloud monitoring tools (Datadog preferred).
    • Possess excellent communication skills, strong analytical skills, and the ability to work independently and as part of a team.
    • The ability to thrive in a dynamic environment, being flexible and willing to jump in and do whatever it takes to be successful.
    About Nightfall:

    Nightfall is a cybersecurity startup dedicated to helping organizations secure and manage their sensitive data. As a leading enterprise technology company, our product affects the personal data that people entrust businesses to store & process with care every day. Critical data in modern organizations is often sprayed across a broad set of cloud data silos, and it's a herculean task for security & compliance teams to monitor, manage, and protect this highly sensitive data. Via machine learning, our product makes it easy for organizations to discover, classify, and protect this sensitive data across their cloud footprint - such as their corporate SaaS, data infrastructure, and even their own apps. In doing so, we prevent data leakage, provide unprecedented data visibility & protection across the cloud, and enable compliance. We're a technology startup founded in San Francisco, well-funded by leading institutional investors like Bain and Venrock, and a cadre of security & IT leaders from Okta, Salesforce, Atlassian, Splunk, FireEye, and more. Learn more on our website or by reaching out via email at

  • WPRO TALENTS

    Data Engineer

    2 weeks ago


    WPRO TALENTS San Francisco, United States

    This is a remote position. · Our client is at the forefront of web3 innovation. Our mission is to establish The Graph as the unbreakable foundation of open data. Our pioneering sub graphs set the industry standard and solidify The Graph as the premier solution for organizing and ...

  • WPRO TALENTS

    Data Engineer

    2 weeks ago


    WPRO TALENTS San Francisco, United States

    This is a remote position. · Our client is at the forefront of web3 innovation. Our mission is to establish The Graph as the unbreakable foundation of open data. Our pioneering sub graphs set the industry standard and solidify The Graph as the premier solution for organizing and ...


  • Meta San Francisco, United States

    **Data Engineering Leader (Generative AI) Responsibilities**: · - Proactively drive the vision for BI and Data Warehousing across a product vertical, and define and execute on a plan to achieve that vision. · - Define the processes needed to achieve operational excellence in all ...

  • Infinity Ventures

    Data Engineer

    3 weeks ago


    Infinity Ventures Oakland, United States

    Oakland Infomotion GmbH is looking for a Data Engineer (m/w/d) to join our team. We are passionate about extracting the maximum value from data and are looking for someone who shares our enthusiasm and has a strong understanding of digital technology. · As a Data Engineer, you wi ...

  • Nexus Solutions

    Data Engineer

    3 weeks ago


    Nexus Solutions Emeryville, United States

    Soda is teaming up with a leading E-commerce platform based in Germany that specializes in creating lottery platforms. With 20 years of experience, they have continuously grown and innovated across Europe. In 2022, they raised an impressive €286 million for social projects and ch ...

  • Legalist

    Data Engineer

    2 weeks ago


    Legalist San Francisco, United States

    Job Description · Job DescriptionIntro description:Legalist is an institutional alternative asset management firm. Founded in 2016 and incubated at Y Combinator, the firm uses data-driven technology to invest in credit assets at scale. We are always looking for talented people to ...

  • Speak

    Data Engineer

    2 weeks ago


    Speak San Francisco, United States

    Job Description · Job DescriptionAbout usOur mission is to become the de facto way people learn foreign languages. We begin by teaching the next billion people English and Spanish. · English is the global language of business, culture, and communication, and over 1.5 billion peop ...

  • Saxon Global

    Data Engineer

    3 weeks ago


    Saxon Global San Francisco, United States

    Client: T he County of Sacramento · Position: Data Engineer - ETL, Spark, Airflow Specialist · Location: Sacramento, Ca ONLY CANDIDATES LOCAL TO SACRAMENTO WILL BE CONSIDERED. 100% ONSITE WORK · Rate:$65/hr. on C2C (Some Flex) · Visa: Open · Duration: 12+ Months · Looking f ...

  • Speak LLC

    Data Engineer

    2 weeks ago


    Speak LLC San Francisco, United States

    About us · Our mission is to become the de facto way people learn foreign languages. We begin by teaching the next billion people English and Spanish. · English is the global language of business, culture, and communication, and over 1.5 billion people around the world are activ ...

  • Hazel Health, Inc.

    Data Engineer

    3 weeks ago


    Hazel Health, Inc. San Francisco, United States

    Hazel Health, the national leader in school-based telehealth, was founded in 2015 to address systemic inequities in healthcare access, and ensure all children can get the quality care they need and deserve. We leverage digital health technology to provide on-demand physical and m ...

  • BayOne Solutions

    Data Engineer

    3 weeks ago


    BayOne Solutions San Francisco, United States Full time

    Senior Data Engineer · Location: (100% Remote) · Duration: Full time · The Opportunity: · Technology · Our technology team works fast and smart. With San Francisco as our home, we take bringing new tech to market seriously, developing the latest in mobile technologies, scalable a ...

  • FocusKPI Inc.

    Data Engineer

    2 weeks ago


    FocusKPI Inc. San Francisco, United States

    Job Description · Job DescriptionFocusKPI is looking for a Data Engineer to join one of our client's team and to support them. As a member of the Data Engineering, you own the ETL/ELT pipelines and data warehouse that are used to analyze trends and activity in our client's produc ...

  • BayOne Solutions

    Data Engineer

    4 weeks ago


    BayOne Solutions San Francisco, United States Full time

    Senior Data Engineer · Location: (100% Remote) · Duration: Full time · The Opportunity: · Technology · Our technology team works fast and smart. With San Francisco as our home, we take bringing new tech to market seriously, developing the latest in mobile technologies, scala ...

  • Hexcel

    Data Engineer

    1 week ago


    Hexcel West Valley City, United States

    With our strong investment in research and development and our culture of continuous improvement, Hexcel is the industry leader in the manufacturing of advance composite materials, including carbon fiber, woven reinforcements, resins, prepregs, honeycombs and additive manufacture ...

  • Pathway Vet Alliance

    Data Engineer

    3 weeks ago


    Pathway Vet Alliance San Francisco, United States

    About Pathway · Deeptech start-up, founded in March 2020. Our primary developer offering is an ultra-performant Data Processing Framework (unified streaming + batch) with a Python API, distributed Rust engine, and capabilities for data source integration & transformation at scal ...

  • Stefanini, Inc

    Data Engineer

    1 week ago


    Stefanini, Inc San Francisco, United States

    Job Description · Job DescriptionReference #57151 · Stefanini Group is hiringStefanini is looking for Cloud Data Engineer in San Francisco, CA(Hybrid)For quick Apply, please reach out to Ayush Dwivedi · - call: / email: Open to W2 Candidates only (US Citizens & Green Card Holders ...

  • Figma

    Data Engineer

    3 weeks ago


    Figma San Francisco, United States

    Figma is growing our team of passionate people on a mission to make design accessible to all. Born on the Web, Figma helps entire product teams brainstorm, design and build better products — from start to finish. Whether it's consolidating tools, simplifying workflows, or collabo ...

  • Bayone

    Data Engineer

    2 weeks ago


    Bayone San Francisco, United States

    Your role at Sephora: · As a Sr. Software Engineer you will design and implement innovative analytical solutions and work alongside the product engineering team, evaluating new features and architecture. Reporting to the Engineering Manager, Data Platform, you will work closely ...

  • Arine

    Data Engineer

    3 weeks ago


    Arine San Francisco, United States

    Based in San Francisco, Arine is a rapidly growing healthcare technology and clinical services company with a mission to ensure individuals receive the safest and most effective treatments for their unique and evolving healthcare needs. · Frequently, medications cause more harm ...

  • Sia Partners

    Data Engineer

    2 weeks ago


    Sia Partners San Francisco, United States

    Job Description · Job DescriptionCompany Description · Sia Partners is a next-generation management consulting firm. We offer a unique blend of AI and design capabilities, augmenting traditional consulting to deliver superior value to our clients. Counting 3,000 consultants in 19 ...