Staff Data Engineer - Santa Clara, United States - Tenstorrent Inc.

    Default job background
    Description
    Tenstorrent is leading the industry on cutting-edge AI technology, revolutionizing performance expectations, ease of use, and cost efficiency.

    With AI redefining the computing paradigm, solutions must evolve to unify innovations in software models, compilers, platforms, networking, and semiconductors.

    Our diverse team of technologists have developed a high performance RISC-V CPU from scratch, and share a passion for AI and a deep desire to build the best AI platform possible.

    We value collaboration, curiosity, and a commitment to solving hard problems. We are growing our team and looking for contributors of all seniorities.


    As a Staff Data Engineer in our Data Science and Engineering team, you will help design, implement and manage the data platform which powers Tenstorrent's data engineering and data science workflows, including batch processing, streaming, metadata management, and machine learning.

    The ideal candidate for this role excels at building software automations running a modern and scalable data infrastructure and its applications.

    You see the data platform as a product and the data integrations, analytics applications, data science and ML as customers.

    You highly appreciate the importance of IaC, CI/CD, monitoring and logging, security and documentation to achieve the highest levels of automation, quality and functionality.

    Responsibilities

    Help envision and build the future of our data platform.

    You will have a remarkable impact on the overall tech stack we use to process the rich data available at Tenstorrent.

    Design and implement end-to-end data pipelines to process batch and streaming data at scale, employing cutting-edge data processing and orchestration methodologies, including distributed computing solutions when applicable.

    Lead the integration of a wide range of technologies constituting our data infrastructure. Architect and build new ones when available solutions fall short.
    Identify, evolve, and champion data/software engineering best practices.
    Help define and implement scalable data governance, security and privacy solutions, including an AI-powered data catalog.
    Build automation for CI/CD, IaC and containerization.
    Contribute to our data engineering roadmap, working cross-functionally to define priorities.

    Experience & Qualifications

    Excellent Python programming skills, with a focus on data processing.
    Experience designing, managing and optimizing SQL databases and schemas.
    Advanced SQL queries and functions programming.
    Experience working with no-SQL and time-series databases.
    Experience building RESTful APIs.
    Proficiency in containerization technologies.
    Experience building automated CI/CD pipelines.
    Experience working with AWS.
    Familiarity with IaC technologies.
    Familiarity with gRPC.
    Experience deploying front-end data analytics tools.
    Experience with distributed processing and querying solutions is a plus.
    Comfortable using Agile development methodologies and industry standard software development lifecycle processes (Jira, Git, documentation).
    Self-motivated individual with a strong desire to learn, explore, and excel in a fast-paced, innovative environment.

    Compensation for all engineers at Tenstorrent ranges from $100k - $500k including base and variable compensation targets. Experience, skills, education, background and location all impact the actual offer made.
    #J-18808-Ljbffr