Jobs
>
Mountain View

    Senior C+ Software Engineer, Storage - Mountain View, United States - Voltron Data

    Voltron Data
    Voltron Data Mountain View, United States

    3 weeks ago

    Default job background
    Description
    We are looking for a highly motivated Senior C++ Storage Engineer to join Voltron Data's team. On the team, you'll have the opportunity to help support and grow the Voltron Data and Apache Arrow ecosystems.

    You will work closely with Voltron Data development teams to implement performant storage and I/O functions targeting a wide variety of networked, cloud, and local storage solutions.

    Why work at Voltron Data?

    We are Going for Impact
    :

    We are a Series A, venture-backed startup assembling a global team to build a new foundation for data analytics with Apache Arrow.

    This foundation will usher in a wave of innovation in data processing that can take full advantage of the speed and efficiency offered by modern hardware.


    We are Committed to Bridging Open Source Communities:


    We are a collection of open source maintainers who have been driving open source ecosystems over the last 15 years, particularly in the C++, Python, and R programming ecosystems.


    We are Building a Diverse, Inclusive Company:
    We are creating a representative, equitable, and respectful workplace that prioritizes employee growth. Everyone at Voltron Data is bought into the company's success; all voices are critical to shaping the organization's future.

    Timeline

    Below is a rough timeline of where you can expect to be at different points during your career path starting in this position.


    Upon joining:
    Spending time learning about the Apache Arrow memory layout, compute primitives, and APIs.

    Familiarizing yourself with the different partners for compute kernels and the query execution engine on Apache Arrow.

    Learning and embracing the Apache development process.


    Within a month:
    Implementing new high-performance storage and I/O primitives.

    Benchmarking existing I/O library functions to determine where there are bottlenecks.

    Discovering and implementing optimizations in data reads and writes.

    Participating in peer code review of all PRs related to file storage and interacting with different filesystems.

    Contributing to technical discussions and technical design documents.


    Within 6 months:


    Developing a comprehensive set of low level benchmarks for I/O functions targeting various local, networked and cloud storage technologies to enable monitoring for performance regressions.

    Ensuring that all filesystems interactions are compatible and performant across platforms (Linux, MacOS, and Windows).

    Identifying and building reusable software components to ensure a high quality and maintainable codebase.


    Within 12 months:


    Analyzing I/O throughput in a massively parallel and distributed query engine to identify inefficiencies and crafting solutions to tackle those inefficiencies.


    Ensuring that the everything related to storage is built as high quality as possible, balancing performance, usability, and maintainability across the Voltron Data and Apache Arrow ecosystems.


    Previous experience that could be helpful:
    Strong experience developing in C++, especially using Modern C++.

    Experience developing and using various data lake storage technologies as:
    S3, Google Compute Storage, Azure Blob Storage.

    Building and using distributed networked file systems such as HDFS or Ceph.

    Experience working with technologies such as io_uring, DMA, RDMA, or GPUDirect Storage.

    Experience with different data storage file formats such as ORC, Parquet, and Avro.

    Experience with data lake table formats such as Iceberg, Delta Lake, and Hudi.

    US Compensation -

    The salary range for this role is between $140,000 to $165,000. We have a global market-based pay structure which varies by location.

    Please note that the base pay range is a guideline and for candidates who receive an offer, the exact base pay will vary based on factors such as actual work location, skills and experience of the candidate.

    This position is also eligible for additional incentives such as equity awards.

    #J-18808-Ljbffr


  • Microsoft Corporation Mountain View, United States

    Microsoft Silicon Cloud Hardware Infrastructure Engineering (SCHIE) is the team behind Microsofts expanding Cloud Infrastructure and responsible for powering Microsofts Intelligent Cloud mission. SCHIE delivers the core infrastructure and foundational technologies for Microsoft's ...


  • Waymo Mountain View, United States

    Principal Software Engineer, Storage & Compute Mountain View, California, United States Waymo is an autonomous driving technology company with the mission to be the most trusted driver. Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on building ...


  • Fluence Mountain View, United States Full time

    About Fluence: Fluence Energy, Inc. (Nasdaq: FLNC) is a global market leader in energy storage products and services, and optimization software for renewables and storage. With a presence in over 47 markets globally, Fluence provides an ecosystem of offerings to drive the clean ...


  • Microsoft Corporation Mountain View, United States

    Microsoft Silicon Cloud Hardware Infrastructure Engineering (SCHIE) is the team behind Microsoft's expanding Cloud Infrastructure and responsible for powering Microsoft's "Intelligent Cloud" mission. SCHIE delivers the core infrastructure and foundational technologies for Microso ...


  • Waymo Mountain View, United States

    Principal Software Engineer, Storage & Compute · Mountain View, California, United States · Waymo is an autonomous driving technology company with a mission to make it safe and easy for people and things to get where they're going. Since our start as the Google Self-Driving Car ...


  • Waymo Mountain View, United States

    Waymo is an autonomous driving technology company with the mission to be the most trusted driver. Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on building the Waymo Driver-The World's Most Experienced DriverTM-to improve access to mobility whi ...


  • Amazon Development Center U.S., Inc. Sunnyvale, United States Full time

    AWS EC2 Nitro Local Storage is building the foundation of cloud local instance storage platforms at scale. We power customer workloads across industry from startups through the Fortune 500 enterprises. · We provide a virtualized hardware-accelerated instance storage solutions for ...


  • NVIDIA Santa Clara, United States Full time

    Salary 180, ,250 USD per year · Requirements: · - Bachelor's degree in Computer Science, Electrical Engineering, or related field, or equivalent experience. · - 8+ years of experience designing and operating large scale storage infrastructure. · - Experience analyzing and tuning ...


  • NVIDIA Santa Clara, United States

    NVIDIA has continuously reinvented itself over two decades. Our invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined modern computer graphics, and revolutionized parallel computing. More recently, GPU deep learning ignited modern AI - the next era of ...


  • AMISEQ Santa Clara, United States

    Required And Desired Skills/Certifications: · 10 year's of experience in the plan, design, configuring, optimizing and supporting large and diverse enterprise storage systems. Including creating dashboard, reporting and capacity planning. · 7+ year's of hands-on experience Design ...

  • Knewin

    Storage Engineer

    2 weeks ago


    Knewin Foster City, United States

    As a Storage Engineer at Zoox, you will work with a team of engineers to build, implement, and maintain Zoox's petabyte-scale high-performance storage systems which enable our robot and AI research efforts. You will also work to maintain our traditional Network Attached Storage ( ...


  • World Wide Technology San Jose, United States

    This job is part of WWT's Strategic Resourcing services. The candidate will be supporting a WWT customer and will be employed by one of WWT's preferred partners. · Why WWT? · At World Wide Technology, we work together to make a new world happen. Our important work benefits our cl ...


  • NVIDIA Santa Clara, United States

    NVIDIA has continuously reinvented itself over two decades. Our invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined modern computer graphics, and revolutionized parallel computing. More recently, GPU deep learning ignited modern AI - the next era of ...


  • Amiseq Inc. Santa Clara, United States

    Duties And Responsibilities: · - Evaluate, design, implement, and deploy SAN, NAS & DAS hardware and software, to include Dell PowerMax, Unity, PURE, Cisco and Brocade fabric architectures in tiered multi-protocol storage models. · - Create designs and documentation of backup/res ...


  • Google Sunnyvale, United States Full time

    Minimum qualifications: · Bachelor's degree or equivalent practical experience. · 8 years of experience in software development, and with data structures/algorithms. · 5 years of experience with design and architecture, and testing/launching software products. · 2 years of experi ...


  • MongoDB Palo Alto, United States

    The worldwide data management software market is massive (According to IDC, the worldwide database software market, which it refers to as the database management systems software market, was forecasted to be approximately $82 billion in 2023 growing to approximately $137 billion ...


  • Gotion Fremont, United States

    Gotion, Inc. is based in Silicon Valley in California, with R&D centers in Ohio, China, Japan and Europe. We innovate in the next generation electric vehicle and energy storage technologies (lithium batteries and related systems) with the aim to accelerate electrified transportat ...


  • MongoDB Palo Alto, United States

    The worldwide data management software market is massive (According to IDC, the worldwide database software market, which it refers to as the database management systems software market, was forecasted to be approximately $82 billion in 2023 growing to approximately $137 billion ...


  • Info Way Solutions Fremont, United States

    Software Engineer - Cloud Storage Solutions · Walmart Global Tech · Reston, VA or Sunnyvale, CA / Remote · Responsibilities · • Design, implement, optimize private cloud-based Cloud Storage solutions using Ceph · • Build, tune, troubleshoot block and object storage systems i ...


  • TEKsystems San Jose, United States Contract

    Description: · The Challenge · Cloud Engineering makes cloud adoption safe, effective, and easy. · We optimize usage through data analysis, setting and handling company-wide efficiency targets, and programmatically addressing underutilized resources. We provide comprehensive mana ...