Jobs
>
San Francisco

    Data Engineer - San Francisco, United States - Rigil Corporation

    Rigil Corporation
    Rigil Corporation San Francisco, United States

    3 weeks ago

    Default job background
    Description

    Job Description

    Job DescriptionRole: Data Engineer


    About Rigil:
    Rigil is an award-winning, woman-owned, small business that specializes in technology consulting, strategy consulting and product development. We value teamwork and strive to build strong leaders.

    Location: San Francisco, CA
    Job Type: Full Time

    Data Engineer is integral to evolving Vision and its underlying data and AI platform, which forms the backbone of our business. Vision is much more than a tool; it's the operational core and a vital integration layer that connects our installed hardware, connectivity network, and customers. This platform streamlines the marketing, delivery, installation, and maintenance of our energy products globally.

    Your work will be pivotal in enabling our platform to scale, be intelligent and provide secure and easy access to data that customers can trust. By enhancing Vision, you will empower our international partners, simplifying and improving their ability to connect with customers and support our energy appliances. Your efforts will ensure that our data and analytics platform is not only agile and responsive but also anticipates and adapts to the evolving needs of diverse markets and stakeholders.

    In this foundational phase of our platform, your role is central to adopting an AI-centric strategy. You will be at the forefront of building the next stage of Vision, focusing on new capabilities that embed conversational interfaces that dynamically learn and adapt to customer needs. These interfaces will not only enhance user experiences but also glean insightful data about our customers and business operations.

    This position demands a unique combination of technical skill, pragmatic orientation, data- centric thinking, and an intuitive sense for how Large Language Models are poised to change how we approach software, both how it works, and how we develop it.

    Responsibilities
    • Create and maintain optimal data pipeline architecture.
    • Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL, NoSQL and AWS big data technologies.
    • Build analytics (AI & ML) tools that utilize the data pipeline to provide actionable insights into customer acquisition, device operations and other key business performance metrics.
    • Keep our data separated and secure across tenants and geographical boundaries through data segmentation and infrastructure.
    • Manage databases effectively using PostgreSQL, ensuring data integrity and performance.
    • Utilize AWS for continuous deployment and cloud services management.
    • Work within Agile development frameworks, contributing to all phases of the software development lifecycle.
    • Innovate and contribute to a technology roadmap that aligns with our mission of providing sustainable energy solutions.
    Qualifications
    • Bachelors degree in computer science or related field; Advanced degree preferred.
    • At least 5 years of data engineering experience.
    • Experience with object-oriented/object function scripting languages: Python, Java, C++, Scala, etc.
    • Experience building and optimizing big data data pipelines, architectures, and data sets.
    • Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.
    • Experience with AWS cloud services: EC2, EMR, RDS, Redshift.
    • Working knowledge of message queuing, stream processing, and highly scalable big data data stores.
    • Working knowledge of MLOps.
    • Familiarity with IoT platforms and integrating AI tools in data applications.
  • WPRO TALENTS

    Data Engineer

    2 weeks ago

    WPRO TALENTS San Francisco, United States

    This is a remote position. · Our client is at the forefront of web3 innovation. Our mission is to establish The Graph as the unbreakable foundation of open data. Our pioneering sub graphs set the industry standard and solidify The Graph as the premier solution for organizing and ...

  • WPRO TALENTS

    Data Engineer

    2 weeks ago

    WPRO TALENTS San Francisco, United States

    This is a remote position. · Our client is at the forefront of web3 innovation. Our mission is to establish The Graph as the unbreakable foundation of open data. Our pioneering sub graphs set the industry standard and solidify The Graph as the premier solution for organizing and ...

  • Meta

    Data Engineering Leader

    3 days ago

    Meta San Francisco, United States

    **Data Engineering Leader (Generative AI) Responsibilities**: · - Proactively drive the vision for BI and Data Warehousing across a product vertical, and define and execute on a plan to achieve that vision. · - Define the processes needed to achieve operational excellence in all ...

  • Nexus Solutions

    Data Engineer

    3 weeks ago

    Nexus Solutions Emeryville, United States

    Soda is teaming up with a leading E-commerce platform based in Germany that specializes in creating lottery platforms. With 20 years of experience, they have continuously grown and innovated across Europe. In 2022, they raised an impressive €286 million for social projects and ch ...

  • Infinity Ventures

    Data Engineer

    3 weeks ago

    Infinity Ventures Oakland, United States

    Oakland Infomotion GmbH is looking for a Data Engineer (m/w/d) to join our team. We are passionate about extracting the maximum value from data and are looking for someone who shares our enthusiasm and has a strong understanding of digital technology. · As a Data Engineer, you wi ...

  • Legalist

    Data Engineer

    2 weeks ago

    Legalist San Francisco, United States

    Job Description · Job DescriptionIntro description:Legalist is an institutional alternative asset management firm. Founded in 2016 and incubated at Y Combinator, the firm uses data-driven technology to invest in credit assets at scale. We are always looking for talented people to ...

  • BayOne Solutions

    Data Engineer

    3 weeks ago

    BayOne Solutions San Francisco, United States Full time

    Senior Data Engineer · Location: (100% Remote) · Duration: Full time · The Opportunity: · Technology · Our technology team works fast and smart. With San Francisco as our home, we take bringing new tech to market seriously, developing the latest in mobile technologies, scalable a ...

  • Saxon Global

    Data Engineer

    3 weeks ago

    Saxon Global San Francisco, United States

    Client: T he County of Sacramento · Position: Data Engineer - ETL, Spark, Airflow Specialist · Location: Sacramento, Ca ONLY CANDIDATES LOCAL TO SACRAMENTO WILL BE CONSIDERED. 100% ONSITE WORK · Rate:$65/hr. on C2C (Some Flex) · Visa: Open · Duration: 12+ Months · Looking f ...

  • Speak

    Data Engineer

    2 weeks ago

    Speak San Francisco, United States

    Job Description · Job DescriptionAbout usOur mission is to become the de facto way people learn foreign languages. We begin by teaching the next billion people English and Spanish. · English is the global language of business, culture, and communication, and over 1.5 billion peop ...

  • BayOne Solutions

    Data Engineer

    4 weeks ago

    BayOne Solutions San Francisco, United States Full time

    Senior Data Engineer · Location: (100% Remote) · Duration: Full time · The Opportunity: · Technology · Our technology team works fast and smart. With San Francisco as our home, we take bringing new tech to market seriously, developing the latest in mobile technologies, scala ...

  • Speak LLC

    Data Engineer

    2 weeks ago

    Speak LLC San Francisco, United States

    About us · Our mission is to become the de facto way people learn foreign languages. We begin by teaching the next billion people English and Spanish. · English is the global language of business, culture, and communication, and over 1.5 billion people around the world are activ ...

  • Hazel Health, Inc.

    Data Engineer

    3 weeks ago

    Hazel Health, Inc. San Francisco, United States

    Hazel Health, the national leader in school-based telehealth, was founded in 2015 to address systemic inequities in healthcare access, and ensure all children can get the quality care they need and deserve. We leverage digital health technology to provide on-demand physical and m ...

  • FocusKPI Inc.

    Data Engineer

    2 weeks ago

    FocusKPI Inc. San Francisco, United States

    Job Description · Job DescriptionFocusKPI is looking for a Data Engineer to join one of our client's team and to support them. As a member of the Data Engineering, you own the ETL/ELT pipelines and data warehouse that are used to analyze trends and activity in our client's produc ...

  • Hexcel

    Data Engineer

    1 week ago

    Hexcel West Valley City, United States

    With our strong investment in research and development and our culture of continuous improvement, Hexcel is the industry leader in the manufacturing of advance composite materials, including carbon fiber, woven reinforcements, resins, prepregs, honeycombs and additive manufacture ...

  • Tekfortune Inc

    Data Engineer

    3 weeks ago

    Tekfortune Inc San Francisco, United States

    Tekfortune is a fast-growing consulting firm specialized in permanent, contract & project-based staffing services for world's leading organizations in a broad range of industries. In this quickly changing economic landscape, virtual recruiting and remote work are critical for the ...

  • VRChat Inc

    Data Engineer

    2 weeks ago

    VRChat Inc San Francisco, United States

    Join the VRChat team · VRChat offers a first-of-its kind, game-changing platform that provides an endless collection of social immersive experiences and gives the power of creation to its robust community. With over 250,000 worlds and growing, VRChat's vision is to allow users t ...

  • Sia Partners

    Data Engineer

    2 weeks ago

    Sia Partners San Francisco, United States

    Job Description · Job DescriptionCompany Description · Sia Partners is a next-generation management consulting firm. We offer a unique blend of AI and design capabilities, augmenting traditional consulting to deliver superior value to our clients. Counting 3,000 consultants in 19 ...

  • ConsultNet

    Data Engineer

    3 weeks ago

    ConsultNet San Francisco, United States

    Data Engineer · Direct Hire · 100% Remote · Salary: $130, ,000 a year + company equity · Job Description: · Seeking Data Software Engineer who is well versed in Python and SQL and who loves to code. No specific industry experience required but Healthcare background is a plus. Mus ...

  • Pathway Vet Alliance

    Data Engineer

    3 weeks ago

    Pathway Vet Alliance San Francisco, United States

    About Pathway · Deeptech start-up, founded in March 2020. Our primary developer offering is an ultra-performant Data Processing Framework (unified streaming + batch) with a Python API, distributed Rust engine, and capabilities for data source integration & transformation at scal ...

  • Gunderson Dettmer

    Data Engineer

    2 weeks ago

    Gunderson Dettmer San Francisco, United States

    Job Description · Job DescriptionGunderson Dettmer is the only business law firm of its kind - exclusively serving the global venture capital and emerging technology marketplace. With 400 attorneys in eleven offices - from Silicon Valley to Singapore - we innovate for innovators, ...