Jobs
>
San Francisco

    Data Infrastructure Engineer - San Francisco, United States - TWILIO

    TWILIO
    TWILIO San Francisco, United States

    3 days ago

    Default job background
    Description

    Responsibilities

    In this role, you'll:

  • Dive into our dataset and design, implement, and scale data pre/post-processing pipelines.
  • Work on applied ML solutions in the areas of query processing, data mining, cleaning, normalizing and modeling.
  • Design and build data platforms & frameworks for processing high volumes of data, in real-time as well as batch, that will be used across engineering teams.
  • Build data processing streams for cleaning and modeling text data for LLMs
  • Shape the decision-making process for data architecture to effectively deliver insights to the business.
  • Research and evaluate new technologies in the big data space to guide our continuous improvement
  • Collaborate with multi-functional teams to help tune the performance of large data applications
  • Partner with Data Engineering, IT, and business units to ensure the creation of high-quality data solutions that are consistent, clean, and integrated.
  • Conduct data exploration and profiling using analysis, design, and presentation tools.
  • Identify and assess business impacts resulting from strategic initiatives.
  • Deliver analytics solutions to support key business decisions and enhance operational efficiency.

    • Qualifications

    Not all applicants will have skills that match a job description exactly. Twilio values diverse experiences in other industries, and we encourage everyone who meets the required qualifications to apply. While having "desired" qualifications make for a strong candidate, we encourage applicants with alternative experiences to also apply. If your career is just starting or hasn't followed a traditional path, don't let that stop you from considering Twilio. We are always looking for people who will bring something new to the table

    Required:

  • Experience using big data technologies (Airflow, Spark, pySpark, Presto, Athena)
  • AWS experience
  • Demonstrated prior experience in creating data pipelines for text data sets NLP/ large language models
  • Experience building and maintaining ETL (managing high-quality reliable ETL pipelines)
  • Previous experience in building data pipelines for conversational AI APIs

    • Location

    This role will be remote, and based in the United States. This role will be remotebut is not eligible to be hired in San Francisco, CA, Oakland, CA, San Jose, CA, or the surrounding areas.

    What We Offer

    There are many benefits to working at Twilio, including, in addition to competitive pay, things like generous time-off, ample parental and wellness leave, healthcare, a retirement savings program, and much more. Offerings vary by location.

  • Auctomatic

    Infrastructure Engineer, Security Infrastructure

    3 days ago

    Auctomatic San Francisco, United States

    [Full Time] Infrastructure Engineer, Security Infrastructure at Auctomatic (United States) | BEAMSTART Jobs · Infrastructure Engineer, Security Infrastructure · Auctomatic United States · Date Posted · 31 Oct, 2022 · Work Location · San Francisco, United States · Salary Offered ...

  • Crunchbase

    Infrastructure Engineer

    3 hours ago

    Crunchbase San Francisco, United States

    About Crunchbase · Crunchbase helps over 75 million people around the world connect with the companies and people that matter. Powered by best-in-class proprietary data, Crunchbase is democratizing access to opportunities so salespeople, entrepreneurs, investors, job seekers, an ...

  • Equilibrium Energy

    Infrastructure Engineer

    2 days ago

    Equilibrium Energy San Francisco, United States

    What we are looking for · Equilibrium was founded with a vision for building a company where innovation, collaboration, machine learning, and data science power all aspects of our algorithmic decision-making. We are looking for a · Senior Infrastructure Engineer · who can multi ...

  • Hazel Health

    Infrastructure Engineer

    2 days ago

    Hazel Health San Francisco, United States

    Job Description · Job DescriptionHazel Health, the leader in school-based telehealth, partners with school districts as an extension of the school health team to provide mental and physical health services to K-12 students where they are–at school or at home. Nearly 4 million stu ...

  • Sigma Connectivity Inc.

    Infrastructure Engineer

    2 days ago

    Sigma Connectivity Inc. San Francisco Bay Area, United States

    Job description · We seek a talented Infrastructure Engineer to build, support, and continuously meet business needs and increase developer productivity. As an Infrastructure Engineer, you will be designing and developing automated solutions that increase developer productivity. ...

  • Imbue

    Infrastructure Engineer

    2 days ago

    Imbue San Francisco, United States Full time

    Summary · At Imbue, we leverage large amounts of compute to make our small research team more effective. This role is about enabling and supporting those large-scale compute efforts and all of the other software infrastructure that goes into making research a pleasant, seamless e ...

  • Retool

    Infrastructure Engineer

    3 days ago

    Retool San Francisco, United States Full time

    ABOUT RETOOL: · At Retool, we're changing the way software is built. We've developed the fastest way to build internal tools, saving companies time, resources, and engineering bandwidth. Whether it's refunding orders, underwriting loans, managing marketplaces, rolling out new fe ...

  • Acceler8 Talent

    Data Infrastructure Engineer

    5 days ago

    Acceler8 Talent San Francisco, United States

    Data Infrastructure Engineer · Are you an experienced Data Infrastructure Engineer ready to tackle challenges in AI and data processing at an unprecedented scale? Our organization is looking for a skilled professional to join our dynamic team. Here, technology and innovation inte ...

  • Orb

    Software Engineer, Infrastructure

    3 hours ago

    Orb San Francisco, United States

    Mission · Orb is on an ambitious mission to provide every business with the infrastructure to unlock their revenue. Best-in class businesses find ways to effectively align their monetization to product usage-whether that's through seats, consumption, feature limits, or usage-bas ...

  • Hazel Health, Inc.

    Senior Infrastructure Engineer

    20 hours ago

    Hazel Health, Inc. San Francisco, United States

    Hazel partners with schools and families to provide physical and mental virtual health care that helps students feel better and get back to learning. As telehealth becomes more and more relevant in the lives of children, Hazel is experiencing tremendous company growth. Our innova ...

  • TRM Labs

    Staff Engineer, Infrastructure

    8 hours ago

    TRM Labs San Francisco, United States

    [Full Time] Staff Engineer, Infrastructure at TRM Labs (United States) | BEAMSTART Jobs · Staff Engineer, Infrastructure · TRM Labs United States · Date Posted · 24 Dec, 2023 · Work Location · San Francisco, United States · Salary Offered · $188000 — $222000 yearly · Job Type · ...

  • Atomwise

    Staff Engineer, Infrastructure

    2 days ago

    Atomwise San Francisco, United States

    About Atomwise · Atomwise is a TechBio company leveraging AI/ML to revolutionize small molecule drug discovery. The Atomwise team invented the use of deep learning for structure-based drug design; a core technology of Atomwise's best-in-class AI discovery and optimization engine ...

  • Unit21

    Infrastructure Security Engineer

    3 hours ago

    Unit21 San Francisco, United States

    About Unit 21: · Unit21 protects businesses against adversaries engaging in money laundering, fraud, and other sophisticated risks by offering a no-code toolset to model, detect, and remediate suspicious activity. We are backed by investments from Google, Tiger Global, ICONIQ, D ...

  • Autodesk

    Cloud Infrastructure Engineer

    1 day ago

    Autodesk San Francisco, United States

    Job Requisition ID # · 24WD76902 · Position Overview · Autodesk's Platform Services and Emerging Technology (PSET) team is hiring a · Cloud Infrastructure Engineer with experience automating large-scale cloud services · . In this exciting role, you will help us automate a ro ...

  • Stytch

    Experienced Infrastructure Engineer

    3 days ago

    Stytch San Francisco, United States

    What We're Looking ForStytch is the platform for user authentication. We build infrastructure that sits in the critical path of our customer's applications. As an Experienced Software Engineer, you'll work on designing and building back end systems and infrastructure to be secure ...

  • Professional Recruiters

    Sr. Infrastructure Engineer

    20 hours ago

    Professional Recruiters San Francisco, United States

    Sr. Infrastructure Engineer, Tempe, Austin, Charlotte, Austin, Atlanta, Boston · Make Next Happen Now. For more than 30 years, THE BANK has helped innovative companies and their investors move bold ideas forward, fast. THE BANK provides targeted financial services and expertise ...

  • Autodesk

    Cloud Infrastructure Engineer

    3 days ago

    Autodesk San Francisco, United States

    **Job Requisition ID #** · 24WD76902 · **Position Overview** · Autodesk's Platform Services and Emerging Technology (PSET) team is hiring a **Cloud Infrastructure Engineer with experience automating large-scale cloud services** . In this exciting role, you will help us automat ...

  • Stefanini Group

    Infrastructure Automation Engineer

    17 hours ago

    Stefanini Group San Francisco, United States

    Details: · Stefanini Group is hiring · Stefanini is looking for Infrastructure Automation Engineer for San Francisco, CA location (Hybrid work) · For quick Apply, please reach out to Ravi Singh- call: / email: · Open to W2 Candidates only · In this role, you will get an opport ...

  • Gusto

    Storage Infrastructure Engineer

    2 days ago

    Gusto San Francisco, United States

    Storage Infrastructure Engineer @ Gusto · San Francisco, Denver, New York, Seattle WA Remote locations vary · Gusto's Storage Infrastructure Engineering team builds consistent, scalable, and secure storage infrastructure using tools like terraform to manage technologies like My ...

  • Loop, Inc.

    AI Infrastructure Engineer

    20 hours ago

    Loop, Inc. San Francisco, United States

    About Loop · Loop is on a mission to unlock profits trapped in the supply chain ) and lower costs for consumers. Bad data and inefficient workflows create friction that limits working capital and raises costs for every supply chain stakeholder. · Loop's modern audit and pay platf ...