Jobs
>
Irvine

    Data Engineer - Irvine, United States - Nebulaworks

    Default job background
    Description
    About Nebulaworks

    Nebulaworks is a consulting and engineering firm founded, built, and managed by engineers, for engineers.

    Our mission isto be the best in the world at creating high-performance engineering teams where members are inspired to collaborateopenly, incentivized to gather new knowledge and skills, and value simplicity when solving difficult problems.

    We believe technological and cultural change starts when the focus is on developing the team's skillset, collaboration,and process to deliver software.

    The tools come and go, but the right team is invaluable.

    They possess the foundationalknowledge and expertise to reason about any problem, propose numerous reasonable solutions, and identify a low-risk pathto proving their hypothesis.

    Job Purpose


    As a Data Engineer at Nebulaworks, you will be pivotal in managing and analyzing large datasets crucial for advancementsin life sciences.

    This role involves collaborating with cloud engineers and scientists, providing essential datamanagement, machine learning, and data lifecycle expertise to support our cutting-edge research and discovery projects.

    You Will

    Build distributed, scalable, and reliable data pipelines that ingest and process data at scale and in real time.
    Collaborate with other teams to design, develop, and deploy data tools that support both operations and product usecases.
    Perform offline analysis of large data sets using components of a big data software ecosystem. Evaluate and advise ontechnical aspects of open work requests in the product backlog with the product lead.
    Own product features from the development phase through to production deployment. Evaluate big data technologies andprototype solutions to improve data processing architecture.

    Develop and maintain specialist knowledge of database concepts, object and data modeling techniques, and designprinciples, and a detailed knowledge of database architectures, software, and facilities.

    Apply Agile methodologies in project management.
    Deploy and maintain database storage Infrastructures in AWS cloud.

    Troubleshoot and determine the root cause of complex data provenance, metadata issues, and engineering questions thatmay involve interfacing with various technical staff in multiple organizations and with differing levels of expertise.

    Investigate, evaluate, test, and recommend technical solutions for future systems.
    Develop tools and procedures to monitor and automate system tasks on servers and clusters.
    Creates data environments and/or data sets to serve a wide range of data users, including but not limited to DataScientists, Data Analysts, Business Analysts etc
    Code/Build/Deploy - git, jenkins, AWS
    Handle large, complex data sets to meet functional and non-functional business requirements.
    Implement methods for enhancing data reliability, efficiency, and quality.
    Use programming languages such as Python (must) and R for data tasks.
    Expertise in RDBM, NoSQL, JSON, and other database technologies.
    Develop and maintain machine learning models aligned with business objectives.
    Collaborate with data scientists in implementing advanced machine learning algorithms.
    Adapt to dynamic working environments, managing multiple priorities.
    Job Purpose


    As a Data Engineer at Nebulaworks, you will be pivotal in managing and analyzing large datasets crucial for advancementsin life sciences.

    This role involves collaborating with cloud engineers and scientists, providing essential datamanagement, machine learning, and data lifecycle expertise to support our cutting-edge research and discovery projects.

    Requirements

    You value driving all changes through version control
    You value all team members being hands-on and directly contributing to business outcomes
    Proven experience as a Data Engineer or in a similar role.
    Strong understanding of machine learning principles and application in data processes.
    Experience in building and deploying machine learning models.
    Expertise in Python, Object Oriented Programming and SQL database management.
    Familiarity with AWS cloud-based solutions.
    Excellent problem-solving, communication, and analytical skills.
    Bachelor's degree in Data Science, Computer Science, IT, or related field; Master's is a plus.
    Nice to Haves

    Expertise in scientific data, especially within life sciences, is a significant plus.
    Data engineering or machine learning-related certification
    Mastered Continuous Integration, Continuous Delivery, and Continuous Deployment approaches and processes
    Experience with functional programming languages (Haskell, etc.)
    Experience with containers and container platforms (Kubernetes (EKS, GKE, AKS), docker, etc.)
    Experience across multiple major cloud platforms (AWS, Azure, GCP)
    Expertise in advanced deployment patterns (blue/green, feature flags, canary, etc.)
    Experience with Twelve-Factor application architectures
    Experience with managing the large-scale infrastructure supporting numerous teams and applications

    Why Apply:

    Hybrid work:
    Irvine office and work from home
    Competitive salary and compensation package
    401K with match
    Employee Incentive Plan (EIP)
    Health and dental, medical coverage

    Posting Statement:


    All applicants must be legally permitted to work in the United States without a visa; we cannot provide new orcontinuing visa sponsorship opportunities at this time.

    Nebulaworks is an Equal Employment Opportunity employer, and all qualified applicants will receive consideration foremployment without regard to race, color, religion, sex, age, national origin, protected veteran status, disabilitystatus, sexual orientation, gender identity or expression, marital status, genetic information, or any othercharacteristic protected by law.

    We request candidates to scrub such information from their resumes before applying to help make Nebulaworks aninclusive environment for everyone.


    To apply:
    $ ssh -p 23234

    $ scp -P 23234

    .pdf

    Note:
    You must use an SSH key that's associated with the same user in github

    #J-18808-Ljbffr

  • ClifyX

    Data Engineer

    4 days ago


    ClifyX Irvine, United States

    Data Engineer- Infosys/Client - Irvine, CA (Day1 onsite) - Rates $60 · Role · Support: Root Cause Analysis for existing complex data flows from source through to user interface. · Analysis: Build data pipelines, analytics data stores, tools and solutions to automate troublesho ...

  • Kaygen

    Data Engineer

    1 week ago


    Kaygen Irvine, United States

    KAYGEN is an emerging leader in providing top talent for technology based staffing services. We specialize in providing high-volume contingent staffing, direct hire staffing and project based solutions to companies worldwide ranging from startups to Fortune 500 and Managed Servic ...

  • Allergan Aesthetics

    Data Engineer,

    1 week ago


    Allergan Aesthetics Irvine, United States

    Job Description · Job DescriptionCompany Description · AbbVie's mission is to discover and deliver innovative medicines and solutions that solve serious health issues today and address the medical challenges of tomorrow. We strive to have a remarkable impact on people's lives acr ...

  • Allergan Aesthetics

    Data Engineer

    4 days ago


    Allergan Aesthetics Irvine, United States

    Job Description · Overview: · We are seeking a Data Engineer with experience in ETL, Snowflake, ThoughtSpot, and/or Power BI datasets to join our team. As a Data Engineer, you will be responsible for designing, building, and maintaining data pipelines and systems that enable our ...

  • Motion Recruitment

    Data Engineer

    1 week ago


    Motion Recruitment Irvine, United States

    An AdTech is hiring a Senior Data Engineer to join their team. Requirements · This role is fully remote from Southern California, so it will be PST time. To be considered you must currently reside in CA, NY, NJ, FL, TX, WY, AZ, or CO as they need someone to begin asap · Required ...

  • Motion Recruitment Partners LLC

    Data Engineer

    2 weeks ago


    Motion Recruitment Partners LLC Irvine, United States

    An AdTech is hiring a Senior Data Engineer to join their team. Requirements · This role is fully remote from Southern California, so it will be PST time. To be considered you must currently reside in CA, NY, NJ, FL, TX, WY, AZ, or CO as they need someone to begin asap · Required ...

  • Avance Consulting

    Data engineer

    1 week ago


    Avance Consulting Irvine, United States

    Job Description · Job Description · Power BI and Data analytics expert · Works independently with limited direction · Performs DOEs and process characterization · Proficiency in Statistics, Gage R & R · Studies the existing processes to implement improvements on new products. · C ...

  • LanceSoft Inc

    Data Engineer

    5 days ago


    LanceSoft Inc Irvine, United States Full time

    Must Have Skills Experience in Alati on DAG or Colibra Experience in Oracle or DB2 Database Experience in Hadoop Experience in Spark Experience in Python Scripting/programming Experience in Hive Experience in metadata design and development ...


  • CTC Global Irvine, United States

    Job Title:Palantir Data Engineer (On-Site, Irvine, CA) · Reports To: Principal Engineer Manager R&D · Location: Irvine, CA, On-Site · Department: Engineering and Product Development · Salary: $100,000 to $130,000 a year · Shift: Day, Monday to Friday, 8 AM to 5 PM · SUMMARY · ...


  • Finfare Inc. Irvine, United States

    Job Description · Job DescriptionAbout Finfare · Finfare is dedicated to empowering SMBs, by providing the ultimate expense management solution for growing businesses seeking to streamline their financial operations and maximize cash back rewards. Finfare offers easy expense trac ...


  • Convertible Irvine, United States

    Job Description · Job DescriptionAt Convertible, we leverage data to drive intelligent decision-making and optimize operations across various industries. Our Senior Data Engineers play a crucial role in designing and implementing robust data infrastructure that enables organizati ...


  • Finfare Inc. Irvine, United States

    About Finfare · Finfare is dedicated to empowering SMBs, by providing the ultimate expense management solution for growing businesses seeking to streamline their financial operations and maximize cash back rewards. Finfare offers easy expense tracking, personalized spend control ...


  • Capital Group Irvine, United States

    "I can succeed as a Senior Data Engineer at Capital Group." · As a Senior Data Engineer, you will contribute to a C G -designed and operated Quantitative Portfolio Construction Platform that generates trade recommendations and associated analytics to align an investment vehicle ...


  • Capital Group Irvine, United States

    "I can succeed as a Senior Data Engineer at Capital Group." · As a Senior Data Engineer, you will contribute to a CG-designed and operated Quantitative Portfolio Construction Platform that generates trade recommendations and associated analytics to align an investment vehicle po ...

  • Amazon

    Data Engineer II

    4 days ago


    Amazon Irvine, United States

    · We are in the business of building data solutions that allow us, and our partner teams, to apply data in order to improve experiences for our players. This role will directly be responsible for contributing to our data ecosystem, and ensuring that we are building the right sol ...


  • CivicMinds, Inc Irvine, United States

    Role Description: · Data engineering role requires creating and managing technological infrastructure of a data platform, be in-charge / involved in architecting, building, and managing data flows / pipelines and construct data storages (noSQL, SQL), tools to work with big data, ...


  • CTC Global Corporation Irvine, United States

    Job Title:Palantir Data Engineer (On-Site, Irvine, CA) · Reports To: Principal Engineer Manager R&D · Location: Irvine, CA, On-Site · Department: Engineering and Product Development · Salary: $100,000 to $130,000a year · Shift: Day, Monday to Friday, 8 AM to 5 PM · SUMMARY ...

  • Capital Group

    Data Engineer III

    1 week ago


    Capital Group Irvine, United States

    "I can succeed as a Data Engineer III at Capital Group." · Are you passionate about Generative AI? Are you interested in shaping the future of sales and marketing analytics at Capital by utilizing generative AI? In this position, you will play a crucial role in assisting our cli ...

  • Zortechsolutions

    Data Science Engineer

    2 weeks ago


    Zortechsolutions Irvine, United States

    Role: Data Science Engineer · Location: Irvine, CA (Remote) · Duration: Fulltime · Job Description · Summary : · Develops core versions of software applications for sale to external clients. Identifies clients' purchasing requirements and technical specifications through Pro ...

  • Amazon

    Data Engineer II

    2 weeks ago


    Amazon Irvine, United States

    We are in the business of building data solutions that allow us, and our partner teams, to apply data in order to improve experiences for our players. This role will directly be responsible for contributing to our data ecosystem, and ensuring that we are building the right soluti ...