Jobs
>
California

    GCP Data Engineer - California, United States - Sidhicorp

    Sidhicorp
    Sidhicorp California, United States

    1 week ago

    Default job background
    Description

    About the role:
    As a Data Engineer, you will build a variety of big data analytics solutions, including big data lakes


    More specifically, you will:
    Design and build scalable data ingestion pipelines to handle real-time streams, CDC events, and batch data

    Execute high-performance data processing for structured and unstructured data and data harmonization

    Schedule, orchestrate and validate pipelines

    Design exception handling and log monitoring for debugging

    Make tech stack and tools related decisions

    Collaborate with business consultants, data scientists, and application developers to develop analytics solutions

    Job RequirementRequired Experience, Skills & Competencies:

    Hands-on experience with:

    Hadoop ecosystem - HDFS, Hive, Sqoop, Kafka, ELK Stack, etcSpark, Scala, Python, and core/advanced JavaNoSQL databases e.g.

    Hbase, Cassandra, MongoDBRelevant GCP components required to build big data solutionsGood to know:
    Databricks, Snowflake

    Ability to develop and manage scalable Hadoop cluster environments

    Good understanding of data warehousing concepts, distributed systems, data pipelines, ETL

    5-10 years of tech experience with at least 3 years in big data engineering

    Designation will be commensurate with expertise/experience. Compensation packages are among the best in the industry.

    #J-18808-Ljbffr

  • Open Systems Technologies

    Data Engineer

    1 week ago


    Open Systems Technologies California, United States

    A financial firm is looking for a Data Engineer · to join their team in New York, NY. · Pay: $70-100/hr · • Work on migrating applications from an on-premises location to the cloud service providers. · • Develop products and services on the latest technologies through contribu ...

  • Atomwise

    Data Engineer

    1 week ago


    Atomwise California, United States

    [Full Time] Data Engineer at Atomwise (United States) | BEAMSTART Jobs · Data Engineer · Atomwise United States · Date Posted · 25 Jun, 2022 · Work Location · California, United States · Salary Offered · Not Specified · Job Type · Full Time · Experience Required · No experience ...

  • e-Primary

    Data Engineer

    1 week ago


    e-Primary California, United States

    Title: Data Engineer · Location: Orange, CA (Remote. Full time schedule but must work 9:00 a.m. to 2:00 p.m. PT. and can flex start/end times around this). · Duration: 6 months + w/potential temp to perm · Description: · We are seeking qualified candidates to join us in an ente ...

  • Red River

    Data Engineer

    1 week ago


    Red River California, United States

    Data Engineer (ETL Developer) page is loaded · Data Engineer (ETL Developer) · Apply · locations · Remote - California · Client Site - California · time type · Full time · posted on · Posted 3 Days Ago · job requisition id · REQ-2631 · The Data Engineer will be involv ...

  • System 1

    Data Engineer

    1 week ago


    System 1 California, United States

    System1 is one of the largest customer acquisition companies in the world whose growth depends heavily on a very talented data engineering team.The · Sr. · Data Engineering · team at System1 is focused on building frameworks, processes, and automation to ensure smooth running ...

  • Cedars-Sinai

    Data Engineer

    1 week ago


    Cedars-Sinai California, United States

    Job Description · Grow your career at Cedars-Sinai · The Enterprise Information Services (EIS) team at Cedars-Sinai understands that true clinical transformation and the optimization of a clinical information systems implementation is fueled through the alignment of the right pe ...

  • Gilder Search Group

    Data Engineer

    1 week ago


    Gilder Search Group California, United States

    We are looking for a · Data Engineer · based in · Latin America · to work on a long-term project for one of our clients, a Data Analytics and Business Intelligence services company based in Los Angeles, California. · Our client provides a transformational platform that allows ...

  • Apex Systems

    Data Engineer

    1 week ago


    Apex Systems California, United States

    We are seeking Mid To Senior Level Data engineers for an exciting project in the Bay Area. Candidates will need to be able to sit onsite in either Burlingame OR Menlo Park, CA. · Please review the below job details and apply if interested · Pay Range: 60-88 Per Hour/W2 · ??????? ...

  • Kyra Solutions

    Data Engineer

    1 week ago


    Kyra Solutions California, United States

    Data Engineer / Project Leader (On-site from Day One) · Join Our Team Do you want to make an impact on the world around you? The work we do at Kyra Solutions directly impacts government entities and the citizens they serve. In Transportation, our solutions are designed to save l ...

  • Serendeputy LLC

    Data Engineer

    1 week ago


    Serendeputy LLC California, United States

    The role is critical in building the data infrastructure that supports our product, marketing, sales and CX efforts. Leveraging experience in data architecture and modeling we aim to improve data flows and ensure clean and accessible data for reporting and analysis. · Responsibi ...

  • Skyline Enterprises

    Data Engineer

    1 week ago


    Skyline Enterprises West Columbia, United States

    The Bartels-Langness Group is one of the largest privately owned food retailers in northern Germany. Our constantly growing company, currently with employees, supplies around 1,500 independent retailers, gas stations, and kiosks. Our strong corporate network also includes famila ...


  • MURAL California, United States

    YOUR MISSION · As a Staff Data Engineer on the Data Platform team, you will grow our business by leveraging advanced data engineering techniques to enhance our data architecture and streamline data ingestion processes. Your expertise will be instrumental in improving our data-dri ...


  • Paramount Unified School District California, United States

    OVERVIEW & RESPONSIBILITIES · This role will be responsible for growing and optimizing the Studio's data and data pipeline architecture, monitoring and running backend infrastructure, as well as automating data processes for the Global Analytics and Data Science team. We seek a ...

  • Pyromis

    GCP Data Engineer

    1 week ago


    Pyromis California, United States

    Note : · Very strong and deep knowledge · of GCP with Airflow, Dataflow, Composer, Big Query . · Required Past Experience: · Looking for a GCP Data Engineer for its Cloud and Big Data projects in the Data Warehousing, Data Analytics domain. · Develop data-driven solutions with ...

  • Inscripta Inc

    Data Engineer III

    1 week ago


    Inscripta Inc California, United States

    About Inscripta: · Inscripta is a life science technology company committed to creating a cleaner, healthier, and more sustainable world through biomanufacturing. A global leader in genome engineering, our innovations are designed to unlock the full potential of the bioeconomy. W ...

  • Redica Systems, Inc.

    Data Engineer II

    1 week ago


    Redica Systems, Inc. California, United States

    Redica Systems is a SaaS start-up serving more than 200 customers within the life science sector, with a specific focus on Pharmaceuticals and MedTech. Embracing a hybrid model, our workforce is distributed globally, with headquarters in Pleasanton, CA. · Redica's data analytics ...


  • CoStar Group California, United States

    - Senior Data Engineer · Job Description · OVERVIEW CoStar Group (NASDAQ: CSGP) is a leading global provider of commercial and residential real estate information, analytics, and online marketplaces. Included in the S&P 500 Index and the NASDAQ 100, CoStar Group is on a mission t ...


  • Lightspark Group, Inc. California, United States

    Lightspark is the easiest, most reliable, enterprise-grade gateway to the Lightning Network, enabling money to move just like bits and bytes do on the Internet. Lightspark services aim to be the fastest, lowest cost, easiest and most reliable way to send and receive payments glob ...


  • GMMI Inc. California, United States

    The North American branch of Generali Global Assistance offers a diverse and inclusive work environment while employees work towards making real difference in the lives of our clients. As an Organization, we pride ourselves with offering white glove service while being mindful of ...

  • Tekstad

    Sr. Data Engineer

    1 week ago


    Tekstad California, United States

    Seeking a Sr. Data Engineers for my client in SFO CA. · Duration: Long Term · #Contract · Ideal Candidates must have below skills. · •Responsible for scaling up data processing flow to meet rapid data growth. · •Evolve data model and data schema based on business and enginee ...