Jobs
>
Irvine

    Palantir Data Engineer - Irvine, United States - CTC Global Corporation

    CTC Global Corporation
    CTC Global Corporation Irvine, United States

    3 weeks ago

    Default job background
    Description

    Job Title:Palantir Data Engineer (On-Site, Irvine, CA)

    Reports To: Principal Engineer Manager R&D

    Location: Irvine, CA, On-Site

    Department: Engineering and Product Development

    Salary: $100,000 to $130,000a year

    Shift: Day, Monday to Friday, 8 AM to 5 PM

    SUMMARY

    Data engineers work closely with Subject Matter Experts (SMEs) to design the ontology (data model), develop data pipelines, and integrate Foundry with external systems containing the data. Data engineers also need to provide guidance and support on how to access and leverage the data foundation to create new workflows or analyze data.

    ESSENTIAL DUTIES AND RESPONSIBILITIES:

    Integrate new data sources to Foundry using Data Connection

    Implement 2-way integrations between Foundry and external systems

    Develop pipelines transforming tabular or unstructured data

    Implement data transformations in PySpark or Pipeline Builder

    to derive new datasets or create ontology objects.

    Set up support structures for pipelines running in production

    Monitor and debug critical issues such as data staleness or data quality

    Improve performance of data pipelines (latency, resource usage)

    Design and implement an ontology based on business requirements and available data

    Provide data engineering context for application development

    Identify opportunities for turning exploratory or analytical

    applications into interactive operational workflows to drive business value.

    Maintain applications as usage grows and requirements change

    PREFERRED QUALIFICATIONS:

    Between 1 and 3 years of experience, ideally in a customer-facing role

    Experience in Python/PySpark, or experienced in another programming

    language and willing to learn Python and PySpark on their own.

    Experience in TypeScript, or experienced in another

    programming language and willing to learn TypeScript on their own.

    Data engineering experience preferred over data science

    Programming experience requiring collaborative software development

    Python complete language proficiency

    SQL proficiency in querying language (join types, filtering,

    aggregation) and data modeling (relationship types, constraints)

    PySpark basic familiarity (Data Frame operations, PySpark SQL

    functions) and differences with other Data Frame implementations

    (Pandas)

    Typescript experience in TypeScript or experienced in another

    programming language and willing to learn TypeScript on their own.

    Distributed compute conceptual knowledge of Hadoop and Spark (driver,

    executors, partitions)

    Databases general familiarity with common relational database models

    and proprietary instantiations, such as SAP, Salesforce, etc.

    Git knowledge of version control/collaboration workflows and

    best practices

    Iterative working familiarity with an agile and iterative working methodology

    and rapid user feedback gathering concepts.

    UX design knowledge of best practices and applications

    Data quality best practices

    Data literacy data analysis and statistical basics to ensure correctness in

    data aggregation and visualization

    Benefits for all full-time employees include:

    • Medical (HMO/PPO Plan Options)
    • Dental
    • Vision
    • Group Term Life Insurance (CTC pays 100% of the premium)
    • Short-Term Disability and Long-Term Disability (CTC pays 100% of the premium)
    • Flexible Spending Account
    • 401K
    • 15 paid vacation days (more after 5 years)
    • 9 paid holidays
    • 3 paid sick leave days
  • Kaygen

    Data Engineer

    2 weeks ago

    Kaygen Irvine, United States

    KAYGEN is an emerging leader in providing top talent for technology based staffing services. We specialize in providing high-volume contingent staffing, direct hire staffing and project based solutions to companies worldwide ranging from startups to Fortune 500 and Managed Servic ...

  • Nebulaworks

    Data Engineer

    2 weeks ago

    Nebulaworks Irvine, United States

    About Nebulaworks · Nebulaworks is a consulting and engineering firm founded, built, and managed by engineers, for engineers. Our mission isto be the best in the world at creating high-performance engineering teams where members are inspired to collaborateopenly, incentivized to ...

  • Allergan Aesthetics

    Data Engineer

    1 week ago

    Allergan Aesthetics Irvine, United States

    Job Description · Overview: · We are seeking a Data Engineer with experience in ETL, Snowflake, ThoughtSpot, and/or Power BI datasets to join our team. As a Data Engineer, you will be responsible for designing, building, and maintaining data pipelines and systems that enable our ...

  • Motion Recruitment

    Data Engineer

    2 weeks ago

    Motion Recruitment Irvine, United States

    An AdTech is hiring a Senior Data Engineer to join their team. Requirements · This role is fully remote from Southern California, so it will be PST time. To be considered you must currently reside in CA, NY, NJ, FL, TX, WY, AZ, or CO as they need someone to begin asap · Required ...

  • Motion Recruitment Partners LLC

    Data Engineer

    3 weeks ago

    Motion Recruitment Partners LLC Irvine, United States

    An AdTech is hiring a Senior Data Engineer to join their team. Requirements · This role is fully remote from Southern California, so it will be PST time. To be considered you must currently reside in CA, NY, NJ, FL, TX, WY, AZ, or CO as they need someone to begin asap · Required ...

  • ClifyX

    Data Engineer

    1 week ago

    ClifyX Irvine, United States

    Data Engineer- Infosys/Client - Irvine, CA (Day1 onsite) - Rates $60 · Role · Support: Root Cause Analysis for existing complex data flows from source through to user interface. · Analysis: Build data pipelines, analytics data stores, tools and solutions to automate troublesho ...

  • Allergan Aesthetics

    Data Engineer,

    1 week ago

    Allergan Aesthetics Irvine, United States

    Job Description · Job DescriptionCompany Description · AbbVie's mission is to discover and deliver innovative medicines and solutions that solve serious health issues today and address the medical challenges of tomorrow. We strive to have a remarkable impact on people's lives acr ...

  • Avance Consulting

    Data engineer

    2 weeks ago

    Avance Consulting Irvine, United States

    Job Description · Job Description · Power BI and Data analytics expert · Works independently with limited direction · Performs DOEs and process characterization · Proficiency in Statistics, Gage R & R · Studies the existing processes to implement improvements on new products. · C ...

  • LanceSoft Inc

    Data Engineer

    1 week ago

    LanceSoft Inc Irvine, United States Full time

    Must Have Skills Experience in Alati on DAG or Colibra Experience in Oracle or DB2 Database Experience in Hadoop Experience in Spark Experience in Python Scripting/programming Experience in Hive Experience in metadata design and development ...

  • CTC Global

    Palantir Data Engineer

    2 weeks ago

    CTC Global Irvine, United States

    Job Title:Palantir Data Engineer (On-Site, Irvine, CA) · Reports To: Principal Engineer Manager R&D · Location: Irvine, CA, On-Site · Department: Engineering and Product Development · Salary: $100,000 to $130,000 a year · Shift: Day, Monday to Friday, 8 AM to 5 PM · SUMMARY · ...

  • Capital Group

    Senior Data Engineer

    2 weeks ago

    Capital Group Irvine, United States

    "I can succeed as a Senior Data Engineer at Capital Group." · As a Senior Data Engineer, you will contribute to a CG-designed and operated Quantitative Portfolio Construction Platform that generates trade recommendations and associated analytics to align an investment vehicle po ...

  • Amazon

    Data Engineer II

    1 week ago

    Amazon Irvine, United States

    · We are in the business of building data solutions that allow us, and our partner teams, to apply data in order to improve experiences for our players. This role will directly be responsible for contributing to our data ecosystem, and ensuring that we are building the right sol ...

  • CivicMinds, Inc

    Senior Data Engineer

    1 week ago

    CivicMinds, Inc Irvine, United States

    Role Description: · Data engineering role requires creating and managing technological infrastructure of a data platform, be in-charge / involved in architecting, building, and managing data flows / pipelines and construct data storages (noSQL, SQL), tools to work with big data, ...

  • Capital Group

    Senior Data Engineer

    2 weeks ago

    Capital Group Irvine, United States

    "I can succeed as a Senior Data Engineer at Capital Group." · As a Senior Data Engineer, you will contribute to a C G -designed and operated Quantitative Portfolio Construction Platform that generates trade recommendations and associated analytics to align an investment vehicle ...

  • NextXap, Inc.

    AWS Data Engineer

    4 days ago

    NextXap, Inc. Irvine, United States

    Role: AWS Data Engineer · Location: Irvine, CA (Onsite) · Requirements: · 7+ years of experience as a Senior Data Engineer AWS, including designing and implementing complex Cloud applications · 5+ years of experience working with AWS - RDS, S3, Step Functions, Glue, Lambda, Athen ...

  • Convertible

    Senior Data Engineer

    1 week ago

    Convertible Irvine, United States

    Job Description · Job DescriptionAt Convertible, we leverage data to drive intelligent decision-making and optimize operations across various industries. Our Senior Data Engineers play a crucial role in designing and implementing robust data infrastructure that enables organizati ...

  • Finfare Inc.

    Senior Data Engineer

    1 week ago

    Finfare Inc. Irvine, United States

    About Finfare · Finfare is dedicated to empowering SMBs, by providing the ultimate expense management solution for growing businesses seeking to streamline their financial operations and maximize cash back rewards. Finfare offers easy expense tracking, personalized spend control ...

  • Zortechsolutions

    Data Science Engineer

    3 weeks ago

    Zortechsolutions Irvine, United States

    Role: Data Science Engineer · Location: Irvine, CA (Remote) · Duration: Fulltime · Job Description · Summary : · Develops core versions of software applications for sale to external clients. Identifies clients' purchasing requirements and technical specifications through Pro ...

  • Finfare Inc.

    Senior Data Engineer

    1 day ago

    Finfare Inc. Irvine, United States

    Job Description · Job DescriptionAbout Finfare · Finfare is dedicated to empowering SMBs, by providing the ultimate expense management solution for growing businesses seeking to streamline their financial operations and maximize cash back rewards. Finfare offers easy expense trac ...

  • Finfare Inc.

    Senior Data Engineer

    2 weeks ago

    Finfare Inc. Irvine, United States

    Job Description · Job DescriptionAbout Finfare · Finfare is dedicated to empowering SMBs, by providing the ultimate expense management solution for growing businesses seeking to streamline their financial operations and maximize cash back rewards. Finfare offers easy expense trac ...