Jobs
>
Irvine

    Senior Data Engineer - Irvine, United States - CivicMinds, Inc

    CivicMinds, Inc
    CivicMinds, Inc Irvine, United States

    1 week ago

    Default job background
    Description

    Role Description:

    Data engineering role requires creating and managing technological infrastructure of a data platform, be in-charge / involved in architecting, building, and managing data flows / pipelines and construct data storages (noSQL, SQL), tools to work with big data, and integration tools to connect sources or other databases.

    Role Responsibility:


    • Translate functional specifications and change requests into technical specifications


    • Translate business requirement document, functional specification, and technical specification to related coding


    • Develop efficient code with unit testing and code documentation


    • Ensuring accuracy and integrity of data and applications through analysis, coding, documenting, testing, and problem solving


    • Setting up the development environment and configuration of the development tools


    • Communicate with all the project stakeholders on the project status


    • Manage, monitor, and ensure the security and privacy of data to satisfy business needs


    • Contribute to the automation of modules, wherever required


    • To be proficient in written, verbal and presentation communication (English)


    • Co-ordinating with the UAT team

    Role Requirement:


    • Proficient in basic and advanced DBT-SQL programming concepts (Procedures, Analytical functions etc.)


    • Good Knowledge and Understanding of Data warehouse concepts (Dimensional Modeling, change data capture, slowly changing dimensions etc.)


    • Knowledgeable in Shell / PowerShell scripting


    • Knowledgeable in relational databases, nonrelational databases, data streams, and file stores


    • Knowledgeable in performance tuning and optimization


    • Experience in Data Profiling and Data validation


    • Experience in requirements gathering and documentation processes and performing unit testing


    • Understanding and Implementing QA and various testing process in the project


    • Knowledge in any BI tools will be an added advantage


    • Sound aptitude, outstanding logical reasoning, and analytical skills


    • Willingness to learn and take initiatives


    • Ability to adapt to fast-paced Agile environment

    Additional Requirement:


    • Design, develop, and maintain scalable data models and transformations using DBT in conjunction with Snowflake, ensure the effective transformation and load data from diverse sources into data warehouse or data lake.


    • Implement and manage data models in DBT, guarantee accurate data transformation and alignment with business needs.


    • Utilize DBT to convert raw, unstructured data into structured datasets, enabling efficient analysis and reporting.


    • Write and optimize SQL queries within DBT to enhance data transformation processes and improve overall performance.


    • Establish best DBT processes to improve performance, scalability, and reliability.


    • Expertise in SQL and a strong understanding of Data Warehouse concepts and Modern Data Architectures.


    • Familiarity with cloud-based platforms (e.g., AWS, Azure, GCP).


    • Migrate legacy transformation code into modular DBT data models.

  • Allergan Aesthetics

    Data Engineer

    1 week ago

    Allergan Aesthetics Irvine, United States

    Job Description · Overview: · We are seeking a Data Engineer with experience in ETL, Snowflake, ThoughtSpot, and/or Power BI datasets to join our team. As a Data Engineer, you will be responsible for designing, building, and maintaining data pipelines and systems that enable our ...

  • Motion Recruitment

    Data Engineer

    2 weeks ago

    Motion Recruitment Irvine, United States

    An AdTech is hiring a Senior Data Engineer to join their team. Requirements · This role is fully remote from Southern California, so it will be PST time. To be considered you must currently reside in CA, NY, NJ, FL, TX, WY, AZ, or CO as they need someone to begin asap · Required ...

  • Kaygen

    Data Engineer

    2 weeks ago

    Kaygen Irvine, United States

    KAYGEN is an emerging leader in providing top talent for technology based staffing services. We specialize in providing high-volume contingent staffing, direct hire staffing and project based solutions to companies worldwide ranging from startups to Fortune 500 and Managed Servic ...

  • Allergan Aesthetics

    Data Engineer,

    1 week ago

    Allergan Aesthetics Irvine, United States

    Job Description · Job DescriptionCompany Description · AbbVie's mission is to discover and deliver innovative medicines and solutions that solve serious health issues today and address the medical challenges of tomorrow. We strive to have a remarkable impact on people's lives acr ...

  • Nebulaworks

    Data Engineer

    2 weeks ago

    Nebulaworks Irvine, United States

    About Nebulaworks · Nebulaworks is a consulting and engineering firm founded, built, and managed by engineers, for engineers. Our mission isto be the best in the world at creating high-performance engineering teams where members are inspired to collaborateopenly, incentivized to ...

  • ClifyX

    Data Engineer

    1 week ago

    ClifyX Irvine, United States

    Data Engineer- Infosys/Client - Irvine, CA (Day1 onsite) - Rates $60 · Role · Support: Root Cause Analysis for existing complex data flows from source through to user interface. · Analysis: Build data pipelines, analytics data stores, tools and solutions to automate troublesho ...

  • Motion Recruitment Partners LLC

    Data Engineer

    2 weeks ago

    Motion Recruitment Partners LLC Irvine, United States

    An AdTech is hiring a Senior Data Engineer to join their team. Requirements · This role is fully remote from Southern California, so it will be PST time. To be considered you must currently reside in CA, NY, NJ, FL, TX, WY, AZ, or CO as they need someone to begin asap · Required ...

  • Avance Consulting

    Data engineer

    1 week ago

    Avance Consulting Irvine, United States

    Job Description · Job Description · Power BI and Data analytics expert · Works independently with limited direction · Performs DOEs and process characterization · Proficiency in Statistics, Gage R & R · Studies the existing processes to implement improvements on new products. · C ...

  • LanceSoft Inc

    Data Engineer

    1 week ago

    LanceSoft Inc Irvine, United States Full time

    Must Have Skills Experience in Alati on DAG or Colibra Experience in Oracle or DB2 Database Experience in Hadoop Experience in Spark Experience in Python Scripting/programming Experience in Hive Experience in metadata design and development ...

  • CTC Global

    Palantir Data Engineer

    1 week ago

    CTC Global Irvine, United States

    Job Title:Palantir Data Engineer (On-Site, Irvine, CA) · Reports To: Principal Engineer Manager R&D · Location: Irvine, CA, On-Site · Department: Engineering and Product Development · Salary: $100,000 to $130,000 a year · Shift: Day, Monday to Friday, 8 AM to 5 PM · SUMMARY · ...

  • Convertible

    Senior Data Engineer

    1 week ago

    Convertible Irvine, United States

    Job Description · Job DescriptionAt Convertible, we leverage data to drive intelligent decision-making and optimize operations across various industries. Our Senior Data Engineers play a crucial role in designing and implementing robust data infrastructure that enables organizati ...

  • CTC Global Corporation

    Palantir Data Engineer

    2 weeks ago

    CTC Global Corporation Irvine, United States

    Job Title:Palantir Data Engineer (On-Site, Irvine, CA) · Reports To: Principal Engineer Manager R&D · Location: Irvine, CA, On-Site · Department: Engineering and Product Development · Salary: $100,000 to $130,000a year · Shift: Day, Monday to Friday, 8 AM to 5 PM · SUMMARY ...

  • Capital Group

    Senior Data Engineer

    1 week ago

    Capital Group Irvine, United States

    "I can succeed as a Senior Data Engineer at Capital Group." · As a Senior Data Engineer, you will contribute to a C G -designed and operated Quantitative Portfolio Construction Platform that generates trade recommendations and associated analytics to align an investment vehicle ...

  • NextXap, Inc.

    AWS Data Engineer

    1 day ago

    NextXap, Inc. Irvine, United States

    Role: AWS Data Engineer · Location: Irvine, CA (Onsite) · Requirements: · 7+ years of experience as a Senior Data Engineer AWS, including designing and implementing complex Cloud applications · 5+ years of experience working with AWS - RDS, S3, Step Functions, Glue, Lambda, Athen ...

  • Capital Group

    Senior Data Engineer

    1 week ago

    Capital Group Irvine, United States

    "I can succeed as a Senior Data Engineer at Capital Group." · As a Senior Data Engineer, you will contribute to a CG-designed and operated Quantitative Portfolio Construction Platform that generates trade recommendations and associated analytics to align an investment vehicle po ...

  • Amazon

    Data Engineer II

    1 week ago

    Amazon Irvine, United States

    · We are in the business of building data solutions that allow us, and our partner teams, to apply data in order to improve experiences for our players. This role will directly be responsible for contributing to our data ecosystem, and ensuring that we are building the right sol ...

  • Finfare Inc.

    Senior Data Engineer

    1 week ago

    Finfare Inc. Irvine, United States

    About Finfare · Finfare is dedicated to empowering SMBs, by providing the ultimate expense management solution for growing businesses seeking to streamline their financial operations and maximize cash back rewards. Finfare offers easy expense tracking, personalized spend control ...

  • Finfare Inc.

    Senior Data Engineer

    1 week ago

    Finfare Inc. Irvine, United States

    Job Description · Job DescriptionAbout Finfare · Finfare is dedicated to empowering SMBs, by providing the ultimate expense management solution for growing businesses seeking to streamline their financial operations and maximize cash back rewards. Finfare offers easy expense trac ...

  • Zortechsolutions

    Data Science Engineer

    2 weeks ago

    Zortechsolutions Irvine, United States

    Role: Data Science Engineer · Location: Irvine, CA (Remote) · Duration: Fulltime · Job Description · Summary : · Develops core versions of software applications for sale to external clients. Identifies clients' purchasing requirements and technical specifications through Pro ...

  • Capital Group

    Data Engineer III

    2 weeks ago

    Capital Group Irvine, United States

    "I can succeed as a Data Engineer III at Capital Group." · Are you passionate about Generative AI? Are you interested in shaping the future of sales and marketing analytics at Capital by utilizing generative AI? In this position, you will play a crucial role in assisting our cli ...