Jobs
>
Raleigh

    Data Engineer - Raleigh, United States - Fusemachines

    Fusemachines
    Fusemachines Raleigh, United States

    3 weeks ago

    Default job background
    Description
    About Fusemachines
    Fusemachines is a leading AI strategy, talent, and education services provider. Founded by Sameer Maskey Ph.
    D., Adjunct Associate Professor at Columbia University, Fusemachines has a core mission of democratizing AI.

    With a presence in 4 countries (Nepal, United States, Canada, and Dominican Republic and more than 350 full-time employees) Fusemachines seeks to bring its global expertise in AI to transform companies around the world.


    About the role:


    This is a remote, W2 role responsible for designing, building, and maintaining the infrastructure required for data integration, storage, processing, and analytics (BI, visualization and Advanced Analytics).Working in the Financial sector and implementing cyber-security use cases.


    Qualification / Skill Set Requirement:
    3+ years of real-world data engineering development experience in Snowflake and AWS (certifications preferred)
    Proven experience as a Snowflake Developer, with a strong understanding of Snowflake architecture and concepts.
    Proficient in snowflake services such as snowpipe, stages, stored procedures, views, materialized views, tasks and streams.
    Must have previous experience working with security datasets

    Strong programming skills in SQL, with proficiency in writing efficient and optimized code for data integration, storage, processing, and manipulation.

    Robust understanding of data partitioning and other optimization techniques in Snowflake.
    Knowledge of data security measures in Snowflake, including role-based access control (RBAC) and data encryption.

    Highly skilled in one or more languages such as Python, Scala, and proficient in writing efficient and optimized code for data integration, storage, processing and manipulation.

    Strong knowledge of SDLC tools and technologies, including project management software (Jira or similar), source code management (GitHub or similar), CI/CD system (GitHub actions, AWS CodeBuild or similar) and binary repository manager (AWS CodeArtifact or similar).

    Skilled in Data Integration from different sources such as APIs, databases, flat files, event streaming.
    Good understanding of Data Modeling and Database Design Principles.

    Being able to design and implement efficient database schemas that meet the requirements of the data architecture to support data solutions.

    Strong experience in working with ELT and ETL tools and being able to develop custom integration solutions as needed.

    Strong experience with scalable and distributed Data Technologies such as Spark/PySpark, DBT and Kafka, to be able to handle large volumes of data.

    Strong experience in designing and implementing Data Warehousing solutions in AWS with RedShift.

    Demonstrated experience in designing and implementing efficient ELT/ETL processes that extract data from source systems, transform it (DBT), and load it into the data warehouse.

    Strong experience in Orchestration using Apache Airflow.
    Expert in Cloud Computing in AWS, including deep knowledge of a variety of AWS services like Lambda, Kinesis, S3, Lake Formation, EC2, ECS/ECR, IAM, CloudWatch, Redshift, etc

    Good understanding of Data Quality and Governance, including implementation of data quality checks and monitoring processes to ensure that data is accurate, complete, and consistent.


    Good Problem-Solving skills:
    being able to troubleshoot data processing pipelines and identify performance bottlenecks and other issues.

    Responsibilities:
    Follow established design, constructed data architectures. Developing and maintaining data pipelines, ensuring data flows smoothly from source to destination. Handle ELT processes, including data extraction, loading, transformation and load data from various sources into Snowflake.
    Ensure the reliability, scalability, and efficiency of data systems are maintained at all times

    Assist in the configuration and management of Snowflake data warehousing and data lake solutions, working under the guidance of senior team members.

    Collaborate closely with cross-functional teams including Product, Engineering, Data Scientists, and Analysts to thoroughly understand data requirements and provide data engineering support.

    Contribute to data quality assurance efforts, such as implementing data validation checks and tests.
    Evaluate and implement cutting-edge technologies and continue learning and expanding skills in data engineering and cloud platforms.
    Develop, design, and execute data governance strategies encompassing cataloging, lineage tracking, quality control, and data governance frameworks that align with current analytics demands and industry best practices
    Document data engineering processes and data flows.
    Care about architecture, observability, testing, and building reliable infrastructure and data pipelines.
    Takes ownership of storage layer, SQL database management tasks, including schema design, indexing, and performance tuning.
    Swiftly address and resolve complex data engineering issues, incidents and resolve bottlenecks in SQL queries and database operations.
    Assess best practices and design schemas that matches business needs for delivering a modern analytics solution (descriptive, diagnostic, predictive, prescriptive)
    Be an active member of our Agile team, participating in all ceremonies and continuous improvement activities.

    Equal Opportunity Employer:

    Race, Color, Religion, Sex, Sexual Orientation, Gender Identity, National Origin, Age, Genetic Information, Disability, Protected Veteran Status, or any other legally protected group status.

    #J-18808-Ljbffr
  • Novalink Solutions LLC

    Sr Data Engineer

    4 days ago

    Novalink Solutions LLC Raleigh, United States

    The persons in this position will play a crucial role in designing, implementing, and optimizing data pipelines and ETL processes to support the extraction, transformation, and loading of data from various Child Welfare sources into Salesforce. They will collaborate with cross-fu ...

  • LHH

    Data Engineer

    3 weeks ago

    LHH Raleigh, United States

    ***Candidates must be local Raleigh, NC area for a hybrid commute*** · We are seeking a talented junior-mid level experienced data engineer for a mid-large company in the manufacturing industry. The ideal candidate will be passionate about leveraging data to solve complex problem ...

  • DigiTran Technologies Inc.

    Data Engineer

    2 weeks ago

    DigiTran Technologies Inc. Raleigh, United States

    Description: · Under general supervision, responsible for product support and maintenance of the data warehouse. Performs data warehouse design and construction. Codes and documents scripts and stored procedures. Designs and implements data strategy methods. Develops appropriate ...

  • Dexian - DISYS

    Data Engineer

    1 week ago

    Dexian - DISYS Raleigh, United States

    Data Engineer - Senior (Raleigh) · Hybrid schedule: In the office for first 2 months (Raleigh, NC), then remote 3 days a week and 2 days in the office · Required Skills/Experience: · Specific ability with the following languages, tools and utilities is required: · - Ab Initio ET ...

  • Hazen and Sawyer

    Data Engineer

    2 weeks ago

    Hazen and Sawyer Raleigh, United States

    Hazen and Sawyer is actively seeking a Data Engineer/BI Developer with a passion for using technology to make a positive impact on public health and the environment. This unique role offers you the chance to collaborate with teams of engineers, planners, and scientists, applying ...

  • Seneca Resources

    Data Engineer

    2 weeks ago

    Seneca Resources Raleigh, United States

    Position Title: Data Engineer · Location: Raleigh, NC · Environment: Hybrid (First 2 months fully on-site for training, then 3 days remote) · Position Status: Contract -to-hire. · Pay rate: $45-50/hr. · Clearance: Public Trust (Must e able to obtain) · Position Description: · Un ...

  • Georgia IT Inc

    Data Engineer

    2 weeks ago

    Georgia IT Inc Raleigh, United States

    Title :- Sr Data Engineer · Position Type :- Onsite · Duration :- 1+year contract · Rate :- DOE · US Citizens, Green Card Only · Required Qualifications and Skills · Experience with AWS Services, especially, Data Pipeline, Glue, Kinesis, and Redshift Spectrum. · experience ...

  • Logistics Integration Solutions (LIS)

    Data Engineer

    1 week ago

    Logistics Integration Solutions (LIS) Raleigh, United States

    LIS is a leading Technology Company specializing in IT Consulting, Staffing and Enterprise Solutions. We offer a flexible and friendly work environment that enables career growth and opportunities. · Our organization is looking for an experienced Data Engineer - Ab Initio for a ( ...

  • LHH

    Data Engineer

    4 weeks ago

    LHH Raleigh, United States

    ***Candidates must be local Raleigh, NC area for a hybrid commute*** · Is this the role you are looking for If so read on for more details, and make sure to apply today. · We are seeking a talented junior-mid level experienced data engineer for a mid-large company in the manufa ...

  • Zolon Tech Inc.

    Data Engineer

    2 weeks ago

    Zolon Tech Inc. Raleigh, United States

    :Under general supervision, responsible for product support and maintenance of the data warehouse. Performs data warehouse design and construction. Codes and documents scripts and stored procedures. Designs and implements data strategy methods. Develops appropriate programs and s ...

  • Genworth

    Data Engineer

    3 weeks ago

    Genworth Raleigh, United States

    At Enact Mortgage Insurance (Nasdaq: ACT), we understand that there's no place like home. That's why we bring our deep expertise, insightful offerings, and extra mile service to work every day to help lenders put more people in homes and keep them there. · We're looking for an e ...

  • Insight Global

    Data Engineer

    2 weeks ago

    Insight Global Raleigh, United States

    Job Description · * Designs and implements data transformations, ingestion, and curation functions within a Snowflake environment. Responsible for all CI CD pipeline deployments. · * Build data models and table structures within Snowflake from various source systems, SAP, Workday ...

  • TCI Technology Consulting Inc

    Data Engineer

    2 weeks ago

    TCI Technology Consulting Inc Raleigh, United States

    TCI has an immediate need for multiple Data Engineers in Raleigh, NC. This is not a Corp2Corp opportunity. This is a long-term contract opportunity with the possibility of hire. In addition to competitive, market-rate based pay, TCI provides all our Consultants with Comprehensive ...

  • Red Zone Resources Inc.

    Data Engineer

    1 day ago

    Red Zone Resources Inc. Raleigh, United States

    Job Description · Job Description735339 · Hybrid Remote · The primary purpose of these positions is to analyze, map, build, test, and maintain database pipeline architectures using Oracle and DB2 for Child Welfare Data Conversion efforts as the legacy system migrates to Salesfor ...

  • McGriff Insurance Broker

    Data Engineer

    3 weeks ago

    McGriff Insurance Broker Raleigh, United States

    The primary purpose of this role is to provide technical direction on translating business requirements and functional specifications into logical program designs. This includes assisting with the implementation and maintenance of complex business an Data Engineer, Engineer, Data ...

  • Seneca Resources

    Data Engineer

    2 weeks ago

    Seneca Resources Raleigh, United States

    Data Engineer - Senior (Raleigh) - In the office for first 2 months (Raleigh RITSC South Bldg., 4110 Wake Forest Rd), then remote 3 days a week and 2 days in the office · *Description:* · Under general supervision, responsible for product support and maintenance of the data wareh ...

  • Truist

    Data Engineer

    3 weeks ago

    Truist Raleigh, United States Paid Work

    The position is described below. If you want to apply, click the Apply button at the top or bottom of this page. You'll be required to create an account or sign in to an existing one. · Need Help? ) · If you have a disability and need assistance with the application, you can requ ...

  • Arch Capital Group Ltd.

    Data Engineer

    2 weeks ago

    Arch Capital Group Ltd. Raleigh, United States

    With a company culture rooted in collaboration, expertise and innovation, we aim to promote progress and inspire our clients, employees, investors and communities to achieve their greatest potential. Our work is the catalyst that helps others achieve their goals. In short, We Ena ...

  • Insight Global

    Data Engineer

    4 weeks ago

    Insight Global Raleigh, United States

    Job Description · * Designs and implements data transformations, ingestion, and curation functions within a Snowflake environment. Responsible for all CI CD pipeline deployments. · * Build data models and table structures within Snowflake from various source systems, SAP, Workday ...

  • BCforward

    Data Engineer

    2 weeks ago

    BCforward Raleigh, NC, United States

    Data Engineer · BCforward is currently seeking a highly motivated Data Engineer for an opportunity in Raleigh, NC. · Position Title: Data Engineer · Location: Raleigh, NC - Hybrid · Anticipated Start Date: 3rd - June - 2024 · Please note this is the target date and is subje ...