Jobs
>
Raleigh

    Azure Data Engineer - Raleigh, United States - BGSF

    BGSF
    BGSF Raleigh, United States

    2 weeks ago

    Default job background
    Description
    4 days ago

    Be among the first 25 applicants
    Our client is seeking a talented and experienced Azure Data Engineer to join our team.

    The ideal candidate will have a strong background in data engineering, Azure Data Factory (ADF), and Azure Synapse, along with experience ingesting and consolidating data from various data sources including multiple ERP systems.

    This role requires expertise in designing and implementing data pipelines, data transformation, and data warehousing solutions using Azure services.

    The Senior Azure Data Engineer will play a crucial role in ensuring the security, reliability, and performance of our data infrastructure while collaborating with cross-functional teams to meet business objectives.

    Responsibilities


    Collaborate with stakeholders to understand data requirements and design and maintain secure and compliant data processing pipelines using Azure Data Factory, Azure Synapse, and other tools.

    Ingest data from various sources such as databases, files, APIs, and streaming platforms into Azure, ensuring efficient and reliable data transfer.

    Perform data transformation and processing tasks using Azure Synapse to prepare data for analysis and reporting.

    Select and manage appropriate data storage solutions in Azure, including Azure SQL Database, Azure Data Lake Storage, and Azure Blob Storage, based on data requirements.

    Successful data movements and transformations using various file formats such as Delta, Parquet, Avro, and CSV.

    Implement and optimize data warehousing solutions using Azure Synapse SQL and Azure Synapse Analytics to support large-scale analytics and reporting.

    Collaborate with data scientists and analysts to design and implement data models for analytical workloads using Azure Analysis Services or Power BI.

    Implement DevOps and automation practices to automate data pipelines, monitor data processes, and manage deployments using Azure DevOps, Azure Monitor, and Azure Automation.

    Support and troubleshoot on-premises gateways.

    Requirements

    Minimum of bachelor s degree in computer science, Engineering, Mathematics, or related fields
    5+ years of work experience in designing, developing, and troubleshooting complex SQL queries, on DBMS solutions such as Snowflake, Oracle, MS SQL Server, PostgreSQL, and MySQL
    3+ years of hands-on experience in ETL/ELT tools
    3+ years of work experience with Data Platforms
    1+ year of development experience in Python or similar scripting languages for data automation

    Proven experience as an Azure Data Engineer or similar role, with a focus on designing and implementing data pipelines and data warehousing solutions using Azure services.

    Expertise in Azure Data Factory (ADF), Azure Synapse, and multiple ERP systems.
    Experience working with On-Premises and Cloud systems and data sources.
    Strong analytical skills in working with unstructured datasets and designing efficient data processing workflows.
    Proficiency in coding and scripting languages such as SQL, Python, or PowerShell.

    Implement DevOps and automation practices to automate data pipelines, monitor data processes, and manage deployments using Azure DevOps, Azure Monitor, and Azure Automation.

    Excellent communication skills, with the ability to collaborate effectively with cross-functional teams and drive alignment towards common goals.
    Regularly check and maintain data quality by validating data against predefined standards and governance policies.
    Fix data quality issues and errors in data pipelines to maintain accurate data.

    Nice To Have

    Certifications such as Azure Solutions Architect Expert or Azure DevOps Engineer Expert.
    Experience with other Azure services and frameworks beyond ADF and Synapse including Azure Databricks and Snowflake.
    Knowledge of data modeling and analysis techniques using Azure services like Azure Analysis Services.
    Experience with Microsoft Fabric
    Experience with Informatica Data Quality and MDM

    Seniority level

    Seniority level

    Entry level
    Employment type

    Employment type

    Full-time
    Job function

    Job function

    Information Technology
    Industries

    Staffing and Recruiting
    Referrals increase your chances of interviewing at BGSF by 2x
    Get notified about new

    Data Engineer

    jobs in

    Charlotte, NC .
    Dev10 Entry Level Software Developer - Nationwide

    Charlotte, NC

    $50,000 - $60,000

    2 days ago
    Charlotte, NC

    $98,015 - $146,600

    1 month ago
    Charlotte, NC

    $101,000 - $125,000

    2 weeks ago
    Jr. Full Stack Engineer (Contact Center Technologies)

    Charlotte, NC

    $78,970 - $126,140

    6 days ago
    We're unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.

    #J-18808-Ljbffr
  • LHH

    Data Engineer

    1 week ago

    LHH Raleigh, United States

    ***Candidates must be local Raleigh, NC area for a hybrid commute*** · We are seeking a talented junior-mid level experienced data engineer for a mid-large company in the manufacturing industry. The ideal candidate will be passionate about leveraging data to solve complex problem ...

  • TCI Technology Consulting Inc

    Data Engineer

    5 days ago

    TCI Technology Consulting Inc Raleigh, United States

    TCI has an immediate need for multiple Data Engineers in Raleigh, NC. This is not a Corp2Corp opportunity. This is a long-term contract opportunity with the possibility of hire. In addition to competitive, market-rate based pay, TCI provides all our Consultants with Comprehensive ...

  • DigiTran Technologies Inc.

    Data Engineer

    5 days ago

    DigiTran Technologies Inc. Raleigh, United States

    Description: · Under general supervision, responsible for product support and maintenance of the data warehouse. Performs data warehouse design and construction. Codes and documents scripts and stored procedures. Designs and implements data strategy methods. Develops appropriate ...

  • Genworth

    Data Engineer

    2 weeks ago

    Genworth Raleigh, United States

    At Enact Mortgage Insurance (Nasdaq: ACT), we understand that there's no place like home. That's why we bring our deep expertise, insightful offerings, and extra mile service to work every day to help lenders put more people in homes and keep them there. · We're looking for an e ...

  • Zolon Tech Inc.

    Data Engineer

    3 days ago

    Zolon Tech Inc. Raleigh, United States

    :Under general supervision, responsible for product support and maintenance of the data warehouse. Performs data warehouse design and construction. Codes and documents scripts and stored procedures. Designs and implements data strategy methods. Develops appropriate programs and s ...

  • Hazen and Sawyer

    Data Engineer

    1 week ago

    Hazen and Sawyer Raleigh, United States

    Hazen and Sawyer is actively seeking a Data Engineer/BI Developer with a passion for using technology to make a positive impact on public health and the environment. This unique role offers you the chance to collaborate with teams of engineers, planners, and scientists, applying ...

  • Seneca Resources

    Data Engineer

    5 days ago

    Seneca Resources Raleigh, United States

    Position Title: Data Engineer · Location: Raleigh, NC · Environment: Hybrid (First 2 months fully on-site for training, then 3 days remote) · Position Status: Contract -to-hire. · Pay rate: $45-50/hr. · Clearance: Public Trust (Must e able to obtain) · Position Description: · Un ...

  • LHH

    Data Engineer

    2 weeks ago

    LHH Raleigh, United States

    ***Candidates must be local Raleigh, NC area for a hybrid commute*** · Is this the role you are looking for If so read on for more details, and make sure to apply today. · We are seeking a talented junior-mid level experienced data engineer for a mid-large company in the manufa ...

  • Fusemachines

    Data Engineer

    2 weeks ago

    Fusemachines Raleigh, United States

    About Fusemachines · Fusemachines is a leading AI strategy, talent, and education services provider. Founded by Sameer Maskey Ph.D., Adjunct Associate Professor at Columbia University, Fusemachines has a core mission of democratizing AI. With a presence in 4 countries (Nepal, Uni ...

  • McGriff Insurance Broker

    Data Engineer

    2 weeks ago

    McGriff Insurance Broker Raleigh, United States

    The primary purpose of this role is to provide technical direction on translating business requirements and functional specifications into logical program designs. This includes assisting with the implementation and maintenance of complex business an Data Engineer, Engineer, Data ...

  • Arch Capital Group Ltd.

    Data Engineer

    1 week ago

    Arch Capital Group Ltd. Raleigh, United States

    With a company culture rooted in collaboration, expertise and innovation, we aim to promote progress and inspire our clients, employees, investors and communities to achieve their greatest potential. Our work is the catalyst that helps others achieve their goals. In short, We Ena ...

  • Georgia IT Inc

    Data Engineer

    1 week ago

    Georgia IT Inc Raleigh, United States

    Title :- Sr Data Engineer · Position Type :- Onsite · Duration :- 1+year contract · Rate :- DOE · US Citizens, Green Card Only · Required Qualifications and Skills · Experience with AWS Services, especially, Data Pipeline, Glue, Kinesis, and Redshift Spectrum. · experience ...

  • Insight Global

    Data Engineer

    1 week ago

    Insight Global Raleigh, United States

    Job Description · * Designs and implements data transformations, ingestion, and curation functions within a Snowflake environment. Responsible for all CI CD pipeline deployments. · * Build data models and table structures within Snowflake from various source systems, SAP, Workday ...

  • Seneca Resources

    Data Engineer

    4 days ago

    Seneca Resources Raleigh, United States

    Data Engineer - Senior (Raleigh) - In the office for first 2 months (Raleigh RITSC South Bldg., 4110 Wake Forest Rd), then remote 3 days a week and 2 days in the office · *Description:* · Under general supervision, responsible for product support and maintenance of the data wareh ...

  • Truist

    Data Engineer

    1 week ago

    Truist Raleigh, United States Paid Work

    The position is described below. If you want to apply, click the Apply button at the top or bottom of this page. You'll be required to create an account or sign in to an existing one. · Need Help? ) · If you have a disability and need assistance with the application, you can requ ...

  • Insight Global

    Data Engineer

    2 weeks ago

    Insight Global Raleigh, United States

    Job Description · * Designs and implements data transformations, ingestion, and curation functions within a Snowflake environment. Responsible for all CI CD pipeline deployments. · * Build data models and table structures within Snowflake from various source systems, SAP, Workday ...

  • Logistics Integration Solutions (LIS)

    Data Engineer

    13 hours ago

    Logistics Integration Solutions (LIS) Raleigh, NC, United States

    LIS is a leading Technology Company specializing in IT Consulting, Staffing and Enterprise Solutions. We offer a flexible and friendly work environment that enables career growth and opportunities. · Our organization is looking for an experienced Data Engineer - Ab Initio for a ( ...

  • BCforward

    Data Engineer

    3 days ago

    BCforward Raleigh, NC, United States

    Data Engineer · BCforward is currently seeking a highly motivated Data Engineer for an opportunity in Raleigh, NC. · Position Title: Data Engineer · Location: Raleigh, NC - Hybrid · Anticipated Start Date: 3rd - June - 2024 · Please note this is the target date and is subje ...

  • BCforward

    Data Engineer

    12 hours ago

    BCforward Raleigh, United States Full time

    Data Engineer · BCforward is currently seeking a highly motivated Data Engineer for an opportunity in Raleigh, NC. · Position Title: Data Engineer · Location: Raleigh, NC - Hybrid · Anticipated Start Date: 3rd - June - 2024 · Please note this is the target date and is subject to ...

  • Omni Inclusive

    Data Engineer

    1 week ago

    Omni Inclusive Raleigh, United States

    Proven 3+ experience in building and designing solutions for data warehouse and experience in working with large data sets · Strong database knowledge, i.e., RDBMS Oracle/PLSQL, OBIEE/OAS, OODB, ODS, Warehouse, Cloud AWS · Proven experience with Cloud data storage and access usin ...