Jobs
>
Charlotte

    Data Engineer - Charlotte, United States - Clark Davis Associates

    Clark Davis Associates
    Clark Davis Associates Charlotte, United States

    1 week ago

    Default job background
    Description

    *Must be US Citizen or GC holder

    Scroll down to find the complete details of the job offer, including experience required and associated duties and tasks.

    *No C2C

    You Will:

    • Architect and develop data pipelines to optimize performance, quality, and scalability
    • Build, maintain & operate scalable, performant, and containerized infrastructure required for optimal extraction, transformation, and loading of data from various data sources
    • Design, develop, and own robust, scalable data processing and data integration pipelines using Python, dbt, Kafka, Airflow, PySpark, SparkSQL, and REST API endpoints to ingest data from various external data sources to Data Lake
    • Develop testing frameworks and monitoring to improve data quality, observability, pipeline reliability, and performance
    • Orchestrate sophisticated data flow patterns across a variety of disparate tooling
    • Support analytics engineers, data analysts, and business partners in building tools and data marts that enable self-service analytics
    • Partner with the rest of the Data Platform team to set best practices and ensure the execution of them
    • Partner with the analytics engineers to ensure the performance and reliability of our data sources
    • Partner with machine learning engineers to deploy predictive models
    • Partner with the legal and security teams to build frameworks and implement data compliance and security policies
    • Partner with DevOps to build IaC and CI/CD pipelines
    • Support code versioning and code deployments for data Pipelines

    You Have:

    • 8+ years of professional experience designing, creating and maintaining scalable data pipelines using Python, API calls, SQL, and scripting languages
    • Demonstrated experience writing clean, efficient & well-documented Python code and are willing to become effective in other languages as needed
    • Demonstrated experience writing complex, highly optimized SQL queries across large data sets
    • Experience with Azure Cloud technologies
    • Experience with Databricks platform
    • Experience with data warehouses like BigQuery, Databricks, Snowflake, and Postgres
    • Experience building event streaming pipelines using Kafka/Confluent Kafka
    • Experience with modern data stack like Airflow/Astronomer, Databricks, dbt, Fivetran, Confluent, Tableau/Looker
    • Experience with containers and container orchestration tools such as Docker or Kubernetes
    • Experience with CI/CD (Jenkins, GitHub Actions, Circle CI)
    • Thorough understanding of SDLC and Agile frameworks
  • Compunnel Inc.

    Data Engineer

    5 days ago

    Compunnel Inc. Charlotte, United States

    This is a W2 role. · Responsibilities: · The person on this role will play a crucial role in building scalable and cost-effective data pipelines, data lakes, and analytics systems. · Data Ingestion: Implement data ingestion processes to collect data from various sources, includin ...

  • Clark Davis Associates

    Data Engineer

    1 week ago

    Clark Davis Associates Charlotte, United States

    *Must be US Citizen or GC holder · *No C2C · You Will: · Architect and develop data pipelines to optimize performance, quality, and scalability · Build, maintain & operate scalable, performant, and containerized infrastructure required for optimal extraction, transformation, and ...

  • Alpha Theory

    Data Engineer

    1 week ago

    Alpha Theory Charlotte, United States

    About Alpha Theory: · Alpha Theory is a fintech software company that prides itself on an inclusive and transparent culture that attracts curious teammates who are excited about tackling big ideas. We hire smart, motivated team members that crave feedback to be better. We believe ...

  • Belk, Inc. & Belk eCommerce LLC

    Data Engineer

    2 days ago

    Belk, Inc. & Belk eCommerce LLC Charlotte, United States OTHER

    EDW Data Engineer is responsible for designing, maintaining, and optimizing data infrastructure for data collection, management, transformation, and access. Creates pipelines that convert raw data into usable formats for data scientists and other data consumers to utilize. Builds ...

  • Truist Financial

    Data Engineer

    5 days ago

    Truist Financial Charlotte, United States

    The position is described below. If you want to apply, click the Apply button at the top or bottom of this page. You'll be required to create an account or sign in to an existing one. · Need Help? · If you have a disability and need assistance with the application, you can requ ...

  • Diverse Lynx

    DATA ENGINEER

    5 days ago

    Diverse Lynx Charlotte, United States

    We are looking for a highly capable Data Engineer who has experience in building end-to-end systems · • Experience on implementation of Data Lakes using Cloud (AWS or GCP), Hands-on with Big Data and related technologies including Spark, Kafka, ELK. · • Define and setup develop ...

  • PamTen

    Data Engineer

    4 days ago

    PamTen Charlotte, United States

    Experience in Data Warehouse related projects in product or service-based organization · • Expert knowledge of Linux operating systems and environment and Scripting (Shell and Python preferred) · • A deep expertise in your field of Software Engineering · • Expert at troubleshoo ...

  • CRG

    Data Engineer

    5 days ago

    CRG Charlotte, United States

    Data Engineer · Location: Remote EST hours · Duration: 12-month contract w/ potential to hire. · Pay: $65+/hr · JOB DESCRIPTION · Our global Fortune 500 client, with U.S. headquarters in Charlotte, NC, is a world class food service provider with a strong presence across the ...

  • Truist Inc

    Data Engineer

    1 day ago

    Truist Inc Charlotte, United States

    The position is described below. If you want to apply, click the Apply button at the top or bottom of this page. You'll be required to create an account or sign in to an existing one. · Need Help? ) · If you have a disability and need assistance with the application, you can requ ...

  • Syntricate Technologies

    Data Engineer

    5 days ago

    Syntricate Technologies Charlotte, United States

    Hi, · Hope you are doing well · Number of position : 3 · Only Full Time no C2C and No Contract · Full-time · I, Shakib(i3 infotek) would like to share a job opportunity as Data Engineer based in Charlotte, NC (Onsite) location for a Full-time position. · *** In case, if you are ...

  • Ryan Consulting Group

    Data Engineer

    5 days ago

    Ryan Consulting Group Charlotte, United States

    Job Description · Job DescriptionFull-time, in office position · Must have AWS, ETL & Python experience · Must be very hands-on · Data Engineer · The Data Engineer will be part of the overall team that is actively engaged in the ongoing database engineering process, partnering wi ...

  • Sia Partners

    Data Engineer

    1 week ago

    Sia Partners Charlotte, United States

    Sia Partners is a next-generation management consulting firm. We offer a unique blend of AI and design capabilities, augmenting traditional consulting to deliver superior value to our clients. Counting 3,000 consultants in 19 countries, we expect to achieve USD 420 million in tur ...

  • Oriental Trading Company

    Data Engineer

    6 days ago

    Oriental Trading Company Charlotte, United States

    Chello is built on a foundation of pioneering data-intelligence and our team of innovators, driven to tackle the financial challenges of the industries we serve. At its core, it's the first of its kind digital banking platform that delivers daily business insights, cash flow pred ...

  • Sumitomo Mitsui Banking Corp

    Data Engineer

    13 hours ago

    Sumitomo Mitsui Banking Corp Charlotte, United States

    SMBC Group is a top-tier global financial group. Headquartered in Tokyo and with a 400-year history, SMBC Group offers a diverse range of financial services, including banking, leasing, securities, credit cards, and consumer finance. The Group has more than 130 offices and 80,000 ...

  • The Hartford

    Data Engineer

    1 week ago

    The Hartford Charlotte, United States

    Data Engineer - GE08AE · We're determined to make a difference and are proud to be an insurance company that goes well beyond coverages and policies. Working here means having every opportunity to achieve your goals - and to help others accomplish theirs, too. Join our team as w ...

  • SMBC

    Data Engineer

    13 hours ago

    SMBC Charlotte, United States

    SMBC Group is a top-tier global financial group. Headquartered in Tokyo and with a 400-year history, SMBC Group offers a diverse range of financial services, including banking, leasing, securities, credit cards, and consumer finance. The Group has more than 130 offices and 80,000 ...

  • Odyssey Logistics & Technology

    Data Engineer

    1 week ago

    Odyssey Logistics & Technology Charlotte, United States

    Data Engineer · 1916 Ayrsley Town Blvd suite 400, Charlotte, NC 28273, USA · Req #2397 · Wednesday, February 14, 2024 · See yourself at Odyssey. · Join the team as our new Data Engineer · Who We Are & Why We're Hiring · Odyssey Logistics & Technology Corporation (Odyssey) is ...

  • Netskope

    Data Engineer

    1 day ago

    Netskope Charlotte, United States

    About Netskope · Today, there's more data and users outside the enterprise than inside, causing the network perimeter as we know it to dissolve. We realized a new perimeter was needed, one that is built in the cloud and follows and protects data wherever it goes, so we started Ne ...

  • Experis

    Data Engineer

    2 days ago

    Experis Charlotte, United States

    Dallas or Charlotte - Hybrid 2-3 days in office · Pay: · 24 month contract · Lead Data Engineer · Must Have: · typical ETL/Abintio but specifically Metadata hub-> an abinitio etl tool: allowing users to leverage metadata-driven development and automation capabilities. Metada ...

  • Insight Global

    Data Engineer

    1 week ago

    Insight Global Charlotte, United States

    *** THIS ROLE CANNOT WORK C2C OR SPONSOR VISAS *** · Location: Charlotte, NC - 5 days onsite per week · Duration: Permanent · Work Auth: W2 only · Salary: $90,000 - $120,000 · Required Qualifications: · Strong SQL Experience (debug complex queries, create queries etc) · 1-3 years ...