Jobs
>
Charlotte

    DATA ENGINEER - Charlotte, United States - Diverse Lynx

    Diverse Lynx
    Diverse Lynx Charlotte, United States

    2 weeks ago

    Default job background
    Description
    We are looking for a highly capable Data Engineer who has experience in building end-to-end systems

    • Experience on implementation of Data Lakes using Cloud (AWS or GCP), Hands-on with Big Data and related technologies including Spark, Kafka, ELK.
    • Define and setup development, test, release, deployment, and support processes for DevOps/DataOps operations
    • Perform fit gap analysis and recommend appropriate DataOps processes and technologies for data pipelines/applications

    Roles & Responsibilities

    • Experience on implementation of Data Lakes using Cloud (AWS or GCP), Hands-on with Big Data and related technologies including Spark, Kafka, ELK.
    • Define and setup development, test, release, deployment, and support processes for DevOps/DataOps operations
    • Perform fit gap analysis and recommend appropriate DataOps processes and technologies for data pipelines/applications
    • Design and develop CI/CD automation frameworks to support data pipeline development & deployment
    • Manage & automate code deployment across environments and enable automated end-end data validations
    • Setup automated continuous data monitoring processes and alerts/notifications related to data quality issues
    • Establish and enforce standards & best practices across data pipeline development life cycle
    • Create reusable & automation frameworks related to Infrastructure provisioning/Continuous Integration/Continuous Deployment & Continuous Testing
    • Mentor and guide data engineering teams on DataOps processes & frameworks
    • Technical/Process Skills a. Data Lake/Datawarehouse architecture & Data engineering design principles b. Agile implementation & DataOps processes expertise c. GitHub, AWS Tech Stack (S3, Glue, Redshift, CodeCommit, CodeBuild, CodePipeline, Airflow, CloudFormation etc.), Jenkins, Snowflake d. Advanced SQL skills to analyze data in Data Lakes/Warehouses e. Comfortable with programming language (Python preferred) Project Planning and Set-up- Understand project scope Based on the analysis of the type of the project provide inputs on project methodology to senior stakeholders (Project Manager / Architects etc.) Consolidate inputs from developers and collectively provide inputs on activities/ tasks, task level estimates, schedule, dependencies, risks etc. Consolidate inputs from developers and collectively provide inputs to testing strategy, configuration, deployment, hardware/software requirement etc. Analyze in detail resources required for every phase
    Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination.

    All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role.

    We promote and support a diverse workforce across all levels in the company.
  • Clark Davis Associates

    Data Engineer

    3 weeks ago

    Clark Davis Associates Charlotte, United States

    *Must be US Citizen or GC holder · *No C2C · You Will: · Architect and develop data pipelines to optimize performance, quality, and scalability · Build, maintain & operate scalable, performant, and containerized infrastructure required for optimal extraction, transformation, and ...

  • Compunnel Inc.

    Data Engineer

    3 weeks ago

    Compunnel Inc. Charlotte, United States

    This is a W2 role. · Responsibilities: · The person on this role will play a crucial role in building scalable and cost-effective data pipelines, data lakes, and analytics systems. · Data Ingestion: Implement data ingestion processes to collect data from various sources, includin ...

  • Alpha Theory

    Data Engineer

    3 weeks ago

    Alpha Theory Charlotte, United States

    About Alpha Theory: · Alpha Theory is a fintech software company that prides itself on an inclusive and transparent culture that attracts curious teammates who are excited about tackling big ideas. We hire smart, motivated team members that crave feedback to be better. We believe ...

  • Sumitomo Mitsui Banking Corp

    Data Engineer

    2 weeks ago

    Sumitomo Mitsui Banking Corp Charlotte, United States

    SMBC Group is a top-tier global financial group. Headquartered in Tokyo and with a 400-year history, SMBC Group offers a diverse range of financial services, including banking, leasing, securities, credit cards, and consumer finance. The Group has more than 130 offices and 80,000 ...

  • Odyssey Logistics & Technology

    Data Engineer

    3 weeks ago

    Odyssey Logistics & Technology Charlotte, United States

    Data Engineer · 1916 Ayrsley Town Blvd suite 400, Charlotte, NC 28273, USA · Req #2397 · Wednesday, February 14, 2024 · See yourself at Odyssey. · Join the team as our new Data Engineer · Who We Are & Why We're Hiring · Odyssey Logistics & Technology Corporation (Odyssey) is ...

  • SMBC

    Data Engineer

    2 weeks ago

    SMBC Charlotte, United States

    SMBC Group is a top-tier global financial group. Headquartered in Tokyo and with a 400-year history, SMBC Group offers a diverse range of financial services, including banking, leasing, securities, credit cards, and consumer finance. The Group has more than 130 offices and 80,000 ...

  • Oriental Trading Company

    Data Engineer

    3 weeks ago

    Oriental Trading Company Charlotte, United States

    Chello is built on a foundation of pioneering data-intelligence and our team of innovators, driven to tackle the financial challenges of the industries we serve. At its core, it's the first of its kind digital banking platform that delivers daily business insights, cash flow pred ...

  • LHH

    Data Engineer

    2 weeks ago

    LHH Charlotte, United States

    **Must be local to Charlotte area for a weekly hybrid commute** · LHH is seeking a Data Engineer for a rapidly growing company based out the Charlotte, NC area. The ideal candidate will have 3+ years of experience with data engineering and a proven track record of implementing ro ...

  • CRG

    Data Engineer

    3 weeks ago

    CRG Charlotte, United States

    Data Engineer · Location: Remote EST hours · Duration: 12-month contract w/ potential to hire. · Pay: $65+/hr · JOB DESCRIPTION · Our global Fortune 500 client, with U.S. headquarters in Charlotte, NC, is a world class food service provider with a strong presence across the ...

  • Netskope

    Data Engineer

    2 weeks ago

    Netskope Charlotte, United States

    About Netskope · Today, there's more data and users outside the enterprise than inside, causing the network perimeter as we know it to dissolve. We realized a new perimeter was needed, one that is built in the cloud and follows and protects data wherever it goes, so we started Ne ...

  • Experis

    Data Engineer

    2 weeks ago

    Experis Charlotte, United States

    Dallas or Charlotte - Hybrid 2-3 days in office · Pay: · 24 month contract · Lead Data Engineer · Must Have: · typical ETL/Abintio but specifically Metadata hub-> an abinitio etl tool: allowing users to leverage metadata-driven development and automation capabilities. Metada ...

  • Sharp Decisions

    Data Engineer

    1 week ago

    Sharp Decisions Charlotte, United States

    Data Engineer - 4 Openings · Candidate can also work in Jersey City if not located in NC. · Role Objectives · These roles will be involved in the active development of the data platform in close coordination with the client team, beginning with the establishment of a reference da ...

  • Syntricate Technologies

    Data Engineer

    3 weeks ago

    Syntricate Technologies Charlotte, United States

    Hi, · Hope you are doing well · Number of position : 3 · Only Full Time no C2C and No Contract · Full-time · I, Shakib(i3 infotek) would like to share a job opportunity as Data Engineer based in Charlotte, NC (Onsite) location for a Full-time position. · *** In case, if you are ...

  • PamTen

    Data Engineer

    2 weeks ago

    PamTen Charlotte, United States

    Experience in Data Warehouse related projects in product or service-based organization · • Expert knowledge of Linux operating systems and environment and Scripting (Shell and Python preferred) · • A deep expertise in your field of Software Engineering · • Expert at troubleshoo ...

  • Sia Partners

    Data Engineer

    3 weeks ago

    Sia Partners Charlotte, United States

    Sia Partners is a next-generation management consulting firm. We offer a unique blend of AI and design capabilities, augmenting traditional consulting to deliver superior value to our clients. Counting 3,000 consultants in 19 countries, we expect to achieve USD 420 million in tur ...

  • The Hartford

    Data Engineer

    3 weeks ago

    The Hartford Charlotte, United States

    Data Engineer - GE08AE · We're determined to make a difference and are proud to be an insurance company that goes well beyond coverages and policies. Working here means having every opportunity to achieve your goals - and to help others accomplish theirs, too. Join our team as w ...

  • Clark Davis Associates

    Data Engineer

    3 weeks ago

    Clark Davis Associates Charlotte, United States

    *Must be US Citizen or GC holder · Scroll down to find the complete details of the job offer, including experience required and associated duties and tasks. · *No C2C · You Will: · Architect and develop data pipelines to optimize performance, quality, and scalability · Build ...

  • Truist Financial

    Data Engineer

    3 weeks ago

    Truist Financial Charlotte, United States

    The position is described below. If you want to apply, click the Apply button at the top or bottom of this page. You'll be required to create an account or sign in to an existing one. · Need Help? · If you have a disability and need assistance with the application, you can requ ...

  • Insight Global

    Data Engineer

    3 weeks ago

    Insight Global Charlotte, United States

    *** THIS ROLE CANNOT WORK C2C OR SPONSOR VISAS *** · Location: Charlotte, NC - 5 days onsite per week · Duration: Permanent · Work Auth: W2 only · Salary: $90,000 - $120,000 · Required Qualifications: · Strong SQL Experience (debug complex queries, create queries etc) · 1-3 years ...

  • Insight Global

    Data Engineer

    5 days ago

    Insight Global Charlotte, United States

    Job Description · Insight Global is looking for a Data Engineer for a large company based out of Charlotte, NC. This person will be working on a green field implementation and responsible for migrating current data to AWS. This team is working towards enhancements in machine lea ...