Jobs
>
Greenville

    Cloud Data Engineer - Greenville, United States - Datasoft Tech

    Datasoft Tech
    Datasoft Tech Greenville, United States

    2 weeks ago

    Default job background
    Contract
    Description

    Cloud Data EngineerOnsite

    About the Job

  • Duration: Long-term renewable contract
  • Location: Greenville, SC
  • Pay rate: Hourly
  • Job ID: 4819

    • This is a Full Time W2 position, no subcontracting or C2C.

    Overview:

    Provides complete application lifecycle development, deployment, and operations support for large-scale batch and real-time data processing pipelines using cloud technologies.

    Collaborates with product owners, data scientists, business analysts and software engineers to design and build solutions to ingest, transform, store, and export data in a cloud environment while maintaining security, scalability, and personal data protection.

    Responsibilities:

  • Implements and enhances complex data processing pipelines with a focus on collecting, parsing, cleaning, managing and analyzing large data sets that produce valuable business insights and discoveries.
  • Determines the required infrastructure, services, and software required to build advanced data ingestion & transformation pipelines and solutions in the cloud.
  • Assists data scientists and data analysts with data preparation, exploration and analysis activities.
  • Applies problem solving experience and knowledge of advanced algorithms to build high-performance, parallel, and distributed solutions.
  • Performs code and solution review activities and recommends enhancements that improve efficiency, performance, stability, and decreased support costs.
  • Applies the latest DevOps and Agile methodologies to improve delivery time.
  • Works with SCRUM teams in daily stand-up, providing progress updates on a frequent basis.
  • Supports application, including incident and problem management.
  • Performs debugging and triage of incident or problem and deployment of fix to restore services.
  • Documents requirements and configurations and clarifies ambiguous specs.
  • Performs other duties as assigned by management.

    • Qualifications:

  • BA/BS Degree in Business, Computer Science or Electrical Engineering preferred or the equivalent of 4 years professional IT related experience. MS degree (preferred).
  • 3+ years of enterprise software engineering experience with object oriented
  • design, coding and testing patterns, as well as, experience in engineering (commercial or open source) software platforms and large-scale data infrastructure solutions.
  • 3+ years of software engineering and architecture experience within a cloud environment (Azure, AWS).
  • 3+ years of enterprise data engineering experience within any "Big Data " environment (preferred).
  • 3+ years of software development experience using Python.
  • 2+ years of experience working in an Agile environment (Scrum, Lean or Kanban).
  • 3+ years of experience working in large-scale data integration and analytics projects, including using cloud (e.g. AWS Redshift, S3, EC2, Glue, Kinesis, EMR) and data-orchestration (e.g. Oozie, Apache Airflow) technologies
  • 3+ years of experience in implementing distributed data processing pipelines using Apache Spark
  • 3+ years of experience in designing relational/NoSQL databases and data warehouse solutions
  • 2+ years of experience in writing and optimizing SQL queries in a business environment with large-scale, complex datasets
  • 2+ years of Unix/Linux operating system knowledge (including shell programming).
  • 1+ years of experience in automation/configuration management tools such as Terraform, Puppet or Chef.
  • 1+ years of experience in container development and management using Docker.
  • Languages: SQL, Python, Spark
  • AWS/Azure cloud provider training/certifications (preferred)
  • Basic knowledge of continuous integration tools (e.g. Jenkins).
  • Basic knowledge of machine learning algorithms and data visualization tools such as Microsoft Power BI and Tableau

    • About our Company

    DataSoft Technologies is a highly recognized provider of professional IT Consulting services in the US. Founded in 1994, DataSoft Technologies, Inc. provides staff augmentation services for Information Technology and Automotive Services. Our team member benefits include:

  • Paid Holidays/Paid Time Off (PTO)
  • Medical/Dental Insurance Group
  • Accident/Critical Illness Insurance
  • Life Insurance
  • 401 (K)

  • Michelin North America

    Data Engineer

    1 week ago

    Michelin North America Greenville, United States

    Data Engineer (Experienced Level Professional) · Michelin is hiring · THE OPPORTUNITY · The Business Intelligence and Analytics department seeks a Data Engineer to implement business intelligence and analytic solutions or adapt existing solutions that are consistent with the n ...

  • Michelin North America

    Data Engineer

    2 weeks ago

    Michelin North America Greenville, United States

    Data Engineer (Experienced) · Michelin is hiring · The Opportunity · The Data Engineer is responsible for connecting systems, creating interfaces and integrating relevant data to enable users to transform raw data into usable data. · He/she analyses the needs expressed by use ...

  • Michelin

    Data Engineer

    1 week ago

    Michelin Greenville, United States

    Data Engineer (Experienced) · Michelin is hiring · The Opportunity · The Data Engineer is responsible for connecting systems, creating interfaces and integrating relevant data to enable users to transform raw data into usable data. · He/she analyses the needs expressed by use ...

  • Michelin North America

    Data Engineer

    1 week ago

    Michelin North America Greenville, United States

    Data Engineer (Experienced Level Professional) · Michelin is hiring · THE OPPORTUNITY · The Business Intelligence and Analytics department seeks a Data Engineer to implement business intelligence and analytic solutions or adapt existing solutions that are consistent with the n ...

  • MICHELIN

    Data Engineer

    1 week ago

    MICHELIN Greenville, United States Full time

    Data Engineer (Experienced Level Professional) Michelin is hiring · THE OPPORTUNITY · The Business Intelligence and Analytics department seeks a Data Engineer to implement business intelligence and analytic solutions or adapt existing solutions that are consistent with the nee ...

  • United Community Bank

    Azure Data Engineer

    2 weeks ago

    United Community Bank Greenville, United States

    Azure Data Engineer- Senior. Reports To: Director- Database Operations. Direct Reports: N/ A - Salary Grade: 12 SUMMARY - We are looking for an experienced Azure Data Engineer to join our team and help build and maintain the modern data platform on A Data Engineer, Azure, Enginee ...

  • Advanced Automation Consulting

    Azure Data Engineer

    1 week ago

    Advanced Automation Consulting Greenville, United States

    Job Description · Job DescriptionAAC is seeking an Azure Data Engineer to join their reputable client in Downtown Greenville, SC. This is a growing organization with exciting initiatives in the data space as they continue to modernize their data strategies within Azure and Snowfl ...

  • Healthfirst

    Claims Data Engineer

    2 weeks ago

    Healthfirst Greenville, United States Full time

    Search for new opportunities within Healthfirst. · The Data Engineer is responsible for data acquisition strategies and integration, scripting and tools, data migrations, conversions, purging, and back-ups. The incumbent works with product, financial control, analysts, users, and ...

  • NovaWorks Solutions

    Software and Data Engineer

    1 week ago

    NovaWorks Solutions Tryon, United States

    Konecranes is a global leader in providing perfect solutions for material handling, serving a diverse range of customers in various industries. We continuously set industry standards, from daily optimizations to groundbreaking innovations. We believe that there is always a safer, ...

  • United Community Bank

    Senior Azure Data Engineer

    1 week ago

    United Community Bank Greenville, United States

    Job Title: Senior Azure Data Engineer - Contract/Temp to Hire (6 months) · Reports To: Director- Database Operations · Direct Reports: N/A · Salary Grade: 12 · SUMMARY · We are looking for an experienced Azure Data Engineer to join our team and help build and maintain the mo ...

  • United Community Bank

    Senior Azure Data Engineer

    1 week ago

    United Community Bank Greenville, United States Temporary

    SUMMARY · We are looking for an experienced Azure Data Engineer to join our team and help build and maintain the modern data platform on Azure. As an Azure Data Engineer, you will be expected to contribute to all stages of the data lifecycle, including data ingestion, modeling, ...

  • Actalent

    R&D Manager

    1 week ago

    Actalent East Greenville, United States Full time

    Description: · The R&D Product Development (PD) Manager is a subject matter expert in the field of chocolate, chocolate process and applications focused on assessing, developing and implementing new product concepts, proprietary blends and process technologies for the cocoa and c ...

  • Actalent

    R&D Manager

    5 days ago

    Actalent East Greenville, United States Full time

    Description: · The R&D Product Development (PD) Manager is a subject matter expert in the field of chocolate, chocolate process and applications focused on assessing, developing and implementing new product concepts, proprietary blends and process technologies for the cocoa and c ...

  • Actalent

    R&D Manager

    1 week ago

    Actalent East Greenville, United States Full time

    Description: · The R&D Product Development (PD) Manager is a subject matter expert in the field of chocolate, chocolate process and applications focused on assessing, developing and implementing new product concepts, proprietary blends and process technologies for the cocoa and c ...

  • Penske Truck Leasing

    Diesel Technician/Mechanic II

    5 days ago

    Penske Truck Leasing Greenville, United States Full time

    1116 White Horse Rd, Greenville, SC 29605 · What's the Job? · Ready to move your career forward? As a Technician at Penske, you'll do exactly that. Here, you'll perform preventative maintenance and repairs of all levels on the newest and best maintained fleet of vehicles in the i ...

  • Lockheed Martin

    Mission Planning System Admin

    1 week ago

    Lockheed Martin Greenville, United States

    **Job ID**: 664508BR · **Date posted**: Apr. 10, 2024 · **Program**: F-35 Logistics product Operations & Sustainment · **Description**: · **Lockheed Martin Aeronautics. Be More Than You Can Imagine.** · Joining the Lockheed Martin ALIS team immediately opens a world of educationa ...

  • Penske Truck Leasing

    Diesel Technician/Mechanic III

    1 week ago

    Penske Truck Leasing Greenville, United States Full time

    1116 White Horse Rd, Greenville, SC 29605 · What's the Job? · Ready to accelerate your career while helping our customers move forward? As a Technician at Penske, you'll do exactly that. Here, you'll do preventative maintenance and minor repairs on the newest and best maintained ...

  • Infinity Systems

    Electrical installer

    1 week ago

    Infinity Systems Greenville, United States

    About JW FROEHLICH Maschinenfabrik GmbH: · With innovation and great passion, we develop application-oriented assembly and testing systems for electric drives, batteries, fuel cells, and their components such as inverters or electric compressors. · We also focus on the hybrid dev ...

  • Nexus Dynamics

    Engineer Development of Test Equipment and Measurement Technology

    2 weeks ago

    Nexus Dynamics Greenville, United States

    Can technology make the world a better place? That's what TQ and each of our 1,700 employees stand for. As one of the largest electronics specialists in Germany, we develop and produce customized and innovative solutions for renowned clients from various industries. In addition, ...

  • TekGarden

    Senior Electrical Engineer

    1 week ago

    TekGarden Greenville, United States

    Senior Electrical Engineer – Power Distribution · Greenville, SC · We are seeking a Senior Electrical Engineer to join a respected leader in design, construction, & delivery of complex industrial manufacturing & distribution facilities. This role will lead design efforts for powe ...