Jobs
>
Pittsburgh

    Data Engineer - Pittsburgh, United States - Accion Labs

    Accion Labs
    Accion Labs Pittsburgh, United States

    1 week ago

    Default job background
    Technology / Internet
    Description

    Those authorized to work in the United States without sponsorship are encouraged to apply.We are unable to sponsor visas for this position. No H1B's.

    Our direct client is an American chain of convenience stores started interviewing Data Engineering Pittsburgh, PA (Hybrid – 2 day's onsite) 6 month's contract to hire...

    Please note that all candidates submitted must be on your W2.

    Title: Data Engineer

    Location: Pittsburgh, PA (Hybrid – 2 days' onsite a week & rest is remote) Day one onsite.

    Duration: 6 Months contract to hire

    Must have: Need to have strong understanding on Databricks on AWS - batch and real time loads. Data bricks knowledge on-delta table, delta live table, Unity Catalog, incremental loads, dependencies on multiple pipelines, Transit and transformation, managing data quality using Delta Live Tables and Expectations, validating the data. Need sound Spark SQL knowledge. Python knowledge has to be good * Databricks on Azure is not preferred. Data modelling knowledge is required, Schema, dimensional modelling. Airflow is good to have. Terraform is used for deploying the data pipeline. Teradata, data warehousing knowledge is good to have...

    Responsibilities:

    Co-lead in the selection and build of our data and analytic tools including Enterprise Data Warehouse, Data Lake, Analytics platform, and Data Catalogue.

    Design, implement, and manage data architecture and data pipeline across multiple data sources.

    Collaborate closely with Business and Technical Owners in identifying data sources and aggregating structured or unstructured data into dimensional data models able to be consumed by the business.

    Identify potential process improvements and designs and implement automated solutions.

    Manage the democratization of data knowledge across the organization through the communication and maintenance of master data, metadata, data management repositories, data models, and data standards

    Establish standardization and educate data users on query best practices allowing for re-use and analytic efficiency.

    Experience

    End-to-end experience in the analytic lifecycle from structured/unstructured raw data, data wrangling, and creating data pipelines, to self-service dashboards leveraged by the business required

    Advanced knowledge of SQL required

    Minimum 5 years development experience in at least one object-oriented language (Python, Perl, Java, etc.) required

    Proficiency in data visualization tool (Tableau) preferred

    Strong understanding of cloud computing database technologies (Azure, AWS, GCP) required

    Experience building and optimizing "Big Data" pipelines, architectures and data sets required

    Experienced with data wrangling and preparation for use within data science, business intelligence or similar analytical functions required

    Required: Bachelor's degree in Computer Science or a related field

    This role is open to W2 or those seeking Corp-Corp employment. The salary range for this role is 110k-124k. For corp-Corp rates please contact the recruiter. In addition to other benefits, Accion Labs offers a comprehensive benefits package, with Accion covering 65% of the medical, dental, and Vision Premiums for employees, their spouses, and dependent children enrolling in the Accion-provided plans.

  • Quantum Innovations

    Data Engineer

    3 weeks ago

    Quantum Innovations Green Tree, United States

    As the Data Engineering team of Regionalmedien, we develop and operate a next-generation data platform as the basis for analytics, dashboards, AI, and features in our product platform. We are looking for you to join our team in Berlin or Hamburg as a · Data Engineer (m/f/d) · YOU ...

  • Govini

    Data Engineer

    3 weeks ago

    Govini Pittsburgh, United States

    Company Description · Govini builds software that accelerates the Defense Acquisition Process. The Ark, Govini's flagship product, combines commercial data and artificial intelligence into applications that solve challenges across the entire spectrum of Defense Acquisition, inclu ...

  • InfoGravity

    Data Engineer

    2 weeks ago

    InfoGravity Pittsburgh, United States

    Data Engineer - ETL with Python, Spark & Hadoop · Location: Pittsburgh only (Hybrid 2-3 days a week). · Citizens, GC, or L2S · Note: This is a Hyrbid role. The Hiring Manager requires the individual to be onsite for 2-3 days a week. And they must be willing to go fulltime after a ...

  • Innovation Works, Inc.

    Data Engineer

    3 weeks ago

    Innovation Works, Inc. Pittsburgh, United States

    Job Description · Job DescriptionABOUT IDELIC · Idelic uses cutting-edge technology and beautifully designed interfaces to help predict and prevent trucking accidents and reduce driver turnover to ensure drivers get home safely each and every night. Our SaaS solutions are radical ...

  • Armada

    Data Engineer

    1 week ago

    Armada Pittsburgh, United States

    SUMMARY · As a Data Engineer for our Digital Services division, you will drive the evolution of our next generation data infrastructure, which powers a wide range of analytics and software products. You will be responsible for designing, developing, and maintaining advanced data ...

  • Sheetz

    Data Engineer

    2 weeks ago

    Sheetz Pittsburgh, United States

    OVERVIEW · Responsible for developing complex, large scale data models and pipelines that · organize and standardize the data to make it readily accessible and consumable by the business for · reporting and data science needs. Collaborate with various areas of the Business in ...

  • Randstad

    data engineer

    3 weeks ago

    Randstad Pittsburgh, United States

    data engineer. · pittsburgh , pennsylvania · posted march 8, 2024 · job details · summary · $84 - $85 per hour · contract · bachelor degree · category computer and mathematical occupations · reference · job details · job summary: · We are seeking an exceptional and experie ...

  • VeeRteq Solutions Inc.

    Data engineer

    3 weeks ago

    VeeRteq Solutions Inc. Pittsburgh, United States

    Job Description · Job DescriptionPentaho is a must · Data engineering and ingestion effort (there are many data sources from different system and they need to be ingested, reconciled etc) with Pentaho and other ETL expertise · ...

  • Montauk Energy

    Data Engineer

    1 week ago

    Montauk Energy Pittsburgh, United States

    Job Title: Data Engineer · Reports To: Director of IT · Location: Pittsburgh, Pennsylvania · Company Statement: · Montauk Renewables, Inc. (NASDAQ: MNTK) is a renewable energy company specializing in the management, recovery, and conversion of biogas into RNG. The Company ca ...

  • Software Engineering Institute

    Data Engineer

    6 days ago

    Software Engineering Institute Pittsburgh, United States

    What We Do · The CERT Cyber Mission Readiness (CMR) directorate fortifies the U.S. and its partners against cyber threats. We design large and small-scale exercises, facilitate tabletop scenarios, run cybersecurity contests, and create open-source tools to bolster cyber defense ...

  • Carnegie Mellon University

    Data Engineer

    1 day ago

    Carnegie Mellon University Pittsburgh, United States

    What We Do · The CERT Cyber Mission Readiness (CMR) directorate fortifies the U.S. and its partners against cyber threats. We design large and small-scale exercises, facilitate tabletop scenarios, run cybersecurity contests, and create open-source tools to bolster cyber defense ...

  • InfoGravity LLC

    Data Engineer

    1 week ago

    InfoGravity LLC Pittsburgh, United States

    Data Engineer - ETL with Python, Spark & Hadoop · Location: Pittsburgh only (Hybrid 2-3 days a week). · Citizens, GC, or L2S · Ensure you read the information regarding this opportunity thoroughly before making an application. · Note: This is a Hyrbid role. The Hiring Manager ...

  • Accion Labs

    Data Engineer

    1 week ago

    Accion Labs Pittsburgh, United States

    Those authorized to work in the United States without sponsorship are encouraged to apply.We are unable to sponsor visas for this position. No H1B's. · All the relevant skills, qualifications and experience that a successful applicant will need are listed in the following descri ...

  • Accion Labs

    Data Engineer

    1 week ago

    Accion Labs Pittsburgh, United States

    Those authorized to work in the United States without sponsorship are encouraged to apply.We are unable to sponsor visas for this position. No H1B's. · Our direct client is an American chain of convenience stores started interviewing Data Engineering Pittsburgh, PA (Hybrid – 2 d ...

  • Innovation Works

    Data Engineer

    1 week ago

    Innovation Works Pittsburgh, United States

    ABOUT IDELIC · Idelic uses cutting-edge technology and beautifully designed interfaces to help predict and prevent trucking accidents and reduce driver turnover to ensure drivers get home safely each and every night. Our SaaS solutions are radically transforming the way in which ...

  • Govini

    Data Engineer

    13 hours ago

    Govini Pittsburgh, United States Full time

    Company Description · Govini is the leading Commercial Data company in the Defense Technology space. Built by Govini, is used at scale across the National Security sector of the federal government. This platform enables government analysts, program managers, and decision-makers ...

  • Sapphire Enterprises

    Data Engineer

    3 weeks ago

    Sapphire Enterprises Bradford Woods, United States

    We are looking for a dynamic, sustainable, and reliable DATA ENGINEER / BI MANAGER (M/F/D) to join our team at Bradford Woods. YOUR PROFILE * Completed degree in Computer Science, Business Informatics, Statistics, or a related field * Minimum of 5 years of professional experience ...

  • Tekfortune Inc

    Data Engineer

    3 weeks ago

    Tekfortune Inc Pittsburgh, United States

    Python(pyspark), jupyter hub, airflow, Java · Database knowledge - Oracle / SQL / Data Analytics · Regulatory reporting knowledge preferred · Good communication skills · Open / Ability to learn new technologies · Very good Analytical Skills · Experience in ETL is preferable · ...

  • Randstad USA

    Data Engineer

    3 weeks ago

    Randstad USA Pittsburgh, United States Freelance, Full time

    job summary: · We are seeking an exceptional and experienced data engineer who shares our passion and obsession with quality. You'll be a core member of our product and engineering team dedicated to helping our clients replace time-consuming, manual processes to reach informed re ...

  • Randstad USA

    Data Engineer

    3 weeks ago

    Randstad USA Pittsburgh, United States Freelance, Full time

    job summary: · Seeking an exceptional and experienced data engineer who shares our passion and obsession with quality. You'll be a core member of our product and engineering team dedicated to helping our clients replace time-consuming, manual processes to reach informed real-time ...