Sr. (Lead) Data Engineer I (II) - Norristown, United States - PJM Inc

PJM Inc Norristown, United States

1 week ago

Description

Flexible Work Arrangement - Hybrid

The Sr. (Lead) Data Engineer is responsible for designing and implementing methods to improve data: reliability, security and quality across the enterprise. They combine raw information from different sources to create consistent and machine-readable formats. They also develop, test and build algorithms, architectures and infrastructure that enable data extraction and transformation for various modeling needs for example predictive or prescriptive modeling. Other functions can include organizing large datasets.

Essential Functions:

Analyze and organize raw data, cataloging fields and entities
Building data architectures, and data pipelines to collectively bring together data
Analyzing, planning, and defining data architecture framework(s), including security, reference data, metadata, and master data
Participation in analyzing business needs and objectives with analysts, data Architects and engineers, developers, report writers and report consumers
Inform and support the organizations data strategy
Conduct complex data analysis and collaboration with analysts, developers and
Prepare data for prescriptive and predictive modeling
Build algorithms and prototypes to support data integration and other data related functions
Identify opportunities for data acquisition and determine data update velocity
Collaborating with other teams within the organization to devise and implement data strategies, build models, and assess customers needs and goals
Work with Data Architects in developing and supporting patterns that data engineers, developers and others can follow
Support and inform data governance practices
Creating and implementing data management processes and procedure

Characteristics & Qualifications:
Required:

BS degree in Computer Engineering, Information Systems, Statistics, Informatics or at least 5 years of experience Data Engineer or Architect role
At least 5 years of experience Strong knowledge of SQL
Experience with data pipeline and workflow management tools
Experience in Azure data engineering and cloud data processing services
Knowledge of Programming e.g. SAS, Python, PySpark, R, Oracle PL/ SQL
Experience in one or more of the following: C, C++, Java, Python, Go, Perl or Ruby.
Experience with algorithms, data structures, complexity analysis and software design.
Experience with managing database infrastructure (particular emphasis on Oracle and Sql Server)
Experience with configuration management tools like Puppet, Chef
Experience with Unix, AIX, Debian, Windows operating systems, containers, container orchestrators
Experience with git based code repositories.
Experience using and administering JEE application servers including JBoss, WebSphere, or WebLogic

Preferred:

MS degree in Computer Science, Information Systems, Statistics or Informatics
At least 5 years of work experience
Experience with SAS development tools and datasets (e.g. SAS Grid, SAS Display manager, SAS Studio )
Hands on experience in Data Warehousing and ETL tools
Experience in Big Data technologies (e.g. Spark, Databricks,) Experience building and optimizing 'big data' data pipelines, architectures, and data sets
Performance/security-oriented data design, including partitions, different types of indexes, views, and most effective data management practices.
Experience with Azure Synapse Analytics, Azure DevOps
Experience with Purview, PowerBI, Alteryx, Qlik, or Tableau Experience with NoSQL
Experience with PJM operations, markets, and planning functions

Data Engineer

1 week ago

Libertyjobs King of Prussia, United States

Job Details: · Data Engineer · My Client has hired me to find a Data Engineer. In this role you will be building data architectures and data pipelines. You will also be designing solutions using Microsoft Azure. Previous experience using Data Warehousing and ETL tools is import ...
Data Engineer

1 week ago

Eigen X King of Prussia, United States

Amanda Mittnacht March 31, Data Engineer - Senior Consultant · Amanda Mittnacht March 31, Data Engineer – Senior Consultant · The Data Engineer Senior Consultant is responsible for designing and building data pipelines for BI and reporting purposes, leveraging ind ...
Sr. Data Engineer

2 weeks ago

Comcast Norristown, United States

Comcast brings together the best in media and technology. We drive innovation to create the world's best entertainment and online experiences. As a Fortune 50 leader, we set the pace in a variety of innovative and fascinating businesses and create career opportunities across a wi ...
Associate Data Engineer

1 week ago

Onbe Conshohocken, United States

Onbe, a fast-growing FinTech, bringing innovation to a rapidly growing global marketplace, stands for "on behalf." Because that's exactly how we work: on behalf of our clients, as their comprehensive payments partner. We transform the way payments are imagined - as an opportunity ...
Analytics Data Engineer

12 hours ago

Cencora Conshohocken, United States Full time

Our team members are at the heart of everything we do. At Cencora, we are united in our responsibility to create healthier futures, and every person here is essential to us being able to deliver on that purpose. If you want to make a difference at the center of health, come join ...
Junior Consultant Data Engineering

1 week ago

Titan Industries Jersey Village, United States

What You Bring · Above-average degree in an IT-related field · Programming experience (SQL, C++) · Knowledge of DWH, Data Engineering, and Business Intelligence · Strong communication, analytical, and conceptual skills · Fluent in German · Team spirit and willingness to travel · ...
Data Engineer

1 week ago

Piper Companies Wayne, United States

Piper Companies · is looking for a · Data Engineer · for an Investment Firm in · Wayne, PA · for a · Hybrid, Full-Time opportunity. · Responsibilities of the Data Engineer: · •Conduct data profiling, source-target mappings, ETL development, SQL tunings and optimization, te ...
Analytics Data Engineer

10 hours ago

Cencora Conshohocken, United States Full time

Our team members are at the heart of everything we do. At Cencora, we are united in our responsibility to create healthier futures, and every person here is essential to us being able to deliver on that purpose. If you want to make a difference at the center of health, come join ...
IT-Engineer Factory Data Hub

1 week ago

FusionWorks Roebling, United States

Job Opening: Immediate · Your Work Environment · At MAN Truck & Bus, we are part of a strong international team and one of the leading European commercial vehicle manufacturers and providers of transport solutions. Together with the brands Scania, Volkswagen Caminhões e Ônibus, N ...
Data Engineer with R Programming

1 week ago

CGI Technologies and Solutions, Inc. Plymouth Meeting, United States

**Data Engineer with R Programming** · **Category:** Software Development/ Engineering · **Main location:** United States, Pennsylvania, Plymouth Meeting · **Position ID:** J · **Employment Type:** Full Time · **Position Description:** · This is an opportunity to work as a ...
Data Engineer with R Programming

2 weeks ago

CGI Technologies and Solutions, Inc. Plymouth Meeting, United States

**Data Engineer with R Programming** · **Category:** Software Development/ Engineering · **Main location:** United States, Pennsylvania, Plymouth Meeting · **Position ID:** J · **Employment Type:** Full Time · **Position Description:** · This is an opportunity to work as a Data ...
Data Engineer

1 week ago

Insight Global Collegeville, United States

Job Description · Insight Global's Pharmaceutical client is seeking a Data Engineer to help build solutions for their Supply Chain Analytics Division. The DE will be responsible for helping develop this Supply Chain Data Lake and Data Ingestion Pipelines using Snowflake/Airflow/P ...
Data Engineer

1 week ago

GlaxoSmithKline Collegeville, United States Full time

Site Name: UK - Hertfordshire - Ware RD, UK - Hertfordshire - Stevenage, Upper Merion, USA - Maryland - Rockville, USA - Massachusetts - Cambridge, USA - North Carolina - Zebulon, USA - Pennsylvania - Upper Providence · Posted Date: May 7 2024 · GSK Pharma R&D is seeking innovati ...
Senior Data Center Engineer

1 day ago

firstPRO, Inc Blue Bell, United States

firstPRO is seeking a Senior Data Center Engineer to join our client's dynamic team. This role is a contract to hire opportunity that has a hybrid work model which includes some onsite in Blue Bell, PA. This role also includes some local travel as well. · Responsibilities: · Dep ...
Data Engineer 3

1 week ago

Comcast Wayne, United States

Comcast brings together the best in media and technology. We drive innovation to create the world's best entertainment and online experiences. As a Fortune 50 leader, we set the pace in a variety of innovative and fascinating businesses and create career opportunities across a wi ...
Construction Project Manager

1 week ago

Robert E. Lamb, Inc. Norristown, United States

**Construction Project Manager** · Robert E. Lamb, Inc. is an established Architecture, Engineering and Construction firm located 5 minutes from King of Prussia and Norristown, PA. Our in-house team collaborates for full design and construction on high reliability, shielded contr ...
Data Engineer 3

1 week ago

Comcast Wayne, United States

Comcast brings together the best in media and technology. We drive innovation to create the world's best entertainment and online experiences. As a Fortune 50 leader, we set the pace in a variety of innovative and fascinating businesses and create career opportunities across a wi ...
Senior Data Center Engineer

1 week ago

FirstPRO Blue Bell, United States

firstPRO is seeking a Senior Data Center Engineer to join our clients dynamic team. This role is a contract to hire opportunity that has a hybrid work model which includes some onsite in Blue Bell, PA. This role also includes some local travel as well. · Responsibilities: · Dep ...
Senior Manager, Data Architecture and Engineering

3 days ago

ECRI Plymouth Meeting, United States

Reference #: Job Details Job Location · Remote - , PA · Remote Type · Fully Remote · Position Type · Full Time · Education Level · Bachelor's Degree Required · Travel Percentage · 0% · Job Shift · Day · Job Category · Health Care · Description · WHY CHOOSE ECRI? ECRI is an inspir ...
Senior Manager, Data Architecture and Engineering

1 week ago

ECRI Plymouth Meeting, United States

Reference #: Job Details Job Location · Remote - , PA · Remote Type · Fully Remote · Position Type · Full Time · Education Level · Bachelor's Degree Required · Travel Percentage · 0% · Job Shift · Day · Job Category · Health Care · Description · WHY CHOOSE ECRI? EC ...