GCP Data Engineer - Canonsburg, United States - myIT

myIT Canonsburg, United States

3 weeks ago

Description

Responsibilities

Design, develop, and implement data pipelines on GCP using tools like Cloud Dataflow, Cloud Dataproc, and Cloud Composer.
Manage data storage and transformation in BigQuery, Cloud Storage, and other GCP services.
Collaborate with data scientists and Client engineers to understand their needs and translate them into effective data solutions.

Develop and deploy Client models in production using Google Cloud AI Platform, including AI Platform Training and AI Platform Prediction.

Monitor and maintain data pipelines and Client models, ensuring high performance and data quality.
Proactively identify and implement data security best practices.
Document data pipelines and Client models for future reference and maintainability.

Qualifications

2-3 years of experience as a Data Engineer or similar role.
Solid understanding of GCP data services, including BigQuery, Cloud Dataflow, Dataproc, Cloud Client Engine, AI Platform, etc.
Expertise in building and maintaining data pipelines, data modeling, data warehousing, and data quality management.
Familiarity with Artificial Intelligence and Machine Learning concepts, including Python libraries like TensorFlow, PyTorch, scikit-learn, etc.
Proficiency in Python and SQL.
Excellent communication, collaboration, and problem-solving skills.
Strong attention to detail and ability to work independently and as part of a team.
EAD (Employment Authorization Document) is welcome.

#J-18808-Ljbffr

Data Engineer

5 days ago

Audubon Companies Canonsburg, United States

External Description · Audubon is currently seeking a Data Engineer to join our team in our Canonsburg, PA Office. As the Data Engineer and front-end visualization developer at Audubon, you will play a crucial role in designing, developing, and maintaining data solutions that em ...
Senior Data Engineer

3 weeks ago

CleanChoice Energy Washington, United States

· Job Title: Senior Data Engineer · Full-Time 40 Hours/Week · Classification: exempt under FLSA · Location: 100% Remote · Skills, Experience, Qualifications, If you have the right match for this opportunity, then make sure to apply today. · About · CleanChoice Ene ...
Data Engineer

2 weeks ago

Govini Pittsburgh, United States Full time

Company Description · Govini is the leading Commercial Data company in the Defense Technology space. Built by Govini, is used at scale across the National Security sector of the federal government. This platform enables government analysts, program managers, and decision-makers ...
Senior Data Engineer

3 weeks ago

Development Dimensions International Bridgeville, United States

The Senior Engineer is responsible for the design, development, implementation and support of ELT processes for Data Platform. Works as part of a team to develop data pipelines, data transformation logic in ADF, python or Scala and other technologies to move data from a variety o ...
Data Engineer

2 weeks ago

Software Engineering Institute Pittsburgh, United States

What We Do · The CERT Cyber Mission Readiness (CMR) directorate fortifies the U.S. and its partners against cyber threats. We design large and small-scale exercises, facilitate tabletop scenarios, run cybersecurity contests, and create open-source tools to bolster cyber defense ...
Data Engineer

5 days ago

Govini Pittsburgh, United States

Company Description · Govini builds software to accelerate the Defense Acquisition Process. Ark, Govini's flagship product, is a suite of AI-enabled applications, powered by integrated government and commercial data, that solves problems across the entire spectrum of Defense Acqu ...
Data Engineer

1 day ago

Sheetz Pittsburgh, United States

OVERVIEW · Responsible for developing complex, large scale data models and pipelines that · organize and standardize the data to make it readily accessible and consumable by the business for · reporting and data science needs. Collaborate with various areas of the Business in ...
Data Engineer

3 weeks ago

Accion Labs Pittsburgh, United States

Those authorized to work in the United States without sponsorship are encouraged to apply.We are unable to sponsor visas for this position. No H1B's. · Our direct client is an American chain of convenience stores started interviewing Data Engineering Pittsburgh, PA (Hybrid – 2 da ...
Data Engineer

1 week ago

Tekfortune Inc Pittsburgh, United States

Python(pyspark), jupyter hub, airflow, Java · Database knowledge - Oracle / SQL / Data Analytics · Regulatory reporting knowledge preferred · Good communication skills · Open / Ability to learn new technologies · Very good Analytical Skills · Experience in ETL is preferable · ...
Data Engineer

3 days ago

Innovation Works, Inc. Pittsburgh, United States

Job Description · Job DescriptionABOUT IDELIC · Idelic uses cutting-edge technology and beautifully designed interfaces to help predict and prevent trucking accidents and reduce driver turnover to ensure drivers get home safely each and every night. Our SaaS solutions are radical ...
Data Visualization Engineer

3 weeks ago

Elliot Group Jeannette, United States Full time

Overview & Responsibilities · Purpose of the job : · The Visualization Engineer will be responsible for developing efficient reporting and analytics across the enterprise. In this role, the Visualization Engineer will be gathering requirements, work very closely with the busines ...
Senior Data Engineer

3 weeks ago

TWO95 International, Inc Pennsylvania, United States Full time

Title : Senior Data Engineer · Location : Philadelphia, PA / Hybrid (1-2days onsite) · Type : Full-Time with client · Salary: Market · MINIMUM QUALIFICATIONS: · Bachelor's or Master's degree in Computer Science, Information Systems, or a related field · 4+ years of SQL experi ...
Data Engineering Architect

1 week ago

Synechron Pittsburgh, United States

Title: Data Engineering Architect (Neo4j and PySpark) · Location: Pittsburgh, PA · Job Type: Full time · About the role: The Data Architect will specifically help to generate and assess the calculated data quality, Risk Tech Analyst also supports Quants and Risk models validation ...
Lead Data Engineer

5 days ago

DICK'S Sporting Goods Coraopolis, United States

At DICK'S Sporting Goods, we believe in how positively sports can change lives. On our team, everyone plays a critical role in creating confidence and excitement by personally equipping all athletes to achieve their dreams. We are committed to creating an inclusive and diverse wo ...
Senior Data Engineer

3 weeks ago

Citian Washington, United States

Citian is seeking a passionate and self-motivated Senior Data Engineer with expertise in architecting and building data pipelines to join our dynamic team You will contribute to developing secure, scalable, and efficient data-driven solutions to tackle pressing needs in our trans ...
Data Engineering Lead

3 weeks ago

Performance Review Institute Warrendale, United States

Performance Review Institute · Data Engineering Lead · Warrendale , · Pennsylvania · Apply Now · Reference #: fa f-465f-84d5-e94c57cb5a58Description · JOB SUMMARYWe are seeking a Data Engineering Lead to spearhead the agile development of our data platform, which is crucial ...
Sr. AWS Data Engineer

2 weeks ago

YASH Technologies Pennsylvania, United States

Role: Sr. AWS Data Engineer · Duration: Full Time with Yash Technologies / Long term contract · Location: Remote (Prefer - Pennsylvania) need basis travel to PA · Technical · Experience Designing, developing, and maintaining scalable, secure, and cost-effective data solutions on ...
Data Engineer Associate

1 day ago

PNC Pittsburgh, United States

Position Overview · At PNC, our people are our greatest differentiator and competitive advantage in the markets we serve. We are all united in delivering the best experience for our customers. We work together each day to foster an inclusive workplace culture where all of our emp ...
Senior Data Engineer

1 week ago

EOS USA Pittsburgh, United States

WHO WE ARE: · EOS IT Solutions is a Global Technology and Logistics company, providing Collaboration and Business IT Support services to some of the world's largest industry leaders, delivering forward-thinking solutions based on multi-domain architecture. Customer satisfaction ...
Senior Data Engineer

2 days ago

Mindera Pittsburgh, United States

· Here at Mindera, we are continuously building a fantastic team and would love for you to join us. · We're looking for data engineers with at least 10 years of experience who have an appetite for solving complex and exciting problems. We develop to a very high standard, mainta ...