- Proven experience in working with relational, data warehouse databases, query authoring (SQL), as well as working familiarity with a variety of databases. Experience/Knowledge in working with NoSQL databases and ability to create E2E pipelines.
- Proven experience in working on any one of the data engineering technologies, including but not limited to, ADLS, ADF, Azure Databricks, Azure SQL, and/or SAP HANA.
- Advanced knowledge of any one of the higher-level scripting languages: Python, SQL, Spark-SQL/ PySpark.
- Established proficiency with Python libraries: Numpy, Panda, Django, etc.
- Advanced knowledge in data visualization tools: Power BI, Power Apps, Power Automate, and Azure Analysis Services.
- Experience with source control technologies (GitHub, Azure DevOps, etc.).
- Experience working with Agile, Kanban, and other workflow methodologies.
- Advanced knowledge of authoring and troubleshooting SQL queries.
- Highly Experienced in building and optimizing complex queries.
- Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.
- Proficient with advanced scripting.
- Proficient with manipulating, processing, and extracting value from large and disconnected datasets.
- Excellent understanding in Data Foundation initiatives, including Modelling, Data Quality Management, Data Governance, Data Maturity Assessments, and Data Strategy in support of the key business stakeholders.
- Bachelor's Degree in Engineering, MIS, Computer Information Systems, Computer Science, Data Analytics, or Data Science, preferably from an ABET accredited institution.
- Minimum 7+ years in a technical leadership or contractual role with hands on experience with Data Engineering.
- Ability to execute and lead multiple projects or large initiatives simultaneously.
- Ability to generate and maintain a schedule for projects and initiatives.
- Understands many other aspects of business analytics, data acquisition, and how to optimize presentation for stakeholders.
- Ability to create or enhance CI/CD builds to release pipelines.
- Ability to independently find a solution for, or to deal proactively with, work related problems.
- Ability to comprehend instructions and request clarification as necessary.
- Ability to lead in a team oriented environment.
- Excellent grammar, punctuation, and etiquette desired.
- Willingness to learn new platforms and new technologies.
- Must be very organized, detail oriented, with the ability to identify outliers quickly.
- Must be self-motivated, innovative, and adept in championing new initiatives in order to drive those initiatives to finality.
- Ability to follow and perform work in accordance with company and customer HSE policy.
-
Data Engineer
2 weeks ago
Govini Pittsburgh, United States Full timeCompany Description · Govini is the leading Commercial Data company in the Defense Technology space. Built by Govini, is used at scale across the National Security sector of the federal government. This platform enables government analysts, program managers, and decision-makers ...
-
Data Engineer
2 days ago
OpenArc, LLC. Pittsburgh, United StatesOpenArc - Empowering Your Career. As a leading IT staffing firm, we are dedicated to connecting talented professionals with your ideal opportunities. We are currently seeking a qualified Data Engineer to join our client's organization and contribute to their ongoing success. · Jo ...
-
Senior Data Engineer
4 weeks ago
Development Dimensions International Bridgeville, United StatesThe Senior Engineer is responsible for the design, development, implementation and support of ELT processes for Data Platform. Works as part of a team to develop data pipelines, data transformation logic in ADF, python or Scala and other technologies to move data from a variety o ...
-
Data Engineer
1 week ago
Govini Pittsburgh, United StatesCompany Description · Govini builds software to accelerate the Defense Acquisition Process. Ark, Govini's flagship product, is a suite of AI-enabled applications, powered by integrated government and commercial data, that solves problems across the entire spectrum of Defense Acqu ...
-
Data Engineer
5 days ago
Sheetz Pittsburgh, United StatesOVERVIEW · Responsible for developing complex, large scale data models and pipelines that · organize and standardize the data to make it readily accessible and consumable by the business for · reporting and data science needs. Collaborate with various areas of the Business in ...
-
Data Engineer
3 weeks ago
Software Engineering Institute Pittsburgh, United StatesWhat We Do · The CERT Cyber Mission Readiness (CMR) directorate fortifies the U.S. and its partners against cyber threats. We design large and small-scale exercises, facilitate tabletop scenarios, run cybersecurity contests, and create open-source tools to bolster cyber defense ...
-
Data Engineer
2 days ago
OpenArc Pittsburgh, United StatesPlans, designs, develops, and manages an organization's databases to ensure efficient data storage, access, and security. Collaborates with users to design, code, test, debug, and deploy databases that meet requirements and organizational needs. Writ Data Engineer, Engineer, Data ...
-
Data Engineer
1 week ago
Innovation Works, Inc. Pittsburgh, United StatesJob Description · Job DescriptionABOUT IDELIC · Idelic uses cutting-edge technology and beautifully designed interfaces to help predict and prevent trucking accidents and reduce driver turnover to ensure drivers get home safely each and every night. Our SaaS solutions are radical ...
-
Data Engineering Architect
2 weeks ago
Synechron Pittsburgh, United StatesTitle: Data Engineering Architect (Neo4j and PySpark) · Location: Pittsburgh, PA · Job Type: Full time · About the role: The Data Architect will specifically help to generate and assess the calculated data quality, Risk Tech Analyst also supports Quants and Risk models validation ...
-
Data Engineer
1 week ago
Tekfortune Inc Pittsburgh, United StatesPython(pyspark), jupyter hub, airflow, Java · Database knowledge - Oracle / SQL / Data Analytics · Regulatory reporting knowledge preferred · Good communication skills · Open / Ability to learn new technologies · Very good Analytical Skills · Experience in ETL is preferable · ...
-
Data Visualization Engineer
4 weeks ago
Elliot Group Jeannette, United States Full timeOverview & Responsibilities · Purpose of the job : · The Visualization Engineer will be responsible for developing efficient reporting and analytics across the enterprise. In this role, the Visualization Engineer will be gathering requirements, work very closely with the busines ...
-
Senior Data Engineer
3 weeks ago
TWO95 International, Inc Pennsylvania, United States Full timeTitle : Senior Data Engineer · Location : Philadelphia, PA / Hybrid (1-2days onsite) · Type : Full-Time with client · Salary: Market · MINIMUM QUALIFICATIONS: · Bachelor's or Master's degree in Computer Science, Information Systems, or a related field · 4+ years of SQL experi ...
-
Lead Data Engineer
1 week ago
DICK'S Sporting Goods Coraopolis, United StatesAt DICK'S Sporting Goods, we believe in how positively sports can change lives. On our team, everyone plays a critical role in creating confidence and excitement by personally equipping all athletes to achieve their dreams. We are committed to creating an inclusive and diverse wo ...
-
Data Engineer Senior
1 day ago
PNC Bank NA Pittsburgh, United States Full timeDescription · Leads in developing, supporting and implementing data solutions for multiple applications in order to meet business objectives and user requirements. Leverages technical knowledge and industry experience to design, build and maintain technology solutions. · Leads d ...
-
Data Engineer II
1 week ago
University of Pittsburgh Pittsburgh, United States· Data Engineer II · Job Summary · Job Title: Data Engineer II · Job Location: Pittsburgh, PA · Job Description: Support data acquisition by locating datasets and software produced by MIDAS researchers through online searching, reviewing the scientific literature, and communi ...
-
Data Engineer Associate
4 days ago
PNC Pittsburgh, United StatesPosition Overview · At PNC, our people are our greatest differentiator and competitive advantage in the markets we serve. We are all united in delivering the best experience for our customers. We work together each day to foster an inclusive workplace culture where all of our emp ...
-
Senior Data Engineer
1 week ago
EOS USA Pittsburgh, United StatesWHO WE ARE: · EOS IT Solutions is a Global Technology and Logistics company, providing Collaboration and Business IT Support services to some of the world's largest industry leaders, delivering forward-thinking solutions based on multi-domain architecture. Customer satisfaction ...
-
Data Engineer Senior
1 week ago
PNC Pittsburgh, United StatesPosition Overview · At PNC, our people are our greatest differentiator and competitive advantage in the markets we serve. We are all united in delivering the best experience for our customers. We work together each day to foster an inclusive workplace culture where all of our em ...
-
Data Engineering Manager
5 days ago
Pantherx Specialty LLC Pittsburgh, United StatesJob Description · Job Description7,000 Diseases - 500 Treatments - 1 Rare Pharmacy · PANTHERx is the nation's largest rare disease pharmacy, and we put the patient experience at the top of everything that we do. · If you are looking for a career in the healthcare field that embr ...
-
Data Engineering Lead
3 weeks ago
Performance Review Institute Warrendale, United StatesPerformance Review Institute · Data Engineering Lead · Warrendale , · Pennsylvania · Apply Now · Reference #: fa f-465f-84d5-e94c57cb5a58Description · JOB SUMMARYWe are seeking a Data Engineering Lead to spearhead the agile development of our data platform, which is crucial ...
Data Engineer - Canonsburg, United States - Audubon Companies
Description
External DescriptionAudubon is currently seeking a Data Engineer to join our team in our Canonsburg, PA Office. As the Data Engineer and front-end visualization developer at Audubon, you will play a crucial role in designing, developing, and maintaining data solutions that empower data-driven decision making across Commercial and Asset Management teams. You will be responsible for the delivery of end-to-end data platform pipelines and front-end analytics capabilities. The Data Engineer shall also possess the ability to skillfully communicate with developers, architects, and business stakeholders.
PRIMARY RESPONSIBILITIES:
Equal Opportunity Employer/Veterans/Disabled
Working at Audubon
Client-focused. People-powered. Safety-driven.
The Audubon Family of Companies provides professional consulting solutions to the energy industry. For over 25 years, our proven reputation for operational excellence and dedication to client satisfaction has helped us become a leading service provider to some of the biggest names in oil and gas. Our team of over 1,000 of the country's top professionals can deliver a full range of consulting services, from EPCM to field solutions and operational support.
At Audubon we are always growing, though we never lose sight of our commitment to excellence. Our focus on flexibility and our demand for unsurpassed quality control over continue to guide our growth as they have since our inception. We realize that service goes beyond plugging in a professional skill set. Service means flexibility. Service means understanding and solving project challenges in dynamic environments. Service means communication. We pride ourselves on providing the service of the quality which allows us to implement efficient solutions that deliver immediate value and long-term returns.
Our dedication to people requires an equal dedication to safety. Our rigorous safety program helps us maintain a safe and incident-free work environment from the desktop to the pipeline trench. Our people drive the quality and efficiency that have established Audubon as a leader in the oil and gas industry - their growth and safety are at the core of our business.
