- Lead a team of data engineers to build algorithm-heavy data pipelines.
- Build end-to-end data pipelines from raw data to visualizations.
- Build a workflow orchestration platform to be used by other developers.
- Partner with other development teams to build metrics pipelines.
- Aid in setting the overall vision and core data infrastructure for the company.
- Experience leading a team as a technical lead or manager.
- Hands-on experience implementing data pipeline infrastructure for data ingestion and transformation near real-time availability of data for applications, BI analytics, and ML pipelines.
- Experience designing optimized solutions for large datasets.
- Expert level working knowledge of Data Lake technologies, data storage formats (Parquet, ORC, Avro), and query engines (Athena, Presto, Dremio) and associated concepts for building optimized solutions at scale.
- Expert level in one of the following programming languages or similar- Python, Java, Go.
- Working experience with BI tools like Apache Superset or Tableau.
- Experience in designing data streaming and event-based data solutions (Kafka, Kinesis, SQS/SNS or the like).
- Working experience with cloud-based data warehouses like (Greenplum, RedShift, Azure SQL Data Warehouse, etc).
- Experience with data pipelines tools (Flink, Spark or like) and orchestration tools such as Airflow.
- Knowledge and experience designing solutions with cloud-native AWS Cloud services (EC2, EMR, RDS, EKS etc.) as well as deploying alternative solutions for appropriate use cases.
- Familiarity with cloud-native AWS Cloud services (EC2, S3,DynamoDB,EMR, RDS, EKS etc.) as well as deploying alternative solutions for appropriate use cases.
-
Data Engineer
3 weeks ago
Govini Pittsburgh, United States Full timeCompany Description · Govini is the leading Commercial Data company in the Defense Technology space. Built by Govini, is used at scale across the National Security sector of the federal government. This platform enables government analysts, program managers, and decision-makers ...
-
Data Engineer
5 days ago
OpenArc, LLC. Pittsburgh, United StatesOpenArc - Empowering Your Career. As a leading IT staffing firm, we are dedicated to connecting talented professionals with your ideal opportunities. We are currently seeking a qualified Data Engineer to join our client's organization and contribute to their ongoing success. · Jo ...
-
Data Engineer
2 days ago
Armada Pittsburgh, United StatesSUMMARY · As a Data Engineer for our Digital Services division, you will drive the evolution of our next generation data infrastructure, which powers a wide range of analytics and software products. You will be responsible for designing, developing, and maintaining advanced data ...
-
Data Engineer
6 days ago
OpenArc Pittsburgh, United StatesPlans, designs, develops, and manages an organization's databases to ensure efficient data storage, access, and security. Collaborates with users to design, code, test, debug, and deploy databases that meet requirements and organizational needs. Writ Data Engineer, Engineer, Data ...
-
Data Engineer
1 week ago
Govini Pittsburgh, United StatesCompany Description · Govini builds software to accelerate the Defense Acquisition Process. Ark, Govini's flagship product, is a suite of AI-enabled applications, powered by integrated government and commercial data, that solves problems across the entire spectrum of Defense Acqu ...
-
Data Engineer
3 weeks ago
Software Engineering Institute Pittsburgh, United StatesWhat We Do · The CERT Cyber Mission Readiness (CMR) directorate fortifies the U.S. and its partners against cyber threats. We design large and small-scale exercises, facilitate tabletop scenarios, run cybersecurity contests, and create open-source tools to bolster cyber defense ...
-
Data Engineer
1 week ago
Sheetz Pittsburgh, United StatesOVERVIEW · Responsible for developing complex, large scale data models and pipelines that · organize and standardize the data to make it readily accessible and consumable by the business for · reporting and data science needs. Collaborate with various areas of the Business in ...
-
Data Engineer
1 week ago
Innovation Works, Inc. Pittsburgh, United StatesJob Description · Job DescriptionABOUT IDELIC · Idelic uses cutting-edge technology and beautifully designed interfaces to help predict and prevent trucking accidents and reduce driver turnover to ensure drivers get home safely each and every night. Our SaaS solutions are radical ...
-
Data Engineer
2 weeks ago
Tekfortune Inc Pittsburgh, United StatesPython(pyspark), jupyter hub, airflow, Java · Database knowledge - Oracle / SQL / Data Analytics · Regulatory reporting knowledge preferred · Good communication skills · Open / Ability to learn new technologies · Very good Analytical Skills · Experience in ETL is preferable · ...
-
Senior Data Engineer
3 days ago
YinzCam, Inc. Pittsburgh, United StatesNOTE: This in an in-office role in Pittsburgh, PA, USA. · ABOUT YINZCAM · Our digital products are used by 200+ professional sports teams and leagues around the world, including clubs in the NFL, NBA, MLS, NHL, LigaMX, AFL (Australia), and more. · THE ROLE · As a Senior Data En ...
-
Data Engineering Architect
2 weeks ago
Synechron Pittsburgh, United StatesTitle: Data Engineering Architect (Neo4j and PySpark) · Location: Pittsburgh, PA · Job Type: Full time · About the role: The Data Architect will specifically help to generate and assess the calculated data quality, Risk Tech Analyst also supports Quants and Risk models validation ...
-
Data Engineer Senior
5 days ago
PNC Bank NA Pittsburgh, United States Full timeDescription · Leads in developing, supporting and implementing data solutions for multiple applications in order to meet business objectives and user requirements. Leverages technical knowledge and industry experience to design, build and maintain technology solutions. · Leads d ...
-
Data Engineer Associate
1 week ago
PNC Pittsburgh, United StatesPosition Overview · At PNC, our people are our greatest differentiator and competitive advantage in the markets we serve. We are all united in delivering the best experience for our customers. We work together each day to foster an inclusive workplace culture where all of our emp ...
-
Manager, Data Engineering
2 days ago
Free Market Health Pittsburgh, United StatesJob Description · Job DescriptionSalary: $110,000-$120,000 · Overview · As part of the Technology Services team at Free Market Health, the Manager of Data Engineering will be responsible for helping to guide a team that will implement, grow, and optimize our data intake process, ...
-
Senior Data Engineer
2 weeks ago
EOS USA Pittsburgh, United StatesWHO WE ARE: · EOS IT Solutions is a Global Technology and Logistics company, providing Collaboration and Business IT Support services to some of the world's largest industry leaders, delivering forward-thinking solutions based on multi-domain architecture. Customer satisfaction ...
-
Data Engineer II
2 weeks ago
University of Pittsburgh Pittsburgh, United States· Data Engineer II · Job Summary · Job Title: Data Engineer II · Job Location: Pittsburgh, PA · Job Description: Support data acquisition by locating datasets and software produced by MIDAS researchers through online searching, reviewing the scientific literature, and communi ...
-
Senior Data Engineer
1 week ago
Carnegie Mellon University Pittsburgh, United StatesReference #: What We Do · The CERT Cyber Mission Readiness (CMR) directorate fortifies the U.S. and its partners against cyber threats. We design large and small-scale exercises, facilitate tabletop scenarios, run cybersecurity contests, and create open-source tools to bolster cy ...
-
Data Engineer Senior
1 week ago
PNC Pittsburgh, United StatesPosition Overview · At PNC, our people are our greatest differentiator and competitive advantage in the markets we serve. We are all united in delivering the best experience for our customers. We work together each day to foster an inclusive workplace culture where all of our em ...
-
Data Engineering Manager
1 week ago
Pantherx Specialty LLC Pittsburgh, United StatesJob Description · Job Description7,000 Diseases - 500 Treatments - 1 Rare Pharmacy · PANTHERx is the nation's largest rare disease pharmacy, and we put the patient experience at the top of everything that we do. · If you are looking for a career in the healthcare field that embr ...
-
Senior Data Engineer
1 week ago
Mindera Pittsburgh, United States· Here at Mindera, we are continuously building a fantastic team and would love for you to join us. · We're looking for data engineers with at least 10 years of experience who have an appetite for solving complex and exciting problems. We develop to a very high standard, mainta ...
Technical Lead Manager, Data Engineering - Pittsburgh, United States - Stack AV
Description
AboutWith customers at its core, Stack AV is focused on revolutionizing the way businesses transport goods, designing solutions to alleviate long-standing issues that have plagued the trucking industry including driver shortages, lagging efficiency in uptime per vehicle, overarching safety concerns, high operating costs, and elevated emission levels. By building safe and efficient autonomous trucking solutions, Stack AV is creating better and smarter supply chains for its partners, improving business outcomes for its customers, delivering goods to end-users faster, and ultimately moving the trucking industry forward.
What We're Looking for:
We are looking for people who are passionate about delivering self-driving (L4) products that make the way we move safer, faster, and more efficient. We seek mission-driven, highly skilled people with deep experience in fast-paced, rapidly growing, tech development environments. We are looking for a Technical Lead Manager to build up a team of data engineers to develop and deploy world-class solutions software for next-generation self-driving systems.
What Success Looks Like:
Please Note: Pursuant to its business activities and use of technology, Stack AV complies with all applicable U.S. national security laws, regulations, and administrative requirements, which can restrict Stack AV's ability to employ certain persons in certain positions pursuant to a range of national security-related requirements. As such, this position may be contingent upon Stack AV verifying a candidate's residence, U.S. person status, and/or citizenship status. This position may also involve working with software and technologies subject to U.S. export control regulations. Under these regulations, it may be necessary for Stack AV to obtain a U.S. government export license prior to releasing its technologies to certain persons. If Stack AV determines that a candidate's residence, U.S. person status, and/or citizenship status will require a license, prohibit the candidate from working in this position, or otherwise be subject to national security-related restrictions, Stack AV expressly reserves the right to either consider the candidate for a different position that is not subject to such restrictions, on whatever terms and conditions Stack AV shall establish in its sole discretion, or, in the alternative, decline to move forward with the candidate's application.