Jobs
>
Philadelphia

    Sr Data Engineer - Philadelphia, United States - HealthVerity

    HealthVerity
    HealthVerity Philadelphia, United States

    3 weeks ago

    Default job background
    Description

    Position:
    Data Engineer


    Reporting to:
    Director, Data Engineering


    Location:
    Philadelphia, PA


    How you will help As a data engineer on the data platform team, you will be supporting and enhancing the platform that supports HealthVerity's Petabyte-scale core data asset.

    You will work closely with other engineers, data scientists, and business leaders to ensure that our data platform is available, secure, and reliable.

    You will use your strong engineering and product mindset to understand business needs and develop scalable engineering solutions that support HealthVerity's product roadmap and vision while continuously looking for opportunities to simplify, automate tasks, and build reusable components.


    • What you will do
    Engineer efficient, adaptable and scalable data pipelines to process structured and unstructured data

    Develop and maintain data pipelines to efficiently process and analyze large amounts of streaming data

    Collaborate with other data engineers to maintain a cohesive and standardized data infrastructure

    Work closely with the software engineering team to integrate data pipelines into the overall platform architecture


    Collaborate with cross-functional teams including software engineers, data scientists, product managers, and analysts to understand data needs and deliver valuable platform enhancements that support the overall HealthVerity vision and roadmap.

    Identify and implement solutions to optimize data storage, retrieval, and processing

    Continuously evaluate and improve data engineering processes and systems to increase efficiency and scalability

    Stay up-to-date with emerging technologies and industry trends in data engineering

    Ensure data security and compliance with privacy regulations

    Troubleshoot and resolve data-related issues in a timely manner

    Leverage large-scale distributed computing and serverless architecture including Spark, AWS Lambda, etc. to develop pipelines for transforming data

    Partner with the product teams to understand product goals and provide data that enables us to respond to customer and regulatory data requests

    Monitor data quality and proactively identify and resolve data issues

    Required skills and experience

    You are proficient in at least one primary language (e.g., Java, Scala, Python) and Advanced SQL (any variant)

    ```{=html}

    ``` - *You have a product mindset to understand business needs and develop scalable engineering solutions.

    *You are always looking for opportunities to simplify, automate tasks, and build reusable components across multiple use cases and teams.

    *You have strong communication skills to collaborate with cross-functional partners and drive projects. You are curious and eager to work across a variety of engineering specialties (i.e., Data Science, Data Engineering, and Machine Learning to name a few).


    You have an eye for detail and like to spark joy amongst your partners with well-documented high-quality data products that are modeled and easy to understand.

    You are able to successfully lead large, complex systems design and implementation challenges independently

    You have a strong knowledge of Databricks features and functionalities, such as Unity Catalog, Audit Logs, Databricks SQL and Delta Live Tables

    *Experience with CI/CD pipelines and DataOps

    Experience using Infrastructure as Code (IaC) tools, such as Terraform, YAML, and Helm Charts

    *You have 8+ years of industry experience and proficiency in building distributed data pipelines for both batch and real-time (experience with Databricks, Spark, Hive, Iceberg, Kafka, Snowflake is helpful, but not strictly required).

    You have experience with Databricks pipeline automation, AWS EMR, AWS S3 service AWS Services Snowflake, Spark, Docker.
  • Aramark

    Data Engineer

    1 week ago

    Aramark Philadelphia, United States

    Job Description · Primary duties will include design, implement and support of a hybrid ecosystem of on premise and cloud data solution architectures. The candidate will have knowledge of modern data architecture, Cloud architectures, and integration patterns such as RDBMS, Snowf ...

  • Mondo

    Data Engineer

    4 weeks ago

    Mondo Philadelphia, United States

    Job Description · Job DescriptionApply now: Data Engineer, this is a 100% remote opportunity. The start date is ASAP for this long-term contract position. · Job Title: Data Engineer · Location-Type: 100% remote · Start Date Is: ASAP · Duration: Long-term contract · Rate: $55-$63 ...

  • City of Philadelphia

    Data Engineer

    2 weeks ago

    City of Philadelphia Philadelphia, United States

    Job Description · Job DescriptionCompany Description · A best-in-class city that attracts best-in-class talent, Philadelphia is an incredible place to build a career. From our thriving arts scene and rich history to our culture of passion and grit, there are countless reasons to ...

  • Marvica Technologies

    Data Engineer

    2 weeks ago

    Marvica Technologies Philadelphia, United States

    Job Description · Job DescriptionData Engineer · Location: Philadelphia (Hybrid), Contract to hire · Exp: 8+ Years · Responsibilities: · Develop data-driven solutions with Cloud based technologies to meet evolving business needs. Deliver impactful, scalable, and highly performant ...

  • IntegriChain

    Data Engineer

    2 days ago

    IntegriChain Philadelphia, United States

    Company Description · IntegriChain is the data and application backbone for market access departments of Life Sciences manufacturers. We deliver the data, the applications, and the business process infrastructure for patient access and therapy commercialization. More than 250 ma ...

  • IntegriChain

    Data Engineer

    6 days ago

    IntegriChain Philadelphia, United States

    Job Description · Job DescriptionCompany Description · IntegriChain is the data and application backbone for market access departments of Life Sciences manufacturers. We deliver the data, the applications, and the business process infrastructure for patient access and therapy com ...

  • PENN Interactive

    Senior Data Engineer

    2 weeks ago

    PENN Interactive Philadelphia, United States

    Penn Interactive (PI) is an interactive gaming company headquartered in Philadelphia. PI is the digital arm of PENN Entertainment (NASDAQ: PENN), the largest regional casino operator in the U.S.). Our mission is to challenge the norms of the gaming industry by building an immersi ...

  • PENN Interactive

    Senior Data Engineer, Data Lake

    2 weeks ago

    PENN Interactive Philadelphia, United States

    Penn Interactive (PI) is an interactive gaming company headquartered in Philadelphia. PI is the digital arm of PENN Entertainment (NASDAQ: PENN), the largest regional casino operator in the U.S.). Our mission is to challenge the norms of the gaming industry by building an immersi ...

  • PENN Interactive

    Senior Data Engineer

    4 weeks ago

    PENN Interactive Philadelphia, United States

    Penn Interactive (PI) is an interactive gaming company headquartered in Philadelphia. PI is the digital arm of PENN Entertainment (NASDAQ: PENN), the largest regional casino operator in the U.S.). Our mission is to challenge the norms of the gaming industry by building an immersi ...

  • Hexaware Technologies

    Azure Data Engineer

    3 weeks ago

    Hexaware Technologies Philadelphia, United States

    What Working at Hexaware offers: · Hexaware is a dynamic and innovative IT organization committed to delivering cutting-edge solutions to our clients worldwide. We pride ourselves on fostering a collaborative and inclusive work environment where every team member is valued and em ...

  • InsideHigherEd

    Senior Data Engineer

    2 weeks ago

    InsideHigherEd Philadelphia, United States

    · Senior Data Engineer (Department of Neuropsychiatry) · University Overview · The University of Pennsylvania, the largest private employer in Philadelphia, is a world-renowned leader in education, research, and innovation. This historic, Ivy League school consistently ranks amo ...

  • HealthVerity

    Senior Data Engineer

    1 week ago

    HealthVerity Philadelphia, United States Full time

    How you will help As a data engineer on the data platform team, you will be supporting and enhancing the platform that supports HealthVerity's Petabyte-scale core data asset. You will work closely with other engineers, data scientists, and business leaders to ensure that our data ...

  • Perpay - Career's Page

    Junior Data Engineer

    1 week ago

    Perpay - Career's Page Philadelphia, United States

    Job Description · Job DescriptionAbout Us:We believe everyone deserves a chance to improve their financial future. We're dedicated to building simple and inclusive financial products that help our members create healthy habits and achieve economic stability. · Some things we're e ...

  • Perpay - Career's Page

    Senior Data Engineer

    1 week ago

    Perpay - Career's Page Philadelphia, United States

    Job Description · Job DescriptionAbout Us:We believe everyone deserves a chance to improve their financial future. We're dedicated to building simple and inclusive financial products that help our members create healthy habits and achieve economic stability. · Some things we're e ...

  • Perpay - Career's Page

    Data Engineering Manager

    2 weeks ago

    Perpay - Career's Page Philadelphia, United States

    Job Description · Job DescriptionAbout Us:We believe everyone deserves a chance to improve their financial future. We're dedicated to building simple and inclusive financial products that help our members create healthy habits and achieve economic stability. · Some things we're e ...

  • Penn Interactive

    Senior Data Engineer

    3 weeks ago

    Penn Interactive Philadelphia, United States

    Penn Interactive (PI) is an interactive gaming company headquartered in Philadelphia. PI is the digital arm of PENN Entertainment (NASDAQ: PENN), the largest regional casino operator in the U.S.). Our mission is to challenge the norms of the gaming industry by building an immersi ...

  • Hexaware Technologies

    Azure lead Data engineer

    4 weeks ago

    Hexaware Technologies Philadelphia, United States

    Primary Skill : · 1 Azure databricks- Build Data Pipelines using ADB-Leveraging Python and Spark · Build Data Transformation in ADB · Convert Scala Pgms to Py Spark Pgms · Understand the SCALA program in DataBricks · 2 ADF · Secondary Skills · 1 Azure data lake gen 2 · 2. Synapse ...

  • Expleo Group

    Data Engineer- Big Data developer

    3 days ago

    Expleo Group Alloway, United States

    Overview: · Tu pasin son los datos? Te entusiasma la oportunidad de trabajar en un proyecto internacional? sigue leyendo, esto te interesa · #LI-LD1 · **Lo que te ofrecemos** · Flexibilidad Total: Organiza tu da como prefieras, tu tiempo es tuyo · Teletrabajo 100% · Crecimi ...

  • Aramark

    Data Engineer

    6 days ago

    Aramark Philadelphia, United States

    **Job Description** · The Data Engineer will design, create, maintain and enhance new and existing database platforms and work on improving the performance of existing database systems within a ?Big Data Infrastructure?. They create and fine-tune queries, optimize data retrieval ...

  • Infosys

    Data Engineer

    3 weeks ago

    Infosys Philadelphia, United States

    Data Engineer BR · DESCRIPTION/RESPONSIBILITIES: Infosys is seeking a Data Engineer. This position will interface with key stakeholders and apply your technical proficiency across different stages of the Software Development Life Cycle including Requirements Elicitation, Applicat ...