Senior Data Engineer - New York, United States - Nayya

Nayya New York, United States

1 week ago

Description

Job Description

About Nayya

At Nayya, we believe there's a better way to choose benefits. A more transparent, less confusing way for employees to control their health and financial potential. Powered by billions of data points and machine learning, our benefits experience platform delivers personalized decision support and guidance during open enrollment, new employee onboarding, qualifying life events, and in the moments that matter all year round. This is one of the most stressful and challenging situations consumers face – and we see that as an opportunity to build an innovative response that can help millions of Americans possess the control and understanding they deserve.

Your Role

Work directly with the Nayya health data infrastructure team to power the claims data extraction and integration platform. In addition to maintaining and working on claims file feeds and API integrations, you will join the team as we build a high volume, batch file claims data pipeline.

The team maintains an internal facing API to power end user applications that leverage claims to enhance user experiences. You will help with maintaining that infrastructure, building new endpoints to power new use cases as well as working on an emerging, centralized data strategy for the organization. We will be working as a team to enhance data validation, governance, and access to organizational data from a single source of truth while building new infrastructure to exceed product requirements for our 2024 product goals and beyond. This is an excellent opportunity to get hands-on experience solidifying and scaling data infrastructure at a fast-growing startup.

Responsibilities

Build and maintain our Interoperability API and claims file feed integrations.
Help design and implement new batch processing infrastructure.
Enhance our data enrichment service to interface with external/third party data sources.
Help design and implement a de-identified reporting and analytics platform.
Maintain and improve an existing Python tech stack with a focus on security and scalability for data storage and API endpoints.
Work with the internal stakeholders to build and maintain data and pipelines for various use cases.
Recommend monitoring and analytics tools to automate common data needs and visibility.

Requirements

Strong Python experience.
Strong PySpark experience.
Experience with an orchestration tool like Airflow, Dagster, etc.
Strong SQL skills including query performance and optimization techniques including explain plans.
Experience building and maintaining APIs to serve data to internal stakeholders.
Familiarity with implementing and using Apache Spark, AWS Glue, and/or EMR.
Data pipeline development and maintenance experience.
Familiarity with batch processing pipelines.
Familiarity with data pipeline tuning and performance testing.
Familiarity with building data processing infrastructure from the ground up.
Familiarity with one or more RDBMS.
Ability to identify tradeoffs for warehousing vs data lake infrastructure and applying solutions to the appropriate use case.
Familiar with common pitfalls in high volume, partitioned data ingestion pipelines such as orphaned records and table locks

Nice to haves:

Experience with Terraform.
Experience with Apache Hudi or other data lake platforms.
Experience with data streaming pipelines and sources.
Experience building and maintaining APIs (Flask, FastAPI, etc).
Experience with AWS managed services and data engineering solutions.
Experience with other languages such as Go, Ruby, and Javascript.

The salary range for New York based candidates for this role is $140,000-$175,000. We use a location factor to adjust this range for candidates that are located outside of geographic region of our New York office. Placement within the salary band is determined based on experience.

#LI-KD1

#LI-HYBRID

#BI-Hybrid

Why Join Nayya?

Be an early employee of a quickly growing, VC-backed start-up - grow with us
Have a meaningful impact on a platform that is scaling very rapidly
Contribute to a values-based culture with an emphasis on empowerment and autonomy
Work in a highly collaborative, cross-functional environment
Benefits include: Competitive pay, employer-paid healthcare, stock options

Nayya is proud to be an Equal Employment Opportunity employer. We do not discriminate based upon race, religion, color, national origin, gender (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics

Data Engineering

1 week ago

Understood New York, United States

**About Understood**: · Understood is a nonprofit focused on shaping the world for difference. We raise awareness of the challenges and strengths of people who learn and think differently. Our resources help people navigate challenges, gain confidence, and find support and commun ...
Engineering Contractor, Data

3 days ago

EQUINOX New York, United States Freelance

**Engineering Contractor, Data**: · Overview · **OUR STORY** · Equinox Group is a high growth collective of the world's most influential, experiential, and differentiated lifestyle brands. We restlessly seek what is next for maximizing life - and boldly grow the lifestyle brands ...
Data Engineering Director

6 days ago

FanDuel New York, United States

**ABOUT FANDUEL** · FanDuel Group ("FanDuel") is an innovative sports-tech entertainment company that is changing the way consumers engage with their favorite sports, teams, and leagues. The premier gaming destination in the United States, FanDuel consists of a portfolio of leadi ...
Specialist - Data Engineering

1 week ago

LTIMindtree New York, United States

**Job Req Id**:1287937 · - **About Us**: · - **Job Title**:Specialist - Data Engineering (Geneva Developer) · - **Work Location**: New York, NY days onsite/week) · experience as developer. · - Strong functional experience in financial industry and Portfolio Accounting System Gene ...
Junior Data Engineering Specialist

20 hours ago

STV Group New York, United States

We are seeking a talented and motivated Junior Data Engineering Specialist to join our dynamic Digital Advisory team. As a Junior Data Engineering Specialist, you will play a key role in designing, developing, and maintaining data pipelines and systems to support our data-driven ...
Senior Data Engineer

2 weeks ago

Bayer Industry Services (Currenta GmbH & Co. OHG) New York, United States

Das kannst Du bei uns bewegen · Große Datenmengen · sind Dein Ding – Du unterstützt den Data Steward bei der Anbindung immer neuer Datenquellen an unseren Data Lake, sorgst für die · Transformation der Rohdaten zu "Trusted Data" · und unterstützt die Data Scientists bei der D ...
IT Data Center Engineer

1 week ago

CBRE New York, United States

Teilzeit (20 Wochenstunden) | unbefristet · Die Technische Universität Wien ist Österreichs größte Forschungs- und Bildungseinrichtung im technisch- naturwissenschaftlichen Bereich und leistet seit mehr als 200 Jahren einen unverzichtbaren Beitrag zur Sicherung der international ...
Data Engineer

1 week ago

Net2Source Inc. New York, United States

W2 Candidates Only · Position: Data Engineer – III · Locations: New York, NY Hybrid) · Duration: 12+ months Contract · Qualifications: · Expert-level understanding of Agile, SDLC, CI/CD, DevOps, GitOps, and ProdOps is required. · Expert-level expertise in SQL, Python, Scala or si ...
Data Engineer

2 days ago

Open Systems Technologies New York, United States

An international law firm is looking for a Data Engineer to join their team in NYC. · Compensation: $115-160k · The Data Engineer is responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection. The Data Enginee ...
Data Engineer

2 weeks ago

Stealth AI Startup New York, United States

Are you fascinated by the potential of the intersection between artificial intelligence and blockchain technology? Do you thrive in fast-paced environments where innovation is the norm? Interested in being a founding member of an early-stage start-up? · If so, we want you to be ...
Data Engineer

1 week ago

Codex Tech-it New York, United States

Codex Tech-IT is a leading technology solutions provider specializing in data management and analytics. We are seeking a skilled Data Engineer to join our team and contribute to the development and maintenance of our data infrastructure. With a strong focus on data quality and ac ...
Data Engineer

1 week ago

Codex Tech-it New York, United States

Job Description · Job DescriptionCodex Tech-IT is a leading technology solutions provider specializing in data management and analytics. We are seeking a skilled Data Engineer to join our team and contribute to the development and maintenance of our data infrastructure. With a st ...
Data Engineer

1 week ago

ESB Technologies New Jersey, United States

Only apply if you are willing to W2 · Job Title: Senior Azure Data Engineer · Location: AZ, TX, NJ, NY, FL, (Any of these mentioned locations) · Job Description: · Position Overview: We are seeking a highly skilled and experienced Azure Data Engineer to join our team as a senior ...
Data Engineer

1 week ago

NR Consulting New York, United States

Data Engineer SME · Location: NYC / Charlotte (Candidate should be open for hybrid work model) · Duration: 12 months · Responsibilities: · A background in financial services, investment banking, regulated sectors and large enterprise · DevOps and Agile engineering practitioner w ...
Data Engineer

2 weeks ago

Oxford Knight New York, NY, United States Full time

Data Engineer wanted for systematic arm of globally recognised hedge fund to join the growing Data Engineering team where you will support the Commodities business. This opportunity will give you the chance to design, implement and evolve the data platform, including pipeline, re ...
Data Engineer

1 week ago

Open Systems Technologies New York, United States

A financial firm is looking for a Data Engineer to join their team in New York, NY. · Compensation: $150-200k · Responsibilities: · Build data pipelines · Work with data vendors such as Bloomberg, Refinitiv, etc. · Take vendor data and normalize it for firm consumption · Qualifi ...
Data Engineer

13 hours ago

Action Tech New York, United States

This is a full time, direct hire position that requires 3 to 4 days a week onsite in NYC · All applicants must be local to the NY, NJ, CT area · We are looking for an outstanding Data Engineer to join our New York-based team who can help build the infrastructure to make data a ce ...
Data Engineer

1 week ago

Beauty by Imagination (BBI) New York, United States

Beauty by Imagination · Data Engineer · Hybrid · Position Overview: · We are seeking a highly skilled and motivated Data Engineer to create and manage a data warehouse, integrating data from various sources including NetSuite, IRI, and other sales data. This role is pivotal in ow ...
Data Engineer

1 week ago

ExodusPoint New York, United States

ABOUT EXODUSPOINT · ExodusPoint Capital, founded in 2017 by Michael Gelband and Hyung Lee, began managing investor capital in 2018. The firm employs a global multi-strategy investment approach, seeking to deliver compelling asymmetric returns by combining complementary liquid str ...
Data Engineer

1 week ago

Oakridge Staffing New York, United States

Global hospitality company is looking for an experienced Data Engineer for their Midtown NYC headquarters. · Responsibilities: · Lead the in-house development of ETL/ELT data pipelines and data science projects. · Create and own data products, such as a recommendation engine or ...

Senior Data Engineer - New York, United States - Nayya

Description

Job Description

Data Engineering

Engineering Contractor, Data

Data Engineering Director

Specialist - Data Engineering

Junior Data Engineering Specialist