- Build and maintain our Interoperability API and claims file feed integrations.
- Help design and implement new batch processing infrastructure.
- Enhance our data enrichment service to interface with external/third party data sources.
- Help design and implement a de-identified reporting and analytics platform.
- Maintain and improve an existing Python tech stack with a focus on security and scalability for data storage and API endpoints.
- Work with the internal stakeholders to build and maintain data and pipelines for various use cases.
- Recommend monitoring and analytics tools to automate common data needs and visibility.
- Strong Python experience.
- Strong PySpark experience.
- Experience with an orchestration tool like Airflow, Dagster, etc.
- Strong SQL skills including query performance and optimization techniques including explain plans.
- Experience building and maintaining APIs to serve data to internal stakeholders.
- Familiarity with implementing and using Apache Spark, AWS Glue, and/or EMR.
- Data pipeline development and maintenance experience.
- Familiarity with batch processing pipelines.
- Familiarity with data pipeline tuning and performance testing.
- Familiarity with building data processing infrastructure from the ground up.
- Familiarity with one or more RDBMS.
- Ability to identify tradeoffs for warehousing vs data lake infrastructure and applying solutions to the appropriate use case.
- Familiar with common pitfalls in high volume, partitioned data ingestion pipelines such as orphaned records and table locks
- Experience with Terraform.
- Experience with Apache Hudi or other data lake platforms.
- Experience with data streaming pipelines and sources.
- Experience building and maintaining APIs (Flask, FastAPI, etc).
- Experience with AWS managed services and data engineering solutions.
- Experience with other languages such as Go, Ruby, and Javascript.
- Be an early employee of a quickly growing, VC-backed start-up - grow with us
- Have a meaningful impact on a platform that is scaling very rapidly
- Contribute to a values-based culture with an emphasis on empowerment and autonomy
- Work in a highly collaborative, cross-functional environment
- Benefits include: Competitive pay, employer-paid healthcare, stock options
-
Data Engineering
4 days ago
Understood New York, United States**About Understood**: · Understood is a nonprofit focused on shaping the world for difference. We raise awareness of the challenges and strengths of people who learn and think differently. Our resources help people navigate challenges, gain confidence, and find support and commun ...
-
Data Engineering Director
1 day ago
FanDuel New York, United States**ABOUT FANDUEL** · FanDuel Group ("FanDuel") is an innovative sports-tech entertainment company that is changing the way consumers engage with their favorite sports, teams, and leagues. The premier gaming destination in the United States, FanDuel consists of a portfolio of leadi ...
-
Specialist - Data Engineering
2 days ago
LTIMindtree New York, United States**Job Req Id**:1287937 · - **About Us**: · - **Job Title**:Specialist - Data Engineering (Geneva Developer) · - **Work Location**: New York, NY days onsite/week) · experience as developer. · - Strong functional experience in financial industry and Portfolio Accounting System Gene ...
-
Senior Data Engineer
2 weeks ago
Bayer Industry Services (Currenta GmbH & Co. OHG) New York, United StatesDas kannst Du bei uns bewegen · Große Datenmengen · sind Dein Ding – Du unterstützt den Data Steward bei der Anbindung immer neuer Datenquellen an unseren Data Lake, sorgst für die · Transformation der Rohdaten zu "Trusted Data" · und unterstützt die Data Scientists bei der D ...
-
IT Data Center Engineer
1 week ago
CBRE New York, United StatesTeilzeit (20 Wochenstunden) | unbefristet · Die Technische Universität Wien ist Österreichs größte Forschungs- und Bildungseinrichtung im technisch- naturwissenschaftlichen Bereich und leistet seit mehr als 200 Jahren einen unverzichtbaren Beitrag zur Sicherung der international ...
-
Data Engineer
4 days ago
ESB Technologies New Jersey, United StatesOnly apply if you are willing to W2 · Job Title: Senior Azure Data Engineer · Location: AZ, TX, NJ, NY, FL, (Any of these mentioned locations) · Job Description: · Position Overview: We are seeking a highly skilled and experienced Azure Data Engineer to join our team as a senior ...
-
Data Engineer
6 days ago
Beauty by Imagination (BBI) New York, United StatesBeauty by Imagination · Data Engineer · Hybrid · Position Overview: · We are seeking a highly skilled and motivated Data Engineer to create and manage a data warehouse, integrating data from various sources including NetSuite, IRI, and other sales data. This role is pivotal in ow ...
-
Data Engineer
2 weeks ago
Social Capital Resources New York, United StatesData Engineer · Hybrid Role 4 days/week NYC · $120-130k base + bonus · Our client, an investment manager in NYC, is looking to add a Jr. Data Engineer to their team. The ideal candidate will have 1-3 years of Data Engineer/Development experience. Financial services experience is ...
-
Data Engineer
6 days ago
Net2Source Inc. New York, United StatesW2 Candidates Only · Position: Data Engineer – III · Locations: New York, NY Hybrid) · Duration: 12+ months Contract · Qualifications: · Expert-level understanding of Agile, SDLC, CI/CD, DevOps, GitOps, and ProdOps is required. · Expert-level expertise in SQL, Python, Scala or si ...
-
Data Engineer
6 days ago
NR Consulting New York, United StatesData Engineer SME · Location: NYC / Charlotte (Candidate should be open for hybrid work model) · Duration: 12 months · Responsibilities: · A background in financial services, investment banking, regulated sectors and large enterprise · DevOps and Agile engineering practitioner w ...
-
Data Engineer
5 days ago
Codex Tech-it New York, United StatesJob Description · Job DescriptionCodex Tech-IT is a leading technology solutions provider specializing in data management and analytics. We are seeking a skilled Data Engineer to join our team and contribute to the development and maintenance of our data infrastructure. With a st ...
-
Data Engineer
6 days ago
Oakridge Staffing New York, United StatesGlobal hospitality company is looking for an experienced Data Engineer for their Midtown NYC headquarters. · Responsibilities: · Lead the in-house development of ETL/ELT data pipelines and data science projects. · Create and own data products, such as a recommendation engine or ...
-
Data Engineer
2 weeks ago
Stealth AI Startup New York, United StatesAre you fascinated by the potential of the intersection between artificial intelligence and blockchain technology? Do you thrive in fast-paced environments where innovation is the norm? Interested in being a founding member of an early-stage start-up? · If so, we want you to be ...
-
Data Engineer
6 days ago
iO Associates - US New York, United StatesAn exciting Cloud Cybersecruity start up is looking for a talented Data Engineer to join their team based in New York City. The firm has recently secured new seed funding and are working on not just detecting cloud cybersecurity problems but solving them as well. · The ideal cand ...
-
Data Engineer
4 days ago
ExodusPoint New York, United StatesABOUT EXODUSPOINT · ExodusPoint Capital, founded in 2017 by Michael Gelband and Hyung Lee, began managing investor capital in 2018. The firm employs a global multi-strategy investment approach, seeking to deliver compelling asymmetric returns by combining complementary liquid str ...
-
Data Engineer
6 days ago
Benchmark IT - Technology Talent New York, United StatesOur direct client, a fast-growing FinTech firm in New York City, is looking for a Data Engineer to join the Data and Analytics team. This role will help build the infrastructure to make data a central part of the firm. Data driven decisions are very critical for the business, as ...
-
Data Engineer
3 days ago
Codex Tech-it New York, United StatesCodex Tech-IT is a leading technology solutions provider specializing in data management and analytics. We are seeking a skilled Data Engineer to join our team and contribute to the development and maintenance of our data infrastructure. With a strong focus on data quality and ac ...
-
Data Engineer
1 week ago
Oxford Knight New York, NY, United States Full timeData Engineer wanted for systematic arm of globally recognised hedge fund to join the growing Data Engineering team where you will support the Commodities business. This opportunity will give you the chance to design, implement and evolve the data platform, including pipeline, re ...
-
Data Engineer
1 week ago
OTG New York, United StatesYOUR NEXT OPPORTUNITY IS NOW BOARDING: · Join OTG as the Data Engineer – FLO Solutions now at PAS( Home Office) and drive a new type of hospitality. Explore career opportunities in a unique hospitality environment with some of the industry's best compensation and benefits, includ ...
-
Data Engineer
5 days ago
Open Systems Technologies New York, United StatesA financial firm is looking for a Data Engineer to join their team in New York, NY. · Compensation: $150-200k · Responsibilities: · Build data pipelines · Work with data vendors such as Bloomberg, Refinitiv, etc. · Take vendor data and normalize it for firm consumption · Qualifi ...
Senior Data Engineer - New York, United States - Nayya
Description
About Nayya
At Nayya, we believe there's a better way to choose benefits. A more transparent, less confusing way for employees to control their health and financial potential. Powered by billions of data points and machine learning, our benefits experience platform delivers personalized decision support and guidance during open enrollment, new employee onboarding, qualifying life events, and in the moments that matter all year round. This is one of the most stressful and challenging situations consumers face – and we see that as an opportunity to build an innovative response that can help millions of Americans possess the control and understanding they deserve.
Your Role
Work directly with the Nayya health data infrastructure team to power the claims data extraction and integration platform. In addition to maintaining and working on claims file feeds and API integrations, you will join the team as we build a high volume, batch file claims data pipeline.
The team maintains an internal facing API to power end user applications that leverage claims to enhance user experiences. You will help with maintaining that infrastructure, building new endpoints to power new use cases as well as working on an emerging, centralized data strategy for the organization. We will be working as a team to enhance data validation, governance, and access to organizational data from a single source of truth while building new infrastructure to exceed product requirements for our 2024 product goals and beyond. This is an excellent opportunity to get hands-on experience solidifying and scaling data infrastructure at a fast-growing startup.
Responsibilities
Requirements
Nice to haves:
The salary range for New York based candidates for this role is $140,000-$175,000. We use a location factor to adjust this range for candidates that are located outside of geographic region of our New York office. Placement within the salary band is determined based on experience.
#LI-KD1
#LI-HYBRID
#BI-Hybrid
Why Join Nayya?
Nayya is proud to be an Equal Employment Opportunity employer. We do not discriminate based upon race, religion, color, national origin, gender (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics
&v=024){kind=logo}
Senior Data Engineer professionals in New York City
-
Daniel Mallaco
Paid Media Manager | Brand Manager
-
Jasbir Hanjra
DevOps/ Cloud Architect/ Technical Project Manager
-
Sarthak Joshi
Software engineering generalist with experience in backend, algorithm research and project managemen ...
-
Chen Yin-Tung
Software Development Engineer
-
Jean Duciau
Mortgage Underwriter
-
Maria Paola Santini
Assistant Professor of Medicine