No more applications are being accepted for this job

Sr. Data Engineer - Old Tappan, United States - JSR Tech Consulting

JSR Tech Consulting Old Tappan, United States

1 month ago

Description

Long term contract to hire. Lead data engineer role with a major Financial Services company.

Hybrid work environment days onsite in Newark, NJ.

Qualifications

Engineering lead to help the design/build of the enterprise data platforms Design, Develop and Implement
End-to-end data solutions (ingest, storage, integration, processing, access) on AWS.
Data intake/ request/ onboarding services and service documentation.
Data ingestion services for batch/ real time data ingest and service documentation.
Data processing services for batch/ real time (Glue/ Kinesis/ EMR) and service documentation.
Data storage services for data lake (S3)/ data warehouses (RDS/ Redshift)/ data marts and service documentation.
Data services layer including Athena, Redshift, RDS, microservices and APIs.
Pipeline orchestration services including lambda, step functions, MWAA (optional).
Data security services (IAM/ KMS/ SM/ encryption/ anonymization/ RBAC) and service documentation.
Data access provisioning services (Accounts, IAM Roles RBAC), processes, documentation and education.
Data provisioning services for data consumption patterns including microservices, APIs and extracts.
Metadata capture and catalog services for data lake (S3/ Athena), data warehouses (RDS/ Redshift), Microservices/ APIs.
Metadata capture and catalog services for pipeline/ log data for monitoring / support.
Architect and implement CI/ CD strategy for EDP .
Implement high velocity streaming solutions using Amazon Kinesis, SQS, and SMS.

Migrate data from traditional relational database systems, file systems, NAS shares to AWS relational databases such as Amazon RDS, Aurora, and Redshift.

Migrate data from APIs to AWS data lake (S3) and relational databases such as Amazon RDS, Aurora, and Redshift.
Implement cost/ spend monitoring for AWS based data platform.
Implement audit reporting for access of AWS based data platform.

Contribute to the implementation of a data strategy to enable LOBs and Corporate Functions with a robust, holistic view of data - driven decision making.

Partner with immediate engineering team, product owner, IT, partners on EDP agenda.
Leverage and continuously develop best practices, standards, and frameworks.
Provide technology thought leadership, consulting, and coaching/ mentoring.
Work with scrum master to develop and own backlog, stories, epics, sprints.
System design and Architecture for products/ applications for EDP.

Work closely with various stakeholders (BI, AIML, MDM and other teams) to understand their use-cases and design optimal solution for them.

Execute technical design and infrastructure strategy for EDP .
Implement POCs on any new technology or tools to be implemented on EDP and onboard for real use-case.
Bachelor's degree in computer science, Software Engineering, MIS or equivalent combination of education and experience.
Experience implementing, supporting data platforms on AWS for large enterprises.
Full stack development experience building secure internal facing applications.
Programming experience with Java, Python/ Scala, Shell scripting.

Solid experience of AWS services such as CloudFormation, S3, Glue, EMR/ Spark, RDS, Redshift, DynamoDB, Lambda, Step Functions, IAM, KMS, SM etc.

Solid experience implementing solutions on AWS based data lakes preferred.
Experience implementing metadata solutions leveraging AWS non-relational data solutions such as ElastiCache and DynamoDB.
AWS Solutions Architect or AWS Big Data Certification preferred.
Experience in AWS data lake, data warehouse and business analytics.

Experience and understanding of various core AWS services such as IAM, Cloud Formation, EC2, S3, EMR/Spark, Glue, Datasync, CloudHealth, CloudWatch, Lambda, Athena, and Redshift.

Experience in system analysis, design, development, and implementation of data ingestion pipeline in AWS.
Experience with DevOps and Continuous Integration/ Delivery (CI/ CD) concepts and tools.
Experience with business intelligence tools such as Tableau, Power BI or equivalent.
Knowledge of ETL/ ELT.
Awareness of Data Management & Governance tools.
Working experience with Hadoop, HDFS, SQOOP, Hive, Python, and Spark is desired.
Experience working on Agile projects.

Seniority level

Seniority level

Mid-Senior level
Employment type

Employment type

Contract
Job function

Job function

Information Technology
Industries

IT Services and IT Consulting
Referrals increase your chances of interviewing at JSR Tech Consulting by 2x
Get notified about new

Data Engineer

jobs in

Newark, NJ .
New York, NY

$150,000 - $200,000

10 months ago
New York, NY

$130,000 - $250,000

2 weeks ago
New York, NY

$117,000 - $173,000

1 week ago
New York, NY

$100,000 - $200,000

10 months ago
New York, NY

$80,000 - $150,000

1 month ago
New York, NY

$115,400 - $173,000

3 weeks ago
New York, NY

$40,000 - $80,000

1 month ago
New York, NY

$165,000 - $165,000

2 months ago
New York, NY

$130,000 - $250,000

3 weeks ago
New York, NY

$10,000 - $20,000

3 weeks ago
We're unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.

#J-18808-Ljbffr

Data Engineer

1 week ago

EmpiRx Health Montvale, United States

Job Description · Job DescriptionWho We Are: · EmpiRx Health is the leading clinically-driven, customer-first PBM company that puts the pharmacist at the center of its service model to optimize member care while substantially reducing costs for plan sponsors. · What We Do: · We p ...
SQL Data Engineer

3 weeks ago

Career Developers, Inc. Montvale, United States

SQL Data Engineer (4-6 years of experience) · Location : Montvale, NJ - Hybrid 2 days a week · Salary : K · Summer hours, great perks, and benefits · Please note the following:This person must be a US Citizen or be a Green Card holder to be considered for this role. · Relocation ...
Sr Data Engineer

1 week ago

Dice Montvale, United States

Dice is the leading career destination for tech experts at every stage of their careers. Our client, Orion Business Innovations Careers, is seeking the following. Apply via Dice today · Sr Data Engineer - Pyspark / Databricks/Senior PySpark Developer · Responsibilities : · The ...
Data Engineer

2 weeks ago

Behaviorally Teaneck, United States

Title: Data Engineer · Full-time · We do not accept H1B/H1B Transfer/OPT · Hybrid role, mostly work from home; commute to the office as requested · Minimum Qualifications: · The role is ideal for someone who thrives in a fast-paced, cutting-edge technology environment. · Proven ...
Data Engineer

1 week ago

Motion Recruitment Montvale, United States CONTRACT

Our client is seeking a Data Engineer with GenAI experience for a remote contract role. · Contract Duration: 3-6 Months (Possible Extension) Required Skills & Experience · We are looking for a Mid-level Data Engineer with a minimum of 5 years of experience preferably GenAI projec ...
Data Engineer

3 weeks ago

RedStream Technology Elmwood Park, United States

Data Engineer / Architect · Long Term Contract Role · Hybrid (Northern NJ), 3 days a week in the office · RedStream Technology is recruiting for a candidate that has Data Architecture experience and wants to continue maintaining their development chops by maintaining some hands-o ...
Data Engineer

6 days ago

RedStream Technology Elmwood Park, United States

Data Engineer · Elmwood Park, NJ (Hybrid, 3 days on-site per week) · RedStream Technology is recruiting for a Data Engineer to work with our client, a leading mdeical services provider. The Data Engineer needs to be proficient with Matillion, Snowflake, and dbt in a hybrid Azur ...
Data Engineer

1 week ago

BEHAVIORALLY, Inc. Teaneck, United States

Title: Data Engineer · Minimum Qualifications: · The role is ideal for someone who thrives in a fast-paced, cutting-edge technology environment. · Proven Experience with data modeling and developing Enterprise Data Warehouse solutions - OLTP, OLAP, Dimensions, Facts, and Data ...
Data Engineer

4 weeks ago

BEHAVIORALLY INC Teaneck, United States

Job Description · Job DescriptionTitle: Data Engineer · Minimum Qualifications: · The role is ideal for someone who thrives in a fast-paced, cutting-edge technology environment. · Proven Experience with data modeling and developing Enterprise Data Warehouse solutions - OLTP, OL ...
Data Engineering Director

2 days ago

Insight Global Rockland, United States

Required Skills and Experience · 4+ years of Data Engineering experience · Experience leading/mentoring a team of junior engineers · Proficiency in SQL and Python · Experience with Cloud technologies (AWS Preferred) · Bachelor's Degree in Computer Science, Data Science, or relat ...
Data Engineer

5 days ago

UAE Company Tarrytown, United States

Were looking for a experienced Data Engineer to join our team at Farcana, on a full-time basis. Responsibilities: Design, implement, and maintain vector and graph databases to support advanced data structures and retrieval systems. Develop and optimize RAG (Retriever-Answer Gener ...
data engineer

2 weeks ago

Montefiore Medical Center The Bronx, United States Regular Full time

The role of the Data Engineer is to support the development of informatics capability designed to optimize patient outcomes and increase operational efficiency at Montefiore. The incumbent is responsible for developing and maintaining data structures, technology architectures, as ...
data engineer

3 weeks ago

Montefiore Medical Center The Bronx, United States

The role of the Data Engineer is to support the development of informatics capability designed to optimize patient outcomes and increase operational efficiency at Montefiore. The incumbent is responsible for developing and maintaining data structures, technology architectures, as ...
Data Engineer

5 days ago

Accolite Digital New York, United States

Bounteous x Accolite makes the future faster for the world's most ambitious brands. Our services span Strategy, Analytics, Digital Engineering, Cloud, Data & AI, Experience Design, and Marketing. We are guided by Co-Innovation, our proven methodology of collaborative partnership. ...
Data Engineer

5 days ago

Storm3 New York, United States

Lead Data Engineer · Series B, Startup · New York (Hybrid) · $200, ,000 + Significant Equity + Bonus · The company is a leading provider of virtual care to help tackle substance use. · ‍ Responsibilities: · Develop and maintain data pipelines for extracting, transforming and lo ...
Data Engineer

3 weeks ago

Action Tech New York, United States

This is a full time, direct hire position that requires 3 to 4 days a week onsite in NYC · All applicants must be local to the NY, NJ, CT area · We are looking for an outstanding Data Engineer to join our New York-based team who can help build the infrastructure to make data a ce ...
Senior Data Engineer

2 weeks ago

Insight Global Englewood Cliffs, United States

C2C Employers please DO NOT apply to this job posting. This is a W2 opportunity. Thank you · Role: Sr Data Engineer · Location: Englewood Cliffs, NJ – onsite 3 days/week · Visa: Must be able to work on a W2 without visa sponsorship · Duration: 6-month contract to hire · Rate: 75- ...
Data Engineer

1 day ago

Benchmark IT - Technology Talent New York, United States

Our direct client, a fast-growing FinTech firm in New York City, is looking for a Data Engineer. In this role, you will work with Sales, Marketing, and Product teams to define, calculate, and grow their key operating metrics (e.g. sales, conversions, retention). This individual w ...
Data Engineer

1 week ago

Oxford Knight New York, United States Full time

Data Engineer wanted for systematic arm of globally recognised hedge fund to join the growing Data Engineering team where you will support the Commodities business. This opportunity will give you the chance to design, implement and evolve the data platform, including pipeline, re ...
Data Engineer

2 weeks ago

Jarvis Walker Jersey City, United States

Data Engineer · We are seeking an enthusiastic and experienced Data Engineer to join our team. As a Data Engineer, you will be a key member of our product development team. You will play a pivotal role in turning data into actionable models that our company uses to create new lin ...