AWS Databricks Engineer - Rahway, United States - KTek Resourcing

KTek Resourcing Rahway, United States

2 weeks ago

Technology / Internet

Description

Responsibilities:

Evaluate and understand the latest features and capabilities of the Databricks platform and assess their potential impact on our organization's data ecosystem.
Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions using Databricks.
Help to design, develop, and implement scalable and efficient data science/data engineering solutions using Databricks and related technologies.
Optimize and fine-tune existing Databricks workflows to improve performance and reliability.
Collaborate with data scientists, data engineers, and other stakeholders to ensure seamless integration of Databricks solutions into our data ecosystem.
Understand the typical integrations with other Data Integration / Data Governance frameworks such as Starburst Trino, Collibra, Immuta, etc., and assess their compatibility and potential specific adoption criteria for our organization.
Stay up-to-date with the latest trends and advancements in Databricks and related technologies, and proactively recommend improvements and enhancements to our existing systems.
Strong understanding of Delta Live Tables, Medallion architecture and unity Catalog.

Requirements:

Proven experience as a Databricks Engineer, with a focus on Databricks-AWS implementation.
5+year of experience in Python, Spark, Scala and big data with AWS platform
Nice to have experience in Streaming preferably Kafka and Databricks integrations.
Strong understanding of Databricks architecture and its integration with AWS services.
Experience in designing and implementing scalable data processing pipelines using Databricks.
Familiarity with cloud-based data storage and processing technologies, particularly AWS services.
Strong problem-solving skills and ability to troubleshoot and resolve complex technical issues.
Excellent communication and collaboration skills, with the ability to work effectively in a team environment.
Prior experience in the pharmaceutical or healthcare industry is a plus.

Thanks & Regards

Databricks Engineer

2 weeks ago

EZDynamic, LLC New York, United States

No Visa sponsorship (Only GC holders or U.S. Citizens may apply) · - Please answer all questions provided. Incomplete submissions will NOT be reviewed - - · Databricks Engineer · Role & Responsibilities · Designing, building, and maintaining medallion architecture-based data pipe ...
Databricks Engineer

1 week ago

CHUBB Jersey City, United States Regular - Full time

Job Description: We are searching for a seasoned Databricks Engineer to pioneer advanced Databricks solutions. The Databricks Engineer will serve as a central figure in our data engineering team, delivering highly sophisticated technological solutions using Databricks, Delta Live ...
Databricks Engineer

2 weeks ago

Chubb Whitehouse Station, United States

Job Description · Job Description: We are searching for a seasoned Databricks Engineer to pioneer advanced Databricks solutions. The Databricks Engineer will serve as a central figure in our data engineering team, delivering highly sophisticated technological solutions using Dat ...
Databricks Engineer

2 weeks ago

AI TalentFlow New York, United States

AI TalentFlow: Databricks EngineerFuel Innovation in Financial Services with Data Engineering Expertise · About AI TalentFlow: · AI TalentFlow specializes in accelerating startup growth, scaling enterprise solutions, and nurturing the career growth of the individuals who power th ...
Databricks Engineer

1 week ago

AI Talent Flow New York, United States

AI TalentFlow: Databricks Engineer · Fuel Innovation in Financial Services with Data Engineering Expertise · About AI TalentFlow: · AI TalentFlow specializes in accelerating startup growth, scaling enterprise solutions, and nurturing the career growth of the individuals who po ...
Databricks Engineer

1 week ago

AI Talent Flow New York, United States

Job Description · Job Description AI TalentFlow: Databricks EngineerFuel Innovation in Financial Services with Data Engineering Expertise · About AI TalentFlow: · AI TalentFlow specializes in accelerating startup growth, scaling enterprise solutions, and nurturing the career grow ...
Azure Data Engineer with Databricks Admin

3 weeks ago

Diverse Lynx Iselin, United States

Role: Azure Data Engineer with Databricks Admin · Location: Iselin NJ / New York / Chicago IL (Hybrid Mode) · Experience : 10 + Years · Job Type: Contract · The perfect candidate has to have a mix of Azure Administration skills and Databricks setup/configuration/integration sk ...
Databricks Data Engineer

3 weeks ago

Smart IT Frame New York, United States

Role & Responsibilities Overview: · Develop and optimize ETL pipelines from various data sources using Databricks on cloud (AWS, Azure, etc.) · Experienced in implementing standardized pipelines with automated testing, Airflow scheduling, Azure DevOps for CI/CD, Terraform for inf ...
AWS Databricks Cloud Engineer

2 weeks ago

Cyrten Princeton, United States

AWS Databricks Cloud Engineer - Remote · Location: Remote · Preferred Time Zones: EST, CST, MTN · Rate Type: W2 · Length: 1 to 3 years · Health Benefits: Available to participate in Cyrten's Health Benefits program after 90 Days · 401K: Available to join Cyrten's 401k progra ...
Senior Data Engineer with SAS, Databricks

2 weeks ago

Diverse Lynx Jersey City, United States

Senior Data Engineer with SAS/Databricks/PySpark · Locations Mt Laurel, NJ & Charlotte, NC (Hybrid Work: 3 Days Onsite Per Week) · Required Experience: Years · Primary Tech skills SAS, Databricks, Pyspark · Secondary Tech skills Azure, Synapse Experience in building end to e ...
Databricks Software Engineering Senior Advisor

2 weeks ago

The Cigna Group Morris Plains, United States

Help us lead our future. Get ready for a job that encourages you to think strategically yet stay connected with your teams. Do you have problem-solving or technical pipeline experience? If so, prepare to innovate, create, and inspire. The Databricks Software Engineering Senior Ad ...
Databricks Snowflake Data Engineer(Onsite)

2 weeks ago

Cognizant Technology Solutions Whitehouse Station, United States OTHER

ROLE: Databricks Snowflake Data Engineer(Onsite) · We are Cognizant Artificial Intelligence · Digital technologies, including analytics and AI, give companies a once-in-a-generation opportunity to perform orders of magnitude better than ever before. However, clients need new busi ...
LEAD Azure Databricks Data Engineer with Finance Experience

1 week ago

Delta System & Software, Inc. Jersey City, United States

Position: LEAD Level Azure Databricks Data Engineer with Finance Experience · Duration: 12+ months · Location: Hybrid In Jersey City, NJ (Wednesday & Thursday) from DAY 1 · Rate: $75/hr – W2 · Job Descriptions · AZURE experience: Azure Data Factory (ADF), ADLS Gen 2, Databrick ...
Databricks Architect

2 weeks ago

BSL consulting LLC Jersey City, United States

**Job Role: Databricks Architect** · **Location: Dublin, OH/Jersey City, NJ (Hybrid Role)** · **Job Type: Full Time(Permanent)** · **Skillsets/knowledge required**: · - 8+ years experience in developing and implementing ETL pipelines from various data sources using Databricks on ...
Engineering Manager

1 week ago

Databricks New York, United States

P-1313 · Founded in late 2020 by a small group of machine learning engineers and researchers, MosaicML enables companies to securely fine-tune, train and deploy custom AI models on their own data, for maximum security and control. Compatible with all major cloud providers, the Mo ...
Azure Developer

6 days ago

Barnes & Noble New York, United States

Title: Azure Developer · Category: Information Systems & Technology · EmploymentType: Full-Time · Location: NY-New York (Union Square) · LocationType: corporate · JobLocation: New York, New York 10003 · The Azure Developer position is responsible for ensuring optimal data deliver ...
Genai Research Scientist

6 days ago

Databricks New York, United States

Company Description · At Databricks, we are obsessed with enabling data teams to solve the world's toughest problems, from security threat detection to cancer drug development. We do this by building and running the world's best data and AI platform, so our customers can focus on ...
Head of Document, Ai,

1 week ago

Combined Insurance Jersey City, United States

**Head of Document Ingestion & Engineering** · Chubb is the world's largest publicly traded P&C insurance company and a leading commercial lines insurer in the United States. With operations in 54 countries and territories, Chubb provides commercial and personal property and casu ...
Director/account Manager

2 weeks ago

Tiger Analytics Jersey City, United States

Tiger Analytics is an advanced analytics consulting firm. We are the trusted analytics partner for several Fortune 500 companies, enabling them to generate business value from data. Our consultants bring deep expertise in Data Science, Machine Learning, and AI. Our business value ...
Mongodb Developer

1 week ago

Apptad Inc New York, United States

**Job Title: Apptad -** MongoDB Developer · **Job Location**: Jersey City, NJ/NYC. NY (3 days per week onsite) · **Job Duration**: Full-Time · - This role will be for a Database Developer with prior experience working on NoSQL databases including Mongo. · - Management platform · ...