Databricks Architect - New Jersey, United States - Acunor

Acunor New Jersey, United States

1 week ago

Description

Acunor is looking for Databricks Architect for one of its premier clients. it is fulltime and hybrid opportunity at NJ / OH. interested candidates are encouraged to apply with the most recent resume to

Position: Databricks Architect

Location: New Jersey / Dublin, OH (Hybrid)

Full Time position

Role & Responsibilities Overview:

Develop and optimize ETL pipelines from various data sources using Databricks on cloud (AWS, Azure, etc.)
Experienced in implementing standardized pipelines with automated testing, Airflow scheduling, Azure DevOps for CI/CD, Terraform for infrastructure as code, and Splunk for monitoring
Continuously improve systems through performance enhancements and cost reductions in compute and storage
Data Processing and API Integration: Utilize Spark Structured Streaming for real-time data processing and integrate data outputs with REST APIs
Lead Data Engineering Projects to manage and implement data-driven communication systems
Experienced with Scrum and Agile Methodologies to coordinate global delivery teams, run scrum ceremonies, manage backlog items, and handle escalations
Integrate data across different systems and platforms
Strong verbal and written communication skills to manage client discussions

Candidate Profile:

Required skills:

Azure Databricks. Pyspark, SQL, CI/CD Pipelines for Databricks, ETL Processes, Project Management and Delta Lake Storage.

For this one, we need an experienced architect that is an expert in the whole of Microstrategy environments, and has lead an end-to-end implementation.

8+ years experience in developing and implementing ETL pipelines from various data sources using Databricks on cloud
Based out of US
Some experience in insurance domain/ data is must
Programming Languages – SQL, Python
Technologies - IaaS (AWS or Azure or GCP), Databricks platform, Delta Lake storage, Spark (PySpark, Spark SQL).
o Good to have - Airflow, Splunk, Kubernetes, Power BI, Git, Azure Devops
Project Management using Agile, Scrum
B.S. Degree in a data-centric field (Mathematics, Economics, Computer Science, Engineering or other science field), Information Systems, Information Processing or engineering.
Excellent communication & leadership skills, with the ability to lead and motivate team members
Ability to work independently with some level of ambiguity and juggle multiple demands

Databricks Architect

2 weeks ago

BSL consulting LLC Jersey City, United States

**Job Role: Databricks Architect** · **Location: Dublin, OH/Jersey City, NJ (Hybrid Role)** · **Job Type: Full Time(Permanent)** · **Skillsets/knowledge required**: · - 8+ years experience in developing and implementing ETL pipelines from various data sources using Databricks on ...
Databricks Architect

2 weeks ago

iShare Inc. New Jersey, United States

Hiring on Behalf of a Client for the full time W2 Hire role · Location - 1) East ( CT, MA, NJ, NY) · 2) Midwest (OH,IL) · Candidate should be willing to travel 4-5 days a office as a must requirement. · Role & Responsibilities Overview: · Develop and optimize ETL pipelines fro ...
Databricks Architect

2 weeks ago

Inizio Partners Jersey City, United States

About the job Databricks Architect · Role & Responsibilities Overview: · Develop and optimize ETL pipelines from various data sources using Databricks on cloud (AWS, Azure, etc.) · Experienced in implementing standardized pipelines with automated testing, Airflow scheduling, A ...
Databricks Architect

1 week ago

Zortech Solutions Jersey City, United States

Job Description · Job DescriptionRole: Databricks Architect · Location: NJ, New york · Experience: 8 to 15 · Must Have: · Azure Databricks. Pyspark, SQL, CI/CD Pipelines for Databricks, ETL Processes, Project Management, Delta Lake Storage · Nice to Have: · Airflow, Splunk, Kube ...
Databricks Architect

2 days ago

ishare Inc Jersey City, United States

Hiring on behalf of a client for full time , direct hire role for · Databricks Architect / · 1) Hybrid in Jersey City · 2) Dublin , OH (Hybrid) | requres 2 days in month onstie to Dublin ( Travel Expenses Paid) · Role & Responsibilities Overview: · Develop and optimize ETL pipe ...
Databricks Architect

1 week ago

Inizio Partners Jersey City, United States

Role & Responsibilities Overview: · Develop and optimize ETL pipelines from various data sources using Databricks on cloud (AWS, Azure, etc.) · Experienced in implementing standardized pipelines with automated testing, Airflow scheduling, Azure DevOps for CI/CD, Terraform for inf ...
Databricks Architect

1 week ago

Inizio Partners Jersey City, United States

Role & Responsibilities Overview: · Develop and optimize ETL pipelines from various data sources using Databricks on cloud (AWS, Azure, etc.) · Experienced in implementing standardized pipelines with automated testing, Airflow scheduling, Azure DevOps for CI/CD, Terraform for inf ...
Databricks Architect

2 weeks ago

Inizio Partners Corp Jersey City, United States

Role & Responsibilities Overview: · Develop and optimize ETL pipelines from various data sources using Databricks on cloud (AWS, Azure, etc.) · Experienced in implementing standardized pipelines with automated testing, Airflow scheduling, Azure DevOps for CI/CD, Terraform for in ...
Databricks Architect

5 days ago

Inizio Partners Corp Jersey City, United States

Job Description · Job DescriptionRole & Responsibilities Overview: · Develop and optimize ETL pipelines from various data sources using Databricks on cloud (AWS, Azure, etc.) · Experienced in implementing standardized pipelines with automated testing, Airflow scheduling, Azure De ...
Databricks Data Architect

2 weeks ago

Smart IT Frame LLC Jersey City, United States

Role & Responsibilities Overview: ·  Develop and optimize ETL pipelines from various data sources using Databricks on cloud (AWS, Azure, etc.) ·  Experienced in implementing standardized pipelines with automated testing, Airflow scheduling, AzureDevOps for CI/CD, Terraform for ...
Senior Azure Databricks Architect

2 weeks ago

Tiger Analytics New York, United States

Tiger Analytics is a fast-growing advanced analytics consulting firm. Our consultants bring deep expertise in Data Science, Machine Learning and AI. We are the trusted analytics partner for several Fortune 100 companies, enabling them to generate business value from data. Our bus ...
Senior Data Architect, Databricks Expert

1 week ago

Harnham New York, United States

Senior Data Architect · Fully Remote · 6-Month Contract, possible extensions · $95-$115/hr · It's time to utilize your skills in software and data engineering to drive scientific and technological life-changing solutions within the pharmaceutical industry. This global company ...
Data Architect

2 days ago

The Astor Group New York, United States

Our Firm is responding to the growing demand for alternative data by modernizing their process of building data pipelines. In doing so, we are looking for a senior data architect/engineer: · The Senior Azure Data Architect/Engineer s main responsibilities will be: · Designing and ...
Databricks Engineer

1 week ago

EZDynamic, LLC New York, United States

No Visa sponsorship (Only GC holders or U.S. Citizens may apply) · - Please answer all questions provided. Incomplete submissions will NOT be reviewed - - · Databricks Engineer · Role & Responsibilities · Designing, building, and maintaining medallion architecture-based data pipe ...
Sr. Solutions Architect

1 week ago

Databricks New York, United States

FEQ125R103 · Solutions Architects at Databricks lead the growth of the Databricks Unified Analytics Platform. As a team, we have expertise in cloud platforms, data engineering, data analytics, and data science and machine learning. As a member of our team, you will exercise and ...
Sr. Solutions Architect

2 weeks ago

Databricks New York, United States

FEQ125R103 · Solutions Architects at Databricks lead the growth of the Databricks Unified Analytics Platform. As a team, we have expertise in cloud platforms, data engineering, data analytics, and data science and machine learning. As a member of our team, you will exercise and ...
Healthcare AI/ML Architect

2 weeks ago

RIIM New York, United States

Requirement: · Proven experience with project & data architecture or integration architect, with a strong focus on designing and implementing complex integration solutions in healthcare domain · Strong knowledge of Git, CI/CD, Terraform. · Must have experience in EPIC Systems. · ...
Sr. Data Architect Azure

2 weeks ago

Diverse Lynx New York, United States

Title Sr. Data Architect Azure & Databricks Duration 12 Months Location New York / Weehawken, NJ (Day 1 onsite ) Mandatory Skills Databricks, Azure Datalake, PySpark, Java. No of Open Positions 1 · Job Description : · Minimum 12+ years of IT experience and at least 5+ years i ...
Cloud Data Solutions Architect

2 weeks ago

Fides Info Sys, Inc. New York, United States

FIDESis looking for a Cloud Data SolutionsArchitectwith experience working in the hospital/health systemprovider spacefor a contract position. · The Cloud Data Solutions Architect is responsible for collaborating with the client, including various data team stakeholders, to advi ...
Databricks Certified

2 weeks ago

New York Technology Partners New York, United States

Title: Databricks Certified - Data Architect and Machine Learning · Location: Remote (working hours as per EST time zone) · Position Type: Contract position · Responsibilities: · Databricks Certified Machine Learning Professional is required · Preferred to have current credential ...