Jobs
>
Jersey City

    Databricks Data Architect - Jersey City, United States - Smart IT Frame LLC

    Smart IT Frame LLC
    Smart IT Frame LLC Jersey City, United States

    3 weeks ago

    Default job background
    Technology / Internet
    Description

    Role & Responsibilities Overview:

     Develop and optimize ETL pipelines from various data sources using Databricks on cloud (AWS, Azure, etc.)

     Experienced in implementing standardized pipelines with automated testing, Airflow scheduling, AzureDevOps for CI/CD, Terraform for infrastructure as code, and Splunk for monitoring

     Continuously improve systems through performance enhancements and cost reductions in compute and storage

     Data Processing and API Integration: Utilize Spark Structured Streaming for real-time data processing and integrate data outputs with REST APIs

     Lead Data Engineering Projects to manage and implement data-driven communication systems

     Experienced with Scrum and Agile Methodologies to coordinate global delivery teams, run scrum ceremonies, manage backlog items, and handle escalations

     Integrate data across different systems and platforms

     Strong verbal and written communication skills to manage client discussions

    Candidate Profile:

     8+ years experience in developing and implementing ETL pipelines from various data sources using Databricks on cloud

     Based out of US

     Some experience in insurance domain/ data is must

     Programming Languages – SQL, Python

     Technologies - IaaS (AWS or Azure or GCP), Databricks platform, Delta Lake storage, Spark (PySpark, Spark SQL).

    o Good to have - Airflow, Splunk, Kubernetes, Power BI, Git, Azure Devops

     Project Management using Agile, Scrum

     B.S. Degree in a data-centric field (Mathematics, Economics, Computer Science, Engineering or other science field), Information Systems, Information Processing or engineering.

     Excellent communication & leadership skills, with the ability to lead and motivate team members

  • Pinnacle Technical Resources

    Data Architect

    3 weeks ago

    Pinnacle Technical Resources Jersey City, United States

    **Data Architect** · **Jersey City, NJ** · **W2 only - No C2C** · *** · - Highly proficient in data architecture disciplines with proficiency in the other disciplines. · - Highly proficient in the architecture and design of at least a single functional area. · **Roles and Respons ...

  • CENTSTONE SERVICES LLC

    Data Architect

    1 week ago

    CENTSTONE SERVICES LLC Jersey City, United States

    **data Architect - 5+ years** · **Data modeling - Erwin** · **Data Authority concept** · **understating data concepts** · **Data Catalog** · Risk background is plus. · AWS, private cloud · Data catalogs, RDBMS · Hybrid - 3 days a week - flexible in Jersey City · Job Family Descri ...

  • Virtusa

    Data Architect

    1 week ago

    Virtusa Jersey City, United States

    **Job Description**: · **Responsibilities**: · Architect and Design scalable Data and AI solutions. Evaluate technologies, tools, and platforms. · Identify and evaluate emerging technologies, such as Data and AI, and assess their potential impacts and benefits and present it to I ...

  • MAPSYS INC.

    Data Architect

    1 week ago

    MAPSYS INC. New York, United States

    Our New York based client is seeking a motivated and ambitious mission-driven professional interested in a challenging role that will help them develop their career in data strategy, data engineering, reporting, and analytics. · The Data Architect will be responsible for the Data ...

  • Trident Consulting

    Data Architect

    2 weeks ago

    Trident Consulting Jersey City, United States

    Trident Consulting is seeking a " Data Architect " for one of our clients in "Jersey City, NJ &Boston, MA ". · Role:Data Architect · Location: Jersey City NJ / Boston MA- Hybrid (onsite) · Duration : Contract / Fulltime · Job Description · We are seeking a Data Architect to he ...

  • Acunor

    Data Architect

    2 weeks ago

    Acunor Jersey City, United States

    Acunor is seeking a Data Architect specializing in AWS technologies. This is a full-time hybrid opportunity located in Jersey City, NJ. Interested candidates are encouraged to apply with their most recent resume to · Position: Sr. Data Architect · Location: New Jersey (Hybrid) · ...

  • BCforward

    Data Architect

    3 weeks ago

    BCforward Jersey City, United States

    Data Architect · BCforward is currently seeking highly motivated Data Architect opportunity in Jersey city, NJ · Our client is one of the oldest financial institutions and offers innovative financial solutions to millions of consumers, small businesses and many of the world's mo ...

  • Excelon Solutions

    Data Architect

    3 weeks ago

    Excelon Solutions Jersey City, United States

    Job Description · Job Description · Job Description: · data Architect - 5+ years · Data modeling - Erwin · Data Authority concept · understating data concepts · Data Catalog · Risk background is plus. · AWS, private cloud · Data catalogs, RDBMS · Job Family Description: · High ...

  • Pinnacle Group, Inc.

    Data Architect

    2 weeks ago

    Pinnacle Group, Inc. Jersey City, United States

    W2 only - No C2C · Must Have: Heavy risk background, Erwin, Data Modeling, AWS Cloud · Data authority, data use cases, great communication skills, Data Access · Data initiative for corporate risk space, market risk, · Corporate risk driven architecture space. · Job Description ...

  • HexaQuEST Global, Inc.

    Data Architect

    2 weeks ago

    HexaQuEST Global, Inc. Jersey City, United States

    We are looking for Data architect (Modeller) with 10+ Years experience and will be responsible for the overall solution design including high-level data architecture, data model and load patterns. · • Strong Data Modelling skills and in particular experience with data vault · • ...

  • Beckman Coulter Diagnostics

    Lead Algorithm/data Architect, Artificial

    1 week ago

    Beckman Coulter Diagnostics New York, United States

    At first glance, you'll see that for more than 80 years we've been dedicated to advancing and optimizing the laboratory to move science and healthcare forward. Join a team where you can be heard, be supported, and always be yourself. We're building a culture that celebrates backg ...

  • Entrans Technologies

    Data Architect

    5 days ago

    Entrans Technologies Teaneck, United States

    If you're looking to change the trajectory of your career, make an impact on Day One, develop custom software on the best technology around - and maybe even make people's lives easier -- then you belong here, with us. · We are looking for **Senior Data Architect to join us** · ** ...

  • Tiger Analytics

    Data Architect

    1 week ago

    Tiger Analytics Jersey City, United States

    Job Description · Job DescriptionTiger Analytics is pioneering what AI and analytics can do to solve some of the toughest problems faced by organizations globally. We develop bespoke solutions powered by data and technology for several Fortune 100 companies. We have offices in mu ...

  • HIGH BRIDGE CONSULTING LLC

    Data Architect

    5 days ago

    HIGH BRIDGE CONSULTING LLC Paramus, United States

    **Our client is the** global leader in optimized resource management**. They have nearly 200,000 employees worldwide. The client designs and provides water, waste and energy management solutions which contribute to the sustainable development of communities and industries.** · ** ...

  • Northwell Health

    Data Architect

    2 weeks ago

    Northwell Health New Hyde Park, United States

    **Job Description**: · Coordinates the logical and physical design and development of the enterprise data architecture in support of the Enterprise Data Repository and Business Intelligence infrastructure. Provides strategic direction and input for policies on best practices for ...

  • Citi

    Client - Mca Architect/ Data Quality and Reporting

    2 weeks ago

    Citi New York, United States

    **Client - MCA Architect/ Data Quality and Reporting Lead (SVP)** · **Description** · - The Client organization was established to drive enterprise-wide approaches to client coverage, identifying and filling in gaps or reducing duplication to ensure consistency throughout the fir ...

  • AllSTEM Connections

    Data Architect

    3 weeks ago

    AllSTEM Connections Jersey City, United States

    Client- Largest Financial Organization · Location- Jersey City · 12 months contract to direct hire opportunity · $60 to $70 an hour depending on experience · Is your CV ready If so, and you are confident this is the role for you, make sure to apply asap. · Team/Background: ...

  • Resource Logistics

    Data Architect

    2 weeks ago

    Resource Logistics Jersey City, United States

    Data Clienthitect · Jersey City, NJ · Contract · (Remote work) · Detailed JD · • Determine the scope of Data migration. · • Document the data migration strategy. · • Document Data Migration Protocol to go along with the data migration strategy. · • Produce the Data Migration S ...

  • Spectrum Dynamics

    Data Architect

    2 weeks ago

    Spectrum Dynamics Edison, United States

    Job ID: 13984; Location(s): Attendorn · Your tasks · Building and managing a global data science platform · Creating guidelines and documentation for using the platform · Further development of the existing data platform · Defining requirements for the data engineering team ...

  • The Astor Group

    Data Architect

    1 week ago

    The Astor Group New York, United States

    Our Firm is responding to the growing demand for alternative data by modernizing their process of building data pipelines. In doing so, we are looking for a senior data architect/engineer: · The Senior Azure Data Architect/Engineer s main responsibilities will be: · Designing and ...