Jobs
>
Allendale

    Azure Data Engineer - Allendale, United States - Diverse Lynx

    Diverse Lynx
    Diverse Lynx Allendale, United States

    4 days ago

    Default job background
    Description
    Job Title Azure Data Engineer Relevant Experience
    (in Yrs) 5 - 6 yrs Technical/Functional Skills Azure data factory, data bricks, data lake, automation and performance optimization of ETL Experience Required
    • Good Knowledge of Data Brick lakehouse and Azure DataLake concept
    • Knowledge of Data Bricks delta concept- Delta live tables (DLT)
    • Strong hands-on experience in ELT- pipeline development using Azure Data factory and Databricks Autoloader, Notebook scripting and Azure Synapse Activity Copy, Data Flow Task
    • Strong knowledge of metadata-driven data pipeline, metadata management, dynamic logic
    • In-depth knowledge of data storage solutions, including Azure Data Lake Storage (ADLS), and Azure Serverless SQL Pool.
    • Experience with data transformation using Spark, and SQL technologies.
    • Solid understanding of design patterns, and best practices of the cloud stack.
    • Experience with code management and version control using Git or similar tools.
    • Strong problem-solving and debugging skills in ETL workflows and data pipelines.
    • Strong understanding of Azure Data bricks and Azure Synapse internals - features and capabilities.
    • Knowledge of Azure DevOps and continuous integration and deployment (CI/CD) process.
    • Knowledge of data quality and data profiling techniques, with experience in data validation and data cleansing.
    Roles & Responsibilities
    • Conducting technical sessions, design reviews, code reviews, and demos of pipelines and their functionality
    • Developing technical specification for Data pipelines and workflow and getting sign-off from Architect and Stryker leads.
    • Developing, deploying, and maintaining workflows and data pipelines using Azure Data bricks and Azure Synapse.
    • Developing pipeline/notebook for Delta live tables ( DLT) Databricks Auto Loader, Notebook scripting and Azure Synapse Activity Copy, Data Flow Task.
    • Collaborating with data architects, data analysts, and other stakeholders to design and implement ETL solutions that meet business requirements.
    • Writing efficient and high-performing ETL code using PySpark, and SQL technologies.
    • Building and testing data pipelines using Azure Data bricks and Azure Synapse.
    • Ensuring the accuracy, completeness, and timeliness of data being processed and integrated.
    • Troubleshooting and resolving issues related to data pipelines and notebooks.
    • Performance benchmarking of data ingestion and Data flow pipeline/notebook and ensuring consistency
    Generic Managerial Skills Project Planning , Team management, Stakeholders Management

    Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.
  • EmpiRx Health

    Data Engineer

    1 week ago

    EmpiRx Health Montvale, United States

    Job Description · Job DescriptionWho We Are: · EmpiRx Health is the leading clinically-driven, customer-first PBM company that puts the pharmacist at the center of its service model to optimize member care while substantially reducing costs for plan sponsors. · What We Do: · We p ...

  • Insight Global

    Data Engineering Director

    1 day ago

    Insight Global Rockland, United States

    Required Skills and Experience · 4+ years of Data Engineering experience · Experience leading/mentoring a team of junior engineers · Proficiency in SQL and Python · Experience with Cloud technologies (AWS Preferred) · Bachelor's Degree in Computer Science, Data Science, or relat ...

  • Sun Pharma (Taro Pharma)

    Senior Data Engineer

    1 week ago

    Sun Pharma (Taro Pharma) Hawthorne, NY, United States

    As a member of our Software Engineering Group, we look first and foremost for people passionate about solving business problems through innovation and engineering practices. You'll be required to apply your depth of knowledge and expertise to all aspects of the software developme ...

  • RedStream Technology

    Data Engineer

    3 weeks ago

    RedStream Technology Elmwood Park, United States

    Data Engineer / Architect · Long Term Contract Role · Hybrid (Northern NJ), 3 days a week in the office · RedStream Technology is recruiting for a candidate that has Data Architecture experience and wants to continue maintaining their development chops by maintaining some hands-o ...

  • RedStream Technology

    Data Engineer

    6 days ago

    RedStream Technology Elmwood Park, United States

    Data Engineer · Elmwood Park, NJ (Hybrid, 3 days on-site per week) · RedStream Technology is recruiting for a Data Engineer to work with our client, a leading mdeical services provider. The Data Engineer needs to be proficient with Matillion, Snowflake, and dbt in a hybrid Azur ...

  • Dice

    Sr Data Engineer

    1 week ago

    Dice Montvale, United States

    Dice is the leading career destination for tech experts at every stage of their careers. Our client, Orion Business Innovations Careers, is seeking the following. Apply via Dice today · Sr Data Engineer - Pyspark / Databricks/Senior PySpark Developer · Responsibilities : · The ...

  • Career Developers, Inc.

    SQL Data Engineer

    3 weeks ago

    Career Developers, Inc. Montvale, United States

    SQL Data Engineer (4-6 years of experience) · Location : Montvale, NJ - Hybrid 2 days a week · Salary : K · Summer hours, great perks, and benefits · Please note the following:This person must be a US Citizen or be a Green Card holder to be considered for this role. · Relocation ...

  • Behaviorally

    Data Engineer

    2 weeks ago

    Behaviorally Teaneck, United States

    Title: Data Engineer · Full-time · We do not accept H1B/H1B Transfer/OPT · Hybrid role, mostly work from home; commute to the office as requested · Minimum Qualifications: · The role is ideal for someone who thrives in a fast-paced, cutting-edge technology environment. · Proven ...

  • Accolite Digital

    Data Engineer

    5 days ago

    Accolite Digital New York, United States

    Bounteous x Accolite makes the future faster for the world's most ambitious brands. Our services span Strategy, Analytics, Digital Engineering, Cloud, Data & AI, Experience Design, and Marketing. We are guided by Co-Innovation, our proven methodology of collaborative partnership. ...

  • Storm3

    Data Engineer

    4 days ago

    Storm3 New York, United States

    Lead Data Engineer · Series B, Startup · New York (Hybrid) · $200, ,000 + Significant Equity + Bonus · The company is a leading provider of virtual care to help tackle substance use. · ‍ Responsibilities: · Develop and maintain data pipelines for extracting, transforming and lo ...

  • Oxford Knight

    Data Engineer

    1 week ago

    Oxford Knight New York, United States Full time

    Data Engineer wanted for systematic arm of globally recognised hedge fund to join the growing Data Engineering team where you will support the Commodities business. This opportunity will give you the chance to design, implement and evolve the data platform, including pipeline, re ...

  • Action Tech

    Data Engineer

    3 weeks ago

    Action Tech New York, United States

    This is a full time, direct hire position that requires 3 to 4 days a week onsite in NYC · All applicants must be local to the NY, NJ, CT area · We are looking for an outstanding Data Engineer to join our New York-based team who can help build the infrastructure to make data a ce ...

  • YASH Technologies

    Data Engineer

    3 weeks ago

    YASH Technologies Jersey City, United States

    Hi, · We at Yash Technologies are looking for Data Engineer, if you are looking for new opportunity, please share your updated resume. · Requirement Details: · Location: Jersey City, NJ · Work Authorizations: Citizen, GC EAD, Green Card, H4 EAD · Position Type: Contract · Job Ti ...

  • YASH Technologies

    Data Engineer

    3 weeks ago

    YASH Technologies Jersey City, United States

    Looking for 10+ yrs Senior Resource · Mandatory Skills · Oracle · Mongo DB · Data Engineer · NO SQL database · Data Modeling · The Senior Database Engineer(MongoDB) will lead complex or critical database management initiatives that typically involve multiple disciplines and busin ...

  • Benchmark IT - Technology Talent

    Data Engineer

    1 day ago

    Benchmark IT - Technology Talent New York, United States

    Our direct client, a fast-growing FinTech firm in New York City, is looking for a Data Engineer. In this role, you will work with Sales, Marketing, and Product teams to define, calculate, and grow their key operating metrics (e.g. sales, conversions, retention). This individual w ...

  • Montefiore Medical Center

    data engineer

    2 weeks ago

    Montefiore Medical Center The Bronx, United States

    The role of the Data Engineer is to support the development of informatics capability designed to optimize patient outcomes and increase operational efficiency at Montefiore. The incumbent is responsible for developing and maintaining data structures, technology architectures, as ...

  • Montefiore Medical Center

    data engineer

    2 weeks ago

    Montefiore Medical Center The Bronx, United States Regular Full time

    The role of the Data Engineer is to support the development of informatics capability designed to optimize patient outcomes and increase operational efficiency at Montefiore. The incumbent is responsible for developing and maintaining data structures, technology architectures, as ...

  • Jesica

    Data Engineer

    4 days ago

    Jesica New York, United States

    About: · Jesica is a recruiting agency that utilizes AI to source, screen and match candidates to right career opportunities. We work on behalf on our clients who are actively seeking qualified candidates to these roles. If you are a candidate either actively looking or just brow ...

  • Jarvis Walker

    Data Engineer

    2 weeks ago

    Jarvis Walker Jersey City, United States

    Data Engineer · We are seeking an enthusiastic and experienced Data Engineer to join our team. As a Data Engineer, you will be a key member of our product development team. You will play a pivotal role in turning data into actionable models that our company uses to create new lin ...

  • Coda Search│Staffing

    Data Engineer

    2 weeks ago

    Coda Search│Staffing New York, United States

    Our client, a top hedge fund in Midtown is looking for a Data Engineer to join their Strategic Finance team. This team conducts analysis to drive decision making across the firm. · The ideal candidate will have 3-5 years experience. · Experience: · Degree in a quantitative disc ...