Azure Developer - New York, United States - Barnes & Noble

Barnes & Noble

Verified Company

New York, United States

3 weeks ago

Posted by:

Mark Lane

beBee recruiter

Description

Title:
Azure Developer

Category:
Information Systems & Technology

EmploymentType:
Full-Time

Location:
NY-New York (Union Square)

LocationType:
corporate

JobLocation:
New York, New York 10003

The Azure Developer position is responsible for ensuring optimal data delivery architecture is consistent throughout ongoing projects.

The role requires solid technical skills in Azure Data Factory data pipeline utilizing Azure Databricks Notebooks and SQL Stored procedure.

This role will be focused on expanding and optimizing our data and data pipeline architecture.

You can expect to spend roughly 50% of your time dedicated to creating new pipelines that involve ADF, Databricks Notebooks, and Synapse Stored Procedure, the remaining 30% in Optimizing the existing workflows, and the remaining 20% on support production jobs every day.

The Business Intelligence team focuses on building enterprise level business intelligence platforms, migrating and upgrading the legacy systems to support our business intelligence reporting and analytics.

We work closely with the merchandise and financial analysts on reporting and analytics needs.

An employee in this position can expect a starting rate between $125,000 - $130,000 annually, depending on experience, seniority, geographic locations, and other factors permitted by law.

WhatYouDo:

Create and maintain optimal Azure Data Factory data pipeline utilizing Azure Databricks Notebooks
Develop Azure Databricks notebooks for transformation using PySpark, and SparkSQL in Lakehouse architecture.
Manage endtoend delivery by investigating problem areas and working crossfunctionally with product manager & other stakeholders.
Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, and redesigning infrastructure for greater scalability, optimal cost, and performance.
Design the right infrastructure/compute configuration for optimal extraction, transformation, and loading of data from a wide variety of data sources into ADLS, Databricks, and Synapse.
Implement scalable and sustainable data engineering solutions using tools such as Databricks, Azure, Apache Spark, and Python. The data pipelines must be created, maintained, and optimized as workloads move from development to production for specific use cases.
Drive optimization, testing, and tooling to improve the quality of solutions.

Knowledge&Experience:

Experience handling large and complex sets of data from various sources and databases.
Solid understanding of concepts of data warehouses and programming.
Proven handson Experience creating pipelines and workflow utilizing Azure Data Factory, Azure Databricks, and Synapse
Experience with writing complex SQL Queries, User Defined Functions, Stored procedures, and Materialized views.
Experience supporting oncall businesscritical production systems.
3+ years of experience in a Data Engineering environment with handson experience developing ADF (Azure Data Factory) and Azure Databricks pipelines for an enterprise solution.
3+ years of experience in writing code in Databricks using Python to transform, and manipulate (ETL/ELT) data, along with managing objects in Notebooks, Data Lake, ADLS, and Azure Synapse.
Minimum of 2 years' experience working in a large Retail enterprise and understanding of Retailbased data and reporting models.
Must actively participate in 24x7 SRE oncall rotations and escalation workflows.
Undergraduate degree required (Graduate degree preferred) in Computer Science, Statistics, Informatics, Information Systems, or another quantitative field.
Must be available for East Coast hours of operation.

EeoStatement:
Barnes & Noble is an equal opportunity and affirmative action employer.

All qualified applicants will receive consideration for employment without regard to age, race, color, ancestry, national origin, citizenship status, military or veteran status, religion, creed, disability, sex, sexual orientation, marital status, medical condition as defined by applicable law, genetic information, gender, gender identity, gender expression, hairstyle, pregnancy, childbirth and related medical conditions, reproductive health decisions, or any other characteristic protected by applicable federal, state, or local laws and ordinances.