Jobs
>
New York City

    Data Engineer - New York, United States - The New York Public Library

    The New York Public Library
    The New York Public Library New York, United States

    3 weeks ago

    Default job background
    Description
    Overview
    This is a temporary four-year grant-funded position.
    The New York Public Library is looking to expand our Data Engineering team with a new engineer. In this role you'll have the opportunity to contribute to new and existing data pipelines that help the library understand our activities and support many staff members in making important decisions for the direction of NYPL. The focus of this role is on expanding our data collection while maintaining data fidelity, accuracy and privacy (see our Privacy Policy here) in our data warehouse. A special focus of this role will be for the collection of data from our public domain Digital Research Books Project, which is helping increase access to a wide range of materials not previously available online.
    We are looking for someone we can count on to:Own :
    • Data pipelines and codebases to ensure data consistency and access that can help drive decision making at NYPL
    • Data policies that can help regulate data access and create a consistent picture of NYPL's activities
    Teach:
    • Help NYPL staff understand the usefulness, and limitations, of collected data and how to use it to reach their goals
    • Collaborate with other NYPL engineers to connect data pipelines to new and existing projects
    Learn:
    • Work with product owners to understand available data and how it may be accessed
    • Follow new developments in data engineering and apply these best practices to data engineering at NYPL
    Improve:
    • Collaborate with other NYPL engineers to find best practices and implement new skills into our data engineering work
    • Document existing and new data pipelines, helping our data engineering team communicate the success of our work
    Some expectations for this role are that within:1 month , this person will:
    • Become familiar with the existing data management systems and the pipelines that have already been created
    • Understand the data that NYPL is collecting, their sources and their significance
    • Meet with key stakeholders in Digital and other departments to understand their roles in this work
    • Develop an understanding of Digital Research Books (DRB) and its data requirements
    3 months, this person will:
    • Be comfortable both ingesting and extracting data in our data warehouse
    • Begin building understanding of the systems that connect to the warehouse with the help of of data engineering team members
    • Work on our existing ETL systems to improve and extend them
    6 months and beyond, this person will:
    • Create new pipelines to add data from new sources to our data warehouse
    • Take ownership of key data pipelines and reporting requirements
    • Develop strong relationships with other engineers, product and project managers and other stakeholders outside of digital
    • Contribute to delivering on NYPL Digital's strategic goals for data collection
    • Help create automated reports on key metrics that support NYPL's annual goals
    • Grow data engineering as a unit within NYPL Digital
    Responsibilities:
    • Understand data engineering team priorities and requirements for data collection, reporting, and analysis
    • Work with the Data Engineering Product and Project Managers to understand the core KPIs they are being asked to collect
    • Collaborate with other engineers across the department to understand project requirements and contribute to the designing of complex ETL pipelines
    • Communicate with stakeholders from other NYPL Departments to understand desired data collection, requirements and limitations
    • Support staff in generating regular data reports, including fetching data from the data warehouse if necessary
    • Help ensure best practices-based development of data pipelines and other tools, with the goal of increasing the capacity and reliability of these pipelines

    Required Education, Experience & Skills

    Required Education & Certifications
    • Bachelor's Degree - OR - 5+ years of hands-on development experience on relevant tech stack
    Required Experience
    • 5+ years of hands-on development experience on relevant tech stack
    Required Skills
    • 3+ years of software engineering experience with focus on data aggregation and analysis pipelines
    • Production experience with Python
    • Excellent knowledge of relational databases
    • Familiarity with Data Warehouse technologies (such as AWS's RedShift)
    • Proficiency in producing and consuming spreadsheets (Excel/CSV/Smartsheet)
    • Strong knowledge of the design & use of APIs, particularly using REST
    • Experience with cloud platforms (AWS strongly preferred)
    • The ability to work independently and proactively, as well as to collaborate with colleagues around Digital and the rest of the library
    Managerial/Supervisory Responsibilities
    • None

    More...

    Core Values
    All team members are expected and encouraged to embody the NYPL Core Values:
    • Be Helpful to patrons and colleagues
    • Be Resourceful in solving problems
    • Be Curious in all aspects of your work
    • Be Welcoming and Inclusive
    Work Environment
    • Office Setting
    • Hybrid work environment; requires onsite work in NYC - not remote
    Physical Duties
    • Limited physical effort is required
    • May require travel within NYC
    Pre-PlacementPhysical Required?
    No

    Union/Non Union
    Non-Union

    FLSA Status
    Exempt

    Schedule Monday - Friday, 9am - 5pm

    This job description represents the types and levels of responsibilities that will be required of the position and shall not be construed as a declaration of all of the specific duties and responsibilities for the role. Job duties may change if Library priorities change. Employees may be directed to perform job-related tasks other than those specifically presented in this description as needed.

    The New York Public LibrarySalary Statement At the Library, we believe that pay transparency and pay equity are important to ensuring we source the best candidates and keep the best employees. When making a determination as to the appropriate salary for a candidate, we consider a variety of factors such, including, but not limited to, the position requirements, the skills, prior experience, and educational background required or preferred for the job, the scope and impact of the role within the organization, internal peer equity, and the candidate's specific training, experience, education level, and skills. No single factor is conclusive; the Library reserves the right to consider any and all relevant factors and make a decision consistent with its policies.
    Union Salaries are determined by collective bargaining agreement(s).
  • Understood

    Data Engineering

    2 weeks ago

    Understood New York, United States

    **About Understood**: · Understood is a nonprofit focused on shaping the world for difference. We raise awareness of the challenges and strengths of people who learn and think differently. Our resources help people navigate challenges, gain confidence, and find support and commun ...

  • EQUINOX

    Engineering Contractor, Data

    2 weeks ago

    EQUINOX New York, United States Freelance

    **Engineering Contractor, Data**: · Overview · **OUR STORY** · Equinox Group is a high growth collective of the world's most influential, experiential, and differentiated lifestyle brands. We restlessly seek what is next for maximizing life - and boldly grow the lifestyle brands ...

  • FanDuel

    Data Engineering Director

    2 weeks ago

    FanDuel New York, United States

    **ABOUT FANDUEL** · FanDuel Group ("FanDuel") is an innovative sports-tech entertainment company that is changing the way consumers engage with their favorite sports, teams, and leagues. The premier gaming destination in the United States, FanDuel consists of a portfolio of leadi ...

  • LTIMindtree

    Specialist - Data Engineering

    2 weeks ago

    LTIMindtree New York, United States

    **Job Req Id**:1287937 · - **About Us**: · - **Job Title**:Specialist - Data Engineering (Geneva Developer) · - **Work Location**: New York, NY days onsite/week) · experience as developer. · - Strong functional experience in financial industry and Portfolio Accounting System Gene ...

  • STV Group

    Junior Data Engineering Specialist

    1 week ago

    STV Group New York, United States

    We are seeking a talented and motivated Junior Data Engineering Specialist to join our dynamic Digital Advisory team. As a Junior Data Engineering Specialist, you will play a key role in designing, developing, and maintaining data pipelines and systems to support our data-driven ...

  • CBRE

    IT Data Center Engineer

    3 weeks ago

    CBRE New York, United States

    Teilzeit (20 Wochenstunden) | unbefristet · Die Technische Universität Wien ist Österreichs größte Forschungs- und Bildungseinrichtung im technisch- naturwissenschaftlichen Bereich und leistet seit mehr als 200 Jahren einen unverzichtbaren Beitrag zur Sicherung der international ...

  • ESB Technologies

    Data Engineer

    2 weeks ago

    ESB Technologies New Jersey, United States

    Only apply if you are willing to W2 · Job Title: Senior Azure Data Engineer · Location: AZ, TX, NJ, NY, FL, (Any of these mentioned locations) · Job Description: · Position Overview: We are seeking a highly skilled and experienced Azure Data Engineer to join our team as a senior ...

  • Hunter Bond

    Data Engineer

    1 week ago

    Hunter Bond New York, United States

    Job title: Data Engineer · Client: Elite Quantitative Trading Firm · Salary: Up to $2500 p/d · Location: New York · My client are seeking a Data Engineer to own the design and implementation of data solutions, with previous expertise in data extraction, transformation, and loadin ...

  • Oakridge Staffing

    Data Engineer

    3 weeks ago

    Oakridge Staffing New York, United States

    Global hospitality company is looking for an experienced Data Engineer for their Midtown NYC headquarters. · Responsibilities: · Lead the in-house development of ETL/ELT data pipelines and data science projects. · Create and own data products, such as a recommendation engine or ...

  • Oxford Knight

    Data Engineer

    3 weeks ago

    Oxford Knight New York, NY, United States Full time

    Data Engineer wanted for systematic arm of globally recognised hedge fund to join the growing Data Engineering team where you will support the Commodities business. This opportunity will give you the chance to design, implement and evolve the data platform, including pipeline, re ...

  • iCapital

    Data Engineer

    1 week ago

    iCapital New York, United States

    iCapital is powering the world's alternative investment marketplace. Our financial technology platform has transformed how advisors, wealth management firms, asset managers, and banks evaluate and recommend bespoke public and private market strategies for their high-net-worth cli ...

  • JK Partners

    Data Engineer

    1 week ago

    JK Partners New York, United States

    Key Responsibilities · Cloud-First Data Ingestion: Develop and implement data ingestion processes using Python, SQL, and Spark in a cloud-first environment. · Data Modeling and Infrastructure Engineering: Construct robust data models and infrastructure to accommodate a diverse ar ...

  • Net2Source Inc.

    Data Engineer

    3 weeks ago

    Net2Source Inc. New York, United States

    W2 Candidates Only · Position: Data Engineer – III · Locations: New York, NY Hybrid) · Duration: 12+ months Contract · Qualifications: · Expert-level understanding of Agile, SDLC, CI/CD, DevOps, GitOps, and ProdOps is required. · Expert-level expertise in SQL, Python, Scala or si ...

  • Beauty by Imagination (BBI)

    Data Engineer

    3 weeks ago

    Beauty by Imagination (BBI) New York, United States

    Beauty by Imagination · Data Engineer · Hybrid · Position Overview: · We are seeking a highly skilled and motivated Data Engineer to create and manage a data warehouse, integrating data from various sources including NetSuite, IRI, and other sales data. This role is pivotal in ow ...

  • Codex Tech-it

    Data Engineer

    2 weeks ago

    Codex Tech-it New York, United States

    Codex Tech-IT is a leading technology solutions provider specializing in data management and analytics. We are seeking a skilled Data Engineer to join our team and contribute to the development and maintenance of our data infrastructure. With a strong focus on data quality and ac ...

  • Open Systems Technologies

    Data Engineer

    3 weeks ago

    Open Systems Technologies New York, United States

    A financial firm is looking for a Data Engineer to join their team in New York, NY. · Compensation: $150-200k · Responsibilities: · Build data pipelines · Work with data vendors such as Bloomberg, Refinitiv, etc. · Take vendor data and normalize it for firm consumption · Qualifi ...

  • Hunter Bond

    Data Engineer

    1 week ago

    Hunter Bond New York, United States

    Job title: Data Engineer · Client: Elite Fintech · Salary: Up to $2500 p/d · Location: New York · My client are seeking a Data Engineer to own the design and implementation of data solutions, with previous expertise in data extraction, transformation, and loading (ETL) processes ...

  • iO Associates - US

    Data Engineer

    3 weeks ago

    iO Associates - US New York, United States

    An exciting Cloud Cybersecruity start up is looking for a talented Data Engineer to join their team based in New York City. The firm has recently secured new seed funding and are working on not just detecting cloud cybersecurity problems but solving them as well. · The ideal cand ...

  • Searchability®

    Data Engineer

    2 weeks ago

    Searchability® New York, United States

    Data Engineer · WE'RE LOOKING FOR A DATA ENGINEER TO BECOME AN INSTRUMENTAL PART OF OUR NEXT PHASE OF GROWTH · Data Engineer · Hybrid in New York · $150,000 - $180,000 Depending on experience · To apply please email/ · We are a leading innovator in the AI sector, working on mak ...

  • Action Tech

    Data Engineer

    1 week ago

    Action Tech New York, United States

    This is a full time, direct hire position that requires 3 to 4 days a week onsite in NYC · All applicants must be local to the NY, NJ, CT area · We are looking for an outstanding Data Engineer to join our New York-based team who can help build the infrastructure to make data a ce ...