Jobs
>
New York City

    Data Engineer - New York, United States - Columbia University

    Columbia University
    Columbia University New York, United States

    5 days ago

    Default job background
    Description
    • Job Type: Officer of Administration
    • Regular/Temporary: Regular
    • Hours Per Week: 35
    • Salary Range: $85K - $110K
    The salary of the finalist selected for this role will be set based on a variety of factors, including but not limited to departmental budgets, qualifications, experience, education, licenses, specialty, and training. The above hiring range represents the University's good faith and reasonable estimate of the range of possible compensation at the time of posting.

    Position Summary

    Reporting to the Assistant Director of CUIMC Analytics Data Engineering Team, the Data Engineer collaboratively supports and expands CUIMC Analytics' data infrastructure. This involves developing and managing numerous data processes, including, but not limited to, ETL (Extract, Transfer, Load), file movement, Cognos cube builds, and associated supporting technologies. This position works closely with the development team to deploy and test code in a SQL Server based dev/test/prod data warehouse environment. This position will create, schedule, and monitor complex data workflows using automation software, working with internal and external colleagues to quickly troubleshoot and resolve any issues that arise. This individual must be team oriented and possess strong customer service, communication, problem solving, and critical thinking skills.

    Responsibilities

    • Automation: Develop and maintain complex data workflows that keep our data warehouse environment up to date, secure, and accessible using automation and scheduling software, as well as scripting and other technologies - 25%
    • Process Monitoring and Troubleshooting: Monitor the data infrastructure, including all automated processes, for any issues that arise, such as process or system error/failure, quickly addressing the problem as needed - 25%
    • DevOps: Work closely with the Development team to deploy code using GitLab version control in dev/test/prod environment - 15%
    • ETL Development: Develop new and maintain legacy ETL workflows - 15%
    • Database Administration: Develop and maintain SQL Server instances in a dev/test/prod data warehouse environment - 10%
    • Continuous Improvement: Seeks out additional training to improve skills in the team's technologies and new technologies, and to improve soft skills for better client and team relations - 5%
    • Other Duties as Assigned - 5%

    Minimum Qualifications

    • Requires a bachelor's degree in a quantitative discipline, plus 3 years of experience or the equivalent in education and experience.
    • Proficiency in writing and tuning SQL queries and creating SQL objects.
    • Knowledge of a scripting language, such as PowerShell or Python.
    • Experience with ETL applications, such as IBM DataStage, Microsoft SSIS, or others.
    • Experience with automation/scheduling applications, such as Fortra Automate, Automize, or others.
    • Ability to think logically and troubleshoot expeditiously.

    Preferred Qualifications

    • Excellent decision making, critical thinking, and problem-solving skills.
    • Strong organizational skills with an emphasis on communication, detail, and follow-up.
    • Experience in academic or hospital environments.
    • Process improvement and efficiency mindset.
    • Experience with SQL Server.
    • Experience with Docker or other containers.
    • Experience with AWS services, such as EC2, Lambda, IAM.
    • Experience using APIs.

    Equal Opportunity Employer / Disability / Veteran

    Columbia University is committed to the hiring of qualified local residents.

  • Understood

    Data Engineering

    6 days ago

    Understood New York, United States

    **About Understood**: · Understood is a nonprofit focused on shaping the world for difference. We raise awareness of the challenges and strengths of people who learn and think differently. Our resources help people navigate challenges, gain confidence, and find support and commun ...

  • FanDuel

    Data Engineering Director

    2 days ago

    FanDuel New York, United States

    **ABOUT FANDUEL** · FanDuel Group ("FanDuel") is an innovative sports-tech entertainment company that is changing the way consumers engage with their favorite sports, teams, and leagues. The premier gaming destination in the United States, FanDuel consists of a portfolio of leadi ...

  • LTIMindtree

    Specialist - Data Engineering

    4 days ago

    LTIMindtree New York, United States

    **Job Req Id**:1287937 · - **About Us**: · - **Job Title**:Specialist - Data Engineering (Geneva Developer) · - **Work Location**: New York, NY days onsite/week) · experience as developer. · - Strong functional experience in financial industry and Portfolio Accounting System Gene ...

  • Bayer Industry Services (Currenta GmbH & Co. OHG)

    Senior Data Engineer

    2 weeks ago

    Bayer Industry Services (Currenta GmbH & Co. OHG) New York, United States

    Das kannst Du bei uns bewegen · Große Datenmengen · sind Dein Ding – Du unterstützt den Data Steward bei der Anbindung immer neuer Datenquellen an unseren Data Lake, sorgst für die · Transformation der Rohdaten zu "Trusted Data" · und unterstützt die Data Scientists bei der D ...

  • CBRE

    IT Data Center Engineer

    1 week ago

    CBRE New York, United States

    Teilzeit (20 Wochenstunden) | unbefristet · Die Technische Universität Wien ist Österreichs größte Forschungs- und Bildungseinrichtung im technisch- naturwissenschaftlichen Bereich und leistet seit mehr als 200 Jahren einen unverzichtbaren Beitrag zur Sicherung der international ...

  • Stealth AI Startup

    Data Engineer

    2 weeks ago

    Stealth AI Startup New York, United States

    Are you fascinated by the potential of the intersection between artificial intelligence and blockchain technology? Do you thrive in fast-paced environments where innovation is the norm? Interested in being a founding member of an early-stage start-up? · If so, we want you to be ...

  • Oakridge Staffing

    Data Engineer

    1 week ago

    Oakridge Staffing New York, United States

    Global hospitality company is looking for an experienced Data Engineer for their Midtown NYC headquarters. · Responsibilities: · Lead the in-house development of ETL/ELT data pipelines and data science projects. · Create and own data products, such as a recommendation engine or ...

  • Oxford Knight

    Data Engineer

    1 week ago

    Oxford Knight New York, NY, United States Full time

    Data Engineer wanted for systematic arm of globally recognised hedge fund to join the growing Data Engineering team where you will support the Commodities business. This opportunity will give you the chance to design, implement and evolve the data platform, including pipeline, re ...

  • Open Systems Technologies

    Data Engineer

    6 days ago

    Open Systems Technologies New York, United States

    A financial firm is looking for a Data Engineer to join their team in New York, NY. · Compensation: $150-200k · Responsibilities: · Build data pipelines · Work with data vendors such as Bloomberg, Refinitiv, etc. · Take vendor data and normalize it for firm consumption · Qualifi ...

  • iO Associates - US

    Data Engineer

    1 week ago

    iO Associates - US New York, United States

    An exciting Cloud Cybersecruity start up is looking for a talented Data Engineer to join their team based in New York City. The firm has recently secured new seed funding and are working on not just detecting cloud cybersecurity problems but solving them as well. · The ideal cand ...

  • Searchability®

    Data Engineer

    2 days ago

    Searchability® New York, United States

    Data Engineer · WE'RE LOOKING FOR A DATA ENGINEER TO BECOME AN INSTRUMENTAL PART OF OUR NEXT PHASE OF GROWTH · Data Engineer · Hybrid in New York · $150,000 - $180,000 Depending on experience · To apply please email/ · We are a leading innovator in the AI sector, working on mak ...

  • Social Capital Resources

    Data Engineer

    2 weeks ago

    Social Capital Resources New York, United States

    Data Engineer · Hybrid Role 4 days/week NYC · $120-130k base + bonus · Our client, an investment manager in NYC, is looking to add a Jr. Data Engineer to their team. The ideal candidate will have 1-3 years of Data Engineer/Development experience. Financial services experience is ...

  • The New York Public Library

    Data Engineer

    1 week ago

    The New York Public Library New York, United States

    Overview · This is a temporary four-year grant-funded position. · The New York Public Library is looking to expand our Data Engineering team with a new engineer. In this role you'll have the opportunity to contribute to new and existing data pipelines that help the library unde ...

  • New York Blood Center

    Data Engineer

    5 days ago

    New York Blood Center New York, United States

    · Data Engineer · Job Locations · US-NY-New York · Job ID · Category · Information Technology · Minimum Rate · USD $100,000.00/Yr. · Maximum Rate · USD $115,000.00/Yr. · Work Location Type · Hybrid · Overview · At New York Blood Center Enterprises (NYBCe), one of the most ...

  • Numeus

    Data Engineer

    1 week ago

    Numeus New York, United States

    Numeus is a diversified digital asset investment firm built to the highest institutional standards, combining synergistic businesses across Trading, Alpha Strategies, Asset Management, and Venture Capital . · Numeus was founded by successful executives with decades of experience ...

  • Qloo Inc.

    Data Engineer

    1 week ago

    Qloo Inc. New York, United States

    The Company You'll Join · At Qloo, our cutting-edge Taste AI technology leverages extraordinary amounts of data-over half a billion records of public figures, places, and things, plus a globe-spanning consumer behavior and sentiment database-to unearth deep insights about consum ...

  • Spino Inc

    Data Engineer

    2 weeks ago

    Spino Inc New York City, United States

    Data Engineer · New York City, NY (Onsite) · Full Time · Databricks & MySQL exp. is a must · Qualifications: · Bachelor's degree orhigher in Computer Science, Engineering, or related field. · 5+ years of experience working as a Data Engineer or similar role. · Strong proficiency ...

  • ESB Technologies

    Data Engineer

    6 days ago

    ESB Technologies New Jersey, United States

    Only apply if you are willing to W2 · Job Title: Senior Azure Data Engineer · Location: AZ, TX, NJ, NY, FL, (Any of these mentioned locations) · Job Description: · Position Overview: We are seeking a highly skilled and experienced Azure Data Engineer to join our team as a senior ...

  • Wider Circle

    Data Engineer

    1 week ago

    Wider Circle New York, United States

    Overview: · Data Engineers serve a unique and important role in daily operations at Wider Circle. Customer data is the bedrock of our business, and Data Engineering is responsible for laying the foundation for our success. Data Engineers work with internal and external stakeholde ...

  • Net2Source Inc.

    Data Engineer

    1 week ago

    Net2Source Inc. New York, United States

    W2 Candidates Only · Position: Data Engineer – III · Locations: New York, NY Hybrid) · Duration: 12+ months Contract · Qualifications: · Expert-level understanding of Agile, SDLC, CI/CD, DevOps, GitOps, and ProdOps is required. · Expert-level expertise in SQL, Python, Scala or si ...