Jobs
>
New York City

    Engineering Manager, Data Engineering - New York, United States - Trepp, LLC

    Trepp, LLC
    Trepp, LLC New York, United States

    6 days ago

    Default job background
    Description

    (This position is based in Trepp's NYC office which operates in a hybrid work schedule)

    The Data Engineering Manager is responsible for leading the migration of legacy systems to the Data Lake and providing technical leadership in support of Trepps initiatives in data ingestion and pipeline automation, with a focus on the design and implementation of Spark/EMR and streaming platforms. The Data Engineering Manager reports into the Data Engineering organization.

    The ideal candidate will have a bachelors degree in Computer Science or closely related subject; an advanced degree is preferred. In addition, 7 or more years experience in migrating complex IT systems in enterprise organizations. The position requires strong technical skills and must be able to collaborate effectively with a group of high performing individuals. The position requires an individual who can collaborate on setting mid/long term goals and objectives, then be self-directed to estimate timelines and take ownership of the work, while communicating with stakeholders on a regular basis. The data engineering manager role sets an example for junior team members through modelling best practices and provides guidance during weekly team calls, feedback through code reviews etc., and generally supports the knowledge and skills development of junior team members.

    Data Engineering, Design and Development Requirements:

    • This role is expected to lead & manage a team but will be hands-on 70-80% of the time
    • Ensure the delivery and accuracy of data from external vendors and internal data-producing groups.
    • Work within the Platform Pipelines team to implement modern architectures for data collection, processing and storage. Youll be working with 3rd party partners & vendors along with internal data sources.
    • Consult senior-level stakeholders across the entire organization to identify business and technology needs and to optimize the use of technology, systems, and software tools
    • Provide robust operational support for systems when there are issues or questions with data accuracy or processing.
    • Develop a technology roadmap of projects to enhance current processing and modernize systems taking advantage of Cloud architectures.
    • Analyze existing data operations processes and identify opportunities for efficiency gains. Demonstrate knowledge of batch and streaming pipelines technologies
    • Be responsible for core analytics, data lake and date pipeline products.
    • Demonstrate knowledge of Data Quality and Data Governance.
    • Build data applications, products, integrate with third-party data and technology platforms.
    • Demonstrate expertise in comprehension and construction of complex SQL queries
    • Act as a Subject Matter Expert to the organization for Trepps ingestion frameworks, including AWS and future providers, networking, provisioning, and management
    • Demonstrate leadership ability to back decisions with research and the why, and articulate several options, the pros and cons for each, and a recommendation
    • Maintain overall industry knowledge on latest trends, technology, etc.
    • Demonstrate application of Realtime vs Batch pipelines

    Qualifications:

    • Bachelors degree in computer science, systems analysis or a related study, or equivalent experience
    • 4+ years managing an engineering team.
    • 7+ years of experience with Python or Java, or Scala and AWS (Lambda, ECS, EMR)
    • 7+ years of experience with SQL (DDL, DML, complex queries)
    • Experience with SQL RDBMS implementations and RDS is a plus
    • Experience with AWS enterprise implementations (Lambda, ECS, Spark, Kinesis, DMS)
    • Experience with Spark / EMR (or similar) implementations
    • Exposure to multiple, diverse technologies and processing environments
    • Knowledge of components within a technical architecture
    • Experience with Agile and SDLC, Git workflows, and CI/CD
    • Strong preference for process and documentation
    • Strong understanding of network architecture and application development methodologies.

    Preferred Skills:

    • A drive to work on financial data systems & pipelines including experience working with structured finance or commercial real estate datasets.
    • Understanding of serverless architectures, containers, and modern application development practices.
    • Ability to quickly learn, understand, and work with new emerging technologies, methodologies, and solutions in the Cloud/IT technology space.
    • Experience working in Financial Services or related industry.

    Salary Range:

    • Base salary starting from $180k plus bonus eligible

    Benefits and Perks:

    • Base + target bonus compensation structure
    • Medical, Dental, Vision insurance
    • 401K (with employer match)
    • Life insurance, long term disability, short term disability all covered by the company
    • Flexible paid time off (PTO)
    • Sixteen (16) weeks paid primary caregiver leave (Biological, adoptive, and foster parents are all eligible)
    • Four (4) weeks paid parental leave
    • Wellness subsidy
    • Pet insurance
    • Laptop + WFH equipment
    • Career progression plan
    • Pre-tax commuter benefit with company subsidy (For NYC-office based employees only)
    • Involvement in Diversity and Inclusion programs
    • Fun company events and volunteering opportunities

    Workplace Policy:

    NYC, Dallas, PA, and London office-based positions: Trepps offices follows a 3-2 hybrid-working policy with the expectation of in-office work on Tuesday-Thursday and the option to work from home on Monday and Friday.

    Applicants for employment in the US must have work authorization that does not now or in the future require sponsorship of a visa for employment authorization in the United States and with Trepp (i.e., H1-B visa, F-1 visa (OPT), TN visa or any other non-immigrant status).

    Trepp, Inc. is an equal opportunity / affirmative action employer, complying with all laws governing employment in each jurisdiction in which operating, and provides equal opportunity to all applicants and employees. All qualified applicants will be considered without regard to race, color, religion, gender, national origin, age, disability, marital or protected veteran status, sexual orientation, gender identity and other status protected by applicable laws.

  • Social Capital Resources

    Data Engineer

    1 week ago

    Social Capital Resources New York, United States

    Data Engineer · Hybrid Role 4 days/week NYC · $120-130k base + bonus · Our client, an investment manager in NYC, is looking to add a Jr. Data Engineer to their team. The ideal candidate will have 1-3 years of Data Engineer/Development experience. Financial services experience is ...

  • Oakridge Staffing

    Data Engineer

    1 week ago

    Oakridge Staffing New York, United States

    Global hospitality company is looking for an experienced Data Engineer for their Midtown NYC headquarters. · Responsibilities: · Lead the in-house development of ETL/ELT data pipelines and data science projects. · Create and own data products, such as a recommendation engine or ...

  • Beauty by Imagination (BBI)

    Data Engineer

    1 week ago

    Beauty by Imagination (BBI) New York, United States

    Beauty by Imagination · Data Engineer · Hybrid · Position Overview: · We are seeking a highly skilled and motivated Data Engineer to create and manage a data warehouse, integrating data from various sources including NetSuite, IRI, and other sales data. This role is pivotal in ow ...

  • iO Associates - US

    Data Engineer

    1 week ago

    iO Associates - US New York, United States

    An exciting Cloud Cybersecruity start up is looking for a talented Data Engineer to join their team based in New York City. The firm has recently secured new seed funding and are working on not just detecting cloud cybersecurity problems but solving them as well. · The ideal cand ...

  • RedStream Technology

    Data Engineer

    1 week ago

    RedStream Technology New York, United States

    Data Engineer · Elmwood Park, NJ (Hybrid, 3 days on-site per week) · RedStream Technology is recruiting for a Data Engineer to work with our client, a leading mdeical services provider. The Data Engineer needs to be proficient with Matillion, Snowflake, and dbt in a hybrid Azure ...

  • Stealth AI Startup

    Data Engineer

    1 week ago

    Stealth AI Startup New York, United States

    Are you fascinated by the potential of the intersection between artificial intelligence and blockchain technology? Do you thrive in fast-paced environments where innovation is the norm? Interested in being a founding member of an early-stage start-up? · If so, we want you to be ...

  • Net2Source Inc.

    Data Engineer

    1 week ago

    Net2Source Inc. New York, United States

    W2 Candidates Only · Position: Data Engineer – III · Locations: New York, NY Hybrid) · Duration: 12+ months Contract · Qualifications: · Expert-level understanding of Agile, SDLC, CI/CD, DevOps, GitOps, and ProdOps is required. · Expert-level expertise in SQL, Python, Scala or si ...

  • Benchmark IT - Technology Talent

    Data Engineer

    1 week ago

    Benchmark IT - Technology Talent New York, United States

    Our direct client, a fast-growing FinTech firm in New York City, is looking for a Data Engineer to join the Data and Analytics team. This role will help build the infrastructure to make data a central part of the firm. Data driven decisions are very critical for the business, as ...

  • Logistics Management Institute

    Data Engineer

    4 days ago

    Logistics Management Institute New York, United States

    Overview · LMI is a consultancy dedicated to powering a future-ready, high-performing government, drawing from expertise in digital and analytic solutions, logistics, and management advisory services. We deliver integrated capabilities that incorporate emerging technologies and a ...

  • Oxford Knight

    Data Engineer

    1 day ago

    Oxford Knight New York, NY, United States Full time

    Data Engineer wanted for systematic arm of globally recognised hedge fund to join the growing Data Engineering team where you will support the Commodities business. This opportunity will give you the chance to design, implement and evolve the data platform, including pipeline, re ...

  • Bardess Group, Ltd.

    Data Engineer

    4 days ago

    Bardess Group, Ltd. New York, United States

    Job Description · Job DescriptionLocation Desired: New Jersey or Remote · Location Option: Virtual Home Office with occasional travel to client sites · Data Engineer: · As a Data Engineer you will work hands-on with some of the most innovative clients and use cases. Leveraging yo ...

  • ASCENDING LLC

    Data Engineer

    1 week ago

    ASCENDING LLC New York, United States Full time

    Full-time, Remote - Location Requirement: MUST be located in the Eastern Time Zone · Available for W-2 or 1099 Individual. · Our client, one of the largest Amazon Web Services (AWS) partners for data services, is looking for a true Mid level Big Data Engineer to contribute to jo ...

  • Open Systems Technologies

    Data Engineer

    5 days ago

    Open Systems Technologies New York, United States

    A financial firm is looking for a Data Engineer to join their team in New York, NY. · Compensation: $150-200k · Responsibilities: · Build data pipelines · Work with data vendors such as Bloomberg, Refinitiv, etc. · Take vendor data and normalize it for firm consumption · Qualifi ...

  • OTG

    Data Engineer

    2 days ago

    OTG New York, United States

    YOUR NEXT OPPORTUNITY IS NOW BOARDING: · Join OTG as the Data Engineer – FLO Solutions now at PAS( Home Office) and drive a new type of hospitality. Explore career opportunities in a unique hospitality environment with some of the industry's best compensation and benefits, includ ...

  • Capital Fund Management (CFM)

    Data Engineer

    1 week ago

    Capital Fund Management (CFM) New York, United States

    ABOUT CFM · Founded in 1991, we are a global quantitative and systematic asset management firm applying a scientific approach to finance to develop alternative investment strategies that create value for our clients. · We value innovation, dedication, collaboration and the abilit ...

  • Optomi

    Data Engineer

    1 week ago

    Optomi New York, United States

    Note: · Due to the nature of the role, please do NOT apply for this opportunity if you're partnering with a third party(C2C) or if you require sponsorship · Overview: · Optomi, in partnership with a leader in the HVAC, Electrical, & Network Infrastructure Industry, is inviting ...

  • Spino Inc

    Data Engineer

    6 days ago

    Spino Inc New York City, United States

    Data Engineer · New York City, NY (Onsite) · Full Time · Databricks & MySQL exp. is a must · Qualifications: · Bachelor's degree orhigher in Computer Science, Engineering, or related field. · 5+ years of experience working as a Data Engineer or similar role. · Strong proficiency ...

  • Publicis Groupe

    Data Engineer

    23 hours ago

    Publicis Groupe New York, United States

    Company Description · Publicis Media harnesses the power of modern media through global agency brands CJ, Performics, Publicis Collective, Publicis Health Media, Spark Foundry, Starcom and Zenith. A key business solution of Publicis Groupe ([Euronext Paris FR , CAC 40], Publicis ...

  • GroTech Search

    Data Engineer

    5 days ago

    GroTech Search New York, United States

    Senior Data Engineer - Generative AI · New York - hybrid · $160-180k · We are working with a leading financial services client who are looking for a dynamic and enthusiastic Senior Data Engineer to spearhead the design and execution of our company's modern data management stra ...

  • Atlantic Group

    Data Engineer

    21 hours ago

    Atlantic Group New York, United States

    Our client, a high-profile equities investment management firm with over $400B in AUM with offices in San Francisco, NYC, Shanghai, Hong Kong, Tokyo and London, is hiring · They are looking for a talented full-time Data Developer/Engineer to work out of their NYC office (hybrid c ...