- This role is expected to lead & manage a team but will be hands-on 70-80% of the time
- Ensure the delivery and accuracy of data from external vendors and internal data-producing groups.
- Work within the Platform Pipelines team to implement modern architectures for data collection, processing and storage. You'll be working with 3rd party partners & vendors along with internal data sources.
- Consult senior-level stakeholders across the entire organization to identify business and technology needs and to optimize the use of technology, systems, and software tools
- Provide robust operational support for systems when there are issues or questions with data accuracy or processing.
- Develop a technology roadmap of projects to enhance current processing and modernize systems taking advantage of Cloud architectures.
- Analyze existing data operations processes and identify opportunities for efficiency gains. Demonstrate knowledge of batch and streaming pipelines technologies
- Be responsible for core analytics, data lake and date pipeline products.
- Demonstrate knowledge of Data Quality and Data Governance.
- Build data applications, products, integrate with third-party data and technology platforms.
- Demonstrate expertise in comprehension and construction of complex SQL queries
- Act as a Subject Matter Expert to the organization for Trepp's ingestion frameworks, including AWS and future providers, networking, provisioning, and management
- Demonstrate leadership ability to back decisions with research and the "why," and articulate several options, the pros and cons for each, and a recommendation
- Maintain overall industry knowledge on latest trends, technology, etc.
- Demonstrate application of Realtime vs Batch pipelines
- Bachelor's degree in computer science, systems analysis or a related study, or equivalent experience
- 4+ years managing an engineering team.
- 7+ years of experience with Python or Java, or Scala and AWS (Lambda, ECS, EMR)
- 7+ years of experience with SQL (DDL, DML, complex queries)
- Experience with SQL RDBMS implementations and RDS is a plus
- Experience with AWS enterprise implementations (Lambda, ECS, Spark, Kinesis, DMS)
- Experience with Spark / EMR (or similar) implementations
- Exposure to multiple, diverse technologies and processing environments
- Knowledge of components within a technical architecture
- Experience with Agile and SDLC, Git workflows, and CI/CD
- Strong preference for process and documentation
- Strong understanding of network architecture and application development methodologies.
- A drive to work on financial data systems & pipelines including experience working with structured finance or commercial real estate datasets.
- Understanding of serverless architectures, containers, and modern application development practices.
- Ability to quickly learn, understand, and work with new emerging technologies, methodologies, and solutions in the Cloud/IT technology space.
- Experience working in Financial Services or related industry.
- Base salary starting from $180k plus bonus eligible
- Base + target bonus compensation structure
- Medical, Dental, Vision insurance
- 401K (with employer match)
- Life insurance, long term disability, short term disability all covered by the company
- Flexible paid time off (PTO)
- Sixteen (16) weeks paid primary caregiver leave (Biological, adoptive, and foster parents are all eligible)
- Four (4) weeks paid parental leave
- Wellness subsidy
- Pet insurance
- Laptop + WFH equipment
- Career progression plan
- Pre-tax commuter benefit with company subsidy (For NYC-office based employees only)
- Involvement in Diversity and Inclusion programs
- Fun company events and volunteering opportunities
-
Capco New York, United StatesAls globale Unternehmensberatung mit Fokus auf die Finanzdienstleistungsbranche kombinieren wir bei Capco innovatives Denken mit einzigartigem Know-How. So divers wie unsere Mitarbeiter*, sind auch unsere Lösungen, die wir unseren Kunden anbieten. Bringe Dich ein und setze Deine ...
-
Data Engineer
2 weeks ago
Capstone Investment Advisors New York, United StatesRESPONSIBILITIES: · Be part of Data Engineering team responsible for all market data in the firmDesign and implement data-ingestion and data-processing pipelines and tools for a diverse range of datasets using Python, Linux and AWS Cloud platform.Work with variety of backend dat ...
-
Data Engineer
4 weeks ago
Silver Search, Inc New York, United StatesData Engineer New York, NY Senior Data Engineer--Redshift/AWS/Python/Scripting---**Will be hybrid onsite in January 2022 onwards** · Contract-to-hire · Our client is a cutting edge E-Learning company based in NYC and is looking to hire a Senior Data Engineer to join their data ...
-
Data Engineer
3 weeks ago
Storm3 New York, United StatesLead Data Engineer · Series B, Startup · New York (Hybrid) · $200, ,000 + Significant Equity + Bonus · The company is a leading provider of virtual care to help tackle substance use. · Responsibilities: · Develop and maintain data pipelines for extracting, transforming and lo ...
-
Data Engineer
1 week ago
BeaconFire Inc. New Jersey, United StatesBeaconFire is based in Central NJ, specializing in Software Development, Web · Development, and Business Intelligence; looking for candidates who are good communicators and self-motivated. You will play a key role in building, maintaining, and operating integrations, · reporting ...
-
Data Engineer
2 weeks ago
Jane Street New York, United States Full timeAbout the Position · We are looking for a Data Engineer who can help us understand, clean, manage, and share the data that guides our trading. At Jane Street, having a thorough and accurate understanding of data is at the core of the work we do. · Using our mix of in-house and op ...
-
Data Engineer
1 week ago
Artech LLC Newark, United StatesJob Description: · Artech is currently looking for experienced professional for the below position. · Job Title: Data Engineer · Job ID: · Location: 213 Washington St, Newark, Nj 07102 · Duration: 6+ Months · Job Description: · Greater than 10 years of data engineering developme ...
-
Data Engineer
5 days ago
Coda Search│Staffing New York, United StatesOur client, a top hedge fund in Midtown is looking for a Data Engineer to join their Strategic Finance team. This team conducts analysis to drive decision making across the firm. · The ideal candidate will have 3-5 years experience. · Experience: · Degree in a quantitative disc ...
-
Data Engineer
3 weeks ago
The Tie New York, United StatesThe Tie is a leading provider of information services for digital assets. Our core offering, The Tie Terminal, is the fastest and most comprehensive workstation for institutional digital asset investors. The Terminal brings together real-time news from thousands of primary source ...
-
Senior Data Engineer
2 weeks ago
UnitedHealth Group New York, United StatesLead design, development, enhancement, and integration of analytical data products and/or data warehouse solutions. Analyze data sources and system landscape related to medical claims and adjacent domains. Partner with SMEs to become a domain expert. ...
-
Data Engineer
1 week ago
Hunter Bond New York, United StatesJob title: Data Engineer · Client: Elite Quantitative Trading Firm · Salary: Up to $2500 p/d · Location: New York · My client are seeking a Data Engineer to own the design and implementation of data solutions, with previous expertise in data extraction, transformation, and loadin ...
-
Data Engineer
3 weeks ago
New York Blood Center New York, United States· Data Engineer · Job Locations · US-NY-New York · Job ID · Category · Information Technology · Minimum Rate · USD $100,000.00/Yr. · Maximum Rate · USD $115,000.00/Yr. · Work Location Type · Hybrid · Overview · At New York Blood Center Enterprises (NYBCe), one of the most ...
-
Data Engineer
3 weeks ago
Open Systems Technologies New York, United StatesA financial firm is looking for a Data Engineer to join their team in New York, NY. · Compensation: $150-200k · Responsibilities: · Build data pipelines · Work with data vendors such as Bloomberg, Refinitiv, etc. · Take vendor data and normalize it for firm consumption · Qualifi ...
-
Data Engineer
2 weeks ago
Hunter Bond New York, United StatesJob title: Data Engineer · Client: Elite Fintech · Salary: Up to $2500 p/d · Location: New York · My client are seeking a Data Engineer to own the design and implementation of data solutions, with previous expertise in data extraction, transformation, and loading (ETL) processes ...
-
Data Engineer
3 weeks ago
Oakridge Staffing New York, United StatesGlobal hospitality company is looking for an experienced Data Engineer for their Midtown NYC headquarters. · Responsibilities: · Lead the in-house development of ETL/ELT data pipelines and data science projects. · Create and own data products, such as a recommendation engine or ...
-
Data Engineer
1 week ago
Jobot New York, United StatesJob Description · Job Description100% Remote · This Jobot Consulting Job is hosted by: Duran Workman · Are you a fit? Easy Apply now by clicking the "Apply Now" buttonand sending us your resume. · Salary: $75 - $95 per hour · A bit about us: · We are seeking a dynamic and experie ...
-
Data Engineer
2 weeks ago
iCapital New York, United StatesiCapital is powering the world's alternative investment marketplace. Our financial technology platform has transformed how advisors, wealth management firms, asset managers, and banks evaluate and recommend bespoke public and private market strategies for their high-net-worth cli ...
-
Data Engineer
3 weeks ago
NR Consulting New York, United StatesData Engineer SME · Location: NYC / Charlotte (Candidate should be open for hybrid work model) · Duration: 12 months · Responsibilities: · A background in financial services, investment banking, regulated sectors and large enterprise · DevOps and Agile engineering practitioner w ...
-
Data Engineer
3 weeks ago
Logistics Management Institute New York, United StatesOverview · LMI is a consultancy dedicated to powering a future-ready, high-performing government, drawing from expertise in digital and analytic solutions, logistics, and management advisory services. We deliver integrated capabilities that incorporate emerging technologies and a ...
-
Data Engineer
3 weeks ago
Codex Tech-it New York, United StatesJob Description · Job DescriptionCodex Tech-IT is a leading technology solutions provider specializing in data management and analytics. We are seeking a skilled Data Engineer to join our team and contribute to the development and maintenance of our data infrastructure. With a st ...
Engineering Manager, Data Engineering - New York, United States - Trepp, Inc.
Description
(This position is based in Trepp's NYC office which operates in a hybrid work schedule)
The Data Engineering Manager is responsible for leading the migration of legacy systems to the Data Lake and providing technical leadership in support of Trepp's initiatives in data ingestion and pipeline automation, with a focus on the design and implementation of Spark/EMR and streaming platforms. The Data Engineering Manager reports into the Data Engineering organization.
The ideal candidate will have a bachelor's degree in Computer Science or closely related subject; an advanced degree is preferred. In addition, 7 or more years' experience in migrating complex IT systems in enterprise organizations. The position requires strong technical skills and must be able to collaborate effectively with a group of high performing individuals. The position requires an individual who can collaborate on setting mid/long term goals and objectives, then be self-directed to estimate timelines and take ownership of the work, while communicating with stakeholders on a regular basis. The data engineering manager role sets an example for junior team members through modelling best practices and provides guidance during weekly team calls, feedback through code reviews etc., and generally supports the knowledge and skills development of junior team members.
Data Engineering, Design and Development Requirements:
Qualifications:
Preferred Skills:
Salary Range:
Benefits and Perks:
Workplace Policy:
NYC, Dallas, PA, and London office-based positions: Trepp's offices follows a 3-2 hybrid-working policy with the expectation of in-office work on Tuesday-Thursday and the option to work from home on Monday and Friday.
Applicants for employment in the US must have work authorization that does not now or in the future require sponsorship of a visa for employment authorization in the United States and with Trepp (i.e., H1-B visa, F-1 visa (OPT), TN visa or any other non-immigrant status).
Trepp, Inc. is an equal opportunity / affirmative action employer, complying with all laws governing employment in each jurisdiction in which operating, and provides equal opportunity to all applicants and employees. All qualified applicants will be considered without regard to race, color, religion, gender, national origin, age, disability, marital or protected veteran status, sexual orientation, gender identity and other status protected by applicable laws.