Databricks Engineer - New York - Treliant

    Treliant
    Treliant New York

    1 week ago

    Description
    Overview
    Treliant is a global consulting firm serving banks, mortgage originators and servicers, FinTechs, and other companies providing financial services. We are led by practitioners from the industry and the regulatory community who bring deep domain knowledge to help our clients drive business change and address the most pressing compliance, regulatory, and operational challenges. We provide data-driven, technology-enabled advisory, implementation, and staffing solutions to the regulatory compliance, risk, financial crimes, and capital markets functions of our clients. Founded in 2005, Treliant is headquartered in Washington, DC, with offices in New York, London, Belfast, Northern Ireland and Łódź, Poland. For more information visit
    Treliant is committed to fostering a diverse, equitable and inclusive environment that values and embraces all races, religions, ages, abilities, genders, sexual orientations, ethnicities, languages, nationalities, political parties, socioeconomic groups and other characteristics that inform an individual's worldview, experiences and system of beliefs ("the principles"). We believe in championing every voice and ensuring everyone's full potential.
    Our Capital Markets business unit is looking for two Databricks Engineers to join our existing team at a large, global bank. Successful candidates will work among a mixture of bank and Treliant staff in a hybrid role in the Greater New York City metro area.
    Primary Location: Hybrid - Greater New York City metro area
    Primary Location Salary Range: $160,000 - $200,000
    Responsibilities
    The client, a large bank, is in the process of centralizing its key reporting and aggregation processes on cloud platforms.
    In 2024, the intention is to centralize cashflow aggregation onto a platform based on Databricks technologies (Databricks and Deltalake).
    The project involves collecting both actual and forecast cashflows from both real-time and batch data sources, cleaning and enriching the data, and storing the resulting aggregated data in Deltalake for use in reporting.
    Qualifications
    Technical skills:
    Successful candidates will have played an important role in at least one Databricks platform implementation. Experience in data migration, data integration, and delivery of data warehouses is also advantageous.
    • Databricks: the candidate should be familiary with ETL/ELT in Databricks, with Medallion architecture and with Deltalake.
    • Other relevant technologies include:
      • Streaming technologies such as Kafka
      • Delta Share and Deltalake Connector
      • SQL, Python and PySpark
    Domain knowledge:
    The successful candidate will have a background in financial products and processes. Relevant areas of domain knowledge include:
    • Cashflow forecasting and liquidity management
    • Financial products including securities such as swaps, and banking products such as loans
    • Reference data including counterparty and business hierarchy data
    • Regulatory and risk management reporting needs
    • Experience of the challenges of aggregating data in bulk across business units and asset classes
    Other capabilities:
    This role is likely to have an element of communication and leadership, rather than being purely a technical role within the team.
    • The bank is at a relatively early stage in implementing the transition to Databricks.
    • The role will involve guiding and understanding aspects of the migration such as cost management and use case prioritization.
    • The role will involve communicating with data providers and data consumers to understand the requirements and to source and map the needed data fields.
    Benefits
    Treliant offers a comprehensive, total rewards package that includes competitive compensation and a flexible benefit package that reflects our commitment to creating a diverse and supportive workplace. In addition to a competitive base salary, candidate is eligible for incentive pay as well as a full range of health benefits, vacation plan, and 401k plan.
    If you want to be part of a dynamic team of professionals, we invite you to join the team at Treliant. We invest in people, and challenge you to advance your career while achieving your aspirations and goals. Here at Treliant, we pride ourselves on our collaborative team culture, where we embrace diversity of thought and innovation. If you strive for excellence and seek an inclusive environment apply on line and follow us on LinkedIn.

  • Only for registered members New York

    Databricks Engineer. Develop and maintain Databricks notebooks for ETL and data transformation, · design scalable data pipelines using Databricks and Azure Data Factory. · Apply distributed computing concepts to large-scale data processing. ...

  • Only for registered members New York Remote job

    We are seeking a skilled Databricks Engineer to join our team in New York. · ...

  • Only for registered members New York

    Dice is the leading career destination for tech experts at every stage of their careers. Our client AIT Global Inc seeks Databricks Engineer for NYC Hybrid. · ...

  • Only for registered members New York

    We are seeking an experienced Databricks Engineer to join our team in New York. · Apply strong knowledge of distributed computing concepts to large-scale data processing. · ...

  • Only for registered members New York TEMPORARY $160,000 - $200,000 (USD)

    Treliant is a global consulting firm serving banks, · mortgage originators and servicers, FinTechs, · and other companies providing financial services. · Treliant offers a comprehensive total rewards package. · ...

  • Only for registered members New York

    We are currently seeking a talented and motivated Senior Data Engineer to join our Insider Risk team. · This role will be responsible for designing, developing & deploying cloud data solutions for risk, regulatory, finance & compliance projects · Work with business teams, product ...

  • Only for registered members New York

    We are currently seeking a talented and motivated Senior Data Engineer to join our Insider Risk team.This role will be responsible for designing, developing & deploying cloud data solutions for risk, regulatory, finance & compliance projects. · ...

  • Only for registered members New York, NY

    We are currently seeking a talented and motivated Senior Data Engineer to join our Insider Risk team. This role will be responsible for designing, developing & deploying cloud data solutions for risk, regulatory, finance & compliance projects and be at the forefront of on-prem to ...

  • Only for registered members New York

    Databricks Engineer responsible for designing deploying and scaling data pipelines and models on Databricks. · Collaborate with Data Engineers/Scientists/Software Engineers to design deploy and scale data pipelines and models on Databricks. · Implement Infrastructure as Code IaC ...

  • Only for registered members Jersey City

    Dice is the leading career destination for tech experts at every stage of their careers. Our client, Nityo Infotech Corporation, is seeking an Azure Databricks Engineer. · Azure Cloud Services · Pyspark · ...

  • Only for registered members Jersey City

    We are seeking an experienced Databricks Data Engineer to join our team for an onsite contract opportunity. · Design, develop, and maintain scalable data pipelines using Databricks. · ...

  • Only for registered members New York, NY

    Join us and help the world's leading organizations unlock the value of technology and build a more sustainable, more inclusive world. · ...

  • Only for registered members New York, NY

    Dice is the leading career destination for tech experts at every stage of their careers. Our client, SolutionIT, Inc., is seeking the following. · ...

  • Only for registered members New York

    Data Engineer w/ Databricks for large-scale data processing and analytics. · Develop, optimize, and maintain Databricks notebooks for ETL and data transformation. · Design and implement scalable data pipelines using Databricks and Azure Data Factory. · ...

  • Only for registered members New York

    Data Engineer with Azure and Databricks. · Develop, optimize, and maintain Databricks notebooks for ETL and data transformation. · Design and implement scalable data pipelines using Databricks and Azure Data Factory. · ...

  • Only for registered members New York, New York, United States

    Join our Talent Community for New York. Local postings emphasize production grade ELT on Snowflake and Databricks with strong Python and SQL and Airflow and dbt plus secure data sharing and cost governance. · ...

  • Only for registered members New York $140,000 - $150,000 (USD)

    This role involves leading and managing a team of data engineers to drive the success of data engineering initiatives. The job requires expertise in Databricks and Apache Spark, as well as proficiency in Python and SQL. The successful candidate will be responsible for developing ...

  • Only for registered members New York $140,000 - $160,000 (USD)

    The Data Engineering team is seeking a Senior Data Engineer to help design, build, and scale the modern data platform that powers analytics, data science, and data products across Versant brands.Design and implement lakehouse architecture using Delta Lake ...

  • Only for registered members New York

    Databricks ETL QA Engineer is being sought after by ADDSOURCE. The ideal candidate should have experience with Pytest Framework and Python Programming. · Pytest Framework Hands-on knowledge is Mandatory · Python Programming · Unit Testing · ...

  • Only for registered members Jersey City, NJ, United States

    This is a job opportunity for a Lead Data Engineer at JPMorgan Chase. The role involves enhancing, building, and delivering data collection, storage, access, and analytics solutions in a secure and stable way. · Generates data models using firmwide tooling. · Delivers data platfo ...

  • Only for registered members New York, NY

    We are looking for a Databricks ETL QA Engineer with hands-on knowledge of Pytest Framework and experience in Python programming for our team in New York. The ideal candidate will have a strong background in software testing and quality assurance. · ...

Jobs
>
Databricks engineer
>
Jobs for Databricks engineer in New York City