Jobs
>
New York City

    Data Engineer - New York, NY, United States - Cybersyn

    Cybersyn
    Cybersyn New York, NY, United States

    2 weeks ago

    Default job background
    Description
    About Cybersyn Cybersyn is a new DaaS (data-as-a-service) company, backed by Sequoia, Coatue, and Snowflake.

    Our mission is to make the world's economic data transparent to governments, businesses, and entrepreneurs and enable a new generation of decision makers.

    We acquire unique data assets (companies, licenses, data rights, consumer dividends) and build derived products on top of that, focusing on measuring what consumers and businesses are spending money on.

    You can think of Cybersyn as a cross between an investment firm and a technology company focused on data:
    if we are successful, we will disrupt the traditional market intelligence space.

    The reward is great - if we are successful, we can disrupt an industry worth $100Bs and build SimCity for the real world.

    We have already released a fair number of public datasets that we have cleaned, restructured and made joinable on the Snowflake Marketplace.

    View our data products here.
    Explore the sources we integrate, and the associated data products here.

    About the role:

    Cybersyn is looking for an experienced engineer to help us refine our technology stack for our data science and product team and implement ingestion pipelines of public domain and private data sources.

    We are looking for someone who is passionate about the Snowflake Data Cloud and optimizing costs and workloads, in particular.

    This is the perfect role for someone who loves to tune databases, thinks about cost-compute optimization, and knows their way around a query plan.


    What you will do:

    Help get data from wherever it is to where we need it (in Snowflake): in practice, this often means writing jobs to extract, download, or transform data as efficiently as possible.

    You need to worry about compute efficiency and also care about building some context for what the data actually is.

    Take research and statistical models and pipelines and implement them in Snowflake in an efficient way that meets time SLA requirements while minimizing costs
    Tune Snowflake for performance and cost optimization
    Provide infrastructure guidance of Snowflake capabilities to accommodate business/technical use cases
    Provide production support for Data Warehouse issues such data load problems, transformation translation problems, query optimization
    Take end-to-end ownership of your work and enjoy working with different functions across the company

    Who you are:
    Experience with Snowflake is requisite
    Experience with query optimization is required. You are comfortable in the Snowflake Query Profiler.

    Snowflake micro-partitions, sortkeys, query acceleration, and search optimization service should all be terms that you are familiar with and ready to discuss.

    Experience in Python and SQL is requisite
    Experience working with multiple (external) datasets, cleaning, joining, and munging data; experience working with public data sources (ie. US Census, ACS Survey) a huge plus
    Experience with dbt and orchestrator systems (Dagster, Prefect, Mage, Kestra, or some equivalent) is highly valued
    Experience building and operating data pipelines for real customers in production systems
    What you get out of it: Ability to shape Cybersyn's initial technology decisions

    Access to some of the most interesting and largest economic data in the world, including real-time spending, transaction, clickstream data from both third-party and first-party sources.

    Much of our data is not available to any other third parties.

    Our system is built with heterogeneous data sources in mind: we are not working on data from a single product or theme, but data from governments, payment processing systems (think bank records), mobile devices and apps, and SaaS exhaust (think data B2B SaaS collects) Fast moving culture, lots of responsibility and autonomy from day 1.

  • Artech LLC

    Data Engineer

    1 week ago

    Artech LLC Newark, United States

    Job Description: · Artech is currently looking for experienced professional for the below position. · Job Title: Data Engineer · Job ID: · Location: 213 Washington St, Newark, Nj 07102 · Duration: 6+ Months · Job Description: · Greater than 10 years of data engineering developme ...

  • Silver Search, Inc

    Data Engineer

    8 hours ago

    Silver Search, Inc New York, United States

    Data Engineer New York, NY Senior Data Engineer--Redshift/AWS/Python/Scripting---**Will be hybrid onsite in January 2022 onwards** · Contract-to-hire · Our client is a cutting edge E-Learning company based in NYC and is looking to hire a Senior Data Engineer to join their data ...

  • BeaconFire Inc.

    Data Engineer

    1 week ago

    BeaconFire Inc. New Jersey, United States

    BeaconFire is based in Central NJ, specializing in Software Development, Web · Development, and Business Intelligence; looking for candidates who are good communicators and self-motivated. You will play a key role in building, maintaining, and operating integrations, · reporting ...

  • Coda Search│Staffing

    Data Engineer

    1 week ago

    Coda Search│Staffing New York, United States

    Our client, a top hedge fund in Midtown is looking for a Data Engineer to join their Strategic Finance team. This team conducts analysis to drive decision making across the firm. · The ideal candidate will have 3-5 years experience. · Experience: · Degree in a quantitative disc ...

  • Storm3

    Data Engineer

    3 weeks ago

    Storm3 New York, United States

    Lead Data Engineer · Series B, Startup · New York (Hybrid) · $200, ,000 + Significant Equity + Bonus · The company is a leading provider of virtual care to help tackle substance use. · ‍ Responsibilities: · Develop and maintain data pipelines for extracting, transforming and lo ...

  • Jane Street

    Data Engineer

    2 weeks ago

    Jane Street New York, United States Full time

    About the Position · We are looking for a Data Engineer who can help us understand, clean, manage, and share the data that guides our trading. At Jane Street, having a thorough and accurate understanding of data is at the core of the work we do. · Using our mix of in-house and op ...

  • The Tie

    Data Engineer

    3 weeks ago

    The Tie New York, United States

    The Tie is a leading provider of information services for digital assets. Our core offering, The Tie Terminal, is the fastest and most comprehensive workstation for institutional digital asset investors. The Terminal brings together real-time news from thousands of primary source ...

  • Capstone Investment Advisors

    Data Engineer

    2 weeks ago

    Capstone Investment Advisors New York, United States

    RESPONSIBILITIES: · Be part of Data Engineering team responsible for all market data in the firmDesign and implement data-ingestion and data-processing pipelines and tools for a diverse range of datasets using Python, Linux and AWS Cloud platform.Work with variety of backend dat ...

  • UnitedHealth Group

    Senior Data Engineer

    2 weeks ago

    UnitedHealth Group New York, United States

    Lead design, development, enhancement, and integration of analytical data products and/or data warehouse solutions. Analyze data sources and system landscape related to medical claims and adjacent domains. Partner with SMEs to become a domain expert. ...

  • Hunter Bond

    Data Engineer

    2 weeks ago

    Hunter Bond New York, United States

    Job title: Data Engineer · Client: Elite Quantitative Trading Firm · Salary: Up to $2500 p/d · Location: New York · My client are seeking a Data Engineer to own the design and implementation of data solutions, with previous expertise in data extraction, transformation, and loadin ...

  • NR Consulting

    Data Engineer

    4 weeks ago

    NR Consulting New York, United States

    Data Engineer SME · Location: NYC / Charlotte (Candidate should be open for hybrid work model) · Duration: 12 months · Responsibilities: · A background in financial services, investment banking, regulated sectors and large enterprise · DevOps and Agile engineering practitioner w ...

  • Jobot

    Data Engineer

    2 weeks ago

    Jobot New York, United States

    Job Description · Job Description100% Remote · This Jobot Consulting Job is hosted by: Duran Workman · Are you a fit? Easy Apply now by clicking the "Apply Now" buttonand sending us your resume. · Salary: $75 - $95 per hour · A bit about us: · We are seeking a dynamic and experie ...

  • Logistics Management Institute

    Data Engineer

    3 weeks ago

    Logistics Management Institute New York, United States

    Overview · LMI is a consultancy dedicated to powering a future-ready, high-performing government, drawing from expertise in digital and analytic solutions, logistics, and management advisory services. We deliver integrated capabilities that incorporate emerging technologies and a ...

  • Hunter Bond

    Data Engineer

    2 weeks ago

    Hunter Bond New York, United States

    Job title: Data Engineer · Client: Elite Fintech · Salary: Up to $2500 p/d · Location: New York · My client are seeking a Data Engineer to own the design and implementation of data solutions, with previous expertise in data extraction, transformation, and loading (ETL) processes ...

  • Aretec Inc

    Data Engineer

    2 days ago

    Aretec Inc New York, United States

    Job Description · Job DescriptionUsAretec, a leading provider of innovative technology solutions for federal agencies, specializing in cybersecurity, data analytics, and insider threat detection. As a trusted partner, we work closely with our clients to develop and implement cutt ...

  • CoreWeave

    Data Engineer

    3 weeks ago

    CoreWeave New York, United States

    Job Description · Job DescriptionCoreWeave is a specialized cloud provider, delivering a massive scale of GPU compute resources on top of the industry's fastest and most flexible infrastructure. CoreWeave builds cloud solutions for compute intensive use cases — VFX and rendering, ...

  • eTeam

    Data Engineer

    3 weeks ago

    eTeam New York, United States

    Tools qualifications: Experience with relational SQL and NoSQL databases · Experience with data pipeline and workflow management tools. · Preferred experience with AWS cloud services · Preferred experience with object-oriented and function scripting languages: Java, Scala, Py ...

  • HappyFunCorp

    Data Engineer

    1 week ago

    HappyFunCorp New York, United States

    Job Description · Job DescriptionData Engineer / Analyst - Remote - Contract · *This position is 100% remote* (This role will primarily operate on East Coast hours) · HappyFunCorp helps businesses develop great products and deliver powerful technical solutions with a blend of dee ...

  • iCapital

    Data Engineer

    2 weeks ago

    iCapital New York, United States

    Job Description · Job DescriptioniCapital is powering the world's alternative investment marketplace. Our financial technology platform has transformed how advisors, wealth management firms, asset managers, and banks evaluate and recommend bespoke public and private market strate ...

  • Splice

    Data Engineer

    2 weeks ago

    Splice New York, United States

    Job Description · Job DescriptionWHO WE ARE: · We are a producers playground, delivering music creators the tools they need to bring their ideas to life. With a massive, industry-leading catalog of licensed samples, paired with powerful AI, and access to affordable plugins and D ...