Jobs
>
New York City

    Distributed Systems, Software Engineer - N/A, N/A, United States - CrowdStrike, Inc.

    Default job background
    Technology / Internet
    Description

    About The Role:

    CrowdStrike is looking to hire a Software Engineer to join the Data Infra Engineering team as a Distributed Systems Engineer. In this team, we are on a mission to create a hyper scale data lake, which helps finding bad actors and stopping breaches. The team builds and operates systems to centralize all of the data the falcon platform collects, making it easy for internal and external customers to transform and access the data for analytics, machine learning, and threat hunting.

    As a Software Engineer in this team you will be responsible for building our Flink/Spark ecosystem in Kubernetes, Flink, Kafka, Spark, MinIO, HDFS, Trino, Hive, Pinot etc. We are looking for candidates that have deep understanding of large scale big data scale Distributed systems in the DataCenter or Cloud (PB-scale would be a plus) in the DataCenter/AWS and are passionate about solving problems at high scale. This role involves leading efforts to build State-of-the-art Flink/Spark k8 platform.

    What You'll Do:

    • Design large scale distributed systems control plane
    • Implement Monitoring and Visualization system for large scale Kubernetes system
    • Implement CRD to orchestrate the distributed system.
    • Build performance monitoring system notification tolling
    • Communicate problem effectively.
    • Experience in developing large scale distributed systems
    • Strong Algorithmic skill
    • Well versed in programming in Golang, Java or Python

    What You'll Need:

    • Strong in one or both of field i.e., Flink/ Spark ecosystem with Kubernetes ecosystem background
    • Strong analytical skills and with deep understanding of Distributed Systems
    • Strong programming skills in languages as Go, Python or Java
    • Understanding of Apache Spark ecosystem technologies (Flink operator or Spark Operator, Kafka, FluxCD, ArgoCD, Jenkin Pipelines etc)
    • Experience with large-scale business critical platforms with Flink/Spark on Kubernetes on data center or cloud.
    • Experience with continuous deployment on K8 with Helm, fluxCD. ArgoCD etc
    • Solid understanding of either Flink or Spark(data) and K8 storage systems (Object stores S3/Minio, Spark ephemeral storage, Persistent volumes mapping and claims)
    • Understanding or Flink streaming/spark memory management or experience with spark internals.
    • Familiarity with Chef is preferred.
    • Proven ability to work with both local and remote teams
    • Strong communication skills both verbal and written

    #LI-DG1

    #LI-MP1

    #LI-Remote

    PandoLogic. Keywords: Software Engineer, Location: New York, NY

  • Heise Online

    IT Software Engineer

    3 weeks ago


    Heise Online New York, United States

    IT Software Engineer (m/w/d) im Bereich Qualitätsmanagement · IT Software Engineer (m/w/d) im Bereich Qualitätsmanagement · Die Deutsche Bundesbank ist eine besondere Bank: ein integraler Bestandteil des Europäischen Systems der Zentralbanken mit bedeutender Funktion in der Fina ...

  • UnitedHealth Group

    Software Engineer

    2 weeks ago


    UnitedHealth Group New York, United States

    Analyze requirements, develop APIs and microservices, troubleshoot and debug applications, communicate with other engineers and QA. Must have 4+ years of .NET experience and 2+ years of experience with front-end technologies and APIs/microservices. ...

  • CrowdStrike, Inc.

    Software Engineer

    2 weeks ago


    CrowdStrike, Inc. N/A, United States

    About the Role: · CrowdStrike Falcon Host is a two-component security product. One component is a "sensor": a driver installed on client machines that observes system activity and recognizes malicious behavior, then provides on-box prevention capability and remote telemetry to th ...

  • Exidetek

    Software Engineer

    3 weeks ago


    Exidetek New York, United States

    You will be working with legacy systems. While our work is to build new systems with up-to-date technology, we have to do that within an existing ecosystem. Our work is building functional, resilient software for production. We don't build flashy prototypes that don't work for re ...

  • STAND 8 Technology Services

    Software Engineer

    2 days ago


    STAND 8 Technology Services New York, United States

    STAND 8 provides end to end IT solutions to enterprise partners across the United States with offices in Los Angeles, New York, New Jersey, Atlanta and more, including internationally in Mexico, India and Japan. · We are seeking a skilled Data Product Software Engineer to join o ...

  • Datadog

    Software Engineer

    2 weeks ago


    Datadog New York, United States

    Software Engineer - Agent · New York, New York, USA; Boston, Massachusetts, USA · Software Engineer - Agent · The Agent Shared Components team at Datadog writes and maintains most of the core shared functionality of the Datadog Agent which schedules integrations, collects logs ...

  • QED National

    Software Engineer

    2 weeks ago


    QED National New York, United States Full time

    A NYC transportation authority located in downtown Manhattan is looking for a Software Engineer with expertise Kronos Timekeeping Systems. · This position is eligible for telework which is currently two day per week. New hires are eligible to apply 30 days after their effective ...

  • Unreal Gigs

    Software Engineer

    2 weeks ago


    Unreal Gigs New York, United States Full time

    About You · You are a skilled engineer who thrives on building intricate products and systems from scratch. Collaborative by nature, you contribute actively to team efforts while expressing your opinions confidently. With a keen architectural sense, you adeptly translate concepts ...

  • VSH Staffing

    Software Engineer

    2 weeks ago


    VSH Staffing New York, United States Full time

    As a Software Engineer, you will work closely with the founding team to build highly performant systems on the bleeding edge of blockchain technology. Your primary focus will be developing the core systems built on top of SEQ, including the transaction processing, block building, ...

  • Durlston Partners

    Software Engineer

    6 days ago


    Durlston Partners New York, United States

    Software Engineer(C#) - Hedge Fund - NYC - Up to $250k TC · Boutique Fixed Income Hedge Fund is looking to build out its NYC office with an additional engineering hire that will be working as part of a small team to build a greenfield Middle Office Platform, using a combination o ...

  • STAND 8 Technology Services

    Software Engineer

    2 days ago


    STAND 8 Technology Services New York, United States

    STAND 8 provides end to end IT solutions to enterprise partners across the United States with offices in Los Angeles, New York, New Jersey, Atlanta and more, including internationally in Mexico, India and Japan. · We are seeking a skilled Data Product Software Engineer to join o ...

  • Datadog

    Software Engineer

    2 weeks ago


    Datadog New York, United States

    Software Engineer - Resilience Engineering (Lisbon) · Lisbon, Portugal; · Production Practices is a new team in our SRE organization whose mission is to steward production readiness and support engineers as they implement best practices around reliability and operational excelle ...

  • Evolve Group

    Software Engineer

    1 week ago


    Evolve Group New York, United States

    Software Engineer · Leading Hedge Fund · New York · Python Programming Language · We are looking for Software Engineers with Python experience to join one of the top-performing hedge funds in the world. This firm has experienced tremendous growth and is expanding the headcount wi ...

  • Datadog

    Software Engineer

    2 weeks ago


    Datadog New York, United States

    Software Engineer - Fabric RPC (Lisbon) · Lisbon, Portugal; · The Fabric Remote Procedure Call (RPC) team at Datadog provides safe, reliable and scalable internal service-to-service communication for Datadog's engineering teams. In this role, you'll develop and maintain data pla ...

  • Flipp

    Software Engineer

    2 weeks ago


    Flipp New York, United States New York, NY

    Who We Are · At Justworks, you'll enjoy a welcoming and casual environment, great benefits, wellness program offerings, company retreats, and the ability to interact with and learn from leaders in the startup community. We work hard and care about our most prized asset - our pe ...

  • Aimsun

    Software Engineer

    3 weeks ago


    Aimsun New York, United States

    Location: Partially based in the Aimsun office in New York, combined with remote working and the option of flexible hours. · We are seeking for a Software Engineer to join our Product Development team at Aimsun office in NY. The candidate will work on developing connectors betwee ...

  • In Technology Group Inc (US)

    Software Engineer

    1 week ago


    In Technology Group Inc (US) New York, United States

    Position: Fullstack Engineer (Front-end leaning) · Salary: $185K · Location: NYC (ONSITE) · Are you ready to reshape the future of healthcare? We're a dynamic HealthTech startup on a mission to bring transparency to healthcare pricing through cutting-edge software solutions. If y ...

  • Datadog

    Software Engineer

    2 weeks ago


    Datadog New York, United States

    Software Engineer - Distributed Systems · Paris, France; Nantes, France; Bordeaux, France; Sophia Antipolis, France; Lyon, France · Distributed Systems engineers at Datadog design, implement and run in production the foundational platforms powering our applications. Your data pi ...

  • Morgan Stanley

    Software Engineer

    6 days ago


    Morgan Stanley New York, United States

    Software Engineer - Parametric (.Net) Job Number: · Posting Date · :May 31, 2024 Primary Location · :Americas-United States of America-New York-New YorkEducation Level:Refer to Position Description Job · :DevelopmentEmployment Type:Full TimeJob Level:Associate Descripti ...

  • PERSICO GROUP

    PLC Software Engineer

    2 weeks ago


    PERSICO GROUP New York, United States

    ll Gruppo Persico leader mondiale nellideazione, progettazione, ingegnerizzazione e produzione di stampi, sistemi di automazione e impianti complessi per il settore automotive. · Oltre che in automotive siamo attivi anche in altri settori, tra cui il rotostampaggio, l'aerospazia ...