Jobs
>
Redmond

    Senior Researcher - Redmond, United States - Microsoft Corporation

    Default job background
    Description
    Are you interested in developing and optimizing deep learning systems and LLMs? Are you interested in designing novel technology to accelerate training and highly-efficient inference of cutting-edge LLMs? Do you want to scale LLMs to their limits on massive supercomputers? Are you interested in being part of an exciting open-source library for deep learning systems? The DeepSpeed team is hiring


    Microsoft's DeepSpeed is an open-source library built on the PyTorch (machine learning framework) ecosystem that combines numerous research innovations and technology advancements to make deep learning efficient and easier to use.

    DeepSpeed can parallelize across thousands of GPUs and train models with trillions of parameters.

    Our OSS (Open Source Software) has powered many advanced models like MT-530B and BLOOM, and it supports unprecedented scale and speed for both training and inference.


    The DeepSpeed team is also part of the larger Microsoft AI at Scale initiative, which is pioneering the next-generation AI capabilities that are scaled across the company's products and AI platforms.


    The
    DeepSpeed
    team is looking for a
    Senior Researcher with passion for innovations and for building high-quality systems that will make significant impact inside and outside of Microsoft.

    Our team is highly collaborative, innovative, and end-user obsessed.

    We are looking for candidates with systems skills and passionate about driving innovations to improve the efficiency and effectiveness of deep learning systems.

    We value creativity, agility, accountability, and a desire to learn new technologies.

    Microsoft's mission is to empower every person and every organization on the planet to achieve more.

    As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals.

    Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond


    Responsibilities

    • You will research and develop an understanding of state-of-the-art insights, tools, and technologies and apply deep subject matter knowledge to support planning for research projects. You'll begin to evaluate insights based on their impact and value.
    • You will advance a research agenda through one or more research projects, yielding new algorithms, prototypes, insights, and more. You will contribute to ethics and privacy policies and help develop technologies that uphold company values.
    • You will expand collaborative relationships with relevant product or business groups and participate in activities such as filing patents and authoring white papers. You'll collaborate with other researchers and publish papers as a lead author.
    • You will provide mentorship by participating in onboarding junior team members. You'll guide junior team members in processes and scenarios, research projects, and their careers.
    • Develop and maintain a cutting-edge open-source project to accelerate and optimizeinference of LLMs on GPUs and CPUs.

    Qualifications

    Required/Minimum Qualifications

    • Doctorate in relevant field such as high-performance computing systems (e.g., cache/memory optimization, high-performance GPU programming, compiler-based optimization, fine-grained parallel library and runtime), or parallel/distributed systems (e.g., communication optimization, network architecture design, network programming).
    • OR equivalent experience.
    • 1 year(s) of experience with distributed systems and at least one of the following C, CUDA, Python.

    Additional or Preferred Qualifications:

    • Doctorate in relevant field AND 2 years related research experience
    • OR equivalent experience.
    • Experience publishing academic papers as a lead author or essential contributor.
    • Experience participating in a top conference in relevant research domain such as
    • high-performance computing systems (e.g., cache/memory optimization, high-performance GPU programming, compiler-based optimization, fine-grained parallel library and runtime), or parallel/distributed systems (e.g., communication optimization, network architecture design, network programming).
    • Experience with CUDA, CUTLASS, Triton, and other programming libraries for writing kernels for GPUs.
    • Experience with performance analysis and optimization for CPUs and GPUs
    • History of open-source contributions and working with open-source communities.
    • Experience with machine-learning (ML) and familiarity with an existing ML framework (e.g., PyTorch, TF)
    • Experience with Linux, Docker, and Git
    Research Sciences IC- The typical base pay range for this role across the U.S. is USD $112,000 - $218,400 per year.

    There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $145,800 - $238,600 per year.

    Certain roles may be eligible for benefits and other compensation.

    Find additional benefits and pay information here:
    \#WebXTPlatform#

    \#WebXT#

    \#DeepSpeed#

    \#NSBE

    Microsoft is an equal opportunity employer.

    Consistent with applicable law, all qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances.

    If you need assistance and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations ) .

  • Microsoft Corporation

    Senior Researcher

    3 weeks ago


    Microsoft Corporation Redmond, United States

    The Applied Sciences Group at Microsoft is looking for a Senior Researcher in automated machine learning (AutoML) technologies and infrastructures. The role is responsible for spearheading the development and research of cutting-edge AutoML algorithms including efficient Deep Neu ...

  • Microsoft Corporation

    Senior Researcher

    1 week ago


    Microsoft Corporation Redmond, United States

    The Microsoft Applied Sciences Group incubates disruptive technologies for Microsoft's next-gen Windows and Device products and is working on several exciting projects that will shape how computers and other devices perceive the user and the user's environment. Operating as a sta ...

  • Microsoft Corporation

    Senior Researcher

    3 weeks ago


    Microsoft Corporation Redmond, United States

    Are you interested in developing and optimizing deep learning systems and LLMs? Are you interested in designing novel technology to accelerate training and highly-efficient inference of cutting-edge LLMs? Do you want to scale LLMs to their limits on massive supercomputers? Are yo ...

  • Microsoft Corporation

    Senior Researcher

    1 week ago


    Microsoft Corporation Redmond, United States

    We're a company of learn-it-alls rather than know-it-alls and our culture is centered around embracing a growth mindset, a theme of inspiring excellence, and encouraging teams and leaders to bring their best each day. Does this sound like you? Learn more about our cultural attrib ...

  • Microsoft Corporation

    Senior Researcher

    1 week ago


    Microsoft Corporation Redmond, United States

    Are you interested in developing and optimizing deep learning systems? Are you interested in designing novel technology to accelerate their training and serving for cutting edge models and applications? Do you want to scale large Artificial Intelligence models to their limits on ...

  • Microsoft Corporation

    Senior Researcher

    1 week ago


    Microsoft Corporation Redmond, United States

    Are you interested in developing and optimizing deep learning systems? Are you interested in designing novel technology to accelerate their training and serving for cutting edge models and applications? Do you want to scale large Artificial Intelligence models to their limits on ...

  • Microsoft Corporation

    Senior Researcher

    3 weeks ago


    Microsoft Corporation Redmond, United States

    Microsoft Research's Health Futures is hiring a Senior Researcher in Redmond, WA. · We aspire to advance AI toward developing health systems that can instantly incorporate any new information to optimize delivery and accelerate discovery. · A key bottleneck is that current health ...

  • Microsoft Corporation

    Senior Researcher

    1 week ago


    Microsoft Corporation Redmond, United States

    M365 Research and the Privacy Preserving Machine Learning Initiative (PPML) are recruiting a Senior Researcher to explore privacy and confidentiality aspects of machine learning. The role offers the unique opportunity to work in close collaboration with colleagues in Microsoft Re ...

  • Microsoft Corporation

    Senior Researcher

    1 week ago


    Microsoft Corporation Redmond, United States

    M365 Research and the Privacy Preserving Machine Learning Initiative ) (PPML) are recruiting a Senior Researcher to explore privacy and confidentiality aspects of machine learning. The role offers the unique opportunity to work in close collaboration with colleagues in Microsoft ...

  • Microsoft

    Senior Researcher

    3 weeks ago


    Microsoft Redmond, WA, United States

    Are you interested in developing and optimizing deep learning systems and LLMs? Are you interested in designing novel technology to accelerate training and highly-efficient inference of cutting-edge LLMs? Do you want to scale LLMs to their limits on massive supercomputers? Are yo ...

  • Microsoft Corporation

    Senior Researcher

    1 week ago


    Microsoft Corporation Redmond, United States

    **The Microsoft Applied Sciences Group** incubates disruptive technologies for Microsoft's next-gen Windows and Device products and is working on several exciting projects that will shape how computers and other devices perceive the user and the user's environment. Operating as a ...

  • Microsoft Corporation

    Senior Researcher

    3 weeks ago


    Microsoft Corporation Redmond, United States

    The Deep Learning Group at Microsoft Research Redmond advances the state of the art on deep learning, foundation models and their applications to neuro-symbolic reasoning, software engineering, program synthesis, question answering, multi-modal intelligence, interactive AI, and n ...


  • Microsoft Corporation Redmond, United States

    Microsoft GenAI is hiring a Senior Principal Researcher who will be working at multi-modality (MM) for language models. · The Senior Principal Researcher will join the effort of training MM language models and exploring MM model use cases including MM agents, covering training sy ...


  • Microsoft Corporation Redmond, United States

    Semantic Machines is seeking effective AI researchers to join our world-class team. As a Senior Research Scientist, you will be part of an ambitious plan to reshape human-computer interaction. This includes the ability to influence the design and implementation of conversational ...


  • Microsoft Corporation Redmond, United States

    Semantic Machines is seeking effective AI researchers to join our world-class team. As a Senior Research Scientist, you will be part of an ambitious plan to reshape human-computer interaction. This includes the ability to influence the design and implementation of conversational ...


  • Microsoft Corporation Redmond, United States

    We are seeking skilled and passionate Senior Research Scientist to join our Responsible & Open Ai Research (ROAR) team in Azure Cognitive Services at Redmond, WA. · As a Senior Research Scientist, you will play a key role in advancing Responsible AI approaches to ensure safe rele ...


  • Microsoft Redmond, WA, United States

    Microsoft Research (MSR) AI Frontiers lab is seeking applications for the position of Senior Research Engineer – Generative AI to join their team in Redmond, WA and New York City, NY. The mission of the AI Frontiers lab is to expand the pareto frontier of AI capabilities, efficie ...


  • Microsoft Corporation Redmond, United States

    We are seeking skilled and passionate Senior Research Scientist to join our Responsible & Open Ai Research (ROAR) team in Azure Cognitive Services at Redmond, WA. · As a Senior Research Scientist, you will play a key role in advancing Responsible AI approaches to ensure safe rele ...


  • Microsoft Corporation Redmond, United States

    Microsoft GenAI is looking for Senior Research Scientist to join the team on large language model (LLM) training, which will mostly cover supervised fine-tuning, reinforcement learning from human feedback (RLHF), pre and post-training and their evaluation, as well as multi-modali ...


  • Microsoft Corporation Redmond, United States

    Microsoft Research (MSR) AI Frontiers lab is seeking applications for the position of Senior Research Engineer – Generative AI to join their team in Redmond, WA and New York City, NY. · The mission of the AI Frontiers ) lab is to expand the pareto frontier of AI capabilities, eff ...