• home
    • members
    • about us
    • books
  • Lectures
    • Deep Learning基礎講座
    • Deep Learning応用講座
    • Deep Learning実践開発講座
    • Deep Learning for NLP講座
    • Deep Learning Day
  • DL Seminars
  • DL Hacks
  • members
  • news
  • contact
    • 講座申し込みのよくある質問
    • contact
  • facebook
  • Twitter
  • English
    • 日本語 日本語
    • English English
Skip to content
Logo Deep Learning JP Discover the Gradient
  • home
    • members
    • about us
    • books
  • Lectures
    • Deep Learning基礎講座
    • Deep Learning応用講座
    •  Deep Learning実践開発講座
    • Deep Learning for NLP講座
    • Deep Learning Day
  • DL Seminars
  • DL Hacks
  • members
  • news
  • contact
    • 講座申し込みのよくある質問
    • contact
  • facebook
  • Twitter
  • English
    • 日本語 日本語
    • English English

Lory: Fully Differentiable Mixture-of-Experts forAutoregressive Language Model Pre-training

Thursday September 12th, 2024Thursday September 12th, 2024 risa.murata dls-2024,

Sorry, this entry is only available in 日本語. For the sake of viewer convenience, the content is shown below in the alternative language. You may click the link to switch the active language.

Lory Fully Differentiable Mixture-of-Experts for Autoregressive Language Model Pre-training – 20240912 (1) by @DeepLearning2023

Post navigation

What Do Language Models Learn in Context? The Structured Task Hypothesis
DiG: Scalable and Efficient Diffusion Models with Gated Linear Attention
Copyright © 2017 Deep Learning JP. All Rights Reserved.