U-PaLM (540B)
GoogleLanguage generationLanguage modeling/generationQuestion answeringMathematical reasoningQuantitative reasoning
U-PaLM (540B) is a language generation model from Google released in 2022 with 540000000000.0 parameters.
About U-PaLM (540B)
Scaling language models improves performance but comes with significant computational costs. This paper proposes UL2R, a method that substantially improves existing language models and their scaling curves with a relatively tiny amount of extra compu
Details
- Provider
- Task
- Language generation,Language modeling/generation,Question answering,Mathematical reasoning,Quantitative reasoning
- Parameters
- 540000000000.0
- Released
- 2022-10-20
- Open weights
- No