开始使用免费开始使用

Knowledge Check 1 Question 2

As mentioned in the article The Power of Language Models, the Oxford English Dictionary has entries for around one million words. Assume that there are actually exactly one million entries: 700,000 entries refer to common words (e.g., house) and 300,000 refer to scientific terms (e.g., photosynthesis). If all common words have exactly the same probability and all scientific terms have the same probability, and the probability of each common word is 5 times as high as the probability of each scientific word, what are the probabilities of “hungry” (a common word) and “photosynthesis” (a scientific term)?

本练习是课程的一部分

Google DeepMind: Build Your Own Small Language Model

查看课程

动手互动练习

通过我们的互动练习之一,将理论转化为实践

开始练习