始める無料で始める

Knowledge Check 1 Question 2

As mentioned in the article The Power of Language Models, the Oxford English Dictionary has entries for around one million words. Assume that there are actually exactly one million entries: 700,000 entries refer to common words (e.g., house) and 300,000 refer to scientific terms (e.g., photosynthesis). If all common words have exactly the same probability and all scientific terms have the same probability, and the probability of each common word is 5 times as high as the probability of each scientific word, what are the probabilities of “hungry” (a common word) and “photosynthesis” (a scientific term)?

この演習はコースの一部です

Google DeepMind: Build Your Own Small Language Model

コースを見る

実践的なインタラクティブ演習

理論を実践に変える、インタラクティブな演習のひとつをお試しください

演習を開始する