시작하기무료로 시작하기

Knowledge Check 1 Question 2

As mentioned in the article The Power of Language Models, the Oxford English Dictionary has entries for around one million words. Assume that there are actually exactly one million entries: 700,000 entries refer to common words (e.g., house) and 300,000 refer to scientific terms (e.g., photosynthesis). If all common words have exactly the same probability and all scientific terms have the same probability, and the probability of each common word is 5 times as high as the probability of each scientific word, what are the probabilities of “hungry” (a common word) and “photosynthesis” (a scientific term)?

이 연습은 강의의 일부입니다

Google DeepMind: Build Your Own Small Language Model

강의 보기

실습형 인터랙티브 연습문제

이론을 실습으로 바꾸는 인터랙티브 연습 중 하나를 만나보세요

연습 시작