Do you know how to measure vocabulary size? In this video, I am taking a test to gauge how many words do I know. ... <看更多>

Optimal vocab size is totally task dependent. However, we empirically found that 32k is reasonable choice for neural machine translation. ... <看更多>

The vocabulary size will be the number of unique tokens seen in the training corpus. It won't have any necessary relationship with the ... ... <看更多>