18 lines
891 B
Plaintext
18 lines
891 B
Plaintext
using AddSmooth for 1-grams
|
|
using AddSmooth for 2-grams
|
|
using AddSmooth for 3-grams
|
|
warning: 2.05172e-06 backoff probability mass left for "" -- incrementing denominator
|
|
warning: 2.36496e-06 backoff probability mass left for "" -- incrementing denominator
|
|
warning: 2.6782e-06 backoff probability mass left for "" -- incrementing denominator
|
|
warning: 2.99143e-06 backoff probability mass left for "" -- incrementing denominator
|
|
discarded 5 1-gram probs predicting pseudo-events
|
|
warning: distributing 3.29548e-06 left-over probability mass over 6550 zeroton words
|
|
discarded 2 2-gram contexts containing pseudo-events
|
|
discarded 11 2-gram probs predicting pseudo-events
|
|
discarded 10919 3-gram contexts containing pseudo-events
|
|
discarded 9 3-gram probs predicting pseudo-events
|
|
discarded 1065659 3-gram probs discounted to zero
|
|
writing 33110 1-grams
|
|
writing 425750 2-grams
|
|
writing 268962 3-grams
|