+ h{Ln^RIt^RIHt^RIHt^RIt^RIHtHtH t H t H t H t H t Ht^RIHt]P"!RR7R4t]P"!RR7R 4t]P"!RR7R 4t]P"!RR7R 4t]P"R 4t]P.P1R RR.^3RR.^3RERFRG.4R4tRtRtRtRt]P"R4t]P.P1R RHRR.^3RIRERK.4R4t]P"R4t ]P.P1R RR.RL3RMRNRO.4R4t!Rt"]P"R4t#]P.P1R RR.RL3RR.RP3RRR.RL3RRR.RP3.4R4t$]P"R 4t%]P.P1R RR.RQ3RRRSRT.4R"4t&R#t'R$t(]P"R%4t)]P.P1R RURVRKRR.RW3RRR.RX3RRR.RW3.4R'4t*]P"R(4t+]P.P1R RYRVRGRR.RZ3RRR.R[3RRR.RZ3.4R)4t,]P"R*4t-]P.P1R RURVRKRR.RJ3RRR.R\3RRR.RJ3.4R+4t.]P"R,4t/]P.P1R RURVRKRR.R&3RRR.R!3RRR.R]3.4R-4t0]P"!RR7R.4t1]P.P1R/R0R1R2R3R4R5R6]Pd!R7]P.PgR8R97R:7.4]P.P1R;.R^O]!^4R<7R=44t4R>t5R?t6R@t7RAt8RBt9RCt:RDt;R#)_N)fsum) itemgetter)MLEAbsoluteDiscountingInterpolatedKneserNeyInterpolatedLaplaceLidstone StupidBackoff VocabularyWittenBellInterpolated)padded_everygramssession)scopec \.RO^R7#)a) unk_cutoff)rbcdz)r ?/usr/lib/python3/dist-packages/nltk/test/unit/lm/test_models.py vocabularyrs >1 MMrc.RO.RO.#)r)rrrr)egrrrrrrrr training_datar s "@ AArc VVUu.uFp\\^V44NK up#uupi)listr r sents& rbigram_training_datar'$'9F GD"1d+ , GG G&c VVUu.uFp\\^V44NK up#uupi)r#r%s& rtrigram_training_datar,)r(r)cB\^VR7pVPV4V#r"rrfit)rr'models&& rmle_bigram_modelr3.s j )E II"# Lrzword, context, expected_scorerrrrrc`\P!VPW4R4V8XgQhR#-C6?Npytestapproxscore)r3wordcontextexpected_scores&&&&rtest_mle_bigram_scoresr>5s) ==)//> E WW Wrcd\P!VPRR.44'gQhR#)rrN)mathisinflogscore)r3s&r'test_mle_bigram_logscore_for_zero_scorerCHs' ::&//cU; < << )rFr)rrrrr8r9entropy perplexity)r3trainedHrJs& r'test_mle_bigram_entropy_perplexity_seenrMLs_G" AJ ==)11':D AQ FF F ==)44W=t D RR Rrc.ROp\P!VPV44'gQh\P!VPV44'gQhR#)rN)rErr)rrrG)r@rArIrJ)r3 untraineds& r)test_mle_bigram_entropy_perplexity_unseenrQesIEI ::&..y9 : :: : ::&11)< = == =rcRpRp.ROp\P!VPV4R4V8XgQh\P!VPV4R4V8XgQhR#)g~jt@gs @r6N)rrr)-rrU)rrH)r3rLrJtexts& r+test_mle_bigram_entropy_perplexity_unigramsrYms] AJ HD ==)11$7 >! CC C ==)44T:D AZ OO OrcB\^VR7pVPV4V#r+orderrr0r,rr2s&& rmle_trigram_modelr_s aJ /E II#$ Lrrc`\P!VPW4R4V8XgQhR#r5r7)r_r;r<r=s&&&&rtest_mle_trigram_scoresras)$ ==*00? F. XX XrcD\R^VR7pVPV4V#g?r\r r1r'rr2s&& rlidstone_bigram_modelrfs" Sj 9E II"# Lrc`\P!VPW4R4V8XgQhR#r5r7)rfr;r<r=s&&&&rtest_lidstone_bigram_scorerhs04  +11$@$G   rc.ROpRpRp\P!VPV4R4V8XgQh\P!VPV4R4V8XgQhR#)rg=,Ԛ]@g鷯 1@r6NrErO)rrF)rFr)rr)rrrH)rfrXrLrJs& r test_lidstone_entropy_perplexityrks_ D$ AJ ==.66t E SS Src,VP^8XgQhR#)N)gamma)rqs&rtest_laplace_gammarz5s  % % ** *rcB\^VR7pVPV4V#)r+r/)r r1r^s&& rwittenbell_trigram_modelr|9s "1 >tMtT   rcB\^VR7pVPV4V#r[)r r1r^s&& rstupid_backoff_trigram_modelrs j 9E II#$ Lrc`\P!VPW4R4V8XgQhR#r5r7)rr;r<r=s&&&&r!test_stupid_backoff_trigram_scorers02  288GN   rcB\^VR7pVPV4V#)r"r\rres&& rkneserney_bigram_modelrs !j AE II"# Lr model_fixturer3r_rfrqr|rrrz*Stupid Backoff is not a valid distribution)reason)marksr<)idscaaVPV4o\VV3RlSP44p\P!VR4R8XgQhR#)c3H<"TFpSPVS4xK R#5iN)r:).0wr<r2s& r !test_sums_to_1..!sJkU[[G44ks"gHz>rrN)getfixturevaluesumvocabr8r9)rr<requestscores_for_contextr2s&f& @rtest_sums_to_1rsD0  # #M 2EJekkJJ ==+T 2c 99 9rc8VP^R7R8XgQhR#)r+ random_seedrFNgenerater_s&rtest_generate_one_no_contextr*s  % %! % 4 ?? ?rcVPR.R7R8XgQhVPRR.R7R8XgQhVPRR.R7R8XgQhR#)r text_seedrrrNrrs&r'test_generate_one_from_limiting_contextr.s`  % % % 6# == =  % %c % ;s BB B  % %c % ;s BB Brc:VPR^R7R8XgQhR#)rrrN)rrrrs&r%test_generate_one_from_varied_contextr5s!  % % ! % LPS SS Src\VP\R44.pVPV4VP ^R^R7.RO8XgQhR#)bdbdbdrN)rr)rrrrrrr)r r]r$r1r)r_more_training_texts& rtest_generate_cycler:sV+,=,C,CT(^TU,-  % %a:1 % MR  rc@VP^R^R7.RO8XgQhR#)rN)rr)rFrrrrFrrs&rtest_generate_with_text_seedrKs,  % %arCrMrQrYr_rarfrhrkrmrorqrtrvrzr|r~rrrrrrrparamxfailrrrrrrrrrrrrs     4i N!Ni B!Bi H!Hi H!H # seQ seQ  XX=S2>P( #  seQ "Y#"Y # seY   '010U2 # seY seY sCj)$ sCj)$   # seW   )232 T2+ #    se34 sCjLM sCj9;3<=<( #    se-/ sCjAB sCj24? #HI#H #    se79 sCjKL sCj<>9 BC B #    seU sCj%  sCj=*!*+*i ! ",  *++##C$ $ R1  : %.:@CT "I 3r