+ h.^RIt^RIHt^RIHt^RIHt^RIHt!RR]P4t !RR ]P4t R#) N)closing)data) PorterStemmer)SnowballStemmerc>a]tRt^ toRtRtRtRtRtRt Vt R#) SnowballTestc |\RR4pVPR4R8XgQhVPR4R8XgQhVPR4R8XgQhVPR4R 8XgQhVPR 4R 8XgQhVPR 4R 8XgQhVPR 4R 8XgQhVPR 4R 8XgQhVPR4R8XgQh\RR4pVPR 4R8XgQhVPR4R 8XgQhVPR4R8XgQh\R4pVPR4R8XgQhVPR4R8XgQhVPR4R8XgQhVPR4R 8XgQhVPR4R8XgQhR#)zl this unit testing for test the snowball arabic light stemmer this stemmer deals with prefixes and suffixes arabicTu&الْعَرَبِــــــيَّةuعربuالعربيةu فقالواuقالuالطالباتuطالبuفالطالباتuوالطالباتuالطالبونu اللذانuمنFuاللذuالكلماتuكلمNrstem)self ar_stemmers& :/usr/lib/python3/dist-packages/nltk/test/unit/test_stem.py test_arabicSnowballTest.test_arabic s %Xt4 GHHTTT/0H<<<~.(:::12j@@@34 BBB34 BBB12j@@@~..@@@v&&000$Xu5 ~.*<<<12j@@@/0H<<<$X. GHHTTT/0H<<<~.(:::12j@@@/0H<<<cL\R4pVPR4R8XgQhR#)russianuавантненькаяuавантненькNr )r stemmer_russians& r test_russianSnowballTest.test_russian's'))4##$>?CYYYYrc\R4p\RRR7pVPR4R8XgQhVPR4R8XgQhVPR4R8XgQhVPR4R8XgQhR#)germanT)ignore_stopwordsu SchränkeschrankkeinenkeinNr )r stemmer_germanstemmer_german2s& r test_germanSnowballTest.test_german+s|(2)(TJ""=1Y>>>##M2i???""8,666##H-999rc|\R4pVPR4R8XgQhVPR4R8XgQhR#)spanish VisionadovisionalguealguNr r stemmers& r test_spanishSnowballTest.test_spanish5s<!),||K(H444||G$...rcL\R4pVPR4R8XgQhR#)englishzy'syNr r(s& rtest_short_strings_bug#SnowballTest.test_short_strings_bug=s#!),||E"c)))rN) __name__ __module__ __qualname____firstlineno__rrr r*r/__static_attributes____classdictcell__ __classdict__s@rrr s$=:Z:/**rrcJa]tRt^BtoRtRtRtRtRtRt Rt Rt Vt R #) PorterTestc\\P!R4PRR74;_uu_4pVP 4P 4uuRRR4# +'giR#;i)z*stemmers/porter_test/porter_vocabulary.txtutf-8encodingN)rrfindopenread splitlinesr fps& r _vocabularyPorterTest._vocabularyCs\  IIB C H H  I   779'')     s A!! A2 c\VR7p\VP4V4F5wrEVPV4pWe8XdKQRP VVVV44h R#))modez*{} should stem to {} in {} mode but got {}N)rziprFr format)r stemmer_modeexpected_stemsr)word true_stemour_stems&&& r_test_against_expected_output(PorterTest._test_against_expected_outputKsd\2"4#3#3#5~FOD||D)H% ;BB  % Grc &\\P!R4PRR74;_uu_4pVP \ P VP4P44RRR4R# +'giR#;i)aJTests all words from the test vocabulary provided by M Porter The sample vocabulary and output were sourced from https://tartarus.org/martin/PorterStemmer/voc.txt and https://tartarus.org/martin/PorterStemmer/output.txt and are linked to from the Porter Stemmer algorithm's homepage at https://tartarus.org/martin/PorterStemmer/ z-stemmers/porter_test/porter_martin_output.txtr=r>N) rrr@rArQrMARTIN_EXTENSIONSrBrCrDs& rtest_vocabulary_martin_mode&PorterTest.test_vocabulary_martin_modeXst IIE F K K  L     . .//1E1E1G      =A?? B c&\\P!R4PRR74;_uu_4pVP \ P VP4P44RRR4R# +'giR#;i)z+stemmers/porter_test/porter_nltk_output.txtr=r>N) rrr@rArQrNLTK_EXTENSIONSrBrCrDs& rtest_vocabulary_nltk_mode$PorterTest.test_vocabulary_nltk_modejsr  IIC D I I  J     . .--rwwy/C/C/E      rWc\\P!R4PRR74;_uu_4pVP \ P VP4P44RRR4VP \ P \P!R4PRR7P4P44R# +'giLr;i)z/stemmers/porter_test/porter_original_output.txtr=r>N) rrr@rArQrORIGINAL_ALGORITHMrBrCrDs& rtest_vocabulary_original_mode(PorterTest.test_vocabulary_original_modets IIG H M M  N     . .00"'')2F2F2H    **  , , IIG H T7T # TV Z\    s =C C/ c F\4PR4R8XgQhR#)ztTest for bug https://github.com/nltk/nltk/issues/1581 Ensures that 'oed' can be stemmed without throwing an error. oedoNrr )r s&r test_oed_bugPorterTest.test_oed_bugs ##E*c111rc \4pVPR4R8XgQhVPR4R8XgQhVPRRR7R8XgQhVPR4R8XgQhVPRRR7R8XgQhR #) z}Test for improvement on https://github.com/nltk/nltk/issues/2507 Ensures that stems are lowercased when `to_lowercase=True` OnonIiF) to_lowercaseGithubgithubNrc)r porters& rtest_lowercase_option PorterTest.test_lowercase_options {{4 D((({{33&&&{{3U{3s:::{{8$000{{8%{8HDDDrr1N) r2r3r4r5rFrQrUrZr^rdror6r7r8s@rr;r;Bs/* $ 02 E Err;) unittest contextlibrnltkrnltk.stem.porterrnltk.stem.snowballrTestCaserr;r1rrrws=*.6*8$$6*r[E""[Er