+ h$ Rt^RIt^RI5^RI5^RIHt^RIHt]PR4t ]PR4t ]PR4t ]PR4t !R R ]4t!R R ]]4t!R R]4tR#)zO Corpus reader for corpora that consist of parenthesis-delineated parse trees. N)*)map_tag)Treez\((\d+) ([^\s()]+) ([^\s()]+)\)z\(([^\s()]+) ([^\s()]+)\)z\([^\s()]+ ([^\s()]+)\)z \s*\(\s*\(cPa]tRt^toRtR RltRtRtRtR Rlt Rt R t Vt R#) BracketParseCorpusReaderz Reader for corpora that consist of parenthesis-delineated parse trees, like those found in the "combined" section of the Penn Treebank, e.g. "(S (NP (DT the) (JJ little) (NN dog)) (VP (VBD barked)))". Nc V\PWW%4W0nW@nW`nR#)ag :param root: The root directory for this corpus. :param fileids: A list or regexp specifying the fileids in this corpus. :param comment_char: The character which can appear at the start of a line to indicate that the rest of the line is a comment. :param detect_blocks: The method that is used to find blocks in the corpus; can be 'unindented_paren' (every unindented parenthesis starts a new parse) or 'sexpr' (brackets are matched). :param tagset: The name of the tagset used by this corpus, to be used for normalizing or converting the POS tags returned by the ``tagged_...()`` methods. N)SyntaxCorpusReader__init__ _comment_char_detect_blocks_tagset)selfrootfileids comment_char detect_blocksencodingtagsets&&&&&&&B/usr/lib/python3/dist-packages/nltk/corpus/reader/bracket_parse.pyr !BracketParseCorpusReader.__init__"s%, ##DB)+ c VPR8Xd\WPR7#VPR8Xd \V4#VPR8Xdl\ VRR7pVP'dKVUu.uF>p\ P R\ PVP4,RV4NK@ ppV#QR4huupi) sexpr)r blanklineunindented_parenz^\()start_rez (?m)^%s.*zbad block type)r read_sexpr_blockr read_blankline_blockread_regexp_blockresubescape)r streamtokstoks&& r _read_block$BracketParseCorpusReader._read_block=s   ' )#F9K9KL L  K /'/ /  $6 6$Vf=D!!! $#FF;43E3E)FFCP#K && &1 s8ACcb\PRRV4p\PRRV4pV#)z\((.)\)z(\1 \1)z"\(([^\s()]+) ([^\s()]+) [^\s()]+\)(\1 \2)r r!r ts&&r _normalize#BracketParseCorpusReader._normalizeOs, FF:z1 - FF8*a Hrc \P!VPV44pVP4R8Xd\ V4^8Xd V^,#V# \ dp\ PPR4TPR8Xd|\^^4Fkp\TPTRT,,44p\ PPRT,4TuuRp?# \ dKii;i \ PPR4\RTPT44uRp?#Rp?ii;i)rz(Bad tree detected; trying to recover... )z( Recovered by adding %d close paren(s) Nz' Recovered by returning a flat parse. S)zmismatched parens) r fromstringr-labellen ValueErrorsysstderrwriteargsrange_tag)r r,treeenvs&& r_parseBracketParseCorpusReader._parseVs +??4??1#56Dzz|r!c$i1nAw  + JJ  H Ivv//q!A S1W!=> ((JQN !%% JJ  G HTYYq\* *! +sOAAA E"?E "AC91E 3E9 DE D>E E Ec \PVPV44UUu.uFwr4WC3NK pppV'd<W P8wd,VUUu.uFwrCV\ VPW#43NK pppV#uuppiuuppiN)TAGWORDfindallr-r r)r r,rpw tagged_sents&&& rr;BracketParseCorpusReader._tagqs{,3OODOOA#BcJ\PVPV44#rC)WORDrEr-r+s&&r_wordBracketParseCorpusReader._wordys||DOOA.//r)r r r )Nrutf8NrC) __name__ __module__ __qualname____firstlineno____doc__r r&r-r@r;rL__static_attributes____classdictcell__ __classdict__s@rrrs-6'$+600rrcaa]tRt^}toRtRtR V3RlltR V3RlltR V3RlltR V3Rllt R V3Rllt R V3Rllt R t Vt V;t#) #CategorizedBracketParseCorpusReaderz A reader for parsed corpora whose documents are divided into categories based on their file identifiers. @author: Nathan Schneider c d\PW4\P!V.VO5/VBR#)a< Initialize the corpus reader. Categorization arguments (C{cat_pattern}, C{cat_map}, and C{cat_file}) are passed to the L{CategorizedCorpusReader constructor }. The remaining arguments are passed to the L{BracketParseCorpusReader constructor }. N)CategorizedCorpusReaderr r)r r9kwargss&*,rr ,CategorizedBracketParseCorpusReader.__init__s* ((6 ))$@@@rcB<\SV`VPW4V4#rC)super tagged_words_resolver r categoriesr __class__s&&&&rr`0CategorizedBracketParseCorpusReader.tagged_wordsw#DMM'$FOOrcB<\SV`VPW4V4#rC)r_ tagged_sentsrarbs&&&&rrh0CategorizedBracketParseCorpusReader.tagged_sentsrfrcB<\SV`VPW4V4#rC)r_ tagged_parasrarbs&&&&rrk0CategorizedBracketParseCorpusReader.tagged_parasrfrc@<\SV`VPW44#rC)r_ parsed_wordsrar rrcrds&&&rrn0CategorizedBracketParseCorpusReader.parsed_wordsw#DMM'$FGGrc@<\SV`VPW44#rC)r_ parsed_sentsraros&&&rrs0CategorizedBracketParseCorpusReader.parsed_sentsrqrc@<\SV`VPW44#rC)r_ parsed_parasraros&&&rrv0CategorizedBracketParseCorpusReader.parsed_parasrqr)NNN)NN)rOrPrQrRrSr r`rhrkrnrsrvrTrU __classcell__)rdrWs@@rrYrY}s: APPPHHHHrrYcHa]tRt^toRtRRltR RltR RltRtRt Vt R#) AlpinoCorpusReadera Reader for the Alpino Dutch Treebank. This corpus has a lexical breakdown structure embedded, as read by `_parse` Unfortunately this puts punctuation and some other words out of the sentence order in the xml element tree. This is no good for `tag_` and `word_` `_tag` and `_word` will be overridden to use a non-default new parameter 'ordered' to the overridden _normalize function. The _parse function can then remain untouched. Nc <\PVVRRVVR7R#)z alpino\.xmlr)rrrN)rr )r rrrs&&&&rr AlpinoCorpusReader.__init__s' ))   % * rc LVR,R8wdR#\PRRV4pV'd\PRRV4pM\PRR V4p\PR R V4p\PR RV4p\PR RV4pV#)a=Normalize the xml sentence element in t. The sentence elements , although embedded in a few overall xml elements, are separated by blank lines. That's how the reader can deliver them one at a time. Each sentence has a few category subnodes that are of no use to us. The remaining word nodes may or may not appear in the proper order. Each word node has attributes, among which: - begin : the position of the word in the sentence - pos : Part of Speech: the Tag - word : the actual word The return value is a string with all xml elementes replaced by clauses: either a cat clause with nested clauses, or a word clause. The order of the bracket clauses closely follows the xml. If ordered == True, the word clauses include an order sequence number. If ordered == False, the word clauses only have pos and word parts. :N Nz z(\1z> z (\1 \2 \3)z- r)z r0z.*zr*)r r,ordereds&&&rr-AlpinoCorpusReader._normalizes" S6\ ! FF0&! < QA GUVWA FF<q ) FF-sA 6 FF%sA .rc \PVPVRR74UUUu.uFwr4p\V4WT3NK ppppVP 4V'd@W P 8wd0VUUUu.uFwr5qE\ VP W$43NK ppppV#VUUUu.uF wr5qEV3NK ppppV#uupppiuupppiuupppi)T)r) SORTTAGWRDrEr-intsortr r)r r,rorFrGrHs&&& rr;AlpinoCorpusReader._tags(//40PQ Q qVQNQ    f ,GRGR)1GDLL&45{  4??;iqQq6;K? @sB:6#C%Cc \VPV4pVUUu.uFwr4VNK upp#uuppi)z(Return a correctly ordered list if words)r;)r r,rHrGrFs&& rrLAlpinoCorpusReader._words)iil +, fq ,,,s (rx)z ISO-8859-1N)FrC) rOrPrQrRrSr r-r;rLrTrUrVs@rr{r{s$  D --rr{)rSr6nltk.corpus.reader.apinltk.corpus.reader.utilnltk.tagr nltk.treerr compilerrDrKEMPTY_BRACKETSrrr[rYr{rxrrrs $%ZZ: ; **1 2 zz,-M*`01`0F%H5%HPH-1H-r