+ h,RtRt^RI5^RIHtHt^RIHt!RR]4tR Rlt !R R ] 4t !R R ]4t R#)z& Corpus reader for the SemCor Corpus. z epytext en)*)XMLCorpusReader XMLCorpusView)Treeca]tRt^toRtRRltRRltRRltRR3RltRRlt RR lt RR3R lt R t R t ]R 4tRtTtR#)SemcorCorpusReaderz Corpus reader for the SemCor Corpus. For access to the complete XML data structure, use the ``xml()`` method. For access to simple word lists and tagged word lists, use ``words()``, ``sents()``, ``tagged_words()``, and ``tagged_sents()``. cL\P!WV4W@nW0nR#N)r__init___lazy_wordnet)selfrootfileidswordnetlazys&&&&&;/usr/lib/python3/dist-packages/nltk/corpus/reader/semcor.pyr SemcorCorpusReader.__init__s  W5  Nc ,VPVRRRR4#)zZ :return: the given file(s) as a list of words and punctuation symbols. :rtype: list(str) wordF_itemsr rs&&rwordsSemcorCorpusReader.words s {{7FE5%@@rc ,VPVRRRR4#)z :return: the given file(s) as a list of chunks, each of which is a list of words and punctuation symbols that form a unit. :rtype: list(list(str)) chunkFrrs&&rchunksSemcorCorpusReader.chunks's{{7GUE5AArposc 8VPVRRVR8gVR8g4#)a :return: the given file(s) as a list of tagged chunks, represented in tree form. :rtype: list(Tree) :param tag: `'pos'` (part of speech), `'sem'` (semantic), or `'both'` to indicate the kind of tags to include. Semantic tags consist of WordNet lemma IDs, plus an `'NE'` node if the chunk is a named entity without a specific entry in WordNet. (Named entities of type 'other' have no lemma. Other chunks not in WordNet have no semantic tag. Punctuation tokens have `None` for their part of speech tag.) rFsemr rr rtags&&&r tagged_chunks SemcorCorpusReader.tagged_chunks0s#{{7GUC5L#,OOrc ,VPVRRRR4#)zx :return: the given file(s) as a list of sentences, each encoded as a list of word strings. :rtype: list(list(str)) rTFrrs&&rsentsSemcorCorpusReader.sents?s {{7FD%??rc ,VPVRRRR4#)zx :return: the given file(s) as a list of sentences, each encoded as a list of chunks. :rtype: list(list(list(str))) rTFrrs&&r chunk_sentsSemcorCorpusReader.chunk_sentsGs {{7GT5%@@rc 8VPVRRVR8gVR8g4#)aC :return: the given file(s) as a list of sentences. Each sentence is represented as a list of tagged chunks (in tree form). :rtype: list(list(Tree)) :param tag: `'pos'` (part of speech), `'sem'` (semantic), or `'both'` to indicate the kind of tags to include. Semantic tags consist of WordNet lemma IDs, plus an `'NE'` node if the chunk is a named entity without a specific entry in WordNet. (Named entities of type 'other' have no lemma. Other chunks not in WordNet have no semantic tag. Punctuation tokens have `None` for their part of speech tag.) rTr"r rr#s&&&r tagged_sentsSemcorCorpusReader.tagged_sentsOs#{{7GT3%<NNrc aVR8XdV'gV3RlpM$SP'd\M SPp\SP V4Uu.uFpV!WrW4VSP 4NK up4#uupi)rcf<\SP'd\M SP!V!4#r )LazyConcatenationr SemcorWordView_words)argsr s*r+SemcorCorpusReader._items..bs$/#':::4;;>Fr)r r3r4concatabspathsr )r runit bracket_sentpos_tagsem_tag_fileidsf&&&&& rrSemcorCorpusReader._items^so 6>,A#'***$++A#mmG4 4F& w N4    sA9c  VR9gQh.p\PV4P4pVPR4Fp.p \ V4FOp \ P WWEVP4p VR8XdV PV 4K>V PV 4KQ V'd/VP\VPR,V 44KVPV 4K RV9gQhV#)a Helper used to implement the view methods -- returns a list of tokens, (segmented) words, chunks, or sentences. The tokens and chunks may optionally be tagged (with POS and sense information). :param fileid: The name of the underlying file. :param unit: One of `'token'`, `'word'`, or `'chunk'`. :param bracket_sent: If true, include sentence bracketing. :param pos_tag: Whether to include part-of-speech tags. :param sem_tag: Whether to include semantic tags, namely WordNet lemma and OOV named entity status. rz.//ssnumN)tokenrr) ElementTreeparsegetrootfindall_all_xmlwords_inr_wordr extendappendSemcorSentenceattrib) r r?r:r;r<r=resultxmldocxmlsentsentxmlworditms &&&&&& rr4SemcorCorpusReader._wordsns1111""6*224~~f-GD+G4(..7T]]6>KK$KK$5 nW^^F-CTJK d#. 6!!! rcVPpV'gRpVPRV4pVPR4pVeAVR,V,pR\VPR4^,4^, ,p MR;rVPRV4p VPR4p RVP 49p VPR 4p VR 8Xd?V'g V'gTpV#V3V'dV 3MR,V'dWiW3MR,pV#VPR 4pVR 8XdV#V eVP V4pV'd \W4.MTpV'd0V 'd(V e\X\RV4.4#\RV4#V'dV e \XV4#V'd V^,#V# \ dJR TT \T 43,pL \d#TR,T ,R,T ,pLi;ii;i)lemmalexsnN%:rdfwnsnpnr rCr>rz %s.%s.%02d.NE)nvars) textgetintsplitkeyslemma_from_key Exception ValueErrorr)rRr:r<r=rtknrWrX sense_keywnposredefsensenum isOOVEntityr rSwwsensebottoms&&&&& rrISemcorCorpusReader._wordsllC GS) G$   e+I-EKK$Q'(1,E!% $I 3 ;;v&glln, kk   7?7J F!(vb2@Gh+?@@#D&11!5v..!!9$!M;% $0 % % #H 4%E * % e 3c 9H D"s*,F55 H G)HH HH )r r )Tr )__name__ __module__ __qualname____firstlineno____doc__r rrr%r(r+r.rr4 staticmethodrI__static_attributes____classdictcell__ __classdict__s@rrrsb AB%)u P@A$(e O #JJ"J"rrNcVf.pVF2pVPR9dVPV4K'\W!4K4 V#)Nwfpunc)r$rKrH)eltrNchilds&& rrHrHs= ~ 99 & MM% U +  Mrc*a]tRt^toRtRtRtVtR#)rLz A list of words, augmented by an attribute ``num`` used to record the sentence identifier (the ``n`` attribute from the XML). c<Wn\PW4R#r )numlistr )r ritemss&&&rr SemcorSentence.__init__s d"r)rN)rxryrzr{r|r r~rrs@rrLrLs ##rrLc<a]tRt^toRtRtRtRtRtRt Vt R#)r3zF A stream backed corpus view specialized for use with the BNC corpus. c V'dRpMRpW nW0nW@nWPnW`n\ P !WV4R#)aC :param fileid: The name of the underlying file. :param unit: One of `'token'`, `'word'`, or `'chunk'`. :param bracket_sent: If true, include sentence bracketing. :param pos_tag: Whether to include part-of-speech tags. :param sem_tag: Whether to include semantic tags, namely WordNet lemma and OOV named entity status. z.*/sz.*/s/(punc|wf)N)_unit_sent_pos_tag_sem_tagr rr )r r?r:r;r<r=rtagspecs&&&&&&& rr SemcorWordView.__init__s: G&G !    tW5rcjVP'dVPV4#VPV4#r )r handle_sent handle_word)r rcontexts&&&r handle_eltSemcorWordView.handle_elts- :::##C( (##C( (rc\PWPVPVPVP 4#r )rrIrrrr )r rs&&rrSemcorWordView.handle_words.!'' T]]DMM4==  rc8.pVFvpVPR9dIVPV4pVPR8XdVPV4KIVP V4K\\ RVP,4h \ VPR,V4#)rrzUnexpected element %srBr)r$rrrJrKrmrLrM)r rrQrrSs&& rrSemcorWordView.handle_sents~EyyN*&&u-::'KK$KK$ !8599!DEEcjj0$77r)rrrrr N) rxryrzr{r|r rrrr~rrs@rr3r3s#6,)  8 8rr3r ) r| __docformat__nltk.corpus.reader.apinltk.corpus.reader.xmldocsrr nltk.treerrrHrrLr3rerrrsF $EK"K"\#T#18]18r