+
h- L R t ^ RIt^ RI5 ^ RI5 ]P ! R4 t]P ! R4 t]P ! R4 t]P ! R4 t]P ! R4 t ]P ! R4 t
]P ! R 4 t ! R
R 4 t ! R R
]
4 tR# )a
CorpusReader for the Comparative Sentence Dataset.
- Comparative Sentence Dataset information -
Annotated by: Nitin Jindal and Bing Liu, 2006.
Department of Computer Sicence
University of Illinois at Chicago
Contact: Nitin Jindal, njindal@cs.uic.edu
Bing Liu, liub@cs.uic.edu (https://www.cs.uic.edu/~liub)
Distributed with permission.
Related papers:
- Nitin Jindal and Bing Liu. "Identifying Comparative Sentences in Text Documents".
Proceedings of the ACM SIGIR International Conference on Information Retrieval
(SIGIR-06), 2006.
- Nitin Jindal and Bing Liu. "Mining Comprative Sentences and Relations".
Proceedings of Twenty First National Conference on Artificial Intelligence
(AAAI-2006), 2006.
- Murthy Ganapathibhotla and Bing Liu. "Mining Opinions in Comparative Sentences".
Proceedings of the 22nd International Conference on Computational Linguistics
(Coling-2008), Manchester, 18-22 August, 2008.
N)*z^\*+$z z z
zz (\d)_((?:[\.\w\s/-](?!\d_))+)z
\(([^\(]*)\)$c 4 a ] tR t^3t o RtRR ltR tRtV tR# )
ComparisonzF
A Comparison represents a comparative sentence and its constituents.
Nc N Wn W n W0n W@n WPn W`n R# )a
:param text: a string (optionally tokenized) containing a comparison.
:param comp_type: an integer defining the type of comparison expressed.
Values can be: 1 (Non-equal gradable), 2 (Equative), 3 (Superlative),
4 (Non-gradable).
:param entity_1: the first entity considered in the comparison relation.
:param entity_2: the second entity considered in the comparison relation.
:param feature: the feature considered in the comparison relation.
:param keyword: the word or phrase which is used for that comparative relation.
N)text comp_typeentity_1entity_2featurekeyword)selfr r r r r
r s &&&&&&&F/usr/lib/python3/dist-packages/nltk/corpus/reader/comparative_sents.py__init__Comparison.__init__8 s" & "
c R P V P V P V P V P V P
V P 4 # )z]Comparison(text="{}", comp_type={}, entity_1="{}", entity_2="{}", feature="{}", keyword="{}"))formatr r r r r
r )r s &r
__repr__Comparison.__repr__R s@
*
& II NN MM MM LL LL
r )r r r r
r r )NNNNNN) __name__
__module__ __qualname____firstlineno____doc__r r __static_attributes____classdictcell__
__classdict__s @r
r r 3 s 4
r r c a ] tR t^`t o Rt]t]! 4 RR3R ltRR lt RR lt
R t RR lt RR lt
R
tR tR tR
tRtV tR# ) ComparativeSentencesCorpusReaderaO
Reader for the Comparative Sentence Dataset by Jindal and Liu (2006).
>>> from nltk.corpus import comparative_sentences
>>> comparison = comparative_sentences.comparisons()[0]
>>> comparison.text # doctest: +NORMALIZE_WHITESPACE
['its', 'fast-forward', 'and', 'rewind', 'work', 'much', 'more', 'smoothly',
'and', 'consistently', 'than', 'those', 'of', 'other', 'models', 'i', "'ve",
'had', '.']
>>> comparison.entity_2
'models'
>>> (comparison.feature, comparison.keyword)
('rewind', 'more')
>>> len(comparative_sentences.comparisons())
853
Nutf8c X \ P WW%4 W0n W@n RV n R# )a~
:param root: The root directory for this corpus.
:param fileids: a list or regexp specifying the fileids in this corpus.
:param word_tokenizer: tokenizer for breaking sentences or paragraphs
into words. Default: `WhitespaceTokenizer`
:param sent_tokenizer: tokenizer for breaking paragraphs into sentences.
:param encoding: the encoding that should be used to read the corpus.
z
README.txtN) CorpusReaderr _word_tokenizer_sent_tokenizer_readme)r rootfileidsword_tokenizersent_tokenizerencodings &&&&&&r
r )ComparativeSentencesCorpusReader.__init__t s' " d'< - - # r c
Vf V P pM\ V\ 4 ' d V.p\ V P VRR4 UUUu. uF# w r#pV P W P VR7 NK% uppp4 # u upppi )z
Return all comparisons in the corpus.
:param fileids: a list or regexp specifying the ids of the files whose
comparisons have to be returned.
:return: the given file(s) as a list of Comparison objects.
:rtype: list(Comparison)
Tr* )_fileids
isinstancestrconcatabspaths
CorpusView_read_comparison_blockr r' pathencfileids && r
comparisons,ComparativeSentencesCorpusReader.comparisons sz ?mmG
%
% iG ,0==$+M
+M'T &A&ACP+M
s )A9 c
\ V P VRR4 UUUu. uF# w r#pV P W P VR7 NK% uppp4 pV Uu0 uF qf' g K VP 4 kK ppV# u upppi u upi )z
Return a set of all keywords used in the corpus.
:param fileids: a list or regexp specifying the ids of the files whose
keywords have to be returned.
:return: the set of keywords and comparative phrases used in the corpus.
:rtype: set(str)
Tr- )r1 r2 r3 _read_keyword_blocklower)r r' r6 r7 r8 all_keywordsr keywords_sets && r
keywords)ComparativeSentencesCorpusReader.keywords s ,0==$+M
+M'T &>&>M+M
8DO|Gw
| O
Ps )A9 B !B c D . pV P R4 ;_uu_ 4 pVP 4 pRRR4 XP R4 FC pV' d VP R4 ' d K$ VP VP 4 4 KE V# + ' g i Lj; i)zj
Return the list of words and constituents considered as clues of a
comparison (from listOfkeywords.txt).
zlistOfkeywords.txtN
z//)openreadsplit
startswithappendstrip)r r@ fpraw_textlines & r
keywords_readme0ComparativeSentencesCorpusReader.keywords_readme st
YY+
,
,wwyH - NN4(D4??400 OODJJL ) )
-
,s B B c
\ V P VRR4 UUUu. uF# w r#pV P W P VR7 NK% uppp4 # u upppi )a+
Return all sentences in the corpus.
:param fileids: a list or regexp specifying the ids of the files whose
sentences have to be returned.
:return: all sentences of the corpus as lists of tokens (or as plain
strings, if no word tokenizer is specified).
:rtype: list(list(str)) or list(str)
Tr- )r1 r2 r3 _read_sent_blockr5 s && r
sents&ComparativeSentencesCorpusReader.sents sX ,0==$+M
+M'T &;&;cJ+M
)A c
\ V P VRR4 UUUu. uF# w r#pV P W P VR7 NK% uppp4 # u upppi )z
Return all words and punctuation symbols in the corpus.
:param fileids: a list or regexp specifying the ids of the files whose
words have to be returned.
:return: the given file(s) as a list of words and punctuation symbols.
:rtype: list(str)
Tr- )r1 r2 r3 _read_word_blockr5 s && r
words&ComparativeSentencesCorpusReader.words sX ,0==$+M
+M'T &;&;cJ+M
rS c VP 4 pV' g . # \ P ! \ V4 pV' g K@ \ P ! \ V4 p\ P ! \
V4 pVP 4 P
4 pV P ' d V P P V4 pVP 4 . pV' Ed V EF
p\ \ P ! RV4 P ^4 4 p \ WiR7 p
VP 4 p\ P V4 p V ' df V F_ w rV R8X d V
P
4 V
n K# V R8X d V
P
4 V
n KA V R8X g KJ V
P
4 V
n Ka \" P V4 pV' d V^ , V
n VP' V
4 EK V' dV V FO p\ \ P ! RV4 P ^4 4 p \ WiR7 p
VP' V
4 KQ V# )Tz )r r 123)readlinerefindall
COMPARISONGRAD_COMPARISONNON_GRAD_COMPARISONrI r# tokenizeintmatchgroupr ENTITIES_FEATSr r r
KEYWORDr rH )r streamrL comparison_tagsgrad_comparisonsnon_grad_comparisonscomparison_textcomparison_bundlecompr
comparisonentities_featscode entity_featr s && r
r4 7ComparativeSentencesCorpusReader._read_comparison_block s ??$D jjT :O #%::ot#D ')zz2Et'L$"(//"3"9"9";'''&*&:&:&C&CO&TO! %'!## 0$' t(D(J(J1(M$N %/!0&
& 0)7)?)?)E)5C 1#'3;:E:K:K:MJ$7%)S[:E:K:K:MJ$7%)S[9D9J9J9LJ$6
6D #*//$"7"18J .)00<% !1* ( 4$' t(D(J(J1(M$N %/!0&
*00<
!5 )(r c p . pV P V4 F pVP VP 4 K V# N)r4 rH r )r rh r@ ro s && r
r< 4ComparativeSentencesCorpusReader._read_keyword_block s3 55f=J OOJ . . / >r c VP 4 p\ P ! \ V4 ' d8 VP 4 p\ P ! \ V4 ' g K4 Ki \ P ! \
V4 ' d K \ P V4 ' d K \ P ! \ V4 ' d K V P ' dE V P P V4 Uu. uF pV P P V4 NK up# V P P V4 .# u upi )T) r\ r] rd STARSr^ r_ rf CLOSE_COMPARISONr$ rb r# )r rh rL sents && r
rP 1ComparativeSentencesCorpusReader._read_sent_block s ??$Dxxt$$!??,Dxxt,, JJz400&..t44
#3T::''' %)$8$8$A$A$$G $GD ,,55d;$G
! 0 0 9 9$ ?@@ s <$D?c \ . pV P V4 F pVP V4 K V# ru )rP extend)r rh rV rz s && r
rU 1ComparativeSentencesCorpusReader._read_word_block1 s- ))&1D LL 2 r )r% r$ r# ru )r r r r r StreamBackedCorpusViewr3 WhitespaceTokenizerr r9 r@ rM rQ rV r4 r< rP rU r r r s @r
r r ` sX " (J +,
$,
( &
"
3)j A, r r )r r] nltk.corpus.reader.api
nltk.tokenizecompilerx r_ ry r` ra rf rg r r" r r r
r s 8
$
8
ZZ
'
::o. **]+jj+ <=
**%
&*
*
ZU| Ur