+
h z ^ RI Ht ^ RIHt ^ RIHtHt ]P t]! ]RRRRR7 t R] n
R t R
t R # ) )partial)chain)
everygrams pad_sequenceTzz)pad_leftleft_pad_symbol pad_rightright_pad_symbolzPads both ends of a sentence to length specified by ngram order.
Following convention pads the start of sentence pads its end.
c B \ \ \ WR7 4 V R7 # )zhHelper with some useful defaults.
Applies pad_both_ends to sentence and follows it up with everygrams.
nmax_len)r list
pad_both_ends)ordersentences &&7/usr/lib/python3/dist-packages/nltk/lm/preprocessing.pypadded_everygramsr s
d=;,padded_everygram_pipeline..1 s% LttDD)*E : :ts ),)r r flattenmap)r textr s f&@r padded_everygram_pipeliner! " s2 %0JLtLJ%& r N)
functoolsr itertoolsr nltk.utilr r
from_iterabler r __doc__r r! r r r( sI .
Mr