usage: tacl intersect [-h] [-v] [-m] [-r RAM] [-t {cbeta,latin,pagel}]
DATABASE CORPUS CATALOGUE
List n-grams common to all sub-corpora (as defined by the labels in the
specified catalogue file).
positional arguments:
DATABASE Path to database file.
CORPUS Path to corpus.
CATALOGUE Path to catalogue file.
options:
-h, --help show this help message and exit
-v, --verbose Display debug information; multiple -v options
increase the verbosity. (default: None)
-m, --memory Use RAM for temporary database storage.
This may cause an out of memory error, in which case
run the command without this switch. (default: False)
-r RAM, --ram RAM Number of gigabytes of RAM to use. (default: 3)
-t {cbeta,latin,pagel}, --tokenizer {cbeta,latin,pagel}
Type of tokenizer to use. The "cbeta" tokenizer is
suitable for the Chinese CBETA corpus (tokens are
single characters or workaround clusters within square
brackets). The "pagel" tokenizer is for use with the
transliterated Tibetan corpus (tokens are sets of word
characters plus some punctuation used to transliterate
characters). (default: cbeta)
examples:
Make an intersect query against a CBETA corpus.
tacl intersect cbeta2-10.db corpus/cbeta/ dhr-vs-rest.txt > output.csv
Make an intersect query against a Pagel corpus.
tacl intersect -t pagel pagel1-7.db corpus/pagel/ by-author.txt > output.csv
Due to encoding issues, you may need to set the environment variable
PYTHONIOENCODING to "utf-8".