4.2.8 Excluding Things

To add more exclusion lists than the default ones you can use the -E or --exclusion-list option. The exclusionlist.txt files should be in a specific format, that is explained in section 4.4. You can add more than one -E,

% Spider.py -H plucker:/exclude.html -E Exclude/default.excl -E Exclude/extra.excl -f ExcludeDB

would use default.excl and extra.excl found in $PLUCKERDIR/Exclude as extra exclusion lists.