PACKAGE NAME: perl-www-robotrules-6.02-x86_64-1salix15.0.txz PACKAGE LOCATION: ./salix/perl PACKAGE SIZE (compressed): 12 K PACKAGE SIZE (uncompressed): 48 K PACKAGE REQUIRED: PACKAGE CONFLICTS: PACKAGE SUGGESTS: PACKAGE DESCRIPTION: perl-www-robotrules: perl-www-robotrules (DB of robots.txt-derived perms) perl-www-robotrules: perl-www-robotrules: This perl module parses /robots.txt files as specified in "A perl-www-robotrules: Standard for Robot Exclusion". Webmasters can use the /robots.txt perl-www-robotrules: file to forbid conforming robots from accessing parts of their perl-www-robotrules: web site perl-www-robotrules: perl-www-robotrules: https://metacpan.org/release/WWW-RobotRules perl-www-robotrules: perl-www-robotrules: perl-www-robotrules: