Cidr matching supports ipv4 ranges listed in spider ip ranges file.

Avoid duplicate lines unless you want higher weight through repetition.

Utf8 encoding is assumed for chinese entries in map and diy files.

A single config file controls the core behavior switches.

Cross link density rises when url patterns include multiple keyword slugs.

Random tag count config controls how many label chips appear per template.

Description lines should remain under typical meta length when possible.

Key include query false collapses cache per path ignoring tracking params.

Nginx and apache rewrite examples route all requests through index php.

Random url generation follows patterns you define for internal crawl paths.