Meziantou.FrameworkRobotsParseErrorKind Enum
Identifies the kind of parse error encountered while reading a robots.txt file.
public enum RobotsParseErrorKindFields
| Name | Value | Description |
|---|---|---|
MalformedLine | 0 | A line did not contain the expected directive: value format (missing colon separator). |
UnknownDirective | 1 | A directive name was not recognised by the parser. |
InvalidCrawlDelay | 2 | The value of a Crawl-delay directive could not be parsed as a non-negative number. |