PyDocs

Nav

Internet Protocols and Support

RobotFileParser.mtime

  • RobotFileParser.mtime()
Returns the time the robots.txt file was last fetched.

This is useful for long-running web spiders that need to
check for new robots.txt files periodically.
0 Examples
No examples for urllib.robotparser/RobotFileParser.mtime.
See Also
No see-alsos for urllib.robotparser/RobotFileParser.mtime
0 Notes
No notes for RobotFileParser.mtime