PyDocs

Nav

Internet Protocols and Support

RobotFileParser.site_maps

urllib.robotparser

method of RobotFileParser · Added in 3.8 (source)
  • RobotFileParser.site_maps()
Returns the contents of the Sitemap parameter from robots.txt in the form of a list(). If there is no such parameter or the robots.txt entry for this parameter has invalid syntax, return None.
0 Examples
No examples for urllib.robotparser/RobotFileParser.site_maps.
See Also
No see-alsos for urllib.robotparser/RobotFileParser.site_maps
0 Notes
No notes for RobotFileParser.site_maps