This is an integration environment. Data may not be preserved.
Skip To Content
Toggle navigation
Packages
Upload
Statistics
Documentation
Downloads
Blog
Sign in
Advanced search filters
Frameworks
Include compatible frameworks
Framework Filter Mode
ALL
ANY
.NET
net8.0
net7.0
net6.0
net5.0
.NET Core
netcoreapp3.1
netcoreapp3.0
netcoreapp2.2
netcoreapp2.1
netcoreapp2.0
netcoreapp1.1
netcoreapp1.0
.NET Standard
netstandard2.1
netstandard2.0
netstandard1.6
netstandard1.5
netstandard1.4
netstandard1.3
netstandard1.2
netstandard1.1
netstandard1.0
.NET Framework
net481
net48
net472
net471
net47
net462
net461
net46
net452
net451
net45
net40
net35
net30
net20
Package type
All types
Dependency
.NET tool
Template
Options
Include prerelease
4 packages returned for Tags:"robots.
txt"
Sort by
Relevance
Downloads
Recently updated
RobotsTxt
by:
tsllbn
.NET Framework
1,004 total downloads
last updated
2/19/2014
Latest version:
2014.2.19
Robots.Txt
Parser
Parsing
Library
A robots.txt parser for .NET Supports ; - Allow directives. - Crawl-delay directives. - Sitemap declarations. - * and $ wildcards.
RobotRules
by:
vodevil
.NET Framework 4.5
405 total downloads
last updated
6/10/2014
Latest version:
1.5.2.4
Robots.txt
robot
crawler
web
A Simple and Powerful Library to Deal with Web Robots Control Strategy.
TamTam.
ConditionalRobots
by:
tamtam
106 total downloads
last updated
4/4/2015
Latest version:
1.0.1.5
robots.txt
allow
disallow
- It adds a robots.txt and a robots_closed.txt to the root of the website - It adds a rewrite rule to the web.config that rewrites the robots.txt to robots_closed.txt for all urls ending with tamtam.nl
SimpleSitemap
by:
pure krome
.NET Framework 4.5
547 total downloads
last updated
12/3/2014
Latest version:
2.0.0
simple
sitemap
sitemaps
robots
robots.txt
unicorn
magicalunicorn
magical-unicorn
worlddomination
worldomination
SimpleSitemap is a lite library that helps you create web sitemaps for collections or lists of items. These sitemaps follow the Sitemap Protocol. Both sitemapindex and urlset links are...
More information