RobotsTxt 2014.2.19

.NET Framework This package is compatible with all versions of .NET Framework. 
dotnet add package RobotsTxt --version 2014.2.19
                    


                    

                
NuGet\Install-Package RobotsTxt -Version 2014.2.19
This command is intended to be used within the Package Manager Console in Visual Studio, as it uses the NuGet module's version of Install-Package. 
<PackageReference Include="RobotsTxt" Version="2014.2.19" />
For projects that support PackageReference, copy this XML node into the project file to reference the package. 
<PackageVersion Include="RobotsTxt" Version="2014.2.19" />
                    


                            Directory.Packages.props
                        

                    

                
<PackageReference Include="RobotsTxt" />
                    


                            Project file
For projects that support Central Package Management (CPM), copy this XML node into the solution Directory.Packages.props file to version the package. 
paket add RobotsTxt --version 2014.2.19
                    


                    

                
#r "nuget: RobotsTxt, 2014.2.19"
#r directive can be used in F# Interactive and Polyglot Notebooks. Copy this into the interactive tool or source code of the script to reference the package. 
#addin nuget:?package=RobotsTxt&version=2014.2.19
                    


                            Install RobotsTxt as a Cake Addin
                        

                    

                
#tool nuget:?package=RobotsTxt&version=2014.2.19
                    


                            Install RobotsTxt as a Cake Tool

A robots.txt parser for .NET

Supports ;
- Allow directives.
- Crawl-delay directives.
- Sitemap declarations.
- * and $ wildcards.

Product Compatible and additional computed target framework versions.
.NET Framework net is compatible. 
Compatible target framework(s)
Included target framework(s) (in package)
Learn more about Target Frameworks and .NET Standard.

This package has no dependencies.

GitHub repositories (2)

Showing the top 2 popular GitHub repositories that depend on RobotsTxt:

Repository Stars
nazuke/SEOMacroscope
SEO Macroscope is a website scanning tool, to check your website for broken links; including some technical SEO functionality, site scraping, Excel reporting, and more.
esbencarlsen/NCrawler
.NET based webcrawler
Version Downloads Last updated
2014.2.19 899 2/19/2014