@nuxtjs/robots
@nuxtjs/robots
Tame the robots crawling and indexing your site.
@nuxtjs/robots
Nuxt Robots is a module for configuring the robots crawling your site with minimal config and best practice defaults.
The core feature of the module is:
- Telling crawlers which paths they can and cannot access using a robots.txt file.
- Telling search engine crawlers what they can show in search results from your site using a
<meta name="robots" content="index">X-Robots-TagHTTP header.
New to robots or SEO? Check out the Controlling Web Crawlers guide to learn more about why you might need these features.
| Made possible by my Sponsor Program ๐ Follow me @harlan_zw ๐ฆ โข Join Discord for help |
Features
- ๐ค Merge in your existing robots.txt or programmatically create a new one
- ๐ฟ Automatic
X-Robots-Tagheader and<meta name="robots" ...>meta tag - ๐ต๏ธ Bot detection with optional fingerprinting
- ๐ Disables non-production environments from being indexed
- ๐ค Control AI crawlers using the
Content-SignalandContent-Usagedirectives
Installation
๐ก Using Nuxt 2? Please use the v3.x tag.
Install @nuxtjs/robots dependency to your project:
npx nuxt module add robotsUsing an AI agent? Get the @nuxtjs/robots Skill on skilld.dev/gh/nuxt-modules/robots.
๐ก Configured your robots.txt? Verify what crawlers and AI bots can access with the free Robots.txt Validator, or monitor crawl & indexing status with Nuxt SEO Pro.
Documentation
๐ Read the full documentation for more information.
Demos
Sponsors
License
Licensed under the MIT license.