mcp-server-semgrep/semgrep-rules/html/best-practice/robots-denied.yaml

MCP Server for Semgrep Integration - static code analysis with AI

rules:
  - id: robots-denied
    metadata:
      category: best-practice
      technology:
        - html
    message: This page denies crawlers from indexing the page. Remove the robots 'meta' tag.
    severity: INFO
    languages: [generic]
    pattern-either:
      - pattern: <meta name="robots" ...>
      - pattern: <META NAME="ROBOTS" ...>