Skip to documentation
ValironDocs

Jump to a guide

Crawler ProtectionOverview · Control crawler traffic and protect website and database capacity.Agent AccessOverview · Verify agent identity and enforce access policies in your API.API ScaffoldingOverview · Add payments and optional trust checks through a hosted API URL.QuickstartCrawler Protection · Connect your website and prepare a safe rollout.Gateway & SDK integrationCrawler Protection · Configure your routes and wrap expensive work.Bot verificationCrawler Protection · Understand crawler claims, source evidence, and the directory.Policies & capacityCrawler Protection · Set shared budgets and reserve capacity for customers.Analytics & monitoringCrawler Protection · Connect runtime telemetry and interpret your dashboard.Troubleshooting & recoveryCrawler Protection · Handle limits, outages, retained capacity, and recovery.InstallationAgent Access · Agent identity, access policies, and SDK integration.Identity and trustAgent Access · Agent identity, access policies, and SDK integration.API referenceAgent Access · Agent identity, access policies, and SDK integration.Errors and retriesAgent Access · Agent identity, access policies, and SDK integration.Payments and hosted wrappersAPI Scaffolding · x402, MPP, upstream configuration, and origin authentication.
Developer resourcesDashboard
Docs/Crawler Protection
Browse documentation

Documentation

Valiron Crawler Protection

Let useful crawlers in. Keep your website and database within capacity.

Included with Pro and Enterprise
Start integration Open dashboard ↗

How it works

Valiron checks crawler identity and applies shared request and workload limits before expensive rendering or database work begins.

Request
CDN / WAF
Valiron
Your origin
Choose your integration. Put the HTTP gateway in front of your website, or use the Node.js adapter in your application. Add work admission around database operations for query-level capacity limits.

Explore the guides

Quickstart

Connect your website and prepare a safe rollout.

Gateway & SDK integration

Configure your routes and wrap expensive work.

Bot verification

Understand crawler claims, source evidence, and the directory.

Policies & capacity

Set shared budgets and reserve capacity for customers.

Analytics & monitoring

Connect runtime telemetry and interpret your dashboard.

Troubleshooting & recovery

Handle limits, outages, retained capacity, and recovery.