01 What we do
Spider runs a crawler and a managed cloud. The crawler is open source . The dashboard, API, and AI endpoints are operated as a managed service.
We honor robots.txt and rate-limit per host to avoid overloading the target.
02 Data handling
We do not train models on customer data. That includes the code and configuration you use to call Spider's services.
Prompts and content sent to an AI endpoint (e.g. /ai/scrape) may be processed by a third-party AI provider. No other request data leaves Spider.
Endpoints that route through a third-party AI provider are marked in the docs and on the API.
If you send personal data through an AI endpoint, it may reach one of the providers in section 03. For privacy questions, reach support@spider.cloud.
03 Third-party services
Some AI endpoints route requests through third-party providers. Current list:
- Azure Cognitive Services · AI inference
- Cohere · AI inference
- OpenAI · AI inference
04 Acceptable use
Spider may not be used for:
- Denial-of-service attacks
- Illegal activity
- Inauthentic, deceptive, or impersonation behavior
- Any other use that would violate our standard published policies, codes of conduct, or terms of service
Violations may result in account termination. Report abuse to support@spider.cloud.
05 More information
06 Contact
- Privacy
- support@spider.cloud
- Discussions
- github.com/orgs/spider-rs/discussions