Galon Cloud
Galon API v1

/search/v2/crawl/{crawl_id}/errors

Base URL https://api.galon.ai/v1 · export GALON_API_BASE="https://api.galon.ai/v1"

GET /search/v2/crawl/{crawl_id}/errors

Pages a crawl job could not read

The pages refused during a crawl (address, named code, public message) and, apart, the addresses the site's robots.txt forbids. No content, no internal detail. Not counted. Same 404s as the job itself (crawl_not_found, crawl_expired). Rate limit: the key's POST requests per minute do not apply to this GET.

API key (Bearer), on the public API endpoint.

Parameters

NameInTypeDescription
crawl_idpathstring · required

Responses

StatusDescriptionBody
200The refusalsCrawlErrorsResponse
400query_invalidCrawlError
401api_key_missing, api_key_invalidCrawlError
403scope_missing (search:query)CrawlError
404not_found, crawl_not_found, crawl_expiredCrawlError

Examples

curl

curl -X GET "$GALON_API_BASE/search/v2/crawl/<crawl_id>/errors" \
  -H "Authorization: Bearer $GALON_API_KEY"

Node.js (SDK)

import { Galon } from "galon";

const galon = new Galon(process.env.GALON_API_KEY);
const result = await galon.search.getCrawlErrors("<id>");

Python (SDK)

from galon import Galon

galon = Galon()  # reads GALON_API_KEY
result = galon.search.get_crawl_errors("<id>")