v0.1.0-beta

OpenAPI 3.1.0

Uncrawlable Resources

Felo API Support

MIT

Сервер

https://openapi.felo.ai

Клиентские библиотеки

Shell Curl

DataForSEO

SEO, search-engine results, keyword research, backlinks and AI visibility data.

DataForSEO Операции

post/v1/beta/dataforseo/on_page/uncrawlable_resources

Uncrawlable Resources

The resources a crawl could not fetch, and why. Returns total_items_count, items_count and items. Reads a finished crawl, so it needs the id from post_dataforseo_on_page_submit and returns crawl_progress plus a crawl_status of max_crawl_pages, pages_in_queue and pages_crawled - check those before trusting a small result, because a crawl still running simply has less to report. These are the broken references a site owner would want first; the ones that did load are in post_dataforseo_on_page_resources. 💰 Free upstream: querying a finished crawl costs nothing, only the crawl itself does.

Тело

обязательно

application/json

Тип: array object[]
- id
  Тип: string
  обязательно
  
  ID of the task required field you can get this ID in the response of the Task POST endpoint example: "07131248-1535-0216-1000-17384017ad04"
- filters
  Тип: array
  
  array of results filtering parameters optional field you can add several filters at once (8 filters maximum) you should set a logical operator and, or between the conditions the following operators are supported: regex, not_regex, , , >, >=, =, , in, not_in, like, not_like you can use the % operator with like and not_like to match any string of zero or more characters example: [["meta.content_type","=","image/jpeg"], "and", ["url","not_like","%/help-center/%"]]The full list of possible filters is available by this link.
- limit
  Тип: integer
  
  the maximum number of returned uncrawlable resources optional field default value: 100 maximum value: 1000
- offset
  Тип: integer
  
  offset in the results array of returned uncrawlable resources optional field default value: 0 if you specify the 10 value, the first ten invalid resources in the results array will be omitted and the data will be provided for the successive invalid resources
- order_by
  Тип: array string[]
  
  results sorting rules optional field you can use the same values as in the filters array to sort the results possible sorting types: asc - results will be sorted in the ascending order desc - results will be sorted in the descending order you should use a comma to set up a sorting type example: ["meta.content_type,desc"] note that you can set no more than three sorting rules in a single request you should use a comma to separate several sorting rules example: ["meta.content_type,asc","fetch_time,desc"]

Ответы

200
Тип: object

Successful response
cost
Тип: number

total tasks cost, USD

status_code
Тип: integer

general status code you can find the full list of the response codes here Note: we strongly recommend designing a necessary system for handling related exceptional or error conditions

status_message
Тип: string

general informational message you can find the full list of general informational messages here

tasks
Тип: array string[]

array of tasks

tasks_count
Тип: integer

the number of tasks in the tasks array

tasks_error
Тип: integer

the number of tasks in the tasks array returned with an error

tasks.cost
Тип: number

cost of the task, USD

tasks.data
Тип: object

contains the same parameters that you specified in the POST request

tasks.id
Тип: string

task identifier unique task identifier in our system in the UUID format

tasks.path
Тип: array string[]

URL path

tasks.result
Тип: array string[]

array of results

tasks.result_count
Тип: integer

number of elements in the result array

tasks.result.crawl_progress
Тип: string

status of the crawling session possible values: in_progress, finished

tasks.result.crawl_status
Тип: object

details of the crawling session

tasks.result.crawl_status.max_crawl_pages
Тип: integer

maximum number of pages to crawl indicates the max_crawl_pages limit you specified when setting a task

tasks.result.crawl_status.pages_crawled
Тип: integer

number of crawled pages

tasks.result.crawl_status.pages_in_queue
Тип: integer

number of pages that are currently in the crawling queue

tasks.result.items
Тип: array string[]

array of uncrawlable resources

tasks.result.items_count
Тип: integer

number of uncrawlable resources in the items array

tasks.result.items.fetch_time
Тип: string

date and time when the resource was fetched in the UTC format: “yyyy-mm-dd hh-mm-ss +00:00” example: 2026-03-09 18:20:32 +00:00

tasks.result.items.meta
Тип: object

metadata of the uncrawlable resource

tasks.result.items.meta.content_type
Тип: string

actual content type of the resource

tasks.result.items.meta.expected_content_types
Тип: array string[]

expected content types for the resource list of content types that were expected by the crawler based on how the resource is referenced on the page

tasks.result.items.reason
Тип: string

reason the resource is uncrawlable can take the following values: content_type_inconsistency

tasks.result.items.status_code
Тип: integer

HTTP response code returned by the uncrawlable resource possible values: 200

tasks.result.items.url
Тип: string

URL of the uncrawlable resource

tasks.result.total_items_count
Тип: integer

total number of uncrawlable resources found total number of uncrawlable resources found during the crawl of the target domain

tasks.status_code
Тип: integer

status code of the task generated by DataForSEO; can be within the following range: 10000-60000 you can find the full list of the response codes here

tasks.status_message
Тип: string

informational message of the task you can find the full list of general informational messages here

tasks.time
Тип: string

execution time, seconds

time
Тип: string

execution time, seconds

version
Тип: string

the current version of the API
application/json
400

Bad request
401

Unauthorized
402

The request cannot proceed because a billing requirement is not met.
403

The account is not permitted to perform this operation.
429

Rate limit exceeded
500

Internal server error
502

The service could not complete the request.
503

The API or billing service is temporarily unavailable.
504

The service timed out while processing the request.
default

The operation failed. Keep the response request ID when contacting Felo support.

post/v1/beta/dataforseo/on_page/uncrawlable_resources

curl https://openapi.felo.ai/v1/beta/dataforseo/on_page/uncrawlable_resources \
  --request POST \
  --header 'Content-Type: application/json' \
  --header 'Authorization: Bearer YOUR_SECRET_TOKEN' \
  --data '[
  {
    "id": "",
    "limit": 1,
    "offset": 1,
    "order_by": [
      ""
    ],
    "filters": []
  }
]'

Показать схему

{
  "version": "string",
  "status_code": 1,
  "status_message": "string",
  "time": "string",
  "cost": 1,
  "tasks_count": 1,
  "tasks_error": 1,
  "tasks": [
    "string"
  ],
  "tasks.id": "string",
  "tasks.status_code": 1,
  "tasks.status_message": "string",
  "tasks.time": "string",
  "tasks.cost": 1,
  "tasks.result_count": 1,
  "tasks.path": [
    "string"
  ],
  "tasks.data": {},
  "tasks.result": [
    "string"
  ],
  "tasks.result.crawl_progress": "string",
  "tasks.result.crawl_status": {},
  "tasks.result.crawl_status.max_crawl_pages": 1,
  "tasks.result.crawl_status.pages_in_queue": 1,
  "tasks.result.crawl_status.pages_crawled": 1,
  "tasks.result.total_items_count": 1,
  "tasks.result.items_count": 1,
  "tasks.result.items": [
    "string"
  ],
  "tasks.result.items.url": "string",
  "tasks.result.items.reason": "string",
  "tasks.result.items.status_code": 1,
  "tasks.result.items.fetch_time": "string",
  "tasks.result.items.meta": {},
  "tasks.result.items.meta.content_type": "string",
  "tasks.result.items.meta.expected_content_types": [
    "string"
  ]
}

Successful response

Uncrawlable Resources

АутентификацияRequired

DataForSEO

Uncrawlable Resources