資料 API / DataForSEO / On Page
Uncrawlable Resources
The resources a crawl could not fetch, and why. Returns total_items_count, items_count and items. Reads a finished crawl, so it needs the id from post_dataforseo_on_page_submit and returns crawl_progress plus a crawl_status of max_crawl_pages, pages_in_queue and pages_crawled - check those before trusting a small result, because a crawl still running simply has less to report. These are the broken references a site owner would want first; the ones that did load are in post_dataforseo_on_page_resources. 💰 Free upstream: querying a finished crawl costs nothing, only the crawl itself does.
參數
沒有路徑、查詢或請求標頭參數。
請求主體
idstring必填ID of the task required field you can get this ID in the response of the Task POST endpoint example: "07131248-1535-0216-1000-17384017ad04"
limitinteger選填the maximum number of returned uncrawlable resources optional field default value: 100 maximum value: 1000
offsetinteger選填offset in the results array of returned uncrawlable resources optional field default value: 0 if you specify the 10 value, the first ten invalid resources in the results array will be omitted and the data will be provided for the successive invalid resources
order_bystring[]選填results sorting rules optional field you can use the same values as in the filters array to sort the results possible sorting types: asc - results will be sorted in the ascending order desc - results will be sorted in the descending order you should use a comma to set up a sorting type example: ["meta.content_type,desc"] note that you can set no more than three sorting rules in a single request you should use a comma to separate several sorting rules example: ["meta.content_type,asc","fetch_time,desc"]
filtersarray選填array of results filtering parameters optional field you can add several filters at once (8 filters maximum) you should set a logical operator and, or between the conditions the following operators are supported: regex, not_regex, , , >, >=, =, , in, not_in, like, not_like you can use the % operator with like and not_like to match any string of zero or more characters example: [["meta.content_type","=","image/jpeg"], "and", ["url","not_like","%/help-center/%"]]The full list of possible filters is available by this link.
請求範例
curl -X POST "https://openapi.felo.ai/v1/beta/dataforseo/on_page/uncrawlable_resources" \
-H "Authorization: Bearer $FELO_API_KEY" \
-H "Content-Type: application/json" \
-d '{
"id": "<string>",
"limit": 0,
"offset": 0,
"order_by": [
"<string>"
],
"filters": "<string>"
}'回應
回應欄位
versionstring選填the current version of the API
status_codeinteger選填general status code you can find the full list of the response codes here Note: we strongly recommend designing a necessary system for handling related exceptional or error conditions
status_messagestring選填general informational message you can find the full list of general informational messages here
timestring選填execution time, seconds
costnumber選填total tasks cost, USD
tasks_countinteger選填the number of tasks in the tasks array
tasks_errorinteger選填the number of tasks in the tasks array returned with an error
tasksstring[]選填array of tasks
idstring選填task identifier unique task identifier in our system in the UUID format
status_codeinteger選填status code of the task generated by DataForSEO; can be within the following range: 10000-60000 you can find the full list of the response codes here
status_messagestring選填informational message of the task you can find the full list of general informational messages here
timestring選填execution time, seconds
costnumber選填cost of the task, USD
result_countinteger選填number of elements in the result array
pathstring[]選填URL path
dataobject選填contains the same parameters that you specified in the POST request
resultstring[]選填array of results
crawl_progressstring選填status of the crawling session possible values: in_progress, finished
crawl_statusobject選填details of the crawling session
max_crawl_pagesinteger選填maximum number of pages to crawl indicates the max_crawl_pages limit you specified when setting a task
pages_in_queueinteger選填number of pages that are currently in the crawling queue
pages_crawledinteger選填number of crawled pages
total_items_countinteger選填total number of uncrawlable resources found total number of uncrawlable resources found during the crawl of the target domain
items_countinteger選填number of uncrawlable resources in the items array
itemsstring[]選填array of uncrawlable resources
urlstring選填URL of the uncrawlable resource
reasonstring選填reason the resource is uncrawlable can take the following values: content_type_inconsistency
status_codeinteger選填HTTP response code returned by the uncrawlable resource possible values: 200
fetch_timestring選填date and time when the resource was fetched in the UTC format: “yyyy-mm-dd hh-mm-ss +00:00” example: 2026-03-09 18:20:32 +00:00
metaobject選填metadata of the uncrawlable resource
content_typestring選填actual content type of the resource
expected_content_typesstring[]選填expected content types for the resource list of content types that were expected by the crawler based on how the resource is referenced on the page