データ API / DataForSEO / On Page

OnPage API Content Parsing

Parses one crawled url into structured content, with markdown_view for a markdown rendering. Reads a finished crawl, so it needs the id from post_dataforseo_on_page_submit and returns crawl_progress plus a crawl_status of max_crawl_pages, pages_in_queue and pages_crawled - check those before trusting a small result, because a crawl still running simply has less to report. The standalone twin post_dataforseo_on_page_content_parsing_live parses any URL without a crawl - prefer that unless the page is already part of one.

パラメータ

パス・クエリ・ヘッダーのパラメータはありません。

リクエストボディ

urlstring必須
URL of the content to parse required field URL of the page to parse example: https://dataforseo.com/blog/a-versatile-alternative-to-google-trends-exploring-the-power-of-dataforseo-trends-api
idstring必須
ID of the task required field you can get this ID in the response of the Task POST endpoint note: the enable_content_parsing parameter in the POST request must be set to true example: "07131248-1535-0216-1000-17384017ad04"
markdown_viewboolean任意
return page content as markdown optional field if set to true, the markdown-formatted content of the page will be returned in the page_as_markdown field of the response; default value: false

リクエスト例

curl -X POST "https://openapi.felo.ai/v1/beta/dataforseo/on_page/content_parsing" \
  -H "Authorization: Bearer $FELO_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
  "url": "<string>",
  "id": "<string>",
  "markdown_view": false
}'

レスポンス

レスポンスのフィールド

versionstring任意
the current version of the API
status_codeinteger任意
general status code you can find the full list of the response codes here Note: we strongly recommend designing a necessary system for handling related exceptional or error conditions
status_messagestring任意
general informational message you can find the full list of general informational messages here
timestring任意
execution time, seconds
costnumber任意
total tasks cost, USD
tasks_countinteger任意
the number of tasks in the tasks array
tasks_errorinteger任意
the number of tasks in the tasks array returned with an error
tasksstring[]任意
array of tasks
idstring任意
task identifier unique task identifier in our system in the UUID format
status_codeinteger任意
status code of the task generated by DataForSEO; can be within the following range: 10000-60000 you can find the full list of the response codes here
status_messagestring任意
informational message of the task you can find the full list of general informational messages here
timestring任意
execution time, seconds
costnumber任意
cost of the task, USD
result_countinteger任意
number of elements in the result array
pathstring[]任意
URL path
dataobject任意
contains the same parameters that you specified in the POST request
resultstring[]任意
array of results
crawl_progressstring任意
status of the crawling session possible values: in_progress, finished
crawl_statusobject任意
details of the crawling session
items_countinteger任意
number of items in the results array
itemsstring[]任意
items array
typestring任意
type of the returned item = ‘сontent_parsing_element’
fetch_timestring任意
date and time when the content was fethced example: "2022-11-01 10:02:52 +00:00"
status_codeinteger任意
status code of the page
page_contentobject任意
parsed content of the page
headerobject任意
parsed content of the header
primary_contentstring[]任意
primary content on the page you can find more information about content priority calculation in this help center article
textstring任意
content text
urlstring任意
page URL displayed in case the text is a link anchor
urlsstring[]任意
contains other URLs and anchors found in the content element
urlstring任意
other URL found in the content element
anchor_textstring任意
text of the URL’s anchor
secondary_contentstring[]任意
secondary content on the page you can find more information about content priority calculation in this help center article
textstring任意
content text
urlstring任意
page URL displayed in case the text is a link anchor
urlsstring[]任意
contains other URLs and anchors found in the content element
urlstring任意
other URL found in the content element
anchor_textstring任意
text of the URL’s anchor
table_contentstring[]任意
content of the table on the page
headerstring[]任意
content of the header of the table
row_cellsstring[]任意
content of the row cells of the header
textstring任意
text in the row cell
urlsstring[]任意
contains other URLs and anchors found in the cell
urlstring任意
URL found in the cell
anchor_textstring任意
text of the URL’s anchor
is_headerboolean任意
indicates if the text belongs to the header
bodystring[]任意
content of the body of the table
row_cellsstring[]任意
content of the row cells of the header
textstring任意
text in the row cell
urlsstring[]任意
contains other URLs and anchors found in the cell
urlstring任意
URL found in the cell
anchor_textstring任意
text of the URL’s anchor
is_headerboolean任意
indicates if the text belongs to the header
footerstring[]任意
content of the footer of the table
row_cellsstring[]任意
content of the row cells of the header
textstring任意
text in the row cell
urlsstring[]任意
contains other URLs and anchors found in the cell
urlstring任意
URL found in the cell
anchor_textstring任意
text of the URL’s anchor
is_headerboolean任意
indicates if the text belongs to the header
footerobject任意
parsed content of the footer
main_topicstring[]任意
main topic on the page you can find more information about topic priority calculation in this help center article
h_titlestring任意
meta title
main_titlestring任意
main title of the block
authorstring任意
content author name
languagestring任意
content language
levelstring任意
HTML level
primary_contentstring[]任意
primary content on the page you can find more information about content priority calculation in this help center article
textstring任意
content text
urlstring任意
page URL displayed in case the text is a link anchor
urlsstring[]任意
contains other URLs and anchors found in the content element
urlstring任意
other URL found in the content element
anchor_textstring任意
text of the URL’s anchor
secondary_contentstring[]任意
secondary content on the page you can find more information about content priority calculation in this help center article
secondary_topicstring[]任意
secondary topic on the page you can find more information about topic priority calculation in this help center article
h_titlestring任意
meta title
main_titlestring任意
main title of the block
authorstring任意
content author name
languagestring任意
content language
levelstring任意
HTML level
primary_contentstring[]任意
primary content on the page you can find more information about content priority calculation in this help center article
textstring任意
content text
urlstring任意
page URL displayed in case the text is a link anchor
urlsstring[]任意
contains other URLs and anchors found in the content element
urlstring任意
other URL found in the content element
anchor_textstring任意
text of the URL’s anchor
secondary_contentstring[]任意
secondary content on the page you can find more information about content priority calculation in this help center article
ratingsstring[]任意
contains objects with rating information for the products displayed on the page
namestring任意
rating name Note: this field is not used in this particular object, and its value is always set to null
rating_valueinteger任意
the value of the rating
max_rating_valueinteger任意
maximum value for the rating
rating_countinteger任意
the amount of feedback
relative_ratingnumber任意
relative rating can take values from 0 to 1
offersstring[]任意
array of products displayed on the page contains objects with information on products displayed on the page
namestring任意
name of the product
priceinteger任意
price of the product
price_currencystring任意
price currency
price_valid_untilinteger任意
displays the date and time until which the price is valid in the UTC format: “yyyy-mm-dd hh-mm-ss +00:00” example: "2022-11-01 10:02:52 +00:00"
commentsstring[]任意
array of comments displayed on the page contains objects with information on comments related to displayed products
ratingobject任意
product’s rating contains information about the rating a customer has given to the product
namestring任意
rating name Note: this field is not used in this particular object, and its value is always null
rating_valueinteger任意
the value of the rating
max_rating_valueinteger任意
maximum value for the rating
rating_countinteger任意
the amount of feedback Note: this field is not used in this particular object, and its value is always null
relative ratingnumber任意
relative rating can take values from 0 to 1
titlestring任意
title of the customer’s comment
publish_datestring任意
date when the comment was published
authorstring任意
author of the comment
primary_contentstring[]任意
primary content on the page you can find more information about content priority calculation in this help center article
textstring任意
text of the comment
urlstring任意
displayed in case the text is a link anchor
urlsstring[]任意
contains other URLs and anchors found in the content element
contactsobject任意
contact information contains contact information displayed on the page
telephonesstring[]任意
array of telephone numbers
emailsstring[]任意
array of emails
page_as_markdownstring任意
page content in the markdown format page content in the text-to-HTML markdown format specify markdown_view as true in the request to return the value