DataForSEO
SEO, search-engine results, keyword research, backlinks and AI visibility data.
Live OnPage API Content Parsing
Parses any url into structured content immediately, with no crawl needed - the only tool in this family that works standalone. browser_preset, browser_screen_width, browser_screen_height and custom_user_agent control the render, disable_cookie_popup removes consent overlays, store_raw_html keeps the source. Wrapped in DataForSEO's envelope: data in tasks[0].result, outcome in tasks[0].status_code - a rejected request still returns HTTP 200. For pages already inside a crawl use post_dataforseo_on_page_content_parsing, which is free.
Pricing reference
- Metering: Reported response cost.
- Reference request estimate: USD 0.0001.
- Reference customer multiplier: 1.0. Do not apply it again to a settled customer amount.
Reference metadata only, not an account quote, a guaranteed price or a spending cap. Resource credits are not Felo credits. Final charges follow Felo billing records.
- Type: array (object | null)[]
- acceptType: string | null
_language language header for accessing the website
optional field
all locale formats are supported (xx, xx-XX, xxx-XX, etc.)
Note: if you do not specify this parameter, some websites may deny access; in this case, pages will be returned with the"type":"brokenin the response array - browserType: string | null
_preset preset for browser screen parameters
optional field
if you use this field, you don't need to indicatebrowser_screen_width,browser_screen_height,browser_screen_scale_factorpossible values:
desktop,mobile,tabletdesktoppreset will apply the following values:browser_screen_width: 1920browser_screen_height: 1080browser_screen_scale_factor: 1mobilepreset will apply the following values:browser_screen_width: 390browser_screen_height: 844browser_screen_scale_factor: 3tabletpreset will apply the following values:browser_screen_width: 1024browser_screen_height: 1366browser_screen_scale_factor: 2Note: to use this parameter, set
enable_javascriptorenable_browser_renderingtotrue - browserType: integer | null
_screen _height browser screen height
optional field
you can set a custom browser screen height to perform audit for a particular device;
if you use this field, you don't need to indicatebrowser_presetas it will be ignored;Note: to use this parameter, set
enable_javascriptorenable_browser_renderingtotrueminimum value, in pixels:
240
maximum value, in pixels:9999 - browserType: number | null
_screen _scale _factor browser screen scale factor
optional field
you can set a custom browser screen resolution ratio to perform audit for a particular device;
if you use this field, you don't need to indicatebrowser_presetas it will be ignored;Note: to use this parameter, set
enable_javascriptorenable_browser_renderingtotrueminimum value:
0.5
maximum value:3 - browserType: integer | null Format: int64
_screen _width browser screen width
optional field
you can set a custom browser screen width to perform audit for a particular device;
if you use this field, you don't need to indicatebrowser_presetas it will be ignored;Note: to use this parameter, set
enable_javascriptorenable_browser_renderingtotrueminimum value, in pixels:
240
maximum value, in pixels:9999 - customType: string | null
_user _agent custom user agent
optional field
custom user agent for crawling a website
example:Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/83.0.4103.116 Safari/537.36
default value:Mozilla/5.0 (compatible; RSiteAuditor) - disableType: boolean | null
_cookie _popup disable the cookie popup
optional field
set totrueif you want to disable the popup requesting cookie consent from the user;
default value:false - enableType: boolean | null
_browser _rendering emulate browser rendering to measure Core Web Vitals
optional field
by using this parameter you will be able to emulate a browser when loading a web page;enable_browser_renderingloads styles, images, fonts, animations, videos, and other resources on a page;
default value:false
set totrueto obtain Core Web Vitals (FID, CLS, LCP) metrics in the response;
if you use this field,enable_javascript, andload_resourcesparameters must be set totrue
Note: if you use this parameter, additional charges will apply; learn more about the cost of tasks with this parameter in our help article; the cost can be calculated on the Pricing Page - enableType: boolean | null
_javascript load javascript on a page
optional field
set totrueif you want to load the scripts available on a page
default value:false
Note: if you use this parameter, additional charges will apply; learn more about the cost of tasks with this parameter in our help article; the cost can be calculated on the Pricing Page - enableType: boolean | null
_xhr enable XMLHttpRequest on a page
optional field
set totrueif you want our crawler to request data from a web server using the XMLHttpRequest object
default value:falseif you use this field,
enable_javascriptmust be set totrue; - ipType: string | null
_pool _for _scan proxy pool
optional field
you can choose a location of the proxy pool that will be used to obtain the requested data;
the parameter can be used if page content is inaccessible in one of the locations, resulting in occasionalsite_unreachableerrors
possible values:us,de - markdownType: boolean | null
_view return page content as markdown
optional field
if set totrue, the markdown-formatted content of the page will be returned in thepage_as_markdownfield of the response;
default value:false - storeType: boolean | null
_raw _html - switchType: boolean | null
_pool switch proxy pool
optional field
iftrue, additional proxy pools will be used to obtain the requested data;
the parameter can be used if a multitude of tasks is set simultaneously, resulting in occasionalrate-limitand/orsite_unreachableerrors - urlType: string
URL of the content to parse
required field
URL of the page to parse
example:https://www.fujielectric.com/
- Type: object | null · Response36Afe1097B20_OnPageContentParsingLiveResponseInfo200
- Type: number | null Format: doublecost
total tasks cost, USD
- Type: integer | nullstatus
_code general status code you can find the full list of the response codes here
- Type: string | nullstatus
_message general informational message you can find the full list of general informational messages here
- Type: array (object | null)[] | nulltasks
array of tasks
- Type: object | null · Response36Afe1097B20_OnPageContentParsingLiveTaskInfo
- costType: number | null Format: double
total tasks cost, USD
- dataType: object | null
contains the same parameters that you specified in the POST request
- propertyType: object | null
Name
- idType: string | null
task identifier unique task identifier in our system in the UUID format
- pathType: array (string | null)[] | null
URL path
- resultType: array (object | null)[] | null
array of results
- crawlType: string | null
_progress status of the crawling session
possible values:in_progress,finished - crawlType: object | null · Response36Afe1097B20_CrawlStatusInfo
_status details of the crawling session
- maxType: integer | null Format: int64
_crawl _pages maximum number of pages to crawl indicates the max_crawl_pages limit you specified when setting a task
- pagesType: integer | null Format: int64
_crawled number of crawled pages
- pagesType: integer | null Format: int64
_in _queue number of pages that are currently in the crawling queue
- itemsType: array (object | null)[] | null
items array
- fetchType: string | null
_time date and time when the content was fethced
example:"2022-11-01 10:02:52 +00:00" - pageType: string | null
_as _markdown - pageType: object | null · Response36Afe1097B20_PageContentInfo
_content parsed content of the page
- commentsType: array (object | null)[] | null
array of comments displayed on the page
contains objects with information on comments related to displayed products- authorType: string | null
author of the comment
- haveType: boolean | null
_form - primaryType: array (object | null)[] | null
_content primary content on the page you can find more information about content priority calculation in this help center article
- textType: string | null
secondary content on the page you can find more information about content priority calculation in this help center article
- urlType: string | null
page URL. displayed in case the text is a link anchor
- urlsType: array (object | null)[] | null
contains other URLs and anchors found in the content element
- anchorType: string | null
_text text of the URL’s anchor
- urlType: string | null
contains other URLs and anchors found in the content element
- publishType: string | null
_date date when the comment was published
- ratingType: object | null · Response36Afe1097B20_ContententRatingInfo
product’s rating contains information about the rating a customer has given to the product
- maxType: number | null Format: double
_rating _value maximum value for the rating name
- nameType: string | null
rating name here you can find the following elements: Max5, Percents, CustomMax
- ratingType: integer | null Format: int64
_count number of votes
- ratingType: number | null Format: double
_value the value of the rating
- relativeType: number | null Format: double
_rating relative rating
- titleType: string | null
title of the customer’s comment
- contactsType: object | null · Response36Afe1097B20_Contacts
contact information
contains contact information displayed on the page- emailsType: array (string | null)[] | null
array of emails
- telephonesType: array (string | null)[] | null
array of telephone numbers
- footerType: object | null · Response36Afe1097B20_PageSectionContentInfo
content of the footer of the table
- primaryType: array (object | null)[] | null
_content - textType: string | null
secondary content on the page you can find more information about content priority calculation in this help center article
- urlType: string | null
page URL. displayed in case the text is a link anchor
- urlsType: array (object | null)[] | null
contains other URLs and anchors found in the content element
- anchorType: string | null
_text text of the URL’s anchor
- urlType: string | null
contains other URLs and anchors found in the content element
- secondaryType: array (object | null)[] | null
_content - textType: string | null
secondary content on the page you can find more information about content priority calculation in this help center article
- urlType: string | null
page URL. displayed in case the text is a link anchor
- urlsType: array (object | null)[] | null
contains other URLs and anchors found in the content element
- anchorType: string | null
_text text of the URL’s anchor
- urlType: string | null
contains other URLs and anchors found in the content element
- tableType: array (object | null)[] | null
_content content of the table on the page
- bodyType: array (object | null)[] | null
content of the body of the table
- rowType: array (object | null)[] | null
_cells content of the row cells of the header
- isType: boolean | null
_header content of the row cells of the header
- textType: string | null
content of the row cells of the header
- urlsType: array (object | null)[] | null
contains other URLs and anchors found in the content element
- anchorType: string | null
_text text of the URL’s anchor
- urlType: string | null
contains other URLs and anchors found in the content element
- footerType: array (object | null)[] | null
content of the footer of the table
- rowType: array (object | null)[] | null
_cells content of the row cells of the header
- isType: boolean | null
_header content of the row cells of the header
- textType: string | null
content of the row cells of the header
- urlsType: array (object | null)[] | null
contains other URLs and anchors found in the content element
- anchorType: string | null
_text text of the URL’s anchor
- urlType: string | null
contains other URLs and anchors found in the content element
- headerType: array (object | null)[] | null
parsed content of the header
- rowType: array (object | null)[] | null
_cells content of the row cells of the header
- isType: boolean | null
_header content of the row cells of the header
- textType: string | null
content of the row cells of the header
- urlsType: array (object | null)[] | null
contains other URLs and anchors found in the content element
- anchorType: string | null
_text text of the URL’s anchor
- urlType: string | null
contains other URLs and anchors found in the content element
- headerType: object | null · Response36Afe1097B20_PageSectionContentInfo
parsed content of the header
- primaryType: array (object | null)[] | null
_content - textType: string | null
secondary content on the page you can find more information about content priority calculation in this help center article
- urlType: string | null
page URL. displayed in case the text is a link anchor
- urlsType: array (object | null)[] | null
contains other URLs and anchors found in the content element
- anchorType: string | null
_text text of the URL’s anchor
- urlType: string | null
contains other URLs and anchors found in the content element
- secondaryType: array (object | null)[] | null
_content - textType: string | null
secondary content on the page you can find more information about content priority calculation in this help center article
- urlType: string | null
page URL. displayed in case the text is a link anchor
- urlsType: array (object | null)[] | null
contains other URLs and anchors found in the content element
- anchorType: string | null
_text text of the URL’s anchor
- urlType: string | null
contains other URLs and anchors found in the content element
- tableType: array (object | null)[] | null
_content content of the table on the page
- bodyType: array (object | null)[] | null
content of the body of the table
- rowType: array (object | null)[] | null
_cells content of the row cells of the header
- isType: boolean | null
_header content of the row cells of the header
- textType: string | null
content of the row cells of the header
- urlsType: array (object | null)[] | null
contains other URLs and anchors found in the content element
- anchorType: string | null
_text text of the URL’s anchor
- urlType: string | null
contains other URLs and anchors found in the content element
- footerType: array (object | null)[] | null
content of the footer of the table
- rowType: array (object | null)[] | null
_cells content of the row cells of the header
- isType: boolean | null
_header content of the row cells of the header
- textType: string | null
content of the row cells of the header
- urlsType: array (object | null)[] | null
contains other URLs and anchors found in the content element
- anchorType: string | null
_text text of the URL’s anchor
- urlType: string | null
contains other URLs and anchors found in the content element
- headerType: array (object | null)[] | null
parsed content of the header
- rowType: array (object | null)[] | null
_cells content of the row cells of the header
- isType: boolean | null
_header content of the row cells of the header
- textType: string | null
content of the row cells of the header
- urlsType: array (object | null)[] | null
contains other URLs and anchors found in the content element
- anchorType: string | null
_text text of the URL’s anchor
- urlType: string | null
contains other URLs and anchors found in the content element
- mainType: array (object | null)[] | null
_topic - authorType: string | null
content author name
- hType: string | null
_title meta title
- languageType: string | null
content language
- levelType: integer | null
HTML level
- mainType: string | null
_title main title of the block
- primaryType: array (object | null)[] | null
_content - textType: string | null
secondary content on the page you can find more information about content priority calculation in this help center article
- urlType: string | null
page URL. displayed in case the text is a link anchor
- urlsType: array (object | null)[] | null
contains other URLs and anchors found in the content element
- anchorType: string | null
_text text of the URL’s anchor
- urlType: string | null
contains other URLs and anchors found in the content element
- secondaryType: array (object | null)[] | null
_content - textType: string | null
secondary content on the page you can find more information about content priority calculation in this help center article
- urlType: string | null
page URL. displayed in case the text is a link anchor
- urlsType: array (object | null)[] | null
contains other URLs and anchors found in the content element
- anchorType: string | null
_text text of the URL’s anchor
- urlType: string | null
contains other URLs and anchors found in the content element
- tableType: array (object | null)[] | null
_content content of the table on the page
- bodyType: array (object | null)[] | null
content of the body of the table
- rowType: array (object | null)[] | null
_cells content of the row cells of the header
- isType: boolean | null
_header content of the row cells of the header
- textType: string | null
content of the row cells of the header
- urlsType: array (object | null)[] | null
contains other URLs and anchors found in the content element
- anchorType: string | null
_text text of the URL’s anchor
- urlType: string | null
contains other URLs and anchors found in the content element
- footerType: array (object | null)[] | null
content of the footer of the table
- rowType: array (object | null)[] | null
_cells content of the row cells of the header
- isType: boolean | null
_header content of the row cells of the header
- textType: string | null
content of the row cells of the header
- urlsType: array (object | null)[] | null
contains other URLs and anchors found in the content element
- anchorType: string | null
_text text of the URL’s anchor
- urlType: string | null
contains other URLs and anchors found in the content element
- headerType: array (object | null)[] | null
parsed content of the header
- rowType: array (object | null)[] | null
_cells content of the row cells of the header
- isType: boolean | null
_header content of the row cells of the header
- textType: string | null
content of the row cells of the header
- urlsType: array (object | null)[] | null
contains other URLs and anchors found in the content element
- anchorType: string | null
_text text of the URL’s anchor
- urlType: string | null
contains other URLs and anchors found in the content element
- offersType: array (object | null)[] | null
array of products displayed on the page
contains objects with information on products displayed on the page- nameType: string | null
name of the product
- priceType: number | null Format: double
price of the product
- priceType: string | null
_currency price currency
- priceType: string | null
_valid _until displays the date and time until which the price is valid in the UTC format: “yyyy-mm-dd hh-mm-ss +00:00” example: "2022-11-01 10:02:52 +00:00"
- ratingsType: array (object | null)[] | null
contains objects with rating information for the products displayed on the page
- maxType: number | null Format: double
_rating _value maximum value for the rating name
- nameType: string | null
rating name here you can find the following elements: Max5, Percents, CustomMax
- ratingType: integer | null Format: int64
_count number of votes
- ratingType: number | null Format: double
_value the value of the rating
- relativeType: number | null Format: double
_rating relative rating
- secondaryType: array (object | null)[] | null
_topic - authorType: string | null
content author name
- hType: string | null
_title meta title
- languageType: string | null
content language
- levelType: integer | null
HTML level
- mainType: string | null
_title main title of the block
- primaryType: array (object | null)[] | null
_content - textType: string | null
secondary content on the page you can find more information about content priority calculation in this help center article
- urlType: string | null
page URL. displayed in case the text is a link anchor
- urlsType: array (object | null)[] | null
contains other URLs and anchors found in the content element
- anchorType: string | null
_text text of the URL’s anchor
- urlType: string | null
contains other URLs and anchors found in the content element
- secondaryType: array (object | null)[] | null
_content - textType: string | null
secondary content on the page you can find more information about content priority calculation in this help center article
- urlType: string | null
page URL. displayed in case the text is a link anchor
- urlsType: array (object | null)[] | null
contains other URLs and anchors found in the content element
- anchorType: string | null
_text text of the URL’s anchor
- urlType: string | null
contains other URLs and anchors found in the content element
- tableType: array (object | null)[] | null
_content content of the table on the page
- bodyType: array (object | null)[] | null
content of the body of the table
- rowType: array (object | null)[] | null
_cells content of the row cells of the header
- isType: boolean | null
_header content of the row cells of the header
- textType: string | null
content of the row cells of the header
- urlsType: array (object | null)[] | null
contains other URLs and anchors found in the content element
- anchorType: string | null
_text text of the URL’s anchor
- urlType: string | null
contains other URLs and anchors found in the content element
- footerType: array (object | null)[] | null
content of the footer of the table
- rowType: array (object | null)[] | null
_cells content of the row cells of the header
- isType: boolean | null
_header content of the row cells of the header
- textType: string | null
content of the row cells of the header
- urlsType: array (object | null)[] | null
contains other URLs and anchors found in the content element
- anchorType: string | null
_text text of the URL’s anchor
- urlType: string | null
contains other URLs and anchors found in the content element
- headerType: array (object | null)[] | null
parsed content of the header
- rowType: array (object | null)[] | null
_cells content of the row cells of the header
- isType: boolean | null
_header content of the row cells of the header
- textType: string | null
content of the row cells of the header
- urlsType: array (object | null)[] | null
contains other URLs and anchors found in the content element
- anchorType: string | null
_text text of the URL’s anchor
- urlType: string | null
contains other URLs and anchors found in the content element
- statusType: integer | null
_code general status code
you can find the full list of the response codes here
Note: we strongly recommend designing a necessary system for handling related exceptional or error conditions - typeType: string | null
type of element
- itemsType: integer | null Format: int64
_count number of items in the results array
- resultType: integer | null Format: int64
_count number of elements in the result array
- statusType: integer | null
_code status code of the task generated by DataForSEO, can be within the following range: 10000-60000 you can find the full list of the response codes here
- statusType: string | null
_message informational message of the task you can find the full list of general informational messages here
- timeType: string | null
execution time, seconds
- Type: integer | null Format: int64tasks
_count the number of tasks in the tasks array
- Type: integer | null Format: int64tasks
_error the number of tasks in the tasks array returned with an error
- Type: string | nulltime
total execution time, seconds
- Type: string | nullversion
the current version of the API
application/json - 400
The request could not be processed. Check the request parameters.
- 401
A valid Felo API key is required.
- 402
The request cannot proceed because a billing requirement is not met.
- 403
The account is not permitted to perform this operation.
- 429
A request or spending limit has been reached.
- 502
The service could not complete the request.
- 503
The API or billing service is temporarily unavailable.
- 504
The service timed out while processing the request.
- default
Error response; upstream passthrough responses may use provider formats
application/json
curl https://openapi.felo.ai/v1/beta/dataforseo/on_page/content_parsing/live \
--request POST \
--header 'Content-Type: application/json' \
--header 'Authorization: Bearer YOUR_SECRET_TOKEN' \
--data '[
{
"url": "https://dataforseo.com/blog/a-versatile-alternative-to-google-trends-exploring-the-power-of-dataforseo-trends-api"
}
]'
{
"version": null,
"status_code": null,
"status_message": null,
"time": null,
"cost": null,
"tasks_count": null,
"tasks_error": null,
"tasks": [
{
"id": null,
"status_code": null,
"status_message": null,
"time": null,
"cost": null,
"result_count": null,
"path": [
null
],
"data": null,
"result": [
{
"crawl_progress": null,
"crawl_status": {
"max_crawl_pages": null,
"pages_in_queue": null,
"pages_crawled": null
},
"items_count": null,
"items": [
{
"type": null,
"fetch_time": null,
"status_code": null,
"page_content": "[Max Depth Exceeded]",
"page_as_markdown": null
}
]
}
]
}
]
}