Data API / DataForSEO / On Page

OnPage API Duplicate Tags

Pages within a crawl sharing a title or meta description. ⚠️ type accepts exactly duplicate_title or duplicate_description - anything else, including the obvious 'title', is rejected with status_code 40501 inside an HTTP 200. accumulator narrows the result to pages carrying one specific tag value. Returns total_pages_count, pages_count, items_count and items. Reads a finished crawl, so it needs the id from post_dataforseo_on_page_submit and returns crawl_progress plus a crawl_status of max_crawl_pages, pages_in_queue and pages_crawled - check those before trusting a small result, because a crawl still running simply has less to report. For duplicated body content instead, use post_dataforseo_on_page_duplicate_content. 💰 Free upstream: querying a finished crawl costs nothing, only the crawl itself does.

Параметры

Параметров пути, запроса и заголовков нет.

Тело запроса

idstringОбязательный
ID of the task required field you can get this ID in the response of the Task POST endpoint example: “07131248-1535-0216-1000-17384017ad04”
typestringОбязательный
Допустимые значения: duplicate_title · duplicate_description
duplicate tags type required field indicates the type of duplicate elements found on the pages. The results will depend on the type you specify possible values: duplicate_title, duplicate_description
accumulatorstringНеобязательный
tag value optional field specify a title or description here if you want to receive a list of duplicate pages that contains this tag
limitintegerНеобязательный
the maximum number of returned pages optional field default value: 100 maximum value: 1000
offsetintegerНеобязательный
offset in the results array of returned pages optional field default value: 0 if you specify the 10 value, the first ten pages in the results array will be omitted and the data will be provided for the successive pages
tagstringНеобязательный
user-defined task identifier optional field the character limit is 255 you can use this parameter to identify the task and match it with the result you will find the specified tag value in the data object of the response

Пример запроса

curl -X POST "https://openapi.felo.ai/v1/beta/dataforseo/on_page/duplicate_tags" \
  -H "Authorization: Bearer $FELO_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
  "id": "<string>",
  "type": "<string>",
  "accumulator": "<string>",
  "limit": 0,
  "offset": 0,
  "tag": "<string>"
}'

Ответ

Поля ответа

versionstringНеобязательный
the current version of the API
status_codeintegerНеобязательный
general status code you can find the full list of the response codes here Note: we strongly recommend designing a necessary system for handling related exceptional or error conditions
status_messagestringНеобязательный
general informational message you can find the full list of general informational messages here
timestringНеобязательный
execution time, seconds
costnumberНеобязательный
total tasks cost, USD
tasks_countintegerНеобязательный
the number of tasks in the tasks array
tasks_errorintegerНеобязательный
the number of tasks in the tasks array returned with an error
tasksstring[]Необязательный
array of tasks
idstringНеобязательный
task identifier unique task identifier in our system in the UUID format
status_codeintegerНеобязательный
status code of the task generated by DataForSEO; can be within the following range: 10000-60000 you can find the full list of the response codes here
status_messagestringНеобязательный
informational message of the task you can find the full list of general informational messages here
timestringНеобязательный
execution time, seconds
costnumberНеобязательный
cost of the task, USD
result_countintegerНеобязательный
number of elements in the result array
pathstring[]Необязательный
URL path
dataobjectНеобязательный
contains the same parameters that you specified in the POST request
resultstring[]Необязательный
array of results
crawl_progressstringНеобязательный
status of the crawling session possible values: in_progress, finished
crawl_statusobjectНеобязательный
details of the crawling session
max_crawl_pagesintegerНеобязательный
maximum number of pages to crawl indicates the max_crawl_pages limit you specified when setting a task
pages_in_queueintegerНеобязательный
number of pages that are currently in the crawling queue
pages_crawledintegerНеобязательный
number of crawled pages
total_pages_countintegerНеобязательный
total number of pages with duplicate tags displays the total number of pages with duplicate tags of the target website
pages_countintegerНеобязательный
number of pages with duplicate tags in the response displays the number of pages with duplicate tags returned in the response
items_countintegerНеобязательный
number of items in the results array
itemsstring[]Необязательный
items array
accumulatorstringНеобязательный
contains the value of duplicated tag
total_countintegerНеобязательный
total count of duplicate pages
pagesstring[]Необязательный
pages with duplicate tags
resource_typestringНеобязательный
type of the returned resource = ‘html’
status_codeintegerНеобязательный
status code of the page
locationstringНеобязательный
location header indicates the URL to redirect a page to
urlstringНеобязательный
page URL
metaobjectНеобязательный
page properties the value depends on the resource_type
titleintegerНеобязательный
page title
charsetintegerНеобязательный
code page example: 65001
followbooleanНеобязательный
indicates whether a page’s ‘meta robots’ allows crawlers to follow the links on the page if false, the page’s ‘meta robots’ tag contains “nofollow” parameter instructing crawlers not to follow the links on the page
generatorstringНеобязательный
meta tag generator
htagsobjectНеобязательный
HTML header tags
descriptionstringНеобязательный
content of the meta description tag
faviconstringНеобязательный
favicon of the page
meta_keywordsstringНеобязательный
content of the keywords meta tag
canonicalstringНеобязательный
canonical page
internal_links_countintegerНеобязательный
number of internal links on the page
external_links_countintegerНеобязательный
number of external links on the page
inbound_links_countintegerНеобязательный
number of internal links pointing at the page
images_countintegerНеобязательный
number of images on the page
images_sizeintegerНеобязательный
total size of images on the page measured in bytes
scripts_countintegerНеобязательный
number of scripts on the page
scripts_sizeintegerНеобязательный
total size of scripts on the page measured in bytes
stylesheets_countintegerНеобязательный
number of stylesheets on the page
stylesheets_sizeintegerНеобязательный
total size of stylesheets on the page measured in bytes
title_lengthintegerНеобязательный
length of the title tag in characters
description_lengthintegerНеобязательный
length of the description tag in characters
render_blocking_scripts_countintegerНеобязательный
number of scripts on the page that block page rendering
render_blocking_stylesheets_countintegerНеобязательный
number of CSS styles on the page that block page rendering
cumulative_layout_shiftnumberНеобязательный
Core Web Vitals metric measuring the layout stability of a page measures the sum total of all individual layout shift scores for every unexpected layout shift that occurs during the entire lifespan of the page. Learn more.
contentobjectНеобязательный
overall information about content of the page
plain_text_sizeintegerНеобязательный
total size of the text on the page measured in bytes
plain_text_rateintegerНеобязательный
plaintext rate value plain_text_size to size ratio
plain_text_word_countnumberНеобязательный
number of words on the page
automated_readability_indexnumberНеобязательный
Automated Readability Index
coleman_liau_readability_indexnumberНеобязательный
Coleman–Liau Index
dale_chall_readability_indexnumberНеобязательный
Dale–Chall Readability Index
flesch_kincaid_readability_indexnumberНеобязательный
Flesch–Kincaid Readability Index
smog_readability_indexnumberНеобязательный
SMOG Readability Index
description_to_content_consistencynumberНеобязательный
consistency of the meta description tag with the page content measured from 0 to 1
title_to_content_consistencynumberНеобязательный
consistency of the meta title tag with the page content measured from 0 to 1
meta_keywords_to_content_consistencynumberНеобязательный
consistency of meta keywordstag with the page content measured from 0 to 1
deprecated_tagsstring[]Необязательный
deprecated tags on the page
duplicate_meta_tagsstring[]Необязательный
duplicate meta tags on the page
spellobjectНеобязательный
spellcheck hunspell spellcheck errors
hunspell_language_codestringНеобязательный
spellcheck language code
misspelledstring[]Необязательный
array of misspelled words
wordstringНеобязательный
misspelled word
resource_errorsobjectНеобязательный
resource errors and warnings
errorsstring[]Необязательный
resource errors
lineintegerНеобязательный
line where the error was found
messagestringНеобязательный
text message of the error the full list of possible HTML errors can be found here
warningsstring[]Необязательный
resource warnings
lineintegerНеобязательный
line the warning relates to note that if "line": 0, the warning relates to the whole page
messagestringНеобязательный
text message of the warning possible messages: "Has node with more than 60 childs." – HTML page has at least 1 tag nesting over 60 tags of the same level "Has more that 1500 nodes." – DOM tree contains over 1,500 elements "HTML depth more than 32 tags." – DOM depth exceeds 32 nodes
social_media_tagsobjectНеобязательный
object of social media tags found on the page contains social media tags and their content supported tags include but are not limited to Open Graph and Twitter card
page_timingobjectНеобязательный
array of page load metrics
time_to_interactiveintegerНеобязательный
Time To Interactive (TTI) metric the time it takes until the user can interact with a page (in milliseconds)
dom_completeintegerНеобязательный
time to load resources the time it takes until the page and all of its subresources are downloaded (in milliseconds)
largest_contentful_paintnumberНеобязательный
Core Web Vitals metric measuring how fast the largest above-the-fold content element is displayed The amount of time (in milliseconds) to render the largest content element visible in the viewport, from when the user requests the URL. Learn more.
first_input_delaynumberНеобязательный
Core Web Vitals metric indicating the responsiveness of a page The time (in milliseconds) from when a user first interacts with your page to the time when the browser responds to that interaction. Learn more.
connection_timeintegerНеобязательный
time to connect to a server the time it takes until the connection with a server is established (in milliseconds)
time_to_secure_connectionintegerНеобязательный
time to establish a secure connection the time it takes until the secure connection with a server is established (in milliseconds)
request_sent_timeintegerНеобязательный
time to send a request to a server the time it takes until the request to a server is sent (in milliseconds)
waiting_timeintegerНеобязательный
time to first byte (TTFB) in milliseconds
download_timeintegerНеобязательный
time it takes for a browser to receive a response (in milliseconds)
duration_timeintegerНеобязательный
total time it takes until a browser receives a complete response from a server (in milliseconds)
fetch_startintegerНеобязательный
time to start downloading the HTML resource the amount of time the browser needs to start downloading a page
fetch_endintegerНеобязательный
time to complete downloading the HTML resource the amount of time the browser needs to complete downloading a page
onpage_scorenumberНеобязательный
shows how page is optimized on a 100-point scale this field shows how page is optimized considering critical on-page issues and warnings detected; 100 is the highest possible score that means the page does not have any critical on-page issues and important warnings; learn more about how the metric is calculated in this help center article
total_dom_sizeintegerНеобязательный
total DOM size of a page
custom_js_responsestringНеобязательный
the result of executing a specified JS script note that you should specify a custom_js field when setting a task to receive this data and the field type and its value will totally depend on the script you specified;
custom_js_client_exceptionstringНеобязательный
error when executing a custom js if the error occurred when executing the script you specified in the custom_js field, the error message would be displayed here
broken_resourcesbooleanНеобязательный
indicates whether a page contains broken resources
broken_linksbooleanНеобязательный
indicates whether a page contains broken links
duplicate_titlebooleanНеобязательный
indicates whether a page has duplicate title tags
duplicate_descriptionbooleanНеобязательный
indicates whether a page has a duplicate description
duplicate_contentbooleanНеобязательный
indicates whether a page has duplicate content
click_depthintegerНеобязательный
number of clicks it takes to get to the page indicates the number of clicks from the homepage needed before landing at the target page
sizeintegerНеобязательный
resource size indicates the size of a given page measured in bytes
encoded_sizeintegerНеобязательный
page size after encoding indicates the size of the encoded page measured in bytes
total_transfer_sizeintegerНеобязательный
compressed page size indicates the compressed size of a given page
fetch_timestringНеобязательный
date and time when a resource was fetched in the UTC format: “yyyy-mm-dd hh-mm-ss +00:00” example: 2019-11-15 12:57:46 +00:00
cache_controlobjectНеобязательный
instructions for caching
cachablebooleanНеобязательный
indicates whether the page is cacheable
ttlintegerНеобязательный
time to live the amount of time the browser caches a resource
checksobjectНеобязательный
website checks on-page check-ups related to the page
no_content_encodingbooleanНеобязательный
page with no content encoding indicates whether a page has no compression algorithm of the content
high_loading_timebooleanНеобязательный
page with high loading time indicates whether a page loading time exceeds 3 seconds
is_redirectbooleanНеобязательный
page with redirects indicates whether a page has 3XX redirects to other pages
is_4xx_codebooleanНеобязательный
page with 4xx status codes indicates whether a page has 4xx response code
is_5xx_codebooleanНеобязательный
page with 5xx status codes indicates whether a page has 5xx response code
is_brokenbooleanНеобязательный
broken page indicates whether a page returns a response code less than 200 or greater than 400
is_wwwbooleanНеобязательный
page with www indicates whether a page is on a www subdomain
is_httpsbooleanНеобязательный
page with the https protocol
is_httpbooleanНеобязательный
page with the http protocol
high_waiting_timebooleanНеобязательный
page with high waiting time indicates whether a page waiting time (aka Time to First Byte) exceeds 1.5 seconds
no_doctypebooleanНеобязательный
page with no doctype indicates whether a page is without the declaration
canonicalbooleanНеобязательный
page is canonical
no_encoding_meta_tagbooleanНеобязательный
page with no meta tag encoding indicates whether a page is without Content-Type informative only if the encoding is not explicit in the Content-Type header for example: Content-Type: "text/html; charset=utf8"; Note: available for pages with canonical check set to true
no_h1_tagbooleanНеобязательный
page with empty or absent h1 tags Note: available for pages with canonical check set to true
https_to_http_linksbooleanНеобязательный
HTTPS page has links to HTTP pages if true, this HTTPS page has links to HTTP pages Note: available for pages with canonical check set to true
has_html_doctypebooleanНеобязательный
page with HTML doctype declaration if true, the page has HTML DOCTYPE declaration
size_greater_than_3mbbooleanНеобязательный
page with size larger than 3 MB if true, the page size is exceeding 3 MB; Note: available for pages with canonical check set to true
meta_charset_consistencybooleanНеобязательный
consistency between charset encoding and page charset if true, the page’s charset encoding doesn’t match the actual charset of the page; Note: available for pages with canonical check set to true
has_meta_refresh_redirectbooleanНеобязательный
pages with meta refresh redirect if true, the page has tag that instructs a browser to load another page after a specified time span; Note: available for pages with canonical check set to true
has_render_blocking_resourcesbooleanНеобязательный
page with render-blocking resources if true, the page has render-blocking scripts or stylesheets; Note: available for pages with canonical check set to true
redirect_chainbooleanНеобязательный
page with multiple redirects if true, there were at least two redirects before our crawler reached this page
low_content_ratebooleanНеобязательный
page with low content rate indicates whether a page has the plaintext size to page size ratio of less than 0.1; Note: available for pages with canonical check set to true
high_content_ratebooleanНеобязательный
page with high content rate indicates whether a page has the plaintext size to page size ratio of more than 0.9; Note: available for pages with canonical check set to true
low_character_countbooleanНеобязательный
indicates whether the page has less than 1024 characters Note: available for pages with canonical check set to true
high_character_countbooleanНеобязательный
indicates whether the page has more than 256,000 characters Note: available for pages with canonical check set to true
small_page_sizebooleanНеобязательный
indicates whether a page is too small the value will be true if a page size is smaller than 1024 bytes; Note: available for pages with canonical check set to true
large_page_sizebooleanНеобязательный
indicates whether a page is too heavy the value will be true if a page size exceeds 1 megabyte; Note: available for pages with canonical check set to true
low_readability_ratebooleanНеобязательный
page with a low readability rate indicates whether a page is scored less than 15 points on the Flesch–Kincaid readability test; Note: available for pages with canonical check set to true
irrelevant_descriptionbooleanНеобязательный
page with irrelevant description indicates whether a page description tag is irrelevant to the content of a page; the relevance threshold is 0.2; Note: available for pages with canonical check set to true
irrelevant_titlebooleanНеобязательный
page with irrelevant title indicates whether a page title tag is irrelevant to the content of the page; the relevance threshold is 0.3; Note: available for pages with canonical check set to true
irrelevant_meta_keywordsbooleanНеобязательный
page with irrelevant meta keywords indicates whether a page keywords tags are irrelevant to the content of a page; the relevance threshold is 0.6; Note: available for pages with canonical check set to true
title_too_longbooleanНеобязательный
page with a long title indicates whether the content of the title tag exceeds 65 characters; Note: available for pages with canonical check set to true
title_too_shortbooleanНеобязательный
page with short titles indicates whether the content of title tag is shorter than 30 characters; Note: available for pages with canonical check set to true
deprecated_html_tagsbooleanНеобязательный
page with deprecated tags indicates whether a page has deprecated HTML tags; Note: available for pages with canonical check set to true
duplicate_meta_tagsbooleanНеобязательный
page with duplicate meta tags indicates whether a page has more than one meta tag of the same type; Note: available for pages with canonical check set to true
duplicate_title_tagbooleanНеобязательный
page with more than one title tag indicates whether a page has more than one title tag; Note: available for pages with canonical check set to true
no_image_altbooleanНеобязательный
images without alt tags Note: available for pages with canonical check set to true
no_image_titlebooleanНеобязательный
images without title tags Note: available for pages with canonical check set to true
no_descriptionbooleanНеобязательный
pages with no description indicates whether a page has an empty or absent description meta tag; Note: available for pages with canonical check set to true
no_titlebooleanНеобязательный
page with no title indicates whether a page has an empty or absent title tag; Note: available for pages with canonical check set to true
no_faviconbooleanНеобязательный
page with no favicon Note: available for pages with canonical check set to true
seo_friendly_urlbooleanНеобязательный
page with seo-frienldy URL the ‘SEO-friendliness’ of a page URL is checked by four parameters: – the length of the relative path is less than 120 characters – no special characters – no dynamic parameters – relevance of the URL to the page if at least one of them is failed then such URL is considered as not ‘SEO-friendly’ Note: available for pages with canonical check set to true
flashbooleanНеобязательный
page with flash indicates whether a page has flash elements
framebooleanНеобязательный
page with frames indicates whether a page contains frame, iframe, frameset tags
lorem_ipsumbooleanНеобязательный
page with lorem ipsum indicates whether a page has lorem ipsum content; Note: available for pages with canonical check set to true
has_misspellingbooleanНеобязательный
page with misspelled content
seo_friendly_url_characters_checkbooleanНеобязательный
URL characters check-up indicates whether a page URL containing only uppercase and lowercase Latin characters, digits and dashes
seo_friendly_url_dynamic_checkbooleanНеобязательный
URL dynamic check-up the value will be true if a page has no dynamic parameters in the url
seo_friendly_url_keywords_checkbooleanНеобязательный
URL keyword check-up indicates whether a page URL is consistent with the title meta tag
seo_friendly_url_relative_length_checkbooleanНеобязательный
URL length check-up the value will be true if a page URL no longer than 120 characters
is_orphan_pagebooleanНеобязательный
page with no internal links pointing to it true if the page has no reference from other pages of the domain
is_link_relation_conflictbooleanНеобязательный
mix of both followed and nofollowed incoming internal links true if the page receives at least one link with the rel="nofollow" attribute and at least one dofollow link
has_links_to_redirectsbooleanНеобязательный
page is pointing to a page that redirect elsewhere true if the page is pointing to a page that responds with a 3XX redirect
recursive_canonicalbooleanНеобязательный
recursive canonical error true if the page contains rel="canonical" tag to another page, which in turn, refers back to the initial page
canonical_chainbooleanНеобязательный
pages with canonical pointing to a page that has a canonical pointing elsewhere true if the page has a canonical link element pointing to a page that has a canonical pointing to a different page e.g. page a is canonicalized to page b, which is canonicalized to page c
canonical_to_redirectbooleanНеобязательный
canonical page pointing to a page that redirect elsewhere true if the page has a canonical link element pointing to a page that responds with a 3XX redirect
canonical_to_brokenbooleanНеобязательный
canonical link pointing to a broken page true if the page has a a canonical link pointing to a page that responds with a 4xx or 5xx response codes
content_encodingstringНеобязательный
type of encoding
media_typestringНеобязательный
types of media used to display a page
serverstringНеобязательный
server version
is_resourcebooleanНеобязательный
indicates whether a page is a single resource
last_modifiedobjectНеобязательный
contains data on changes related to the resource if there is no data, the value will be null
headerstringНеобязательный
date and time when the header was last modified in the UTC format: “yyyy-mm-dd hh-mm-ss +00:00” example: 2019-11-15 12:57:46 +00:00 if there is no data, the value will be null
sitemapstringНеобязательный
date and time when the sitemap was last modified in the UTC format: “yyyy-mm-dd hh-mm-ss +00:00” example: 2019-11-15 12:57:46 +00:00 if there is no data, the value will be null
meta_tagstringНеобязательный
date and time when the meta tag was last modified in the UTC format: “yyyy-mm-dd hh-mm-ss +00:00” example: 2019-11-15 12:57:46 +00:00 if there is no data, the value will be null