Felo API PlatformFelo API Platform

데이터 API / DataForSEO / On Page

OnPage API Duplicate Tags

Pages within a crawl sharing a title or meta description. ⚠️ type accepts exactly duplicate_title or duplicate_description - anything else, including the obvious 'title', is rejected with status_code 40501 inside an HTTP 200. accumulator narrows the result to pages carrying one specific tag value. Returns total_pages_count, pages_count, items_count and items. Reads a finished crawl, so it needs the id from post_dataforseo_on_page_submit and returns crawl_progress plus a crawl_status of max_crawl_pages, pages_in_queue and pages_crawled - check those before trusting a small result, because a crawl still running simply has less to report. For duplicated body content instead, use post_dataforseo_on_page_duplicate_content. 💰 Free upstream: querying a finished crawl costs nothing, only the crawl itself does.

파라미터

경로, 쿼리, 헤더 파라미터가 없습니다.

요청 본문

  • idstring필수

    ID of the task required field you can get this ID in the response of the Task POST endpoint example: “07131248-1535-0216-1000-17384017ad04”

  • typestring필수

    허용 값: duplicate_title · duplicate_description

    duplicate tags type required field indicates the type of duplicate elements found on the pages. The results will depend on the type you specify possible values: duplicate_title, duplicate_description

  • accumulatorstring선택

    tag value optional field specify a title or description here if you want to receive a list of duplicate pages that contains this tag

  • limitinteger선택

    the maximum number of returned pages optional field default value: 100 maximum value: 1000

  • offsetinteger선택

    offset in the results array of returned pages optional field default value: 0 if you specify the 10 value, the first ten pages in the results array will be omitted and the data will be provided for the successive pages

  • tagstring선택

    user-defined task identifier optional field the character limit is 255 you can use this parameter to identify the task and match it with the result you will find the specified tag value in the data object of the response

요청 예시

curl -X POST "https://openapi.felo.ai/v1/beta/dataforseo/on_page/duplicate_tags" \
  -H "Authorization: Bearer $FELO_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
  "id": "<string>",
  "type": "<string>",
  "accumulator": "<string>",
  "limit": 0,
  "offset": 0,
  "tag": "<string>"
}'

응답

응답 필드

  • versionstring선택

    the current version of the API

  • status_codeinteger선택

    general status code you can find the full list of the response codes here Note: we strongly recommend designing a necessary system for handling related exceptional or error conditions

  • status_messagestring선택

    general informational message you can find the full list of general informational messages here

  • timestring선택

    execution time, seconds

  • costnumber선택

    total tasks cost, USD

  • tasks_countinteger선택

    the number of tasks in the tasks array

  • tasks_errorinteger선택

    the number of tasks in the tasks array returned with an error

  • tasksstring[]선택

    array of tasks

  • idstring선택

    task identifier unique task identifier in our system in the UUID format

  • status_codeinteger선택

    status code of the task generated by DataForSEO; can be within the following range: 10000-60000 you can find the full list of the response codes here

  • status_messagestring선택

    informational message of the task you can find the full list of general informational messages here

  • timestring선택

    execution time, seconds

  • costnumber선택

    cost of the task, USD

  • result_countinteger선택

    number of elements in the result array

  • pathstring[]선택

    URL path

  • dataobject선택

    contains the same parameters that you specified in the POST request

  • resultstring[]선택

    array of results

  • crawl_progressstring선택

    status of the crawling session possible values: in_progress, finished

  • crawl_statusobject선택

    details of the crawling session

  • max_crawl_pagesinteger선택

    maximum number of pages to crawl indicates the max_crawl_pages limit you specified when setting a task

  • pages_in_queueinteger선택

    number of pages that are currently in the crawling queue

  • pages_crawledinteger선택

    number of crawled pages

  • total_pages_countinteger선택

    total number of pages with duplicate tags displays the total number of pages with duplicate tags of the target website

  • pages_countinteger선택

    number of pages with duplicate tags in the response displays the number of pages with duplicate tags returned in the response

  • items_countinteger선택

    number of items in the results array

  • itemsstring[]선택

    items array

  • accumulatorstring선택

    contains the value of duplicated tag

  • total_countinteger선택

    total count of duplicate pages

  • pagesstring[]선택

    pages with duplicate tags

  • resource_typestring선택

    type of the returned resource = ‘html’

  • status_codeinteger선택

    status code of the page

  • locationstring선택

    location header indicates the URL to redirect a page to

  • urlstring선택

    page URL

  • metaobject선택

    page properties the value depends on the resource_type

  • titleinteger선택

    page title

  • charsetinteger선택

    code page example: 65001

  • followboolean선택

    indicates whether a page’s ‘meta robots’ allows crawlers to follow the links on the page if false, the page’s ‘meta robots’ tag contains “nofollow” parameter instructing crawlers not to follow the links on the page

  • generatorstring선택

    meta tag generator

  • htagsobject선택

    HTML header tags

  • descriptionstring선택

    content of the meta description tag

  • faviconstring선택

    favicon of the page

  • meta_keywordsstring선택

    content of the keywords meta tag

  • canonicalstring선택

    canonical page

  • internal_links_countinteger선택

    number of internal links on the page

  • external_links_countinteger선택

    number of external links on the page

  • inbound_links_countinteger선택

    number of internal links pointing at the page

  • images_countinteger선택

    number of images on the page

  • images_sizeinteger선택

    total size of images on the page measured in bytes

  • scripts_countinteger선택

    number of scripts on the page

  • scripts_sizeinteger선택

    total size of scripts on the page measured in bytes

  • stylesheets_countinteger선택

    number of stylesheets on the page

  • stylesheets_sizeinteger선택

    total size of stylesheets on the page measured in bytes

  • title_lengthinteger선택

    length of the title tag in characters

  • description_lengthinteger선택

    length of the description tag in characters

  • render_blocking_scripts_countinteger선택

    number of scripts on the page that block page rendering

  • render_blocking_stylesheets_countinteger선택

    number of CSS styles on the page that block page rendering

  • cumulative_layout_shiftnumber선택

    Core Web Vitals metric measuring the layout stability of a page measures the sum total of all individual layout shift scores for every unexpected layout shift that occurs during the entire lifespan of the page. Learn more.

  • contentobject선택

    overall information about content of the page

  • plain_text_sizeinteger선택

    total size of the text on the page measured in bytes

  • plain_text_rateinteger선택

    plaintext rate value plain_text_size to size ratio

  • plain_text_word_countnumber선택

    number of words on the page

  • automated_readability_indexnumber선택

    Automated Readability Index

  • coleman_liau_readability_indexnumber선택

    Coleman–Liau Index

  • dale_chall_readability_indexnumber선택

    Dale–Chall Readability Index

  • flesch_kincaid_readability_indexnumber선택

    Flesch–Kincaid Readability Index

  • smog_readability_indexnumber선택

    SMOG Readability Index

  • description_to_content_consistencynumber선택

    consistency of the meta description tag with the page content measured from 0 to 1

  • title_to_content_consistencynumber선택

    consistency of the meta title tag with the page content measured from 0 to 1

  • meta_keywords_to_content_consistencynumber선택

    consistency of meta keywordstag with the page content measured from 0 to 1

  • deprecated_tagsstring[]선택

    deprecated tags on the page

  • duplicate_meta_tagsstring[]선택

    duplicate meta tags on the page

  • spellobject선택

    spellcheck hunspell spellcheck errors

  • hunspell_language_codestring선택

    spellcheck language code

  • misspelledstring[]선택

    array of misspelled words

  • wordstring선택

    misspelled word

  • resource_errorsobject선택

    resource errors and warnings

  • errorsstring[]선택

    resource errors

  • lineinteger선택

    line where the error was found

  • messagestring선택

    text message of the error the full list of possible HTML errors can be found here

  • warningsstring[]선택

    resource warnings

  • lineinteger선택

    line the warning relates to note that if "line": 0, the warning relates to the whole page

  • messagestring선택

    text message of the warning possible messages: "Has node with more than 60 childs." – HTML page has at least 1 tag nesting over 60 tags of the same level "Has more that 1500 nodes." – DOM tree contains over 1,500 elements "HTML depth more than 32 tags." – DOM depth exceeds 32 nodes

  • social_media_tagsobject선택

    object of social media tags found on the page contains social media tags and their content supported tags include but are not limited to Open Graph and Twitter card

  • page_timingobject선택

    array of page load metrics

  • time_to_interactiveinteger선택

    Time To Interactive (TTI) metric the time it takes until the user can interact with a page (in milliseconds)

  • dom_completeinteger선택

    time to load resources the time it takes until the page and all of its subresources are downloaded (in milliseconds)

  • largest_contentful_paintnumber선택

    Core Web Vitals metric measuring how fast the largest above-the-fold content element is displayed The amount of time (in milliseconds) to render the largest content element visible in the viewport, from when the user requests the URL. Learn more.

  • first_input_delaynumber선택

    Core Web Vitals metric indicating the responsiveness of a page The time (in milliseconds) from when a user first interacts with your page to the time when the browser responds to that interaction. Learn more.

  • connection_timeinteger선택

    time to connect to a server the time it takes until the connection with a server is established (in milliseconds)

  • time_to_secure_connectioninteger선택

    time to establish a secure connection the time it takes until the secure connection with a server is established (in milliseconds)

  • request_sent_timeinteger선택

    time to send a request to a server the time it takes until the request to a server is sent (in milliseconds)

  • waiting_timeinteger선택

    time to first byte (TTFB) in milliseconds

  • download_timeinteger선택

    time it takes for a browser to receive a response (in milliseconds)

  • duration_timeinteger선택

    total time it takes until a browser receives a complete response from a server (in milliseconds)

  • fetch_startinteger선택

    time to start downloading the HTML resource the amount of time the browser needs to start downloading a page

  • fetch_endinteger선택

    time to complete downloading the HTML resource the amount of time the browser needs to complete downloading a page

  • onpage_scorenumber선택

    shows how page is optimized on a 100-point scale this field shows how page is optimized considering critical on-page issues and warnings detected; 100 is the highest possible score that means the page does not have any critical on-page issues and important warnings; learn more about how the metric is calculated in this help center article

  • total_dom_sizeinteger선택

    total DOM size of a page

  • custom_js_responsestring선택

    the result of executing a specified JS script note that you should specify a custom_js field when setting a task to receive this data and the field type and its value will totally depend on the script you specified;

  • custom_js_client_exceptionstring선택

    error when executing a custom js if the error occurred when executing the script you specified in the custom_js field, the error message would be displayed here

  • broken_resourcesboolean선택

    indicates whether a page contains broken resources

  • broken_linksboolean선택

    indicates whether a page contains broken links

  • duplicate_titleboolean선택

    indicates whether a page has duplicate title tags

  • duplicate_descriptionboolean선택

    indicates whether a page has a duplicate description

  • duplicate_contentboolean선택

    indicates whether a page has duplicate content

  • click_depthinteger선택

    number of clicks it takes to get to the page indicates the number of clicks from the homepage needed before landing at the target page

  • sizeinteger선택

    resource size indicates the size of a given page measured in bytes

  • encoded_sizeinteger선택

    page size after encoding indicates the size of the encoded page measured in bytes

  • total_transfer_sizeinteger선택

    compressed page size indicates the compressed size of a given page

  • fetch_timestring선택

    date and time when a resource was fetched in the UTC format: “yyyy-mm-dd hh-mm-ss +00:00” example: 2019-11-15 12:57:46 +00:00

  • cache_controlobject선택

    instructions for caching

  • cachableboolean선택

    indicates whether the page is cacheable

  • ttlinteger선택

    time to live the amount of time the browser caches a resource

  • checksobject선택

    website checks on-page check-ups related to the page

  • no_content_encodingboolean선택

    page with no content encoding indicates whether a page has no compression algorithm of the content

  • high_loading_timeboolean선택

    page with high loading time indicates whether a page loading time exceeds 3 seconds

  • is_redirectboolean선택

    page with redirects indicates whether a page has 3XX redirects to other pages

  • is_4xx_codeboolean선택

    page with 4xx status codes indicates whether a page has 4xx response code

  • is_5xx_codeboolean선택

    page with 5xx status codes indicates whether a page has 5xx response code

  • is_brokenboolean선택

    broken page indicates whether a page returns a response code less than 200 or greater than 400

  • is_wwwboolean선택

    page with www indicates whether a page is on a www subdomain

  • is_httpsboolean선택

    page with the https protocol

  • is_httpboolean선택

    page with the http protocol

  • high_waiting_timeboolean선택

    page with high waiting time indicates whether a page waiting time (aka Time to First Byte) exceeds 1.5 seconds

  • no_doctypeboolean선택

    page with no doctype indicates whether a page is without the declaration

  • canonicalboolean선택

    page is canonical

  • no_encoding_meta_tagboolean선택

    page with no meta tag encoding indicates whether a page is without Content-Type informative only if the encoding is not explicit in the Content-Type header for example: Content-Type: "text/html; charset=utf8"; Note: available for pages with canonical check set to true

  • no_h1_tagboolean선택

    page with empty or absent h1 tags Note: available for pages with canonical check set to true

  • https_to_http_linksboolean선택

    HTTPS page has links to HTTP pages if true, this HTTPS page has links to HTTP pages Note: available for pages with canonical check set to true

  • has_html_doctypeboolean선택

    page with HTML doctype declaration if true, the page has HTML DOCTYPE declaration

  • size_greater_than_3mbboolean선택

    page with size larger than 3 MB if true, the page size is exceeding 3 MB; Note: available for pages with canonical check set to true

  • meta_charset_consistencyboolean선택

    consistency between charset encoding and page charset if true, the page’s charset encoding doesn’t match the actual charset of the page; Note: available for pages with canonical check set to true

  • has_meta_refresh_redirectboolean선택

    pages with meta refresh redirect if true, the page has tag that instructs a browser to load another page after a specified time span; Note: available for pages with canonical check set to true

  • has_render_blocking_resourcesboolean선택

    page with render-blocking resources if true, the page has render-blocking scripts or stylesheets; Note: available for pages with canonical check set to true

  • redirect_chainboolean선택

    page with multiple redirects if true, there were at least two redirects before our crawler reached this page

  • low_content_rateboolean선택

    page with low content rate indicates whether a page has the plaintext size to page size ratio of less than 0.1; Note: available for pages with canonical check set to true

  • high_content_rateboolean선택

    page with high content rate indicates whether a page has the plaintext size to page size ratio of more than 0.9; Note: available for pages with canonical check set to true

  • low_character_countboolean선택

    indicates whether the page has less than 1024 characters Note: available for pages with canonical check set to true

  • high_character_countboolean선택

    indicates whether the page has more than 256,000 characters Note: available for pages with canonical check set to true

  • small_page_sizeboolean선택

    indicates whether a page is too small the value will be true if a page size is smaller than 1024 bytes; Note: available for pages with canonical check set to true

  • large_page_sizeboolean선택

    indicates whether a page is too heavy the value will be true if a page size exceeds 1 megabyte; Note: available for pages with canonical check set to true

  • low_readability_rateboolean선택

    page with a low readability rate indicates whether a page is scored less than 15 points on the Flesch–Kincaid readability test; Note: available for pages with canonical check set to true

  • irrelevant_descriptionboolean선택

    page with irrelevant description indicates whether a page description tag is irrelevant to the content of a page; the relevance threshold is 0.2; Note: available for pages with canonical check set to true

  • irrelevant_titleboolean선택

    page with irrelevant title indicates whether a page title tag is irrelevant to the content of the page; the relevance threshold is 0.3; Note: available for pages with canonical check set to true

  • irrelevant_meta_keywordsboolean선택

    page with irrelevant meta keywords indicates whether a page keywords tags are irrelevant to the content of a page; the relevance threshold is 0.6; Note: available for pages with canonical check set to true

  • title_too_longboolean선택

    page with a long title indicates whether the content of the title tag exceeds 65 characters; Note: available for pages with canonical check set to true

  • title_too_shortboolean선택

    page with short titles indicates whether the content of title tag is shorter than 30 characters; Note: available for pages with canonical check set to true

  • deprecated_html_tagsboolean선택

    page with deprecated tags indicates whether a page has deprecated HTML tags; Note: available for pages with canonical check set to true

  • duplicate_meta_tagsboolean선택

    page with duplicate meta tags indicates whether a page has more than one meta tag of the same type; Note: available for pages with canonical check set to true

  • duplicate_title_tagboolean선택

    page with more than one title tag indicates whether a page has more than one title tag; Note: available for pages with canonical check set to true

  • no_image_altboolean선택

    images without alt tags Note: available for pages with canonical check set to true

  • no_image_titleboolean선택

    images without title tags Note: available for pages with canonical check set to true

  • no_descriptionboolean선택

    pages with no description indicates whether a page has an empty or absent description meta tag; Note: available for pages with canonical check set to true

  • no_titleboolean선택

    page with no title indicates whether a page has an empty or absent title tag; Note: available for pages with canonical check set to true

  • no_faviconboolean선택

    page with no favicon Note: available for pages with canonical check set to true

  • seo_friendly_urlboolean선택

    page with seo-frienldy URL the ‘SEO-friendliness’ of a page URL is checked by four parameters: – the length of the relative path is less than 120 characters – no special characters – no dynamic parameters – relevance of the URL to the page if at least one of them is failed then such URL is considered as not ‘SEO-friendly’ Note: available for pages with canonical check set to true

  • flashboolean선택

    page with flash indicates whether a page has flash elements

  • frameboolean선택

    page with frames indicates whether a page contains frame, iframe, frameset tags

  • lorem_ipsumboolean선택

    page with lorem ipsum indicates whether a page has lorem ipsum content; Note: available for pages with canonical check set to true

  • has_misspellingboolean선택

    page with misspelled content

  • seo_friendly_url_characters_checkboolean선택

    URL characters check-up indicates whether a page URL containing only uppercase and lowercase Latin characters, digits and dashes

  • seo_friendly_url_dynamic_checkboolean선택

    URL dynamic check-up the value will be true if a page has no dynamic parameters in the url

  • seo_friendly_url_keywords_checkboolean선택

    URL keyword check-up indicates whether a page URL is consistent with the title meta tag

  • seo_friendly_url_relative_length_checkboolean선택

    URL length check-up the value will be true if a page URL no longer than 120 characters

  • is_orphan_pageboolean선택

    page with no internal links pointing to it true if the page has no reference from other pages of the domain

  • is_link_relation_conflictboolean선택

    mix of both followed and nofollowed incoming internal links true if the page receives at least one link with the rel="nofollow" attribute and at least one dofollow link

  • has_links_to_redirectsboolean선택

    page is pointing to a page that redirect elsewhere true if the page is pointing to a page that responds with a 3XX redirect

  • recursive_canonicalboolean선택

    recursive canonical error true if the page contains rel="canonical" tag to another page, which in turn, refers back to the initial page

  • canonical_chainboolean선택

    pages with canonical pointing to a page that has a canonical pointing elsewhere true if the page has a canonical link element pointing to a page that has a canonical pointing to a different page e.g. page a is canonicalized to page b, which is canonicalized to page c

  • canonical_to_redirectboolean선택

    canonical page pointing to a page that redirect elsewhere true if the page has a canonical link element pointing to a page that responds with a 3XX redirect

  • canonical_to_brokenboolean선택

    canonical link pointing to a broken page true if the page has a a canonical link pointing to a page that responds with a 4xx or 5xx response codes

  • content_encodingstring선택

    type of encoding

  • media_typestring선택

    types of media used to display a page

  • serverstring선택

    server version

  • is_resourceboolean선택

    indicates whether a page is a single resource

  • last_modifiedobject선택

    contains data on changes related to the resource if there is no data, the value will be null

  • headerstring선택

    date and time when the header was last modified in the UTC format: “yyyy-mm-dd hh-mm-ss +00:00” example: 2019-11-15 12:57:46 +00:00 if there is no data, the value will be null

  • sitemapstring선택

    date and time when the sitemap was last modified in the UTC format: “yyyy-mm-dd hh-mm-ss +00:00” example: 2019-11-15 12:57:46 +00:00 if there is no data, the value will be null

  • meta_tagstring선택

    date and time when the meta tag was last modified in the UTC format: “yyyy-mm-dd hh-mm-ss +00:00” example: 2019-11-15 12:57:46 +00:00 if there is no data, the value will be null