Felo API PlatformFelo API Platform
v0.1.0-beta
OpenAPI 3.1.0

OnPage API Duplicate Content

Сервер:https://openapi.felo.ai
Клиентские библиотеки

DataForSEO

​

SEO, search-engine results, keyword research, backlinks and AI visibility data.

OnPage API Duplicate Content

​

Pages within a crawl whose content resembles a given url, above a similarity threshold. Reads a finished crawl, so it needs the id from post_dataforseo_on_page_submit and returns crawl_progress plus a crawl_status of max_crawl_pages, pages_in_queue and pages_crawled - check those before trusting a small result, because a crawl still running simply has less to report. For duplicated titles or meta descriptions rather than body text, use post_dataforseo_on_page_duplicate_tags. 💰 Free upstream: querying a finished crawl costs nothing, only the crawl itself does.

Тело
обязательно
application/json
  • Тип: array object[]
    • id
      Тип: string
      обязательно

      ID of the task required field you can get this ID in the response of the Task POST endpoint example: “07131248-1535-0216-1000-17384017ad04”

    • url
      Тип: string
      обязательно

      page URL required field specify the initial page you want to receive duplicate content for

    • limit
      Тип: integer

      the maximum number of returned pages optional field default value: 100 maximum value: 1000

    • offset
      Тип: integer

      offset in the results array of returned pages optional field default value: 0 if you specify the 10 value, the first ten pages in the results array will be omitted and the data will be provided for the successive pages

    • similarity
      Тип: integer

      content similarity score by default, the content is considered duplicate if the value is greater than or equals 6 you can specify any similarity score in the 0-to-10 range

    • tag
      Тип: string

      user-defined task identifier optional field the character limit is 255 you can use this parameter to identify the task and match it with the result you will find the specified tag value in the data object of the response

Ответы
  • 200
    Тип: object

    Successful response

    • cost
      Тип: number

      total tasks cost, USD

    • status_code
      Тип: integer

      general status code you can find the full list of the response codes here Note: we strongly recommend designing a necessary system for handling related exceptional or error conditions

    • status_message
      Тип: string

      general informational message you can find the full list of general informational messages here

    • tasks
      Тип: array string[]

      array of tasks

    • tasks_count
      Тип: integer

      the number of tasks in the tasks array

    • tasks_error
      Тип: integer

      the number of tasks in the tasks array returned with an error

    • tasks.cost
      Тип: number

      cost of the task, USD

    • tasks.data
      Тип: object

      contains the same parameters that you specified in the POST request

    • tasks.id
      Тип: string

      task identifier unique task identifier in our system in the UUID format

    • tasks.path
      Тип: array string[]

      URL path

    • tasks.result
      Тип: array string[]

      array of results

    • tasks.result_count
      Тип: integer

      number of elements in the result array

    • tasks.result.crawl_progress
      Тип: string

      status of the crawling session possible values: in_progress, finished

    • tasks.result.crawl_status
      Тип: object

      details of the crawling session

    • tasks.result.crawl_status.max_crawl_pages
      Тип: integer

      maximum number of pages to crawl indicates the max_crawl_pages limit you specified when setting a task

    • tasks.result.crawl_status.pages_crawled
      Тип: integer

      number of crawled pages

    • tasks.result.crawl_status.pages_in_queue
      Тип: integer

      number of pages that are currently in the crawling queue

    • tasks.result.items
      Тип: array string[]

      items array

    • tasks.result.items_count
      Тип: integer

      number of items in the results array

    • tasks.result.items.pages
      Тип: array string[]

      pages with duplicate content

    • tasks.result.items.pages.page
      Тип: array string[]

      information about the page with duplicate content

    • Тип: boolean

      indicates whether a page contains broken links

    • tasks.result.items.pages.page.broken_resources
      Тип: boolean

      indicates whether a page contains broken resources

    • tasks.result.items.pages.page.cache_control
      Тип: object

      instructions for caching

    • tasks.result.items.pages.page.cache_control.cachable
      Тип: boolean

      indicates whether the page is cacheable

    • tasks.result.items.pages.page.cache_control.ttl
      Тип: integer

      time to live the amount of time the browser caches a resource

    • tasks.result.items.pages.page.checks
      Тип: object

      website checks on-page check-ups related to the page

    • tasks.result.items.pages.page.checks.canonical
      Тип: boolean

      page is canonical

    • tasks.result.items.pages.page.checks.canonical_chain
      Тип: boolean

      pages with canonical pointing to a page that has a canonical pointing elsewhere true if the page has a canonical link element pointing to a page that has a canonical pointing to a different page e.g. page a is canonicalized to page b, which is canonicalized to page c

    • tasks.result.items.pages.page.checks.canonical_to_broken
      Тип: boolean

      canonical link pointing to a broken page true if the page has a a canonical link pointing to a page that responds with a 4xx or 5xx response codes

    • tasks.result.items.pages.page.checks.canonical_to_redirect
      Тип: boolean

      canonical page pointing to a page that redirect elsewhere true if the page has a canonical link element pointing to a page that responds with a 3XX redirect

    • tasks.result.items.pages.page.checks.deprecated_html_tags
      Тип: boolean

      page with deprecated tags indicates whether a page has deprecated HTML tags; Note: available for pages with canonical check set to true

    • tasks.result.items.pages.page.checks.duplicate_meta_tags
      Тип: boolean

      page with duplicate meta tags indicates whether a page has more than one meta tag of the same type; Note: available for pages with canonical check set to true

    • tasks.result.items.pages.page.checks.duplicate_title_tag
      Тип: boolean

      page with more than one title tag indicates whether a page has more than one title tag; Note: available for pages with canonical check set to true

    • tasks.result.items.pages.page.checks.flash
      Тип: boolean

      page with flash indicates whether a page has flash elements

    • tasks.result.items.pages.page.checks.frame
      Тип: boolean

      page with frames indicates whether a page contains frame, iframe, frameset tags

    • tasks.result.items.pages.page.checks.has_html_doctype
      Тип: boolean

      page with HTML doctype declaration if true, the page has HTML DOCTYPE declaration

    • Тип: boolean

      page is pointing to a page that redirect elsewhere true if the page is pointing to a page that responds with a 3XX redirect

    • tasks.result.items.pages.page.checks.has_meta_refresh_redirect
      Тип: boolean

      pages with meta refresh redirect if true, the page has tag that instructs a browser to load another page after a specified time span; Note: available for pages with canonical check set to true

    • tasks.result.items.pages.page.checks.has_misspelling
      Тип: boolean

      page with misspelled content

    • tasks.result.items.pages.page.checks.has_render_blocking_resources
      Тип: boolean

      page with render-blocking resources if true, the page has render-blocking scripts or stylesheets; Note: available for pages with canonical check set to true

    • tasks.result.items.pages.page.checks.high_character_count
      Тип: boolean

      indicates whether the page has more than 256,000 characters Note: available for pages with canonical check set to true

    • tasks.result.items.pages.page.checks.high_content_rate
      Тип: boolean

      page with high content rate indicates whether a page has the plaintext size to page size ratio of more than 0.9; Note: available for pages with canonical check set to true

    • tasks.result.items.pages.page.checks.high_loading_time
      Тип: boolean

      page with high loading time indicates whether a page loading time exceeds 3 seconds

    • tasks.result.items.pages.page.checks.high_waiting_time
      Тип: boolean

      page with high waiting time indicates whether a page waiting time (aka Time to First Byte) exceeds 1.5 seconds

    • Тип: boolean

      HTTPS page has links to HTTP pages if true, this HTTPS page has links to HTTP pages Note: available for pages with canonical check set to true

    • tasks.result.items.pages.page.checks.irrelevant_description
      Тип: boolean

      page with irrelevant description indicates whether a page description tag is irrelevant to the content of a page; the relevance threshold is 0.2; Note: available for pages with canonical check set to true

    • tasks.result.items.pages.page.checks.irrelevant_meta_keywords
      Тип: boolean

      page with irrelevant meta keywords indicates whether a page keywords tags are irrelevant to the content of a page the relevance threshold is 0.6 Note: available for pages with canonical check set to true

    • tasks.result.items.pages.page.checks.irrelevant_title
      Тип: boolean

      page with irrelevant title indicates whether a page title tag is irrelevant to the content of the page the relevance threshold is 0.3 Note: available for pages with canonical check set to true

    • tasks.result.items.pages.page.checks.is_4xx_code
      Тип: boolean

      page with 4xx status codes indicates whether a page has 4xx response code

    • tasks.result.items.pages.page.checks.is_5xx_code
      Тип: boolean

      page with 5xx status codes indicates whether a page has 5xx response code

    • tasks.result.items.pages.page.checks.is_broken
      Тип: boolean

      broken page indicates whether a page returns a response code less than 200 or greater than 400

    • tasks.result.items.pages.page.checks.is_http
      Тип: boolean

      page with the http protocol

    • tasks.result.items.pages.page.checks.is_https
      Тип: boolean

      page with the https protocol

    • Тип: boolean

      mix of both followed and nofollowed incoming internal links true if the page receives at least one link with the rel="nofollow" attribute and at least one dofollow link

    • tasks.result.items.pages.page.checks.is_orphan_page
      Тип: boolean

      page with no internal links pointing to it true if the page has no reference from other pages of the domain

    • tasks.result.items.pages.page.checks.is_redirect
      Тип: boolean

      page with redirects indicates whether a page has 3XX redirects to other pages

    • tasks.result.items.pages.page.checks.is_www
      Тип: boolean

      page with www indicates whether a page is on a www subdomain

    • tasks.result.items.pages.page.checks.large_page_size
      Тип: boolean

      indicates whether a page is too heavy the value will be true if a page size exceeds 1 megabyte; Note: available for pages with canonical check set to true

    • tasks.result.items.pages.page.checks.lorem_ipsum
      Тип: boolean

      page with lorem ipsum indicates whether a page has lorem ipsum content; Note: available for pages with canonical check set to true

    • tasks.result.items.pages.page.checks.low_character_count
      Тип: boolean

      indicates whether the page has less than 1024 characters Note: available for pages with canonical check set to true

    • tasks.result.items.pages.page.checks.low_content_rate
      Тип: boolean

      page with low content rate indicates whether a page has the plaintext size to page size ratio of less than 0.1; Note: available for pages with canonical check set to true

    • tasks.result.items.pages.page.checks.low_readability_rate
      Тип: boolean

      page with a low readability rate indicates whether a page is scored less than 15 points on the Flesch–Kincaid readability test; Note: available for pages with canonical check set to true

    • tasks.result.items.pages.page.checks.meta_charset_consistency
      Тип: boolean

      consistency between charset encoding and page charset if true, the page’s charset encoding doesn’t match the actual charset of the page; Note: available for pages with canonical check set to true

    • tasks.result.items.pages.page.checks.no_content_encoding
      Тип: boolean

      page with no content encoding indicates whether a page has no compression algorithm of the content

    • tasks.result.items.pages.page.checks.no_description
      Тип: boolean

      pages with no description indicates whether a page has an empty or absent description meta tag; Note: available for pages with canonical check set to true

    • tasks.result.items.pages.page.checks.no_doctype
      Тип: boolean

      page with no doctype indicates whether a page is without the declaration

    • tasks.result.items.pages.page.checks.no_encoding_meta_tag
      Тип: boolean

      page with no meta tag encoding indicates whether a page is without Content-Type; informative only if the encoding is not explicit in the Content-Type header; for example: Content-Type: "text/html; charset=utf8"; Note: available for pages with canonical check set to true

    • tasks.result.items.pages.page.checks.no_favicon
      Тип: boolean

      page with no favicon Note: available for pages with canonical check set to true

    • tasks.result.items.pages.page.checks.no_h1_tag
      Тип: boolean

      page with empty or absent h1 tags Note: available for pages with canonical check set to true

    • tasks.result.items.pages.page.checks.no_image_alt
      Тип: boolean

      images without alt tags Note: available for pages with canonical check set to true

    • tasks.result.items.pages.page.checks.no_image_title
      Тип: boolean

      images without title tags Note: available for pages with canonical check set to true

    • tasks.result.items.pages.page.checks.no_title
      Тип: boolean

      page with no title indicates whether a page has an empty or absent title tag; Note: available for pages with canonical check set to true

    • tasks.result.items.pages.page.checks.recursive_canonical
      Тип: boolean

      recursive canonical error true if the page contains rel="canonical" tag to another page, which in turn, refers back to the initial page

    • tasks.result.items.pages.page.checks.redirect_chain
      Тип: boolean

      page with multiple redirects if true, there were at least two redirects before our crawler reached this page

    • tasks.result.items.pages.page.checks.seo_friendly_url
      Тип: boolean

      page with seo-frienldy URL the ‘SEO-friendliness’ of a page URL is checked by four parameters: – the length of the relative path is less than 120 characters – no special characters – no dynamic parameters – relevance of the URL to the page if at least one of them is failed then such URL is considered as not ‘SEO-friendly’; Note: available for pages with canonical check set to true

    • tasks.result.items.pages.page.checks.seo_friendly_url_characters_check
      Тип: boolean

      URL characters check-up indicates whether a page URL containing only uppercase and lowercase Latin characters, digits and dashes

    • tasks.result.items.pages.page.checks.seo_friendly_url_dynamic_check
      Тип: boolean

      URL dynamic check-up the value will be true if a page has no dynamic parameters in the url

    • tasks.result.items.pages.page.checks.seo_friendly_url_keywords_check
      Тип: boolean

      URL keyword check-up indicates whether a page URL is consistent with the title meta tag

    • tasks.result.items.pages.page.checks.seo_friendly_url_relative_length_check
      Тип: boolean

      URL length check-up the value will be true if a page URL no longer than 120 characters

    • tasks.result.items.pages.page.checks.size_greater_than_3mb
      Тип: boolean

      page with size larger than 3 MB if true, the page size is exceeding 3 MB; Note: available for pages with canonical check set to true

    • tasks.result.items.pages.page.checks.small_page_size
      Тип: boolean

      indicates whether a page is too small the value will be true if a page size is smaller than 1024 bytes; Note: available for pages with canonical check set to true

    • tasks.result.items.pages.page.checks.title_too_long
      Тип: boolean

      page with a long title indicates whether the content of the title tag exceeds 65 characters; Note: available for pages with canonical check set to true

    • tasks.result.items.pages.page.checks.title_too_short
      Тип: boolean

      page with short titles indicates whether the content of title tag is shorter than 30 characters; Note: available for pages with canonical check set to true

    • tasks.result.items.pages.page.click_depth
      Тип: integer

      number of clicks it takes to get to the page indicates the number of clicks from the homepage needed before landing at the target page

    • tasks.result.items.pages.page.content_encoding
      Тип: string

      type of encoding

    • tasks.result.items.pages.page.custom_js_client_exception
      Тип: string

      error when executing a custom js if the error occurred when executing the script you specified in the custom_js field, the error message would be displayed here

    • tasks.result.items.pages.page.custom_js_response
      Тип: string

      the result of executing a specified JS script note that you should specify a custom_js field when setting a task to receive this data and the field type and its value will totally depend on the script you specified;you can also filter the results by this value specifying filters in the following way: ["custom_js_response.url", "like", "pixel"]

    • tasks.result.items.pages.page.duplicate_content
      Тип: boolean

      indicates whether a page has duplicate content

    • tasks.result.items.pages.page.duplicate_description
      Тип: boolean

      indicates whether a page has a duplicate description

    • tasks.result.items.pages.page.duplicate_title
      Тип: boolean

      indicates whether a page has duplicate title tags

    • tasks.result.items.pages.page.encoded_size
      Тип: integer

      page size after encoding indicates the size of the encoded page measured in bytes

    • tasks.result.items.pages.page.fetch_time
      Тип: string

      date and time when a resource was fetched in the UTC format: “yyyy-mm-dd hh-mm-ss +00:00” example: 2019-11-15 12:57:46 +00:00

    • tasks.result.items.pages.page.header
      Тип: string

      date and time when the header was last modified in the UTC format: “yyyy-mm-dd hh-mm-ss +00:00” example: 2019-11-15 12:57:46 +00:00 if there is no data, the value will be null

    • tasks.result.items.pages.page.is_resource
      Тип: boolean

      indicates whether a page is a single resource

    • tasks.result.items.pages.page.last_modified
      Тип: object

      contains data on changes related to the resource if there is no data, the value will be null

    • tasks.result.items.pages.page.location
      Тип: string

      location header indicates the URL to redirect a page to

    • tasks.result.items.pages.page.media_type
      Тип: string

      types of media used to display a page

    • tasks.result.items.pages.page.meta
      Тип: object

      page properties the value depends on the resource_type

    • tasks.result.items.pages.page.meta_tag
      Тип: string

      date and time when the meta tag was last modified in the UTC format: “yyyy-mm-dd hh-mm-ss +00:00” example: 2019-11-15 12:57:46 +00:00 if there is no data, the value will be null

    • tasks.result.items.pages.page.meta.canonical
      Тип: string

      canonical page

    • tasks.result.items.pages.page.meta.charset
      Тип: integer

      code page example: 65001

    • tasks.result.items.pages.page.meta.content
      Тип: object

      overall information about content of the page

    • tasks.result.items.pages.page.meta.content.automated_readability_index
      Тип: number

      Automated Readability Index

    • tasks.result.items.pages.page.meta.content.coleman_liau_readability_index
      Тип: number

      Coleman–Liau Index

    • tasks.result.items.pages.page.meta.content.dale_chall_readability_index
      Тип: number

      Dale–Chall Readability Index

    • tasks.result.items.pages.page.meta.content.description_to_content_consistency
      Тип: number

      consistency of the meta description tag with the page content measured from 0 to 1

    • tasks.result.items.pages.page.meta.content.flesch_kincaid_readability_index
      Тип: number

      Flesch–Kincaid Readability Index

    • tasks.result.items.pages.page.meta.content.meta_keywords_to_content_consistency
      Тип: number

      consistency of meta keywordstag with the page content measured from 0 to 1

    • tasks.result.items.pages.page.meta.content.plain_text_rate
      Тип: integer

      plaintext rate value plain_text_size to size ratio

    • tasks.result.items.pages.page.meta.content.plain_text_size
      Тип: integer

      total size of the text on the page measured in bytes

    • tasks.result.items.pages.page.meta.content.plain_text_word_count
      Тип: number

      number of words on the page

    • tasks.result.items.pages.page.meta.content.smog_readability_index
      Тип: number

      SMOG Readability Index

    • tasks.result.items.pages.page.meta.content.title_to_content_consistency
      Тип: number

      consistency of the meta title tag with the page content measured from 0 to 1

    • tasks.result.items.pages.page.meta.cumulative_layout_shift
      Тип: number

      Core Web Vitals metric measuring the layout stability of a page measures the sum total of all individual layout shift scores for every unexpected layout shift that occurs during the entire lifespan of the page. Learn more.

    • tasks.result.items.pages.page.meta.deprecated_tags
      Тип: array string[]

      deprecated tags on the page

    • tasks.result.items.pages.page.meta.description
      Тип: string

      content of the meta description tag

    • tasks.result.items.pages.page.meta.description_length
      Тип: integer

      length of the description tag in characters

    • tasks.result.items.pages.page.meta.duplicate_meta_tags
      Тип: array string[]

      duplicate meta tags on the page

    • Тип: integer

      number of external links on the page

    • tasks.result.items.pages.page.meta.favicon
      Тип: string

      favicon of the page

    • tasks.result.items.pages.page.meta.follow
      Тип: boolean

      indicates whether a page’s ‘meta robots’ allows crawlers to follow the links on the page if false, the page’s ‘meta robots’ tag contains “nofollow” parameter instructing crawlers not to follow the links on the page

    • tasks.result.items.pages.page.meta.generator
      Тип: string

      meta tag generator

    • tasks.result.items.pages.page.meta.htags
      Тип: object

      HTML header tags

    • tasks.result.items.pages.page.meta.images_count
      Тип: integer

      number of images on the page

    • tasks.result.items.pages.page.meta.images_size
      Тип: integer

      total size of images on the page measured in bytes

    • Тип: integer

      number of internal links pointing at the page

    • Тип: integer

      number of internal links on the page

    • tasks.result.items.pages.page.meta.meta_keywords
      Тип: string

      content of the keywords meta tag

    • tasks.result.items.pages.page.meta.render_blocking_scripts_count
      Тип: integer

      number of scripts on the page that block page rendering

    • tasks.result.items.pages.page.meta.render_blocking_stylesheets_count
      Тип: integer

      number of CSS styles on the page that block page rendering

    • tasks.result.items.pages.page.meta.resource_errors
      Тип: object

      resource errors and warnings

    • tasks.result.items.pages.page.meta.resource_errors.errors
      Тип: array string[]

      resource errors

    • tasks.result.items.pages.page.meta.resource_errors.errors.line
      Тип: integer

      line where the error was found

    • tasks.result.items.pages.page.meta.resource_errors.errors.message
      Тип: string

      text message of the error the full list of possible HTML errors can be found here

    • tasks.result.items.pages.page.meta.resource_errors.warnings
      Тип: array string[]

      resource warnings

    • tasks.result.items.pages.page.meta.resource_errors.warnings.line
      Тип: integer

      line the warning relates to note that if "line": 0, the warning relates to the whole page

    • tasks.result.items.pages.page.meta.resource_errors.warnings.message
      Тип: string

      text message of the warning possible messages: "Has node with more than 60 childs." – HTML page has at least 1 tag nesting over 60 tags of the same level "Has more that 1500 nodes." – DOM tree contains over 1,500 elements "HTML depth more than 32 tags." – DOM depth exceeds 32 nodes

    • tasks.result.items.pages.page.meta.scripts_count
      Тип: integer

      number of scripts on the page

    • tasks.result.items.pages.page.meta.scripts_size
      Тип: integer

      total size of scripts on the page measured in bytes

    • tasks.result.items.pages.page.meta.social_media_tags
      Тип: object

      array of social media tags found on the page contains social media tags and their content supported tags include but are not limited to Open Graph and Twitter card

    • tasks.result.items.pages.page.meta.spell
      Тип: object

      spellcheck hunspell spellcheck errors

    • tasks.result.items.pages.page.meta.spell.hunspell_language_code
      Тип: string

      spellcheck language code

    • tasks.result.items.pages.page.meta.spell.misspelled
      Тип: array string[]

      array of misspelled words

    • tasks.result.items.pages.page.meta.spell.misspelled.word
      Тип: string

      misspelled word

    • tasks.result.items.pages.page.meta.stylesheets_count
      Тип: integer

      number of stylesheets on the page

    • tasks.result.items.pages.page.meta.stylesheets_size
      Тип: integer

      total size of stylesheets on the page measured in bytes

    • tasks.result.items.pages.page.meta.title
      Тип: integer

      page title

    • tasks.result.items.pages.page.meta.title_length
      Тип: integer

      length of the title tag in characters

    • tasks.result.items.pages.page.onpage_score
      Тип: number

      shows how page is optimized on a 100-point scale this field shows how page is optimized considering critical on-page issues and warnings detected; 100 is the highest possible score that means the page does not have any critical on-page issues and important warnings; learn more about how the metric is calculated in this help center article

    • tasks.result.items.pages.page.page_timing
      Тип: object

      object of page load metrics

    • tasks.result.items.pages.page.page_timing.connection_time
      Тип: integer

      time to connect to a server the time it takes until the connection with a server is established (in milliseconds)

    • tasks.result.items.pages.page.page_timing.dom_complete
      Тип: integer

      time to load resources the time it takes until the page and all of its subresources are downloaded (in milliseconds)

    • tasks.result.items.pages.page.page_timing.download_time
      Тип: integer

      time it takes for a browser to receive a response (in milliseconds)

    • tasks.result.items.pages.page.page_timing.duration_time
      Тип: integer

      total time it takes until a browser receives a complete response from a server (in milliseconds)

    • tasks.result.items.pages.page.page_timing.fetch_end
      Тип: integer

      time to complete downloading the HTML resource the amount of time the browser needs to complete downloading a page

    • tasks.result.items.pages.page.page_timing.fetch_start
      Тип: integer

      time to start downloading the HTML resource the amount of time the browser needs to start downloading a page

    • tasks.result.items.pages.page.page_timing.first_input_delay
      Тип: number

      Core Web Vitals metric indicating the responsiveness of a page The time (in milliseconds) from when a user first interacts with your page to the time when the browser responds to that interaction. Learn more.

    • tasks.result.items.pages.page.page_timing.largest_contentful_paint
      Тип: number

      Core Web Vitals metric measuring how fast the largest above-the-fold content element is displayed The amount of time (in milliseconds) to render the largest content element visible in the viewport, from when the user requests the URL. Learn more.

    • tasks.result.items.pages.page.page_timing.request_sent_time
      Тип: integer

      time to send a request to a server the time it takes until the request to a server is sent (in milliseconds)

    • tasks.result.items.pages.page.page_timing.time_to_interactive
      Тип: integer

      Time To Interactive (TTI) metric the time it takes until the user can interact with a page (in milliseconds)

    • tasks.result.items.pages.page.page_timing.time_to_secure_connection
      Тип: integer

      time to establish a secure connection the time it takes until the secure connection with a server is established (in milliseconds)

    • tasks.result.items.pages.page.page_timing.waiting_time
      Тип: integer

      time to first byte (TTFB) in milliseconds

    • tasks.result.items.pages.page.resource_type
      Тип: string

      type of the returned resource = ‘html’

    • tasks.result.items.pages.page.server
      Тип: string

      server version

    • tasks.result.items.pages.page.sitemap
      Тип: string

      date and time when the sitemap was last modified in the UTC format: “yyyy-mm-dd hh-mm-ss +00:00” example: 2019-11-15 12:57:46 +00:00 if there is no data, the value will be null

    • tasks.result.items.pages.page.size
      Тип: integer

      resource size indicates the size of a given page measured in bytes

    • tasks.result.items.pages.page.status_code
      Тип: integer

      status code of the page

    • tasks.result.items.pages.page.total_dom_size
      Тип: integer

      total DOM size of a page

    • tasks.result.items.pages.page.total_transfer_size
      Тип: integer

      compressed page size indicates the compressed size of a given page

    • tasks.result.items.pages.page.url
      Тип: string

      page URL

    • tasks.result.items.pages.similarity
      Тип: integer

      content similarity score by default, the content is considered duplicate if the value is greater than or equals 6 can take values from 0 to 10

    • tasks.result.items.total_count
      Тип: integer

      total count of duplicate pages

    • tasks.result.items.url
      Тип: string

      URL of the specified page

    • tasks.status_code
      Тип: integer

      status code of the task generated by DataForSEO; can be within the following range: 10000-60000 you can find the full list of the response codes here

    • tasks.status_message
      Тип: string

      informational message of the task you can find the full list of general informational messages here

    • tasks.time
      Тип: string

      execution time, seconds

    • time
      Тип: string

      execution time, seconds

    • version
      Тип: string

      the current version of the API

    application/json
  • 400

    Bad request

  • 401

    Unauthorized

  • 402

    The request cannot proceed because a billing requirement is not met.

  • 403

    The account is not permitted to perform this operation.

  • 429

    Rate limit exceeded

  • 500

    Internal server error

  • 502

    The service could not complete the request.

  • 503

    The API or billing service is temporarily unavailable.

  • 504

    The service timed out while processing the request.

  • default

    The operation failed. Keep the response request ID when contacting Felo support.

Request Example for post/v1/beta/dataforseo/on_page/duplicate_content
curl https://openapi.felo.ai/v1/beta/dataforseo/on_page/duplicate_content \
  --request POST \
  --header 'Content-Type: application/json' \
  --header 'Authorization: Bearer YOUR_SECRET_TOKEN' \
  --data '[
  {
    "id": "",
    "url": "",
    "similarity": 1,
    "limit": 1,
    "offset": 1,
    "tag": ""
  }
]'
{
  "version": "string",
  "status_code": 1,
  "status_message": "string",
  "time": "string",
  "cost": 1,
  "tasks_count": 1,
  "tasks_error": 1,
  "tasks": [
    "string"
  ],
  "tasks.id": "string",
  "tasks.status_code": 1,
  "tasks.status_message": "string",
  "tasks.time": "string",
  "tasks.cost": 1,
  "tasks.result_count": 1,
  "tasks.path": [
    "string"
  ],
  "tasks.data": {},
  "tasks.result": [
    "string"
  ],
  "tasks.result.crawl_progress": "string",
  "tasks.result.crawl_status": {},
  "tasks.result.crawl_status.max_crawl_pages": 1,
  "tasks.result.crawl_status.pages_in_queue": 1,
  "tasks.result.crawl_status.pages_crawled": 1,
  "tasks.result.items_count": 1,
  "tasks.result.items": [
    "string"
  ],
  "tasks.result.items.url": "string",
  "tasks.result.items.total_count": 1,
  "tasks.result.items.pages": [
    "string"
  ],
  "tasks.result.items.pages.similarity": 1,
  "tasks.result.items.pages.page": [
    "string"
  ],
  "tasks.result.items.pages.page.resource_type": "string",
  "tasks.result.items.pages.page.status_code": 1,
  "tasks.result.items.pages.page.location": "string",
  "tasks.result.items.pages.page.url": "string",
  "tasks.result.items.pages.page.meta": {},
  "tasks.result.items.pages.page.meta.title": 1,
  "tasks.result.items.pages.page.meta.charset": 1,
  "tasks.result.items.pages.page.meta.follow": true,
  "tasks.result.items.pages.page.meta.generator": "string",
  "tasks.result.items.pages.page.meta.htags": {},
  "tasks.result.items.pages.page.meta.description": "string",
  "tasks.result.items.pages.page.meta.favicon": "string",
  "tasks.result.items.pages.page.meta.meta_keywords": "string",
  "tasks.result.items.pages.page.meta.canonical": "string",
  "tasks.result.items.pages.page.meta.internal_links_count": 1,
  "tasks.result.items.pages.page.meta.external_links_count": 1,
  "tasks.result.items.pages.page.meta.inbound_links_count": 1,
  "tasks.result.items.pages.page.meta.images_count": 1,
  "tasks.result.items.pages.page.meta.images_size": 1,
  "tasks.result.items.pages.page.meta.scripts_count": 1,
  "tasks.result.items.pages.page.meta.scripts_size": 1,
  "tasks.result.items.pages.page.meta.stylesheets_count": 1,
  "tasks.result.items.pages.page.meta.stylesheets_size": 1,
  "tasks.result.items.pages.page.meta.title_length": 1,
  "tasks.result.items.pages.page.meta.description_length": 1,
  "tasks.result.items.pages.page.meta.render_blocking_scripts_count": 1,
  "tasks.result.items.pages.page.meta.render_blocking_stylesheets_count": 1,
  "tasks.result.items.pages.page.meta.cumulative_layout_shift": 1,
  "tasks.result.items.pages.page.meta.content": {},
  "tasks.result.items.pages.page.meta.content.plain_text_size": 1,
  "tasks.result.items.pages.page.meta.content.plain_text_rate": 1,
  "tasks.result.items.pages.page.meta.content.plain_text_word_count": 1,
  "tasks.result.items.pages.page.meta.content.automated_readability_index": 1,
  "tasks.result.items.pages.page.meta.content.coleman_liau_readability_index": 1,
  "tasks.result.items.pages.page.meta.content.dale_chall_readability_index": 1,
  "tasks.result.items.pages.page.meta.content.flesch_kincaid_readability_index": 1,
  "tasks.result.items.pages.page.meta.content.smog_readability_index": 1,
  "tasks.result.items.pages.page.meta.content.description_to_content_consistency": 1,
  "tasks.result.items.pages.page.meta.content.title_to_content_consistency": 1,
  "tasks.result.items.pages.page.meta.content.meta_keywords_to_content_consistency": 1,
  "tasks.result.items.pages.page.meta.deprecated_tags": [
    "string"
  ],
  "tasks.result.items.pages.page.meta.duplicate_meta_tags": [
    "string"
  ],
  "tasks.result.items.pages.page.meta.spell": {},
  "tasks.result.items.pages.page.meta.spell.hunspell_language_code": "string",
  "tasks.result.items.pages.page.meta.spell.misspelled": [
    "string"
  ],
  "tasks.result.items.pages.page.meta.spell.misspelled.word": "string",
  "tasks.result.items.pages.page.meta.resource_errors": {},
  "tasks.result.items.pages.page.meta.resource_errors.errors": [
    "string"
  ],
  "tasks.result.items.pages.page.meta.resource_errors.errors.line": 1,
  "tasks.result.items.pages.page.meta.resource_errors.errors.message": "string",
  "tasks.result.items.pages.page.meta.resource_errors.warnings": [
    "string"
  ],
  "tasks.result.items.pages.page.meta.resource_errors.warnings.line": 1,
  "tasks.result.items.pages.page.meta.resource_errors.warnings.message": "string",
  "tasks.result.items.pages.page.meta.social_media_tags": {},
  "tasks.result.items.pages.page.page_timing": {},
  "tasks.result.items.pages.page.page_timing.time_to_interactive": 1,
  "tasks.result.items.pages.page.page_timing.dom_complete": 1,
  "tasks.result.items.pages.page.page_timing.largest_contentful_paint": 1,
  "tasks.result.items.pages.page.page_timing.first_input_delay": 1,
  "tasks.result.items.pages.page.page_timing.connection_time": 1,
  "tasks.result.items.pages.page.page_timing.time_to_secure_connection": 1,
  "tasks.result.items.pages.page.page_timing.request_sent_time": 1,
  "tasks.result.items.pages.page.page_timing.waiting_time": 1,
  "tasks.result.items.pages.page.page_timing.download_time": 1,
  "tasks.result.items.pages.page.page_timing.duration_time": 1,
  "tasks.result.items.pages.page.page_timing.fetch_start": 1,
  "tasks.result.items.pages.page.page_timing.fetch_end": 1,
  "tasks.result.items.pages.page.onpage_score": 1,
  "tasks.result.items.pages.page.total_dom_size": 1,
  "tasks.result.items.pages.page.custom_js_response": "string",
  "tasks.result.items.pages.page.custom_js_client_exception": "string",
  "tasks.result.items.pages.page.broken_resources": true,
  "tasks.result.items.pages.page.broken_links": true,
  "tasks.result.items.pages.page.duplicate_title": true,
  "tasks.result.items.pages.page.duplicate_description": true,
  "tasks.result.items.pages.page.duplicate_content": true,
  "tasks.result.items.pages.page.click_depth": 1,
  "tasks.result.items.pages.page.size": 1,
  "tasks.result.items.pages.page.encoded_size": 1,
  "tasks.result.items.pages.page.total_transfer_size": 1,
  "tasks.result.items.pages.page.fetch_time": "string",
  "tasks.result.items.pages.page.cache_control": {},
  "tasks.result.items.pages.page.cache_control.cachable": true,
  "tasks.result.items.pages.page.cache_control.ttl": 1,
  "tasks.result.items.pages.page.checks": {},
  "tasks.result.items.pages.page.checks.no_content_encoding": true,
  "tasks.result.items.pages.page.checks.high_loading_time": true,
  "tasks.result.items.pages.page.checks.is_redirect": true,
  "tasks.result.items.pages.page.checks.is_4xx_code": true,
  "tasks.result.items.pages.page.checks.is_5xx_code": true,
  "tasks.result.items.pages.page.checks.is_broken": true,
  "tasks.result.items.pages.page.checks.is_www": true,
  "tasks.result.items.pages.page.checks.is_https": true,
  "tasks.result.items.pages.page.checks.is_http": true,
  "tasks.result.items.pages.page.checks.high_waiting_time": true,
  "tasks.result.items.pages.page.checks.no_doctype": true,
  "tasks.result.items.pages.page.checks.canonical": true,
  "tasks.result.items.pages.page.checks.no_encoding_meta_tag": true,
  "tasks.result.items.pages.page.checks.no_h1_tag": true,
  "tasks.result.items.pages.page.checks.https_to_http_links": true,
  "tasks.result.items.pages.page.checks.has_html_doctype": true,
  "tasks.result.items.pages.page.checks.size_greater_than_3mb": true,
  "tasks.result.items.pages.page.checks.meta_charset_consistency": true,
  "tasks.result.items.pages.page.checks.has_meta_refresh_redirect": true,
  "tasks.result.items.pages.page.checks.has_render_blocking_resources": true,
  "tasks.result.items.pages.page.checks.redirect_chain": true,
  "tasks.result.items.pages.page.checks.low_content_rate": true,
  "tasks.result.items.pages.page.checks.high_content_rate": true,
  "tasks.result.items.pages.page.checks.low_character_count": true,
  "tasks.result.items.pages.page.checks.high_character_count": true,
  "tasks.result.items.pages.page.checks.small_page_size": true,
  "tasks.result.items.pages.page.checks.large_page_size": true,
  "tasks.result.items.pages.page.checks.low_readability_rate": true,
  "tasks.result.items.pages.page.checks.irrelevant_description": true,
  "tasks.result.items.pages.page.checks.irrelevant_title": true,
  "tasks.result.items.pages.page.checks.irrelevant_meta_keywords": true,
  "tasks.result.items.pages.page.checks.title_too_long": true,
  "tasks.result.items.pages.page.checks.title_too_short": true,
  "tasks.result.items.pages.page.checks.deprecated_html_tags": true,
  "tasks.result.items.pages.page.checks.duplicate_meta_tags": true,
  "tasks.result.items.pages.page.checks.duplicate_title_tag": true,
  "tasks.result.items.pages.page.checks.no_image_alt": true,
  "tasks.result.items.pages.page.checks.no_image_title": true,
  "tasks.result.items.pages.page.checks.no_description": true,
  "tasks.result.items.pages.page.checks.no_title": true,
  "tasks.result.items.pages.page.checks.no_favicon": true,
  "tasks.result.items.pages.page.checks.seo_friendly_url": true,
  "tasks.result.items.pages.page.checks.flash": true,
  "tasks.result.items.pages.page.checks.frame": true,
  "tasks.result.items.pages.page.checks.lorem_ipsum": true,
  "tasks.result.items.pages.page.checks.has_misspelling": true,
  "tasks.result.items.pages.page.checks.seo_friendly_url_characters_check": true,
  "tasks.result.items.pages.page.checks.seo_friendly_url_dynamic_check": true,
  "tasks.result.items.pages.page.checks.seo_friendly_url_keywords_check": true,
  "tasks.result.items.pages.page.checks.seo_friendly_url_relative_length_check": true,
  "tasks.result.items.pages.page.checks.is_orphan_page": true,
  "tasks.result.items.pages.page.checks.is_link_relation_conflict": true,
  "tasks.result.items.pages.page.checks.has_links_to_redirects": true,
  "tasks.result.items.pages.page.checks.recursive_canonical": true,
  "tasks.result.items.pages.page.checks.canonical_chain": true,
  "tasks.result.items.pages.page.checks.canonical_to_redirect": true,
  "tasks.result.items.pages.page.checks.canonical_to_broken": true,
  "tasks.result.items.pages.page.content_encoding": "string",
  "tasks.result.items.pages.page.media_type": "string",
  "tasks.result.items.pages.page.server": "string",
  "tasks.result.items.pages.page.is_resource": true,
  "tasks.result.items.pages.page.last_modified": {},
  "tasks.result.items.pages.page.header": "string",
  "tasks.result.items.pages.page.sitemap": "string",
  "tasks.result.items.pages.page.meta_tag": "string"
}
OnPage API Duplicate Content