Does Deskhero scrape every page on my website, including duplicates in other languages?

Deskhero discovers pages from your site (including via its sitemap) and crawls them, but it automatically skips pages that are language or alternate duplicates of another page, and pages excluded by the domain's crawl rules. This keeps the AI knowledge focused on unique content instead of the same page repeated in several languages.