• mriswith@lemmy.world
      link
      fedilink
      English
      arrow-up
      2
      ·
      edit-2
      22 hours ago

      Exactly. They “crawl” category/tag lists, etc. and follow links. And if there are no links to those pages, they wont be indexed.

      (Depending on some settings. For all I know they’ve set up “hidden redirects” for popular crawlers to pages that show them)