underlap,
@underlap@fosstodon.org avatar

@cory Does this mean that it's time to block the regular Google web crawler(s) if one wants to block AI web crawlers?

If so, that's quite a moment: choosing not to be indexed by Google search.

  • All
  • Subscribed
  • Moderated
  • Favorites
  • tech
  • ngwrru68w68
  • rosin
  • GTA5RPClips
  • osvaldo12
  • love
  • Youngstown
  • slotface
  • khanakhh
  • everett
  • kavyap
  • mdbf
  • DreamBathrooms
  • thenastyranch
  • magazineikmin
  • megavids
  • InstantRegret
  • normalnudes
  • tacticalgear
  • cubers
  • ethstaker
  • modclub
  • cisconetworking
  • Durango
  • anitta
  • Leos
  • tester
  • provamag3
  • JUstTest
  • All magazines