- Technical SEO
User-triggered Google fetchers such as NotebookLM generally ignore robots.txt. In log analysis, do you treat them as visits, as scraping, or ignore them?
Treat them as their own category: neither crawling, nor human visits, nor scraping in the usual sense.