AIO– tag –

robots.txt governs which URLs crawlers may access; it does not cover whether fetched content can be used for AI training. This article reviews Google-Extended, the IETF draft, and how to write Japanese URLs, based on Google’s Gary Illyes’s explanation.

Google’s Gary Illyes and Cherry Prommawin explained in a video how URLs are handled in search. They said keywords have a “very small” impact on rankings. Here is a look at URL design, including the use of hyphens and the handling of emoji.

Google doesn’t read PDFs as-is; it converts them to HTML for search processing. This article covers how links are handled, how PDFs appear in AI search, caveats for image-only PDFs, and practical reasons to choose HTML.

Microsoft’s Bing Webmaster Tools has added “Topics Portfolio” in beta, a feature that organizes citations in AI answers by topic. It shifts analysis from tracking search terms one by one to assessing a site’s presence by subject area. Here’s a closer look at how it works and what it means.

Ahrefs data shows that the rankings of sources cited in ChatGPT’s U.S. answers shifted between March and September. PubMed rose from No. 64 to No. 4, while WebMD fell from No. 18 to No. 79. We examine the shift from summary sites to primary sources.

Drawing on Google’s spam update and warnings about AI-generated content, this article considers SEO investment in four areas: attracting visitors, protecting sales, maintaining the information infrastructure, and evaluating AI search.