Page weight is not a ranking factor, but it drives the ones that are. What the numbers mean, where the weight always hides, and the benchmarks worth measuring against.

robots.txt controls crawling, not indexing, and the difference is where sites lose pages. The syntax, the precedence rules, and the mistake that keeps URLs stuck in Google.

Googlebot gives your site a finite amount of attention. Here is how to work out where it is going, and how to stop it disappearing into pages nobody should ever see.