Daily Archives: 2017-03-17

Things You Might Not Know About robots.txt

While bringing one of my old sites up to spec, I realized that I’d never actually looked into robots.txt beyond copy-pasting ready-made directives. So, without further ado, here’s a list of everything I could find about it which isn’t obvious … Continue reading

Posted in Web Wandering & Opinion | Leave a comment