I’m also ignorant of this, and to add a question on top of yours: is it worth wo...

		shikshake on Nov 1, 2024 \| parent \| context \| favorite \| on: Tell HN: Robots.txt pitfalls – what I learned the ... I’m also ignorant of this, and to add a question on top of yours: is it worth worrying about robots.txt for personal portfolio websites built from scratch?

Depends on your hosting platform.