It is arguably one of the most fundamental parts of technical ... That is, the search bots need to be able to access the page to read the HTML code that contains the directive.