Almost the last most important factor that need the ultimate attention of yours to optimize the website with appreciate HTML coding is Robots.txt file. You can say that with a simple mistake in your Robots.txt file can ruin the ultimate hard work of yours, although you can recover it lately when you realized that something is going wrong. So, if you are not looking to pun around the Robots.txt file then you need the assistance of professional SEO firm like SEO London have. However, you need to look into following factors to make sure that the Robots.txt file that you have is valid and compatible for the search engines.

• The Syntax of your robots must be as shown in the following photo.
  
  
• Don’t need to be over efficient by telling the search engines in Robots.txt that they should follow or index a particular location on the website, As the Robots.txt is to let the bots know that where they are not allowed to go, following image represents the appropriate syntax of creating robot meta tags.
  
• Apply Noindex and Nofollow meta attribute on all unnecessary pages and files.

 These are some of the values that you need to take care of while generating a Robots.txt file and also the optimization of the HTML if you are with me since last four days then I’m confident that you will surely create a website with an HTML that will support your other optimization activities efficiently.