SEO
What is robot.txt? Syntax of robot.txt?
What is robot.txt? This is a file for in the website some of the folder we dont want to crawl by the search engine optimization, suppose in the images folder we dont want to crawl . The syntax for the robot.txt **************** User-agent: Disallow: **************** User- agent : This is Read more…