Work2Code > 2019 > June

The ugly side of a Fancy Software

Today, we may be highly proud of the internet society because of great applications that have been developed to make things easier for humans in terms of accessibility of services which includes healthcare, e-commerce, banking, insurance, social media and what not. However, there is a...

Developers usually make mistakes in misconfiguring robots.txt file with or without lack of knowledge. Get to know what things to take care of while creating robots.txt file and making it secure to prevent from malicious hackers in the cyber world.
Santhosh Tuppad

Mistakes to avoid while creating robots.txt

What is the Robots.txt file? Robots.txt file is a text file as you may already know because it has an extension *.txt and these are responsible for helping the search engine spiders from Google, Bing, Yahoo, Yandex, and many other search engines or bots which crawl...