If you want to allow or disallow something from search engine than you can use the robots.txt file. It is a text file format which is uploaded in the root directory.

Robots.txt is a file to restricted to block the unwanted URL's to index in SERP. It will help you to block spammy content URL's.


For your information:

Prateektechnosoft is a Netsuite Partner and expertise in NetSuite ERP, CRM, Cloud CRM, PSA and other Netsuite Solutions. And also providing Netsuite services of implementation, integration, support & development services.