Oddiy misol [code=php]Allow: /rasmlar/ Disallow: /admin_panel/[/code] bu yerda Allow

3339

Yangi formatda davom etish uchun: https://uzfor.net/view.php?act=post&id=61

Postga havola

Сирожиддин [2882] [off]

Oddiy misol

Allow: /rasmlar/
Disallow: /admin_panel/

bu yerda Allow - robot uchun ruxsat berilgan zona. Disallow esa ruxsat berilmagan

User-agent: * / barcha botlar uchun cheklanganlardan tashqari
Disallow: / bot uchun yopiq 
Crawl-delay: 60 / pauklarni cheklash agar cheklanmasa saytga nagruzka tushadi
Disallow: /wp-admin/ / bot uchun yopiq 
Disallow: /wp-includes/ / bot uchun yopiq 
Disallow: /wp-content/plugins / bot uchun yopiq 
Disallow: /wp-content/cache / bot uchun yopiq 
Disallow: /wp-content/themes / bot uchun yopiq 
 
Sitemap: http://sayt-manzili.uz/sitemap.xml / sayt xaritasi
 
User-agent: msnbot / msnbot uchun yopiq 
Disallow: /
User-agent: psbot / psbot uchun yopiq 
Disallow: /
User-agent: yahoo-slurp / yahoo-slurp uchun yopiq 
Disallow: /