Сирожиддин, # Сирожиддин (16.09.2017 / 12:36)
Oddiy misol
Allow: /rasmlar/
Disallow: /admin_panel/
bu yerda Allow - robot uchun ruxsat berilgan zona. Disallow esa ruxsat berilmagan
User-agent: * / barcha botlar uchun cheklanganlardan tashqariAGar togri tushungan bolsa saytimizga buni ornatish uchun robots.txt deb fayl ochib siz yozgan kodni ornatish kk shundaymi
10 daqiqa 7 soniyadan keyin yozdi:
*>
User-agent: *
Disallow: /a/
Disallow: /stat/
Disallow: /index/1
Disallow: /index/2
Disallow: /index/3
Disallow: /index/5
Disallow: /index/7
Disallow: /index/8
Disallow: /index/9
Disallow: /panel/
Disallow: /admin/
Disallow: /secure/
Disallow: /informer/
Disallow: /mchat
Disallow: /search
Disallow: /shop/order/
Disallow: /?ssid=
Disallow: /abnl/
Disallow: /google
Disallow: /twitter
Disallow: /facebook
Disallow: /yandex
Disallow: /vkontakte
Disallow: /vkontakte

Sitemap: http://uzreal.tk/sitemap.xml
Sitemap: http://uzreal.tk/sitemap-forum.xml
Sitemap: http://uzreal.tk/sitemap-shop.xml
<*

Masalan men saytimga qoygan robots.txt togrimi yoki biror joyida xato bormi