둘러보니 아마도 index.php을 통해서 접근되는 내용만 크롤링하게 하는 것 같다. (어드민의 내용은 제외)



User-agent: *


Disallow: /rb/_core/


Disallow: /rb/_var/


Disallow: /rb/_tmp/


Disallow: /rb/layouts/


Disallow: /rb/modules/


Disallow: /rb/pages/


Disallow: /rb/files/


Disallow: /rb/switchs/


Disallow: /rb/widgets/


Disallow: /*system=edit


Disallow: /*_themeConfig


Disallow: /rb/admin


Disallow: /*m=admin


Disallow: /rb/p/login


Disallow: /*mod=login


Disallow: /rb/p/join


Disallow: /*mod=join


Disallow: /*mod=write


Disallow: /*iframe=Y


Disallow: /*keyword=


Disallow: /*mod=delete


Disallow: /*&a=


Disallow: /*?a=


Disallow: /*action/


Disallow: /*type=modify


Posted by 파노카페
: