Versiunea de la data 24 ianuarie 2009 20:45

SEO cu Robots.txt

Asigurati-va ca fisierul robots.txt este pe serverul vostru. Daca nu va trebui sa il realizati sau sa il modificati. Ce este de fapt robots.txt? Nu am sa incerc sa va dau o definitie ci mai degraba sa va fac sa intelegeti importanta unui astfel de fisier pentru optimizarea unui site….si nu numai. Fisierul robots.txt spune spiderilor ce pagini sa fie indexate sau nu.

Googlebot and Robots.txt

Cand va decideti ce pagini sa fie indexate Googlebot merge in ordinea:

1. Googlebot va asculta primul record din fisierul robots.txt cu User-agent care incepe cu ”Googlebot”. 2. Daca nu exista ”Googlebot” User-agent va asculta de prima linie care are declaratia User-agent ”*”.

Robots.txt pentru Wordpress

Robots.txt pentru Wordpress

User-agent: *
# nu permite indexarea tuturor file-urilor existente in directoarele respective
Disallow: /cgi-bin/
Disallow: /z/j/
Disallow: /z/c/
Disallow: /stats/
Disallow: /dh_
Disallow: /about/
Disallow: /contact/
Disallow: /tag/
Disallow: /wp-admin/
Disallow: /wp-includes/
Disallow: /contact
Disallow: /manual
Disallow: /manual/*
Disallow: /phpmanual/
Disallow: /category/

User-agent: Googlebot
# nu permite indexarea fisiere care se termina cu respectivele extensii
Disallow: /*.php$
Disallow: /*.js$
Disallow: /*.inc$
Disallow: /*.css$
Disallow: /*.gz$
Disallow: /*.wmv$
Disallow: /*.cgi$
Disallow: /*.xhtml$

# nu indexeaza file-urile cu ? in url
Disallow: /*?*

# disable duggmirror
User-agent: duggmirror
Disallow: /

# permite google image bot sa caute toate imaginile
User-agent: Googlebot-Image
Disallow:
Allow: /*
# permite adsense bot in tot site-ul
User-agent: Mediapartners-Google*
Disallow:
Allow: /*

Exemplu 2

Robots.txt pentru phpBB

User-agent: *
Disallow: /cgi-bin/
Disallow: /phpbb/admin/
Disallow: /phpbb/cache/
Disallow: /phpbb/db/
Disallow: /phpbb/images/
Disallow: /phpbb/includes/
Disallow: /phpbb/language/
Disallow: /phpbb/templates/
Disallow: /phpbb/faq.php
Disallow: /phpbb/groupcp.php
Disallow: /phpbb/login.php
Disallow: /phpbb/memberlist.php
Disallow: /phpbb/modcp.php
Disallow: /phpbb/posting.php
Disallow: /phpbb/privmsg.php
Disallow: /phpbb/profile.php
Disallow: /phpbb/search.php
Disallow: /phpbb/viewonline.php

User-agent: Googlebot
# nu indexeaza file-urile care au urmatoarele extensii
Disallow: /*.inc$
Disallow: /*.js$
Disallow: /*.inc$
Disallow: /*.css$

# nu indexeaza file-urile cu ? in url
Disallow: *mark=*
Disallow: *view=*

# permite google image bot to caute toate imaginile
User-agent: Googlebot-Image
Disallow:
Allow: /*

# permite adsense bot in tot site-ul
User-agent: Mediapartners-Google*
Disallow:
Allow: /*

User-agent: *
Disallow: /stats
Disallow: /dh_
Disallow: /V
Disallow: /z/j/
Disallow: /z/c/
Disallow: /cgi-bin/
Disallow: /viewtopic.php
Disallow: /viewforum.php
Disallow: /index.php?
Disallow: /posting.php
Disallow: /groupcp.php
Disallow: /search.php
Disallow: /login.php
Disallow: /post
Disallow: /member
Disallow: /profile.php
Disallow: /memberlist.php
Disallow: /faq.php
Disallow: /templates/
Disallow: /mx_
Disallow: /db/
Disallow: /admin/
Disallow: /cache/
Disallow: /images/
Disallow: /includes/
Disallow: /common.php
Disallow: /index.php
Disallow: /memberlist.php
Disallow: /modcp.php
Disallow: /privmsg.php
Disallow: /viewonline.php
Disallow: /images/
Disallow: /rss.php

User-agent: Googlebot
# nu permite indexarea file-urilor cu extensia
Allow: /sitemap.php
Disallow: /*.php$
Allow: /sitemap.php
Disallow: /*.js$
Disallow: /*.inc$
Disallow: /*.css$
Disallow: /*.txt$

# nu permite indexarea file-urilor cu ? in url
Disallow: /*?*
Disallow: /*?

# nu permite indexarea file-urilor din /wp- directorys
Disallow: /wp-*/

# nu permite indexarea arhivei site-ului
User-agent: ia_archiver
Disallow: /

# permite google image bot sa caute toate imaginile

User-agent: Googlebot-Image
Disallow:
Allow: /*.gif$
Allow: /*.png$
Allow: /*.jpeg$
Allow: /*.jpg$
Allow: /*.ico$
Allow: /*.jpg$
Allow: /images
Allow: /z/i/

# permite adsense bot in tot site-ul
User-agent: Mediapartners-Google*
Allow: /*

Pentru a realiza un astfel de fisier deschideti notepad si salvati fisierul robots.txt.
“User -agent:*” se refera la toate motoarele de cautare.

Sursa

@@ Linia 13: / Linia 13: @@
 =Robots.txt pentru Wordpress=
-<p>User-agent:&nbsp;*<br>
+'''<font color="rgb(255, 0, 0)">Robots.txt pentru Wordpress</font>'''
-# nu permite indexarea tuturor file-urilor existente in directoarele respective<br>
-Disallow: /cgi-bin/<br>
-Disallow: /z/j/<br>
-Disallow: /z/c/<br>
-Disallow: /stats/<br>
+User-agent: *<br /> # nu permite indexarea tuturor file-urilor existente in directoarele respective<br /> Disallow: /cgi-bin/<br /> Disallow: /z/j/<br /> Disallow: /z/c/<br /> Disallow: /stats/<br /> Disallow: /dh_<br /> Disallow: /about/<br /> Disallow: /contact/<br /> Disallow: /tag/<br /> Disallow: /wp-admin/<br /> Disallow: /wp-includes/<br /> Disallow: /contact<br /> Disallow: /manual<br /> Disallow: /manual/*<br /> Disallow: /phpmanual/<br /> Disallow: /category/
-Disallow: /dh_<br>
-Disallow: /about/<br>
-Disallow: /contact/<br>
-Disallow: /tag/<br>
-Disallow: /wp-admin/<br>
-Disallow: /wp-includes/<br>
-Disallow: /contact<br>
-Disallow: /manual<br>
-Disallow: /manual/*<br>
+User-agent: Googlebot<br /> # nu permite indexarea fisiere care se termina cu respectivele extensii<br /> Disallow: /*.php$<br /> Disallow: /*.js$<br /> Disallow: /*.inc$<br /> Disallow: /*.css$<br /> Disallow: /*.gz$<br /> Disallow: /*.wmv$<br /> Disallow: /*.cgi$<br /> Disallow: /*.xhtml$<br /><br /> # nu indexeaza file-urile cu ? in url<br /> Disallow: /*?*
-Disallow: /phpmanual/<br>
-Disallow: /category/</p>
-<p>User-agent: Googlebot<br>
-# nu permite indexarea fisiere care se termina cu respectivele extensii<br>
-Disallow: /*.php$<br>
-Disallow: /*.js$<br>
-Disallow: /*.inc$<br>
-Disallow: /*.css$<br>
-Disallow: /*.gz$<br>
+<nowiki># disable duggmirror</nowiki><br /> User-agent: duggmirror<br /> Disallow: /<br /><br /> # permite google image bot sa caute toate imaginile <br /> User-agent: Googlebot-Image<br /> Disallow:<br /> Allow: /*<br /> # permite adsense bot in tot site-ul <br /> User-agent: Mediapartners-Google*<br /> Disallow:<br /> Allow: /*
-Disallow: /*.wmv$<br>
-Disallow: /*.cgi$<br>
-Disallow: /*.xhtml$<br>
-&nbsp;<br>
-# nu indexeaza file-urile cu&nbsp;? in url<br>
-Disallow: /*?*</p>
-<p># disable duggmirror<br>
-User-agent: duggmirror<br>
-Disallow: /<br>
+Exemplu 2
-&nbsp;<br>
-# permite google image bot sa caute toate imaginile&nbsp;<br>
-User-agent: Googlebot-Image<br>
-Disallow:<br>
-Allow: /*<br>
-# permite&nbsp;adsense bot in tot site-ul&nbsp;<br>
-User-agent: Mediapartners-Google*<br>
-Disallow:<br>
-Allow: /*</p>
+'''<font color="rgb(255, 0, 0)">Robots.txt pentru phpBB</font>'''
+User-agent: *<br /> Disallow: /cgi-bin/<br /> Disallow: /phpbb/admin/<br /> Disallow: /phpbb/cache/<br /> Disallow: /phpbb/db/<br /> Disallow: /phpbb/images/<br /> Disallow: /phpbb/includes/<br /> Disallow: /phpbb/language/<br /> Disallow: /phpbb/templates/<br /> Disallow: /phpbb/faq.php<br /> Disallow: /phpbb/groupcp.php<br /> Disallow: /phpbb/login.php<br /> Disallow: /phpbb/memberlist.php<br /> Disallow: /phpbb/modcp.php<br /> Disallow: /phpbb/posting.php<br /> Disallow: /phpbb/privmsg.php<br /> Disallow: /phpbb/profile.php<br /> Disallow: /phpbb/search.php<br /> Disallow: /phpbb/viewonline.php
-. Pentru a realiza un astfel de fisier deschideti notepad si salvati fisierul robots.txt.
+User-agent: Googlebot<br /> # nu indexeaza file-urile care au urmatoarele extensii<br /> Disallow: /*.inc$<br /> Disallow: /*.js$<br /> Disallow: /*.inc$<br /> Disallow: /*.css$
-. “User -agent:*” se refera la toate motoarele de cautare.
+<nowiki># nu indexeaza file-urile cu ? in url</nowiki><br /> Disallow: *mark=*<br /> Disallow: *view=*
+<nowiki># permite google image bot to caute toate imaginile</nowiki><br /> User-agent: Googlebot-Image<br /> Disallow:<br /> Allow: /*<br /><br /> # permite adsense bot in tot site-ul <br /> User-agent: Mediapartners-Google*<br /> Disallow:<br /> Allow: /*
+User-agent: *<br /> Disallow: /stats<br /> Disallow: /dh_<br /> Disallow: /V<br /> Disallow: /z/j/<br /> Disallow: /z/c/<br /> Disallow: /cgi-bin/<br /> Disallow: /viewtopic.php<br /> Disallow: /viewforum.php<br /> Disallow: /index.php?<br /> Disallow: /posting.php<br /> Disallow: /groupcp.php<br /> Disallow: /search.php<br /> Disallow: /login.php<br /> Disallow: /post<br /> Disallow: /member<br /> Disallow: /profile.php<br /> Disallow: /memberlist.php<br /> Disallow: /faq.php<br /> Disallow: /templates/<br /> Disallow: /mx_<br /> Disallow: /db/<br /> Disallow: /admin/<br /> Disallow: /cache/<br /> Disallow: /images/<br /> Disallow: /includes/<br /> Disallow: /common.php<br /> Disallow: /index.php<br /> Disallow: /memberlist.php<br /> Disallow: /modcp.php<br /> Disallow: /privmsg.php<br /> Disallow: /viewonline.php<br /> Disallow: /images/<br /> Disallow: /rss.php
+User-agent: Googlebot<br /> # nu permite indexarea file-urilor cu extensia<br /> Allow: /sitemap.php<br /> Disallow: /*.php$<br /> Allow: /sitemap.php<br /> Disallow: /*.js$<br /> Disallow: /*.inc$<br /> Disallow: /*.css$<br /> Disallow: /*.txt$
+<nowiki># nu permite indexarea file-urilor cu ? in url</nowiki><br /> Disallow: /*?*<br /> Disallow: /*?
+<nowiki># nu permite indexarea file-urilor din /wp- directorys</nowiki><br /> Disallow: /wp-*/
+<nowiki># nu permite indexarea arhivei site-ului</nowiki><br /> User-agent: ia_archiver<br /> Disallow: /
+<nowiki># permite google image bot sa caute toate imaginile</nowiki>
+User-agent: Googlebot-Image<br /> Disallow:<br /> Allow: /*.gif$<br /> Allow: /*.png$<br /> Allow: /*.jpeg$<br /> Allow: /*.jpg$<br /> Allow: /*.ico$<br /> Allow: /*.jpg$<br /> Allow: /images<br /> Allow: /z/i/
+<nowiki># permite adsense bot in tot site-ul </nowiki><br /> User-agent: Mediapartners-Google*<br /> Allow: /*
+# Pentru a realiza un astfel de fisier deschideti notepad si salvati fisierul robots.txt.
+# “User -agent:*” se refera la toate motoarele de cautare.
 [http://tutoriale.anadesign.info/seo-tutoriale/seo-cu-robotstxt/ Sursa]
 [[Categorie:Wordpress]]

Seo wordpress

De la EuroDomenii - Domenii .Eu .Ro Registrator Acreditat

Versiunea de la data 24 ianuarie 2009 20:45

SEO cu Robots.txt

Robots.txt pentru Wordpress

Vizualizări

Unelte personale

Navigare

Caută

Trusa de unelte