• Page 1 of 1
  • 1
UcozBaze All Scripts And Templates » uCoz Support » Klausimai atsakymai » Robots.txt (website indexing) ucoz (Robots.txt (website indexing) ucoz)
Robots.txt (website indexing) ucoz
interoutDate: Thursday, 2011-09-08, 1:28 AM | Message # 1
Group: Administrators
Messages: 1027
35
A website with the standard robots.txt is indexed in the best possible way. We adjusted it in such a way that only pages with content are indexed, and not all existing pages (e.g. login or registration page). Therefore uCoz websites are indexed better and get higher priority in comparison with other sites where all unnecessary pages are indexed.

WE STRONGLY RECOMMEND NOT TO REPLACE THE DEFAULT robots.txt BY YOUR OWN. You may be sure, we do all possible for uCoz sites to develop better. Otherwise, what’s the use of uCoz?!

Here is how the default robots.txt looks

Quote
User-agent: *
Disallow: /a/
Disallow: /stat/
Disallow: /index/1
Disallow: /index/2
Disallow: /index/3
Disallow: /index/5
Disallow: /index/7
Disallow: /index/8
Disallow: /index/9
Disallow: /main/
Disallow: /admin/
Disallow: /secure/
Disallow: /informer/
Disallow: /mchat


There is a "quarantine" for each new website when no modification of the robots.txt file is possible. In case of good traffic the quarantine will last up to 2 weeks, for the sites with low traffic – 30 days. If you pay for any of the additional services quarantine will end immediately after the payment.

Robots.txt file is a system file. If you still want to substitute it by your own, create a text file using notepad or any other text editor and name it "robots.txt". Then upload it to the root folder of your site by means File Manager or FTP.

Address of the robots.txt file is http://your_website_address/robots.txt

Robots.txt during quarantine looks in the following way:

Quote
User-agent: uBot
Disallow: /a/
Disallow: /stat/
Disallow: /index/1
Disallow: /index/2
Disallow: /index/3
Disallow: /index/5
Disallow: /index/7
Disallow: /index/8
Disallow: /index/9
Disallow: /panel/
Disallow: /admin/
Disallow: /secure/
Disallow: /informer/
Disallow: /mchat
Disallow: /search

User-agent: *
Disallow: /


or

Quote
User-agent: *
Disallow: /


Informers are not indexed because they output information that ALREADY exists. As a rule this information is already indexed on the corresponding pages.

All about Robots.txt

I have accidentally corrupted robots.txt. What should I do?
Delete it. Our robots.txt file will be added automatically (the system checks whether a user has it, and if not – adds back the default file).

Websites with low traffic are in the quarantine for a month. This is too long. How can a website have good traffic if it is unknown to search engines?
This time is needed for you to make your website interesting, add unique content and design. Then search engines will index your website well and won’t ignore it because it’s empty.

Is it possible to shorten the period of quarantine for a website with low traffic?
Yes, you need to pay for one of the additional services.

If I attach a domain to my website which is in the quarantine, will the quarantine end?
No. Domain attachment does not influence the quarantine period.

Is there any use in registering a website in search engines if the quarantine hasn’t ended yet?
No, your website won’t be accepted.

Will the robots.txt file be replaced automatically after the quarantine has ended? Or should I update it manually?
It will be updated automatically.

Is it possible to allow the indexing of photo albums in robots.txt? Many people search by images.
It will hardly give any result, but you can if you wish.

How can I forbid the indexing of website mirrors?
Read about mirrors. You should write your host in robots.txt, and then it will be the main one.

Is it possible to delete the default robots.txt?
You can’t delete it, it’s a system file, but you can add your own. But as it is written above it’s better not to do this. During the quarantine it is impossible to add you own robots.txt.

What is "UNetBot"? uCoz robot?
Yes.

What should I do to forbid indexing of the following pages?
_http://site.ucoz.com/index/0-4
_http://site.ucoz.com/index/0-5
Add the following to the robots.txt file:
/index/0-4
/index/0-5

I have forbidden the indexing of some links by means of robots.txt but they are still displayed. Why is it so?
By means of robots.txt you can forbid the indexing of pages, not links.

I want to make some changes in my robots.txt file. What is the process of it??
You must download it to your PC & upload back via File Manager or FTP-client.


 
MessageA website with the standard robots.txt is indexed in the best possible way. We adjusted it in such a way that only pages with content are indexed, and not all existing pages (e.g. login or registration page). Therefore uCoz websites are indexed better and get higher priority in comparison with other sites where all unnecessary pages are indexed.

WE STRONGLY RECOMMEND NOT TO REPLACE THE DEFAULT robots.txt BY YOUR OWN. You may be sure, we do all possible for uCoz sites to develop better. Otherwise, what’s the use of uCoz?!

Here is how the default robots.txt looks

Quote
User-agent: *
Disallow: /a/
Disallow: /stat/
Disallow: /index/1
Disallow: /index/2
Disallow: /index/3
Disallow: /index/5
Disallow: /index/7
Disallow: /index/8
Disallow: /index/9
Disallow: /main/
Disallow: /admin/
Disallow: /secure/
Disallow: /informer/
Disallow: /mchat


There is a "quarantine" for each new website when no modification of the robots.txt file is possible. In case of good traffic the quarantine will last up to 2 weeks, for the sites with low traffic – 30 days. If you pay for any of the additional services quarantine will end immediately after the payment.

Robots.txt file is a system file. If you still want to substitute it by your own, create a text file using notepad or any other text editor and name it "robots.txt". Then upload it to the root folder of your site by means File Manager or FTP.

Address of the robots.txt file is http://your_website_address/robots.txt

Robots.txt during quarantine looks in the following way:

Quote
User-agent: uBot
Disallow: /a/
Disallow: /stat/
Disallow: /index/1
Disallow: /index/2
Disallow: /index/3
Disallow: /index/5
Disallow: /index/7
Disallow: /index/8
Disallow: /index/9
Disallow: /panel/
Disallow: /admin/
Disallow: /secure/
Disallow: /informer/
Disallow: /mchat
Disallow: /search

User-agent: *
Disallow: /


or

Quote
User-agent: *
Disallow: /


Informers are not indexed because they output information that ALREADY exists. As a rule this information is already indexed on the corresponding pages.

All about Robots.txt

I have accidentally corrupted robots.txt. What should I do?
Delete it. Our robots.txt file will be added automatically (the system checks whether a user has it, and if not – adds back the default file).

Websites with low traffic are in the quarantine for a month. This is too long. How can a website have good traffic if it is unknown to search engines?
This time is needed for you to make your website interesting, add unique content and design. Then search engines will index your website well and won’t ignore it because it’s empty.

Is it possible to shorten the period of quarantine for a website with low traffic?
Yes, you need to pay for one of the additional services.

If I attach a domain to my website which is in the quarantine, will the quarantine end?
No. Domain attachment does not influence the quarantine period.

Is there any use in registering a website in search engines if the quarantine hasn’t ended yet?
No, your website won’t be accepted.

Will the robots.txt file be replaced automatically after the quarantine has ended? Or should I update it manually?
It will be updated automatically.

Is it possible to allow the indexing of photo albums in robots.txt? Many people search by images.
It will hardly give any result, but you can if you wish.

How can I forbid the indexing of website mirrors?
Read about mirrors. You should write your host in robots.txt, and then it will be the main one.

Is it possible to delete the default robots.txt?
You can’t delete it, it’s a system file, but you can add your own. But as it is written above it’s better not to do this. During the quarantine it is impossible to add you own robots.txt.

What is "UNetBot"? uCoz robot?
Yes.

What should I do to forbid indexing of the following pages?
_http://site.ucoz.com/index/0-4
_http://site.ucoz.com/index/0-5
Add the following to the robots.txt file:
/index/0-4
/index/0-5

I have forbidden the indexing of some links by means of robots.txt but they are still displayed. Why is it so?
By means of robots.txt you can forbid the indexing of pages, not links.

I want to make some changes in my robots.txt file. What is the process of it??
You must download it to your PC & upload back via File Manager or FTP-client.

Author - interout
Date Added - 2011-09-08 в 1:28 AM
UcozBaze All Scripts And Templates » uCoz Support » Klausimai atsakymai » Robots.txt (website indexing) ucoz (Robots.txt (website indexing) ucoz)
  • Page 1 of 1
  • 1
Search:
                                                               
Statistics Forum
New Posts Popular topic Top Forum Users New User

type list biuro popierius (0)
type list kokiomis kaldromis miegate (0)
type list power bank įkroviklis (0)
type list vaikams pagalvės (0)
type list vartų automatika (0)
type list geriausi pirkiniai (0)
type list ekologiški, tvarūs daiktai kasdienai (0)
type list stovykla Lietuvoje (0)
type list namų apsauga (0)
type list šilumos siurblys oras vanduo (0)
type list powerbank išorinė baterija (0)
type list automobilių numelio rėmeliai (0)
type list pensijų pakopos (0)
type list šildymo sistemos (0)
type list dujinis katilas name (0)
type list karjeros testas (0)
type list drąskyklė katei (0)

type list Skaiciuojam nuo 1 iki 1000 ! (558)
type list Forum SignatureBar (60)
type list Avatars (23)
type list Juokingos Fotkes :) (19)
type list Kaip pakeisti paveiksla mazas? (19)
type list Mini-Chatas islendantis is sono ucoz (15)
type list Mp3-Tau.do.am (13)
type list Шаблон форума для ucoz For-css (12)
type list Apklausa Jūsų Svetainei New ucoz (11)
type list Ucoz script - favicon (11)
type list Megsti samp? Ateik cia (10)
type list Button scrolling up ucoz (10)
type list Slider KinoPlius Help to setup :) (10)
type list Money for the forum ucoz (9)
type list KinoPlius (9)
type list Puslapis "Atliekami techniniai darbai" Ucoz scriptas (9)
type list SexMergytes.do.am (9)
type list 11.17.2011 (9)
type list User personal Page ucoz (8)
interout
Forum Posts: 1027
Comments: 51
Reputation: 83
Rank:
GoblinaS
Forum Posts: 380
Comments: 15
Reputation: 25
Rank:
Adi
Forum Posts: 179
Comments: 11
Reputation: 23
Rank:
Esquire
Forum Posts: 147
Comments: 8
Reputation: 5
Rank:
BAtman
Forum Posts: 129
Comments: 1
Reputation: 18
Rank:
WaSHkaZ
Forum Posts: 83
Comments: 0
Reputation: 3
Rank:
Skacikas
Forum Posts: 71
Comments: 0
Reputation: 12
Rank:
meskis
Forum Posts: 51
Comments: 0
Reputation: 25
Rank:
Gytenas
Forum Posts: 51
Comments: 0
Reputation: 1
Rank:
vicka
Forum Posts: 50
Comments: 1
Reputation: 4
Rank:
jokerzvobscure
Forum Posts: 0
Comments: 0
Reputation: 0
Rank:
dubroviena008
Forum Posts: 0
Comments: 0
Reputation: 0
Rank:
w4bzero
Forum Posts: 0
Comments: 0
Reputation: 0
Rank:
infoebrasha
Forum Posts: 0
Comments: 0
Reputation: 0
Rank:
karilekamo
Forum Posts: 10
Comments: 0
Reputation: 0
Rank:
zoro
Forum Posts: 0
Comments: 0
Reputation: 0
Rank:
pebotapple
Forum Posts: 0
Comments: 0
Reputation: 0
Rank:
aressvi
Forum Posts: 0
Comments: 0
Reputation: 0
Rank:
eddison_martin3
Forum Posts: 2
Comments: 0
Reputation: 0
Rank:
mariuspijunas
Forum Posts: 20
Comments: 0
Reputation: 0
Rank:


Site design by uCozBaze
uCozBaze © 2011-2016