Last 10 active topics

If i add a sitemap in my website can search engine index my all the pages?

Hi,
Is there a single command to prevent a crawler from going into any subfolder? The reason I am asking this is, it seems the google is picking up subfolder that don't even exist on my site. So just excluding each folder is not enough , I need a general command.

Thanks

Hi all, i'm a new entry in this forum. I read that the spider dosnt read the javascript output with document.write().

Now i ask if it is similar to php variable. I think no , but I ask you.

EXAMPLE:
If I write...
$text ="hello hello hello";
echo $textl;

can the spider read the text ?

thank you for your help .

Is there a way to 301 or redirect a https page to http without using Rewriterule.
I don't want every page request to https:// or port 443 to redirect to port 80 or http://

Just one page a assign in htacess. Or in reverse - all pages but declared.

Anyone have any suggestions?

Is there a way to 301 or redirect a https page to http without using Rewriterule.
I don't want every page request to https:// or port 443 to redirect to port 80 or http://

Just one page a assign in htacess. Or in reverse - all pages but declared.

Anyone have any suggestions?

I have some read SEO docs 3-4 days before and created a robots.txt file which I saved it in the root of my website directory. I have saved it in the above location but some doubt if this file is accurate and will work or not. Please check this file and comment some TIPS about robots.txt file which I must always take into mind while creating this file.

Website name is :

google-traffic-generator dot com/robots.txt ...

Hi,
Is there any rule on how to use the hyper links between pages on a site that the spider can visit better and How/where can we learn the spider algorithm? Are robots the only way to communicate with Spider? Help plzzzz!!
thanks

Hi,
Could someone please explain to me, when I put (site:my site) it shows some posts with description in meta tags,
some posts with actual post content
some posts with left side bar content.
Same again for tags, etc.

I was told that the theme I am using, 'ambient glo' has the sidebars content given more weight by the search engines, then the actual content. This really gets me, the one attraction about this theme, ...

I have something that starts to look like a problem. I run a small forum with something like 10-20 topics per day. We have about 5,000 topics in total. Google eat almost 80% of my bandwidth meaning about 6Gb per month. I am using a robots.txt file but it does not seem to do the trick. I want Google to spider but not the whole site every hour. Anyone here who have solved this problem? ...

Hello. I am very new to the way the robots crawl my site and how results are indexed. I am the owner of a baby sling site and we sell over 300 slings and 10 brands of slings. The site has existed for about 2 months. Only the first brand is showing up in goole search. We have about 8 of them. I am at the beginning stages of optimizing this site, but I know ...