 |
|
|
|
Next: link popularity
|
| Author |
Message |
External
Since: Dec 28, 2007
Posts: 3
|
(Msg. 1) Posted: Fri Dec 28, 2007 10:49 am
Post subject: Make search engine not to crawl a web page
Archived from groups: alt>www>webmaster (more info?)
|
|
|
|
|
| Back to top |
|
 | |
External
Since: Dec 28, 2007
Posts: 3
|
(Msg. 2) Posted: Fri Dec 28, 2007 11:26 am
Post subject: Re: Make search engine not to crawl a web page [Login to view extended thread Info.]
Archived from groups: per prev. post (more info?)
|
|
|
On Dec 28, 10:57 am, Fred Atkinson <fatkin....TakeThisOut@mishmash.com> wrote:
> On Fri, 28 Dec 2007 10:49:30 -0800 (PST), sreedhard....TakeThisOut@gmail.com
> wrote:
>
> >Hi,
>
> >I don't want some of my web pages appear in search engine results. Is
> >there anyway to indicate search engine not to crawl those pages (by
> >adding any tags)? Thanks in advance.
>
> >-Sreedhar
>
> Yes. Use a robots.txt file in your primary site directory (it
> only works in the root directory of the site).
>
> There are robots meta tags.
>
> You can get information about that at:http://www.robotstxt..org
>
> The robots.txt file info can be seen at:http://www.robotstxt.org/robotstxt.html
>
> The meta tags are displayed at:http://www.robotstxt.org/meta.html
>
> Regards,
>
> Fred
Thanks for your prompt response. I should have explained my scenario
better.
The page is dynamic which accepts an id in querystring,
e.g. product.asp?id=1.
I want some products appear in the search results, but I don't want
some of them appear in the results (They are exclusive to some
customers).
Thanks in advance.
Regards,
Sreedhar |
|
| Back to top |
|
| |
External
Since: Dec 28, 2007
Posts: 3
|
(Msg. 3) Posted: Fri Dec 28, 2007 1:19 pm
Post subject: Re: Make search engine not to crawl a web page [Login to view extended thread Info.]
Archived from groups: per prev. post (more info?)
|
|
|
On Dec 28, 11:55 am, Mark Goodge <use... RemoveThis @listmail.good-stuff.co.uk>
wrote:
> On Fri, 28 Dec 2007 11:26:23 -0800 (PST), sreedhard... RemoveThis @gmail.com put
> finger to keyboard and typed:
>
> >Thanks for your prompt response. I should have explained my scenario
> >better.
>
> >The page is dynamic which accepts an id in querystring,
>
> >e.g. product.asp?id=1.
>
> >I want some products appear in the search results, but I don't want
> >some of them appear in the results (They are exclusive to some
> >customers).
>
> Well, since the page is being dynamically generated to display
> different products, the simplest option is to add a line of code that
> puts the appropriate meta tag into the headers for products that you
> don't want to be indexed.
>
> Mark
> --
> Blog:http://Mark.Goodge.co.uk Photos:http://www.goodge.co.uk
> "If you never know truth then you never know love"
Thanks for your response. What is the meta tag that tells search
engine not to index that page? Please let me know. >> Stay informed about: Make search engine not to crawl a web page |
|
| Back to top |
|
| |
External
Since: Jul 11, 2003
Posts: 187
|
(Msg. 4) Posted: Fri Dec 28, 2007 1:57 pm
Post subject: Re: Make search engine not to crawl a web page [Login to view extended thread Info.]
Archived from groups: per prev. post (more info?)
|
|
|
|
|
| Back to top |
|
| |
External
Since: Jan 25, 2005
Posts: 345
|
(Msg. 5) Posted: Fri Dec 28, 2007 4:03 pm
Post subject: Re: Make search engine not to crawl a web page [Login to view extended thread Info.]
Archived from groups: per prev. post (more info?)
|
|
|
On Fri, 28 Dec 2007 11:26:23 -0800 (PST), sreedhardasi.DeleteThis@gmail.com put
finger to keyboard and typed:
>Thanks for your prompt response. I should have explained my scenario
>better.
>
>The page is dynamic which accepts an id in querystring,
>
>e.g. product.asp?id=1.
>
>I want some products appear in the search results, but I don't want
>some of them appear in the results (They are exclusive to some
>customers).
Well, since the page is being dynamically generated to display
different products, the simplest option is to add a line of code that
puts the appropriate meta tag into the headers for products that you
don't want to be indexed.
Mark
--
Blog: http://Mark.Goodge.co.uk Photos: http://www.goodge.co.uk
"If you never know truth then you never know love" >> Stay informed about: Make search engine not to crawl a web page |
|
| Back to top |
|
| |
External
Since: Jan 25, 2005
Posts: 345
|
(Msg. 6) Posted: Fri Dec 28, 2007 7:02 pm
Post subject: Re: Make search engine not to crawl a web page [Login to view extended thread Info.]
Archived from groups: per prev. post (more info?)
|
|
|
On Fri, 28 Dec 2007 13:19:14 -0800 (PST), sreedhardasi DeleteThis @gmail.com put
finger to keyboard and typed:
>On Dec 28, 11:55 am, Mark Goodge <use... DeleteThis @listmail.good-stuff.co.uk>
>wrote:
>> On Fri, 28 Dec 2007 11:26:23 -0800 (PST), sreedhard... DeleteThis @gmail.com put
>> finger to keyboard and typed:
>>
>> >Thanks for your prompt response. I should have explained my scenario
>> >better.
>>
>> >The page is dynamic which accepts an id in querystring,
>>
>> >e.g. product.asp?id=1.
>>
>> >I want some products appear in the search results, but I don't want
>> >some of them appear in the results (They are exclusive to some
>> >customers).
>>
>> Well, since the page is being dynamically generated to display
>> different products, the simplest option is to add a line of code that
>> puts the appropriate meta tag into the headers for products that you
>> don't want to be indexed.
>>
>> Mark
>> --
>> Blog:http://Mark.Goodge.co.uk Photos:http://www.goodge.co.uk
>> "If you never know truth then you never know love"
>
>Thanks for your response. What is the meta tag that tells search
>engine not to index that page? Please let me know.
That's in the page referenced by Fred Atkinson, in the post to which
you responded. Follow the links he gave you, and all will become
clear.
Mark
--
http://www.BritishSurnames.co.uk - What does your surname say about you?
"Come on you target for faraway laughter, come on you stranger, you legend, you martyr, and shine!" >> Stay informed about: Make search engine not to crawl a web page |
|
| Back to top |
|
| |
External
Since: Jul 11, 2003
Posts: 187
|
(Msg. 7) Posted: Fri Dec 28, 2007 7:53 pm
Post subject: Re: Make search engine not to crawl a web page [Login to view extended thread Info.]
Archived from groups: per prev. post (more info?)
|
|
|
|
|
| Back to top |
|
| |
| Related Topics: | 404 errors from Google's crawl engine - Hi there, Our website is getting a lot of 404 errors from Google's crawl engine. They all point to old pages (about 1-3 months old). Funny thing is that we've taken all recommended steps to let Google know that those pages are not there any more at the...
Index Page Design versus Search Engine Ranking - Hello, I have a small Flash animation on my home page so that I designed an index page containing a script detecting whether the visitors have Flash. If they have it, they are sent to the Flash homepage and if they do not have it they are sent to..
A better search engine? - Never a stranger to controversy, I should like to propose that there is a better search engine than Google.... I nominate www.alltheweb.com for the title of best search engine. Not from a technical perspective, but from the dual aspects of finding web....
Search Engine Help - My apologies if I am in the wrong forum. As my business has grown the search engine placement piece is being neglected. I do not expect any magic bullet but I would like some thoughts from you folks who manage quite a few sites. Thanks in Advance
ASP search engine - looking for free asp search engine, preferably with rankings, customization options, etc. any recommendations ? thanx much ! |
|
You can post new topics in this forum
You can reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
|
|
|
|
|
|
|
FAQ
Profile
Private Messages
Log in
