|
|
| Site Promotion Information |
|
|
|
|
What If You Dont Want Your Pages To Be Crawled and CachedJerry Yu Some website owners have pages that they want to hide from general public. The pages meet the following criteria:
Lets see this scenario: One day you created a page and you didnt put a link to it on your site. Then you told your family members about the pages URL. You thought nobody else would find it. You just made a mistake. Google and Yahoo would find your page if you or any family member ever visited websites with either Google toolbar PageRank enabled or Yahoo Companion Toolbar. PageRank function When you use Google toolbar with PageRank enabled, the toolbar automatically sends and records the pages URL you visited in Googles database. If a page URL is not found in Googles database, Googlebot - the robot of Google, will visit this page later to index it. Your surfing activities are tracked whether you use the toolbar to search the web or directly type a pages URL in Google search page. Google records your visits anyway. One day when you check what pages on your site have been indexed by Google, your hidden page comes up and you are worried. Furthermore, this page is cached. Even though you remove that page from your site, it can still be found and viewed from the cached version. How to check what pages have been indexed Go to Google, type in "site:www.yoursite.com" without quotes. This query will list all the pages that have been indexed but it will only display up to 999 records as this is the limit set by Google for any queries. How to prevent your hidden pages to be indexed and cached One simple but not sound solution is to disable PageRank function on the toolbar. To stop Google automatically track your surfing information, you can uncheck the PageRank checkbox to disable it. Steps to disable PageRank function:
See Google Toolbar Privacy Policy at http://toolbar.google.com/privacy.html for what information Google is collecting. Unfortunately, disable the PageRank function is not going to completely solve your problem because, in our example, your other family members could have PageRank enabled. A sound solution Your problem can be tackled by using meta robots html tag. The following two tags are what you need to use. Put the tag in the <head> section of your HTML documents. <meta name="robots" content="noindex,nofollow"> Search engines will read this page but will not index it and no links on this page will be traversed through to other pages. <meta name="robots" content="noarchive"> Search engines will not archive/cache the page content. How to remove an indexed and cached page If your page has already been indexed and cached, to remove from search engine databases, do this: 1. Add <meta name="robots" content="noindex,nofollow,noarchive"> to your page head tag section. Next time when Googlebot or other robots visit your page, your page will be removed from their index and cache. 2. Do what Google suggests. "If you believe your request is urgent and cannot wait until the next time Google crawls your site, use our automatic URL removal system. In order for this automated process to work, your webmaster must first insert the appropriate meta tags into the pages HTML code." cited from Google web site Remove Content from Googles Index at http://www.google.com/remove.html One last note. Is your page now 100% hidden Not really. If you have outbound links on the hidden page and you click the links and navigate to other websites, your hidden pages URL will appear in other sites web traffic log as HTTP referer. You can remove outbound links from your hidden pages if thats suitable. More resources
What If... Now you know how to safeguard any page on your site. What if you want to keep robots out from visiting all files in a directory The answer is in my article Robots.txt And Search Engine Robots - http://www.WebActionGuide.com/kb/robots-txt.php
| | | | RELATED ARTICLES Your Newsletters Are Pretty Lame If You Are Doing These 7 Things I remember the good old days of the internet when it was a real treat to subscribe to someone’s newsletter and receive all their wonderful information through the convenience of your email. How To Take Advantage Of Your Competition When people market their business, they pay little attention to their competition. However, they can learn a lot from them. Your competition plays a large role in your business and in your marketing efforts, so dont ignore them. 3 Reasons Your Website Might Fail To Attract Enough Customers Virtually all website owners concentrate their efforts and energy into getting more visitors. With business owners this effort is spent on getting more and more new customers. What many people forget - with both their website and their business - is that getting new customers or visitors is only a small part of the equation for success… Is A Yahoo Listing Still Worth It In October 2002, the Yahoo! portal changed the way it delivers search results. In the past, the most prominent results were exclusively culled from websites listed in the Yahoo directory itself. Since October, sites listed in the Yahoo directory no longer enjoy this privileged status. 7.5 Ways To Get More Sales Through Your Web Site Yes, apparently - websites are supposed to make money! Somebody came up with the strange idea that its really not enough to spend thousands on your site, hundreds of hours creating the content and then sitting back to admire you, and your developers work. No - apparently it is now cool to have a web site that actually makes it onto a sales column in your chart of accounts.. Return on in investment is a good phrase thats being thrown around - what are you actually making from your web site in cash terms Ever thought about that Seven Must Follow Rules While Participating In Message Boards Participating in message boards forums discussions is a greatway of self promotion. It costs you nothing. Not even a penny. All you have to do is allot sometime for this type of promotion. Inside the Mind of a Super Affiliate I only know one risk-free way to retire early, while being lazy. When to Hire a Professional SEO Firm In efforts to increase sales and profitability, more and more companies are turning to online marketing initiatives – specifically, search engine optimization. Search Engine Optimization or SEO is the art and science of blending technical and marketing skills together into a finely tuned website that is both search engine-friendly, ranks well for specific keywords and phrases, and is tailored to your audience from a buyer and seller perspective. Taking E-mail marketing to the next level Many types of Internet advertising dont work as well as they once did. People have gotten used to banners and dont click on them. Some ezines have failed to keep their readers interest and ads sometimes get less response. The Basics of Asking for a Reciprocal Link Asking another webmaster for a reciprocal link is standard practice on the Internet. Webmasters have been asking other webmasters for reciprocal links since the beginnings of the Internet. The very nature of the web is linking websites to one another. It is of even higher importance, now that AltaVista and others have changed their ranking algorithms. What is the Google Dance As with any good web developer, the ability to time the changes Google will update your website and refresh the content for better SEO Search Engine Optimization is in your favor. Welcome to the world of “Google Dance”. The Google Dance is simply that the predetermination of when the actual update will commence. Four Tips For Getting More Mileage From Your Articles It has become common knowledge that the smartest and most effective free method of advertising your business and services is to write and submit articles to the over 400,000 e-zines currently on the net.There are even several e-books written on the topic, including mine, that will help you take advantage of this effective technique.What do you do next after youve invested the hours necessary to research, write, proofread, edit and submit your article to thousands of e-zine publishers Need Article Ideas Writers block...need I say moreEvery writer experiences writers block at one time or another.For a writer using the marketing with articles technique the block often starts with trying to generate a new article idea.There are many creative ways to discover article ideas no matter what your topic and well cover several of them below. The Power of Link Exchanges Lets face it. Getting webmasters to link to your site is difficult. Double Your Revenues with Joint Ventures The best way I know of to multiply your online results, such as doubling the size of your opt-in email list, or increasing your sales, is through the use of joint ventures. The Number One Reason Most Websites Fail Failure, just like success, is measured differently by each and every one of us. What one man treats as success another may view as failure. For the purposes of this article a website that fails is one that fails to attract and convert enough targeted visitors into paying customers. Yeah - positive feedback from your website visitors is great but lets face it - were all in this ultimately to make more money. What is Site Match While you may have heard of a controversial new program called Site Match, which is being run by the Yahoo/Overture team, what you probably dont know is what this program is really all about. Site Match is a program created to get your site into the Yahoo database formerly the Inktomi database and it can be expensive. It is based on a yearly fee and an additional cost for every click you get from a Yahoo based search engine. FFA/Reversed Marketing Have you ever submitted your ad to an FFA page most likely you have. Did you get any results from it or did you just get a ton of emails in your inbox X-Ray Specs, Turning 30 and Achieving Website Success I was writing the final chapter of my book on website marketing a few weeks ago and was wondering how far Id progressed with it in the past nine months so I ran a word count. 44559 words. 3 Simple Ways To Dramatically Improve Your Website Before you start worrying about marketing your website on the internet it always pays dividends to look at the website itself and get the fundamentals right before looking to shout about it from the virtual mountain-tops. |
| home | site map |
| © 2005 |