All the leading search engines use crawlers to find out pages for their algorithmic search results. Pages that are linked from other search engine indexed pages do not need to be submitted because they are found automatically. Some search engines like Yahoo! operate a paid submission service that guarantee crawling for either a set fee or cost per click. These types of programs usually guarantee inclusion in the database, but do not guarantee specific ranking within the search results. Therefore yahoos program has been criticized by advertisers and competitors. Two major directories, the Yahoo Directory and the open directory project need manual submission and human editorial review.

Google offers Google Webmaster Tool, for which an XML Sitemap feed can be created and submitted for free to ensure that all pages are found, especially pages that aren’t discoverable by automatically following links. Search engine crawlers take many other things into its consideration while crawling a site. Not every page is indexed by the search engines. Distance of pages from the root directory of a site may also be a factor in whether or not pages get crawled. To avoid undesirable content in the search indexes, webmasters can instruct spiders not to crawl certain files or directories through the standard file in the root directory of the domain. Additionally, a page can be explicitly excluded from a search engine’s database by using a mete tag specific to robots. When a search engine visits a site, the located in the root directory is the first file crawled. The file is then parsed, and will instruct the robot as to which pages are not to be crawled. As a search engine crawler may keep a cached copy of this file, it may on occasion crawl pages a webmaster does not wish crawled. Pages typically prevented from being crawled include login specific pages such as shopping carts and user-specific content such as search results from internal searches.

In March 2007, Google warned webmasters that they should prevent indexing of internal search results because those pages are considered search spam. Another thing in seo service is important and that is spam care. That same spammer is busy building back links from anywhere they can find them, including some of the webs worst neighborhoods. The spam can be sent from sites of guns, casinos, link directories and many other unimportant sites for you. It is the most prevailing problem and most of the time the spammers are disguising themselves as valid users. One of the most common forms of comment and ping back spam right now is the relatively subtle, ambiguous kind short phrases or questions that are not obviously spam, at least on face value. The more sophisticated spammers have progressed from old standbys like nice post and great blog, to more cunning things like questions (where can I download your theme?) and appeals to your helpful nature (Im having trouble subscribing to your RSS feed). Therefore it is essential for the webmasters to prevent indexing of the internal search results as these pages are considered search spam. For more details please visit

Online business directories can deliver many benefits but first, it is important to understand the difference between business directories and general web directories. If you are new to internet marketing or SEO (Search Engine Optimisation), you would’ve heard many mentions of ‘Directory Submission’, it could be confusing which type of directory you are supposed to submit to unless you know their difference. Directory submission as far as search engine optimization is concerned almost always refer to submitting a website’s information and URL to a general web directory, which is a database of websites and website URLs. They are designed to help search engines discover websites.

Being listed in these general web directories help improve a website’s link popularity and search engine visibility. It is almost used exclusively for SEO purposes. Human users can also search the database and get search engine styled results – a list of websites that match their search keywords. However, for customers looking for particular types of business, products or services, web directory doesn’t offer much information so they are not really useful. On the other hand, business directories contain much more information and usually allow the customer to compare prices, products and ratings. Business directories is a different kind of online advertising, where they usually promote much more specific information about the business such as business summary, open hours, contact information and maybe even product photos, price lists, videos and customer reviews as well. They are designed to help customers find particular businesses, products and services. Customers can search businesses by name, location or business sector.

Their search results look more like what you’d get from a price comparison website or a shopping website with filters. If a business directory also provides links to a business’s own website then it will also deliver SEO benefit as well. For business owners, it is important to utilize general web directories to improve the link popularity and search engine ranking for their own websites. Having already invested significant amount of capital in their own website, it is worth investing a little bit more money in business directories that can further promote their information, the latest offers, products, services and news updates. This will significantly increase a business’s online presence and customer engagement. By making contact information and maybe even price lists available online, prospective customers can contact the business and place their orders directly so business directories can directly generate new revenue.