How Search Engine Look For New Web Page

To properly optimize web page content for the search engines you need to understand how the search engines read web pages.
When the Search Engine Arrives to the Website

 When the search engine arrives to the website in looks in the root (main) folder of the site for a file called robots.txt

 In the robots.txt file it looks for what directories and files it is allowed to look at and index. Some search engine spiders (web crawlers, robots) ignore these instructions.
Web Page Head Section

 Once a web page is found by the search engine spider (robot, web crawler) it takes a look at the head section (the tags between the and tags) of the web page for:

 1. The title of the page
2. The keyword and description meta tags
3. The robots meta tag. Some use the robots meta tag to override the instructions in the robots.txt file or if they cannot create a robots.txt file the instructions for the search engine spiders (robots, web crawlers) are placed here.

 If there is no robots.txt file in place and no robots meta taf in the page(s) it finds, it will follow and index all the links found.

 To learn more about meta tags, see our Meta Tags and Basic Meta Tags articles.
Web Page Content

 Web page content is everything between the and tags.

 This where the search engine spider (robot, web crawler) looks for the keywords and phrases you have in the page's keywords and description meta tags.

 It will also find and follow links within the web page content.

 The search engine spider (robot, web crawler) reads the content in the order that it is inserted into the page. As in from the top down.

 Some search engines use the first few words they find in the web page coding as the description under your listing in the search engine results. This is something you should keep in mind if you use HTML tables for your web page layout.

 If your website uses frames, javascript or flash you should be aware that search engines don't read these.

 A website that uses a doorway page (splash page) won't be too popular with the search engine either. If you are considering one of these or using one, then it would be advisable to reconsider it.

 Proper heading structure is also important when preparing your web page for the search engines.

Comments

Post a Comment

Popular posts from this blog

Events In Advanced Segments in Google Analytics

I’m not sure if I missed the official announcement, but I discovered the ability to add Event based dimensions and metrics to the Advanced Segments features of Google Analytics. The enabing of this feature by the Google product team finally makes using Event Tracking an integral part of your analytics. Event tracking in Google Analytics In the past there was a large problem with Event Tracking, that very few people talked about surprisingly. See here’s the problem, when event tracking was first enabled it was heralded as the solution to fix issues with (eg) pageless websites, flash content - you could ‘enable event tracking without inflating your page view count’. Good stuff? Well, in a way yes - the problem with this solution was that the data was held in it’s own walled garden disconnected from other data. A classic problem was that, let’s say you tracked all of your video with event tracking. Implementation was improved - the multi-dimensional capabilities made it very easy ...
Read more

Importance of Goals in SEO

So you may already imagine what a goal is, but if you’re still wondering how exactly does goal setting in web analytics help your business, you’re in for a treat – this post will show some basics and answer that question to make your site a working asset for your business. How web analytics goals help my business First of all, a goal is a web analytics setting that counts each completion of a specific visitor task on your website. Goals become helpful to your business by selecting tasks that link your site purpose relative to your business. So each task counted can indicate how well your website is contributing to your business. This is not a light consideration — according to Experian in its 2011 Digital Marketer: Benchmark and Trend report most customer research a business online before arriving to the store. Moreover the number of customers who are using mobile devices to discover businesses are increasing, so it is essential to understand the impression your site has on vis...
Read more

How web 2.0 helps in SEO

Web 2.0 is a category of new Internet tools and technologies created around the idea that the people who consume media, access the Internet, and use the Web shouldn't passively absorb what's available; rather, they should be active contributors, helping customize media and technology for their own purposes, as well as those of their communities. Web 2.0 is beginning of a new era in technology — one that promises to help nonprofits operate more efficiently, generate more funding, and affect more lives. What is Web 2.0 Anyway? This piece will help you familiarize yourself with the general concept of Web 2.0 and the many technologies that fall into this category. Publish Information Seven Blogging Tools Reviewed There are a number of good blogging tools, but choosing among them can be confusing. In this report, we’ll take a detailed look at the top blogging tools and outline key consid...
Read more