SEO

 
Forums: » Register « |  User CP |  Games |  Calendar |  Members |  FAQs |  Sitemap |  Support | 
User Name:
Password:
Remember me



Go Back   Tutorialized ForumsWeb Design & DevelopmentSEO

Reply
Add This Thread To:
  Del.icio.us   Digg   Google   Spurl   Blink   Furl   Simpy   Y! MyWeb 
Thread Tools Search this Thread Rate Thread Display Modes
 
Unread Tutorialized Forums Sponsor:
  #1  
Old January 23rd, 2013, 12:41 AM
jamesvili jamesvili is offline
Registered User
Tutorialized Newbie (0 - 499 posts)
 
Join Date: Jan 2013
Posts: 1 jamesvili User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: 5 m 10 sec
Reputation Power: 0
Importance of robots.txt in SEO

what the main benefit of creating a robots.txt file, and how its helps us in seo. Ekarigar.com

Reply With Quote
  #2  
Old February 9th, 2013, 12:00 AM
victoria victoria is offline
Registered User
Tutorialized Newbie (0 - 499 posts)
 
Join Date: Dec 2012
Posts: 23 victoria User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: 2 h 5 m
Reputation Power: 0
Robot.txt file is simple text file in which webowner mention the pages which search engine spider can crawl and which are not.its good to get good ranking

Reply With Quote
  #3  
Old March 22nd, 2013, 08:03 AM
VanessaMeacham VanessaMeacham is offline
Registered User
Tutorialized Newbie (0 - 499 posts)
 
Join Date: Sep 2012
Location: USA
Posts: 53 VanessaMeacham User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: 14 h 59 m 31 sec
Reputation Power: 3
Importance of robots.txt in SEO

HI ! Robots.txt is an important file that contains instructions to search engine spiders that tells them which pages are to be indexed and made public, and which pages should not be crawled.

Reply With Quote
  #4  
Old April 16th, 2013, 12:58 PM
rosejoans rosejoans is offline
Registered User
Tutorialized Newbie (0 - 499 posts)
 
Join Date: Oct 2012
Posts: 29 rosejoans User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: 3 h 47 m 54 sec
Reputation Power: 0
it's a txt file that has instruction for crawler that which webpage should be crawl or not by the search engine.

Reply With Quote
  #5  
Old April 18th, 2013, 02:25 AM
EUWindowsHost EUWindowsHost is offline
Permanently Banned
Tutorialized Newbie (0 - 499 posts)
 
Join Date: Apr 2013
Location: http://www.hostforlife.eu
Posts: 16 EUWindowsHost User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: 2 h 47 m 59 sec
Warnings Level: 10
Number of bans: 1
Reputation Power: 0
That's correct. Robot.txt is not for search engine

Reply With Quote
  #6  
Old April 29th, 2013, 09:44 AM
andyflower916 andyflower916 is offline
Registered User
Tutorialized Newbie (0 - 499 posts)
 
Join Date: Feb 2013
Posts: 2 andyflower916 User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: 17 m 18 sec
Reputation Power: 0
Robots.txt is a plain text file that works like an exclusion protocol. There are some pages that website owner do not want to crawl because they are not helpful pages, the owner mention that in this sheet and submit it. The search engines read this file when they started crawling a website and remove all the pages that owner do not want to crawl.

Reply With Quote
Reply

Viewing: Tutorialized ForumsWeb Design & DevelopmentSEO > Importance of robots.txt in SEO


Developer Shed Advertisers and Affiliates


Thread Tools  Search this Thread 
Search this Thread:

Advanced Search
Display Modes  Rate This Thread 
Rate This Thread:


Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
View Your Warnings | New Posts | Latest News | Latest Threads | Shoutbox
Forum Jump


Forums: » Register « |  User CP |  Games |  Calendar |  Members |  FAQs |  Sitemap |  Support | 
  
 

Powered by: vBulletin Version 3.0.5
Copyright ©2000 - 2014, Jelsoft Enterprises Ltd.

© 2003-2014 by Developer Shed. All rights reserved. DS Cluster - Follow our Sitemap