Robots.txt File kya hai Robot.txt Se Kya Hota Hai 



USER-AGENT: *
DISALLOW:

Robots.txt ek code h jisse ham use ishliye kartain h taaki google ke Robots hamari site ko read kar sake or ye code website mein hone hi chahiye
 ye code google ke sath sath sabhi search engine ke liye use hota h

USER-AGENT: *   MEANS INVITATION FOR SEARCH ENGINE
DISALLOW:          MEANS  100%  AGREE TO VISITING FOR OUR WEBSITE

 or inh dono ka ek sath matlab h = fully read to data

  for example: agar kisi website mein ye code dekhhne h to ham google (search engine) mein website ka url enter karenge
 jaise : www.abhicool.com/robots.txt 

enter karne ke baad ye code a jayega   user-agent: * or disallow agar ye code a jaye to website mein ye code available h nahi
show kar raha to ye code website mein available nahi h
jab kissi khass information ko hame read nahi karwana to hame us page ka url  iss code ke andar past karna h

ROBOTS.TXT CODE

( ex :)  USER-AGENT: *
         DISALLOW: /URL/
TO WO PAGE BLOCK HO JATA H
 (EX:2)  USER-AGENT:*
         DISALLOW: /GALLARY/
         DISALLOW: /HOME/

EX:2   MEIN DO PAGE BLOCK KARE GAYE H  EK GALLARY AND HOME INKA URL PAST KARNA H
       OR JITNE CHAHE UTNE PAGE BLOCK KAR SAKTE H
       AGAR KISI WEBSITE MEIN YE CODE AVAILABLE NAHI H TO HAM ADD KARWA SAKTE H WEB DEVELOPER KO KHE KAR ROOT FILE MEIN ADD KARWA SAKTE H
       YA GOOGLE WEB MASTER KI HELP SE BHI ADD KARWAYA JA SAKTA H

Abhicool