GoogleBot will look inside of JavaScript content to find potential - TopicsExpress



          

GoogleBot will look inside of JavaScript content to find potential URLs... the only problem is that it turns out GoogleBot doesnt actually execute the code in question! If you had something like /test/ as a string in your JavaScript, GoogleBot will just automatically ASSUME it is a URL, and try to access it. Then, out of nowhere, all of a sudden, you have millions of 404s against this URL on your site! Why? because then GoogleBot then tries to index this non-existent page. This is then compounded by Google Webmaster Tools which lists the 404s on the site. Mine is almost entirely flooded with non-existent pages pulled from text within JavaScript. Needless to say, there is a shitton of JavaScript string obfuscation within Cospix *JUST* because Im sick and tired of the reports on Webmaster Tools of GoogleBot not being able to index content that never existed in the first place.
Posted on: Wed, 10 Sep 2014 21:58:48 +0000

Trending Topics



Recently Viewed Topics




© 2015