Googlebot is accessing .aspx pages in my website e.g http://mysite.com/thepage.apx?id=32
I have used Intellgencia URL module for SEO-friendly URLs and my website also has links that present friendly URLs (or extensionless URLs) e.g.: http://mysite.com/thepage/32.
However, googlebot is accessing original URLs (http://mysite.com/thepage.apx?id=32).
In the robot.txt file I have placed following code:
My question is whether it will hide all pages with .aspx pages and friendly URLs (pointing to same .aspx pages) or hide pages just with .aspx extensions.
googlebot is accessing same page with two urls:
- With original path e.g somesite/thepage.aspx?id=xx
- With friendly URL somesite/somepage/xx I want googlebot to access only friendly URLs. I am using asp.net 2.0 and friendly urls are mapped in web.config using intellgencia dll.
Code in web.config with Intellgencia module.
<rewrite url="/category/(.+)" to="/categoryPage.aspx?Id=$1"/></rewrite>