Googlebot is accessing aspx pages it should access SEO-friendly URLs only

0 votes

Googlebot is accessing .aspx pages in my website e.g http://mysite.com/thepage.apx?id=32

I have used Intellgencia URL module for SEO-friendly URLs and my website also has links that present friendly URLs (or extensionless URLs) e.g.: http://mysite.com/thepage/32.

However, googlebot is accessing original URLs (http://mysite.com/thepage.apx?id=32).

In the robot.txt file I have placed following code:

disallow: *.aspx

My question is whether it will hide all pages with .aspx pages and friendly URLs (pointing to same .aspx pages) or hide pages just with .aspx extensions.

Summary:
googlebot is accessing same page with two urls:

  1. With original path e.g somesite/thepage.aspx?id=xx
  2. With friendly URL somesite/somepage/xx I want googlebot to access only friendly URLs. I am using asp.net 2.0 and friendly urls are mapped in web.config using intellgencia dll.

Code in web.config with Intellgencia module.

<rewriter>
    <rewrite url="/category/(.+)" to="/categoryPage.aspx?Id=$1"/></rewrite>
</rewriter>
Feb 23 in Others by Kichu
• 19,040 points
123 views

1 answer to this question.

0 votes

the URL mapping you have done would be wrong thats the first case to check and then there will be a chance of typos in your disallow statement  use google webmaster tool to pinpoint your flaws and then rectify it use this article to learn more about it http://www.google.com/support/webmasters/bin/answer.py?answer=156449 

answered Feb 24 by narikkadan
• 37,660 points

Related Questions In Others

+2 votes
2 answers

Is Reactjs SEO friendly? with google bots

Yes, with SERVER-SIDE RENDERING you will not face ...READ MORE

answered Feb 10 in Others by Shreesh
• 160 points
567 views
0 votes
1 answer

Generate SEO friendly URLs (slugs)

function format_uri( $string, $separator = '-' ) {     $accents_regex ...READ MORE

answered Feb 14 in Others by narikkadan
• 37,660 points
126 views
0 votes
0 answers

Static Pages vs. Dynamic Pages, Which is Better for SEO

which ones better for seo static or ...READ MORE

Feb 18 in Others by Kichu
• 19,040 points
46 views
0 votes
1 answer

Creating SEO friendly urls using htaccess

its just a simple step just use ...READ MORE

answered Feb 20 in Others by narikkadan
• 37,660 points
136 views
0 votes
1 answer

Is the single page app in asp.net MVC 4 examples, "Big Shelf", SEO friendly?

the pages that render on the basics ...READ MORE

answered Feb 20 in Others by narikkadan
• 37,660 points
56 views
0 votes
1 answer

SEO-friendly React-Redux app build

actually best choice is to use Nextjs ...READ MORE

answered Feb 24 in Others by narikkadan
• 37,660 points
132 views
0 votes
1 answer

Authenticate on an ASP.Net Forms Authorization website from a console app

Essentially, we need to record a regular ...READ MORE

answered Sep 20, 2018 in IoT (Internet of Things) by Annie97
• 2,160 points
321 views
0 votes
1 answer

Googlebot is accessing .aspx pages, it should access SEO-friendly URLs only

google bot will find  it if you ...READ MORE

answered Feb 11 in Others by narikkadan
• 37,660 points
120 views
0 votes
1 answer

Googlebot is accessing .aspx pages, it should access SEO-friendly URLs only

the url mapping would be wrong that ...READ MORE

answered Feb 20 in Others by narikkadan
• 37,660 points
96 views
webinar REGISTER FOR FREE WEBINAR X
REGISTER NOW
webinar_success Thank you for registering Join Edureka Meetup community for 100+ Free Webinars each month JOIN MEETUP GROUP