Googlebot is accessing aspx pages it should access SEO-friendly URLs only

0 votes

Googlebot is accessing .aspx pages in my website e.g http://mysite.com/thepage.apx?id=32

I have used Intellgencia URL module for SEO-friendly URLs and my website also has links that present friendly URLs (or extensionless URLs) e.g.: http://mysite.com/thepage/32.

However, googlebot is accessing original URLs (http://mysite.com/thepage.apx?id=32).

In the robot.txt file I have placed following code:

disallow: *.aspx

My question is whether it will hide all pages with .aspx pages and friendly URLs (pointing to same .aspx pages) or hide pages just with .aspx extensions.

Summary:
googlebot is accessing same page with two urls:

  1. With original path e.g somesite/thepage.aspx?id=xx
  2. With friendly URL somesite/somepage/xx I want googlebot to access only friendly URLs. I am using asp.net 2.0 and friendly urls are mapped in web.config using intellgencia dll.

Code in web.config with Intellgencia module.

<rewriter>
    <rewrite url="/category/(.+)" to="/categoryPage.aspx?Id=$1"/></rewrite>
</rewriter>
Feb 19 in Others by Kichu
• 16,850 points
38 views

1 answer to this question.

0 votes
the url mapping would be wrong that one option to consider in this situation  check aspx urls is also mapped the are supposed to be mapped

or there would be typos in your Disallow statement
answered Feb 20 by narikkadan
• 7,860 points

Related Questions In Others

+2 votes
2 answers

Is Reactjs SEO friendly? with google bots

Yes, with SERVER-SIDE RENDERING you will not face ...READ MORE

answered Feb 10 in Others by Shreesh
• 160 points
89 views
0 votes
1 answer

Generate SEO friendly URLs (slugs)

function format_uri( $string, $separator = '-' ) {     $accents_regex ...READ MORE

answered Feb 14 in Others by narikkadan
• 7,860 points
38 views
0 votes
0 answers

Static Pages vs. Dynamic Pages, Which is Better for SEO

which ones better for seo static or ...READ MORE

Feb 18 in Others by Kichu
• 16,850 points
10 views
0 votes
1 answer

Creating SEO friendly urls using htaccess

its just a simple step just use ...READ MORE

answered Feb 20 in Others by narikkadan
• 7,860 points
21 views
0 votes
1 answer

Is the single page app in asp.net MVC 4 examples, "Big Shelf", SEO friendly?

the pages that render on the basics ...READ MORE

answered Feb 20 in Others by narikkadan
• 7,860 points
19 views
0 votes
1 answer

SEO-friendly React-Redux app build

actually best choice is to use Nextjs ...READ MORE

answered Feb 24 in Others by narikkadan
• 7,860 points
40 views
0 votes
1 answer

Authenticate on an ASP.Net Forms Authorization website from a console app

Essentially, we need to record a regular ...READ MORE

answered Sep 20, 2018 in IoT (Internet of Things) by Annie97
• 2,160 points
234 views
0 votes
1 answer
0 votes
1 answer

Googlebot is accessing .aspx pages, it should access SEO-friendly URLs only

the URL mapping you have done would ...READ MORE

answered Feb 24 in Others by narikkadan
• 7,860 points
53 views
webinar REGISTER FOR FREE WEBINAR X
Send OTP
REGISTER NOW
webinar_success Thank you for registering Join Edureka Meetup community for 100+ Free Webinars each month JOIN MEETUP GROUP