Generate sitemap timeout

Posted By Neil Sat 6 Aug 2011
Add to Favorites0
Author Message
Neil
 Posted Sat 6 Aug 2011
Supreme Being

Supreme Being - (109,853 reputation)Supreme Being - (109,853 reputation)Supreme Being - (109,853 reputation)Supreme Being - (109,853 reputation)Supreme Being - (109,853 reputation)Supreme Being - (109,853 reputation)Supreme Being - (109,853 reputation)Supreme Being - (109,853 reputation)Supreme Being - (109,853 reputation)

Group: Forum Members
Last Active: Sat 3 Nov 2018
Posts: 192, Visits: 5,220
Can I change the length of time so our generate sitemap feed script doesn't timeout? Would I need to add a line to web.config or would this need to be done in IIS? I can change it back once the script has finished.
Sat 6 Aug 2011 by Neil
Mohammad
 Posted Mon 8 Aug 2011
Kartris Expert

Kartris Expert - (70,207 reputation)Kartris Expert - (70,207 reputation)Kartris Expert - (70,207 reputation)Kartris Expert - (70,207 reputation)Kartris Expert - (70,207 reputation)Kartris Expert - (70,207 reputation)Kartris Expert - (70,207 reputation)Kartris Expert - (70,207 reputation)Kartris Expert - (70,207 reputation)

Group: Administrators
Last Active: Sun 27 Sep 2015
Posts: 115, Visits: 706
Hi Neil,

Can you past the timeout error message that you've got here ?

Need to know if its coming from IIS or db, cause generating the sitemap is reading the whole products in one go, so maybe its a db one (due to the large number of products) rather than IIS.
Neil
 Posted Tue 9 Aug 2011
Supreme Being

Supreme Being - (109,853 reputation)Supreme Being - (109,853 reputation)Supreme Being - (109,853 reputation)Supreme Being - (109,853 reputation)Supreme Being - (109,853 reputation)Supreme Being - (109,853 reputation)Supreme Being - (109,853 reputation)Supreme Being - (109,853 reputation)Supreme Being - (109,853 reputation)

Group: Forum Members
Last Active: Sat 3 Nov 2018
Posts: 192, Visits: 5,220
-----------------------------------------------------------------------------
>>     Unhandled Error occurred in Page:https://www.mtmc.co.uk/Admin/_GenerateFeeds.aspx
-----------------------------------------------------------------------------
>>     09/08/2011 12:18:03
>>     URL:https://www.mtmc.co.uk/Admin/_GenerateFeeds.aspx
>>     DESCRIPTION:
System.Web.HttpException: Request timed out.

==================================================


hope this helps
Thu 9 Feb 2012 by Neil
Mohammad
 Posted Tue 9 Aug 2011
Kartris Expert

Kartris Expert - (70,207 reputation)Kartris Expert - (70,207 reputation)Kartris Expert - (70,207 reputation)Kartris Expert - (70,207 reputation)Kartris Expert - (70,207 reputation)Kartris Expert - (70,207 reputation)Kartris Expert - (70,207 reputation)Kartris Expert - (70,207 reputation)Kartris Expert - (70,207 reputation)

Group: Administrators
Last Active: Sun 27 Sep 2015
Posts: 115, Visits: 706
Yeah it seems an IIS one. The default timeout is 90 seconds by default.

You can copy the attached web.config file to the "Admin" folder, it will replace the machine.config execution timeout to 10 minutes.
If its still timed out, try to increase the value inside this file.

Copying this file, will restart your website, so try to copy it at a time where the site is not too busy.

Please make sure not to replace the existing "web.config", this one should be in the "Admin" folder.
 Web.zip (1 view, 439 bytes)
Wed 10 Aug 2011 by Mohammad
Neil
 Posted Wed 10 Aug 2011
Supreme Being

Supreme Being - (109,853 reputation)Supreme Being - (109,853 reputation)Supreme Being - (109,853 reputation)Supreme Being - (109,853 reputation)Supreme Being - (109,853 reputation)Supreme Being - (109,853 reputation)Supreme Being - (109,853 reputation)Supreme Being - (109,853 reputation)Supreme Being - (109,853 reputation)

Group: Forum Members
Last Active: Sat 3 Nov 2018
Posts: 192, Visits: 5,220
Great, thank you Mohammad, it works great. It seems to take around 3 minutes to generate the file.
Neil
 Posted Fri 12 Aug 2011
Supreme Being

Supreme Being - (109,853 reputation)Supreme Being - (109,853 reputation)Supreme Being - (109,853 reputation)Supreme Being - (109,853 reputation)Supreme Being - (109,853 reputation)Supreme Being - (109,853 reputation)Supreme Being - (109,853 reputation)Supreme Being - (109,853 reputation)Supreme Being - (109,853 reputation)

Group: Forum Members
Last Active: Sat 3 Nov 2018
Posts: 192, Visits: 5,220
Google seems to be complaining about our feed...

URLs not followedWhen we tested a sample of URLs from your Sitemap, we found that some URLs redirect to other locations. We recommend that your Sitemap contain URLs that point to the final destination (the redirect target) instead of redirecting to another URL.


They use the following URL as an example



Could this be related to the SSL? Should the sitemap really be listing http not https?

edit:

After looking at the actual feed it appears to be creating the URL incorrectly anyway

<url>
   <loc>https:www.mtmc.co.uk/Contact.aspx</loc>
   <priority>0.5</priority>
   <changefreq>weekly</changefreq>
</url>


I will do a find/replace in a text editor to fix https:www to http://www
Fri 12 Aug 2011 by Neil
Mart
 Posted Fri 12 Aug 2011
Top Banana

Top Banana - (84,855 reputation)Top Banana - (84,855 reputation)Top Banana - (84,855 reputation)Top Banana - (84,855 reputation)Top Banana - (84,855 reputation)Top Banana - (84,855 reputation)Top Banana - (84,855 reputation)Top Banana - (84,855 reputation)Top Banana - (84,855 reputation)

Group: Administrators
Last Active: Wed 18 Nov 2020
Posts: 148, Visits: 3,450
Also make sure google indexes your site map at https if the links in it use that. A site map can't contain links that are on another domain or subdomain. I'm not sure if that extends to SSL to - ie that a sitemap indexed on http shouldn't contain links to https pages.
Mohammad
 Posted Fri 12 Aug 2011
Kartris Expert

Kartris Expert - (70,207 reputation)Kartris Expert - (70,207 reputation)Kartris Expert - (70,207 reputation)Kartris Expert - (70,207 reputation)Kartris Expert - (70,207 reputation)Kartris Expert - (70,207 reputation)Kartris Expert - (70,207 reputation)Kartris Expert - (70,207 reputation)Kartris Expert - (70,207 reputation)

Group: Administrators
Last Active: Sun 27 Sep 2015
Posts: 115, Visits: 706
Yeah, looks like the SSL is the 1st suspect; in kartris "https" is allowed only for back-end users (in back & front ends) and for logged-in customers, which means if you try to use the below "https" link (without logging in as customer or back-end user), it will redirect you to the "http" copy of the page.
https://www.mtmc.co.uk/Bosch-400-WATT-SERIE-/-0607461208-Spare-Parts__p-47732.aspx

But if you tried the same above in http, it stays in the same page:
http://www.mtmc.co.uk/Bosch-400-WATT-SERIE-/-0607461208-Spare-Parts__p-47732.aspx
Neil
 Posted Sat 13 Aug 2011
Supreme Being

Supreme Being - (109,853 reputation)Supreme Being - (109,853 reputation)Supreme Being - (109,853 reputation)Supreme Being - (109,853 reputation)Supreme Being - (109,853 reputation)Supreme Being - (109,853 reputation)Supreme Being - (109,853 reputation)Supreme Being - (109,853 reputation)Supreme Being - (109,853 reputation)

Group: Forum Members
Last Active: Sat 3 Nov 2018
Posts: 192, Visits: 5,220
Yeah, looks like the SSL is the 1st suspect; in kartris "https" is allowed only for back-end users (in back & front ends) and for logged-in customers, which means if you try to use the below "https" link (without logging in as customer or back-end user), it will redirect you to the "http" copy of the page.


Yes this is the problem I think.

The backend script is generating the URLs to be https when they should be http.
Mohammad
 Posted Sat 13 Aug 2011
Kartris Expert

Kartris Expert - (70,207 reputation)Kartris Expert - (70,207 reputation)Kartris Expert - (70,207 reputation)Kartris Expert - (70,207 reputation)Kartris Expert - (70,207 reputation)Kartris Expert - (70,207 reputation)Kartris Expert - (70,207 reputation)Kartris Expert - (70,207 reputation)Kartris Expert - (70,207 reputation)

Group: Administrators
Last Active: Sun 27 Sep 2015
Posts: 115, Visits: 706
Will fix that in the next release.

Similar Topics

Expand / Collapse

Reading This Topic

Expand / Collapse

Back To Top