DNN Forums

Ask questions about your website to get help learning DNN and help resolve issues.

Big Sitemap.aspx and time out when loading for DNN 9.7.0

Sort:
You are not authorized to post a reply.





Growing Member





    I got this error when I want to load sitemap.aspx because I have very big sitemap, about 5000 pages.

    What is DNN method to make separate smaller xml site map?

    I got Request timed out error because I have about 5000 URL in my sitemap and DNN 9.7.0 could not handle big websites sitemaps. how can I fix this issue?

    you can see this address:

    https://2020.shaghayegh2.com/sitemap.aspx

    Server Error in '/' Application.


    Request timed out.

    Description: An unhandled exception occurred during the execution of the current web request. Please review the stack trace for more information about the error and where it originated in the code.

    Exception Details: System.Web.HttpException: Request timed out.

    Source Error:

     

    An unhandled exception was generated during the execution of the current web request. Information regarding the origin and location of the exception can be identified using the exception stack trace below.


    Stack Trace:
     

    
    [HttpException (0x80004005): Request timed out.]
    

     


    Version Information: Microsoft .NET Framework Version:4.0.30319; ASP.NET Version:4.8.4261.0

    E-Commerce Brokers Website Design and Ecommerce Solution Best Regards
    Armin Rahimian

    E-Commerce Brokers
    DNN Services in Middle East
    https://www.ecb.ir





    Veteran Member





      DNN should be able to handle large websites and therefore large sitemaps. I never encountered issues with that.

      First thing that I notice: you have a special character language, maybe the sitemap provider is not coping well with that? If possible you can easily check that with other sites in that language, see how that works. If not, please submit an issue on github.

      Second: On page level you can set a page to not be in the sitemap. What would be worth a shot is to create an SQL query that sets certain area's of the structure to be not in the sitemap. That way you can check if a 100 or a 1000 or 2000 pages is the max. Or if it is a certain area where a malicious page is creating the issue. 

      Tjep's digital agencyRegards,
      Tycho de Waard

      Tjep's digital agency
      We just love DNN
      https://www.tjeps.com





      Veteran Member





        Posted By Tycho de Waard (SU) on 03 Nov 2020 03:31 AM

        DNN should be able to handle large websites and therefore large sitemaps. I never encountered issues with that.

        First thing that I notice: you have a special character language, maybe the sitemap provider is not coping well with that? If possible you can easily check that with other sites in that language, see how that works. If not, please submit an issue on github.

        Second: On page level you can set a page to not be in the sitemap. What would be worth a shot is to create an SQL query that sets certain area's of the structure to be not in the sitemap. That way you can check if a 100 or a 1000 or 2000 pages is the max. Or if it is a certain area where a malicious page is creating the issue. 

        I agree, normally 5000 pages should not be a problem.
        Also the sitemap is cached quite heavily to avoid performance issues, so I think it's another problem.

         






        Growing Member





          Thanks for answering dear Tycho

          I have had this problem before.I have had this problem 3 years ago for simillar online store website. This happened when the number of pages increased.

          To solve this problem, we had to do an extra programming that we couldTo solve this problem, we had to do an extra programming that we could Put every 1000 pages in a file and then call those files in the sitemap. put every 1000 pages in a separate xml file and then call those files in the sitemap.aspx and we fix this issue manualy. you can see this on https://www.bazaryab.com/sitemap.aspx:

          This XML file does not appear to have any style information associated with it. The document tree is shown below.


          https://www.bazaryab.com/Sitemap.aspx?i=1
          2020-11-03


          https://www.bazaryab.com/Sitemap.aspx?i=2
          2020-11-03


          https://www.bazaryab.com/Sitemap.aspx?i=3
          2020-11-03

          I think DNN couldn't handle correctly large sitemap files. there is no method to make separate file.

          If you check very big website like amazon or .... all do same method to handle big xml files. I think dnn should be add this separator method in sitemap.aspx core system.

          E-Commerce Brokers Website Design and Ecommerce Solution Best Regards
          Armin Rahimian

          E-Commerce Brokers
          DNN Services in Middle East
          https://www.ecb.ir





          Veteran Member





            Would you be so kind to log your request as an issue on Github? That way we can triage the issue and see if it is indeed DNN related.
            Tjep's digital agencyRegards,
            Tycho de Waard

            Tjep's digital agency
            We just love DNN
            https://www.tjeps.com





            Growing Member





              Posted By Tycho de Waard (SU) on 03 Nov 2020 06:01 AM
              Would you be so kind to log your request as an issue on Github? That way we can triage the issue and see if it is indeed DNN related.

              Sure Mr. Tycho

              Thanks

               

               

              E-Commerce Brokers Website Design and Ecommerce Solution Best Regards
              Armin Rahimian

              E-Commerce Brokers
              DNN Services in Middle East
              https://www.ecb.ir
              You are not authorized to post a reply.

              These Forums are dedicated to the discussion of DNN Platform.

              For the benefit of the community and to protect the integrity of the ecosystem, please observe the following posting guidelines:

              1. If you have (suspected) security issues, please DO NOT post them in the forums but instead follow the official DNN security policy
              2. No Advertising. This includes the promotion of commercial and non-commercial products or services which are not directly related to DNN.
              3. No vendor trolling / poaching. If someone posts about a vendor issue, allow the vendor or other customers to respond. Any post that looks like trolling / poaching will be removed.
              4. Discussion or promotion of DNN Platform product releases under a different brand name are strictly prohibited.
              5. No Flaming or Trolling.
              6. No Profanity, Racism, or Prejudice.
              7. Site Moderators have the final word on approving / removing a thread or post or comment.
              8. English language posting only, please.

              Would you like to help us?

              Awesome! Simply post in the forums using the link below and we'll get you started.

              Get Involved