DNN Forums

Ask questions about your website to get help learning DNN and help resolve issues.
  • Search Forums
    Advanced Search
Prev
Next
Forums Using DNN Platform Administration and Configuration

Database has grown by over 1GB in a few months

 6 Replies
 1 Subscribed to this topic
 40 Subscribed to this forum
Sort:
Author
Messages
TechieMD
Growing Member
Posts: 37
Growing Member
11/12/2019 9:25 AM

My Prior PLESK backups were around 300 MB, consistently.  Now they are 1.6GB.  Host says it's due to database size, and exceptions.

 

Backup history: Before upgrade to 9.3.1 - Full site backup is 329MB

After upgrade to 9.3.1 and 3 months later, with very little changes to the site, no file uploads - Full site backup is 1.6GB

Now, today after updating to 9.4.1 a few days ago, the database itself is 1.9GB

 

How do I get rid of all those exceptions in the log?

 

In Site Settings, ADMIN LOG, there were only 522 items listed, which I cleared.

When I visit /Admin/Site-Log -- it is blank.  There is no log and there is no module to view/clear.

Joe Craig
Veteran Member
Posts: 1246
Veteran Member
MVP
MVP
You're an MVP!
11/12/2019 9:31 AM
I'd suggest taking a look at the database to see where all of that space is going.

Another place to look is portals/default/log to see if there are large files there. If so, you might want to look at the most recent file to see what is filling the log.
TechieMD
Growing Member
Posts: 37
Growing Member
11/12/2019 10:49 PM

Thanks.

Over 1GB is in my dbo.Exceptions table.  Something with Lucene.net which may be the search provider in DNN core?

How do I stop this from happening going forward?

 

 

 

   at Lucene.Net.Util.BitVector.Get(Int32 bit)
   at Lucene.Net.Index.SegmentTermDocs.ReadNoTf(Int32[] docs, Int32[] freqs, Int32 length)
   at Lucene.Net.Index.SegmentTermDocs.Read(Int32[] docs, Int32[] freqs)
   at Lucene.Net.Search.TermScorer.NextDoc()
   at Lucene.Net.Search.ConstantScoreQuery.ConstantScorer.NextDoc()
   at Lucene.Net.Search.ConjunctionScorer..ctor(Similarity similarity, Scorer[] scorers)
   at Lucene.Net.Search.BooleanScorer2.CountingConjunctionSumScorer(List`1 requiredScorers)
   at Lucene.Net.Search.BooleanScorer2.MakeCountingSumScorerSomeReq()
   at Lucene.Net.Search.BooleanScorer2.MakeCountingSumScorer()
   at Lucene.Net.Search.BooleanScorer2..ctor(Similarity similarity, Int32 minNrShouldMatch, List`1 required, List`1 prohibited, List`1 optional)
   at Lucene.Net.Search.BooleanQuery.BooleanWeight.Scorer(IndexReader reader, Boolean scoreDocsInOrder, Boolean topScorer)
   at Lucene.Net.Index.DocumentsWriter.ApplyDeletes(IndexReader reader, Int32 docIDStart)
   at Lucene.Net.Index.DocumentsWriter.ApplyDeletes(SegmentInfos infos)
   at Lucene.Net.Index.IndexWriter.ApplyDeletes()
   at Lucene.Net.Index.IndexWriter.DoFlushInternal(Boolean flushDocStores, Boolean flushDeletes)
   at Lucene.Net.Index.IndexWriter.DoFlush(Boolean flushDocStores, Boolean flushDeletes)
   at Lucene.Net.Index.IndexWriter.PrepareCommit(IDictionary`2 commitUserData)
   at Lucene.Net.Index.IndexWriter.Commit(IDictionary`2 commitUserData)
   at DotNetNuke.Services.Search.Internals.LuceneControllerImpl.Commit()
   at DotNetNuke.Services.Search.Internals.InternalSearchControllerImpl.Commit()
   at DotNetNuke.Services.Search.SearchEngineScheduler.DoWork()

TechieMD
Growing Member
Posts: 37
Growing Member
11/12/2019 11:04 PM

For my personal tracking, 
I am re-indexing content per this post https://www.dnnsoftware.c...arch-not-working-721

Of note.... when I go to Settings...Site Log, even logged in as a host.. it is blank.
Should there be a module there to view the site log?  mydomain.com/Admin/Site-Log has no modules or content...

 

Cody
Growing Member
Posts: 95
Growing Member
11/12/2019 11:07 PM

This github issue may relate

This one and this other one are two with Schedule History issues

Sabastian said this:

if you want to purge the schedule history, you should just execute
TRUNCATE TABLE {databaseOwner}[{objectQualifier}EventLog]
in BersonaBar > Settings > SQL console.

Purging Eventlog is a different task, and due to some changes in DNN 7.4, you may use my TruncateEventlog script (which does not require TurboScripts to be installed). My TurboScripts however try to provide better automated maintenance of the log tables, but require proper application of the scripts (and I am still working on the version for DNN 9.4.x)

https://github.com/dnnsof...Platform/issues/3205

Maybe this can help

TechieMD
Growing Member
Posts: 37
Growing Member
11/12/2019 11:31 PM

Thanks --

Is there no Exceptions log viewer in DNN?  Where I can clear the Exceptions log?

I logged in with SQL studio and ran "TRUNCATE TABLE [databasename].[dbo].[Exceptions]" and now the Exceptions table has 0 records.  

__________________

To identify the table as culprit in SQL Studio... Right Click on the database, Hit Reports... Standard Reports...Disk Usage by Top Tables

Sort by size

_________________

 

My dbo.ScheduleHistory is also large.. but only 5mb.  Is there a way to safely clear this within the DNN GUI?  I hate clearing with scripts that could have unintended consequences...

Cody
Growing Member
Posts: 95
Growing Member
11/13/2019 6:19 PM

https://github.com/dnnwer...runcateEventlog2.sql

This should do them all that are needed.  Thanks Sebastian!

These Forums are for the discussion of the open source CMS DNN platform and ecosystem.

For the benefit of the community and to protect the integrity of the ecosystem, please observe the following posting guidelines:

  1. If you have (suspected) security issues, please DO NOT post them in the forums but instead follow the official DNN security policy. 
  2. No Advertising. This includes the promotion of commercial and non-commercial products or services which are not directly related to DNN.
  3. No vendor trolling / poaching. If someone posts about a vendor issue, allow the vendor or other customers to respond. Any post that looks like trolling / poaching will be removed.
  4. Discussion or promotion of DNN Platform product releases under a different brand name are strictly prohibited.
  5. No Flaming or Trolling.
  6. No Profanity, Racism, or Prejudice.
  7. Site Moderators have the final word on approving / removing a thread or post or comment.
  8. English language posting only, please.

Would you like to help us?

Awesome! Simply post in the forums using the link below and we'll get you started.

Get Involved