DNN Forums

Ask questions about your website to get help learning DNN and help resolve issues.

Export website content (Api)

 3 Replies
 2 Subscribed to this topic
 30 Subscribed to this forum
Sort:
Author
Messages
Advanced Member
Posts: 249
Advanced Member
2 Helpful Replier
Helpful Replier
Thanks for being such a helpful replier!
New Poster
New Poster
Congrats on posting!
3 Engaged Reader
Engaged Reader
You are an engaged reader!

We need to export all website content to a datalake solution.

What's the best practice... API?  Some did this before?

Veteran Member
Posts: 838
Veteran Member
3 Helpful Replier
Helpful Replier
Thanks for being such a helpful replier!
New Poster
New Poster
Congrats on posting!

My advice: don't do it. Leave content that needs managing in a CMS. Content is not data. 

I have had several migrations to a headless cms and it just doesn't make sense if it is just to store content. You want publish dates, versions, urls, authors. workflows. images etc etc. Content is always in context and the editor or comunication professional wants to have control over the way the content is delivered.

Only developers have a mind set where storing content in a data lake makes sense. Not meaning to be offensive here but it is a different profession with a different view.

DNN is basically a decoupled CMS that allows for reuse as well but with all the features you want as a content manager.

Advanced Member
Posts: 208
Advanced Member
Helpful Replier
Helpful Replier
Thanks for being such a helpful replier!
MVP
MVP
You're an MVP!
New Poster
New Poster
Congrats on posting!
I agree with Tycho. But there is always the exception, a sensible reason for using a datalake is to store data gathered by DNN, (logs or data forms or admin data, etc..) And move that to the datalake. It's then the datalake systems job to interpret the data and give sensible results that can be used for all kinds of data reporting.

My thought would be to use an API, leave the data in DNN and copy the required data to the datalake. Maybe the logs could move directly into an API in real time, by having a module created to do this. I use our bespoke modules to connect to the AWS API with our backups and data storage everyday, I presume a datalake will be much the same.

My feeling on datalakes are that they are nothing new, the concept has existed way before "datalake" name was attached to it. However, the big change is the way the data can now be interrogated by the AI tools that have been developed over the last few years. How much of an advantage that is for the company, is a matter of debate, but if the budget is there, why not try.

Senior Member
Posts: 1607
Senior Member
MVP
MVP
You're an MVP!
New Poster
New Poster
Congrats on posting!
If copying the data into another data storage solution, then I'd suggest creating and maintaining forked providers for those specific features (e.g., SqlDataProvider and or DBLoggingProvider. Some people might take the "easier" or "obvious" solution of using database triggers or something instead. There are many downsides to that. This is especially true in environments where there isn't a formal DBA on staff and maintaining the database/data storage.

These Forums are for the discussion of the open source CMS DNN platform and ecosystem.

For the benefit of the community and to protect the integrity of the ecosystem, please observe the following posting guidelines:

  1. If you have (suspected) security issues, please DO NOT post them in the forums but instead follow the official DNN security policy
  2. No Advertising. This includes the promotion of commercial and non-commercial products or services which are not directly related to DNN.
  3. No vendor trolling / poaching. If someone posts about a vendor issue, allow the vendor or other customers to respond. Any post that looks like trolling / poaching will be removed.
  4. Discussion or promotion of DNN Platform product releases under a different brand name are strictly prohibited.
  5. No Flaming or Trolling.
  6. No Profanity, Racism, or Prejudice.
  7. Site Moderators have the final word on approving / removing a thread or post or comment.
  8. English language posting only, please.

Would you like to help us?

Awesome! Simply post in the forums using the link below and we'll get you started.

Get Involved