Performance when TW5 has lots of data tiddlers

I understand there are already lots of discussion about performance of TiddlyWIKI, e.g.

My personal TW has around 10K tiddlers without any performance problem at this stage. My setup is TW 5.3.3 with node.js under Windows 11.

I am starting to use echarts to visualise my data in TW and concerning about the performance in the near future. The data are much bigger than pure text tiddlers and increasing very quick.

For example, a simple visualisation of historical selected agricultural commodities takes 500 KB in text/vnd.tiddlywiki format. Shortly, it will be a problem if I visualise more data.

What should I plan now? For example

  • Store data in echarts data in application/json.
  • Lazy-load all tiddlers or just data tiddlers (i.e. application/json).
  • A separate Tiddlywiki instance or server only for data.

Thanks for any advices.

application/json will not lazy load, at least I couldn’t manage to make that work. I save all my echart data tiddlers as text/vnd.tiddlywiki to utilize lazy load.

This did require me to rollback to echart v0.0.9 to get it working properly. Still an outstanding issue: LazyLoad chartdata with <$echarts $text={{LazyLoadExampleOfTextData}}/> · Issue #84 · tiddly-gittly/tw-echarts · GitHub

2 Likes

Thanks for your suggestions