SQLite make TidGi-Mobile faster

linonetwo · February 9, 2024, 6:20pm

I recently add a “Quick Load” feature to TidGi-Mobile (Currently v0.6.x), so my 30k tiddlers wiki can load faster.

Code is at

tiddly-gittly/TidGi-Mobile/blob/03622a0c7982fd676a95f66ed00464055b381dcb/src/pages/WikiWebView/useStreamChunksToWebView/SQLiteTiddlersReadStream.ts#L156-L161

    
      
            // First, read rows where text IS NULL with pagination, these are system tiddlers
            query = `SELECT * FROM tiddlers WHERE text IS NULL AND id > (?) LIMIT (?)`;
          } else {
            // Next, read rows from the latest rows, those are user tiddlers, only once because of QUICK_LOAD_LIMIT is small, no pagination is needed.
            // TODO: also read those are tags, so tagging system is working.
            query = `SELECT * FROM tiddlers ORDER BY id DESC LIMIT ${QUICK_LOAD_LIMIT}`;

Basic idea is only load 300 recent tiddlers (I think in scenario that I only want to open wiki on mobile and add some quick thought, even load 0 tiddlers is OK), so loading + parsing + filter runs is faster.

Normally my wiki requires 5s to load 30k tiddlers from sqlite, and 5s for filters + indexers to run. Now all just need 5s, 50% reduction. So I can use Mobile iMessage layout and agenda page layout to record things without waiting too much.

TW_Tones · February 11, 2024, 9:17pm

Interesting idea. I would think both recent and a list of nominated tiddlers such as the quick edit code tiddler would make sense.

now packaging this as a tool for users to simply configure by nominating tiddlers through a filter before save would be nice.

linonetwo · February 12, 2024, 5:30am

Yes, I found I may need a config for this, because my quick edit macros are gone in this mode…