Text search on side bar missing results

I have a Tiddlywiki 5.3.8 site under nodesjs with over than 1100 tiddlers.

When I search from the search bar on the side menu sometimes it misses positive occurrences in the presented results.

Anyone else has this issue? Any suggestions on what to check?

Thank you.

The sidebar search only looks in title, text, and tags fields, and is case sensitive.

  • Exactly what did you type into the search input field?
  • Give an example of a tiddler that you feel should have been listed in the results, but was not.

-e

tiddlywiki.com has 1,700+ tiddlers so perhaps place a few of the tiddlers you expect to come up on it and test the search over there? This should lead us to the problem, if any.

I have a backup of my Tiddlywiki main site that I loaded on a different host to test.

On the main site I search for ‘resolv’ in the search input field and got 3 results. On the backup site the exact same search returns 33 results all in the text field.

In a tiddler titled ‘VNC’ the word ‘resolv’ is in a paragraph. This is an example of a tiddler that should have been return my the search on my main site.

Thank you for the assistance.

Not sure I understand what you ask me to do. You want that I add some of my tiddlers to this site?

I guess the tests I’m doing with my backup site is a similar approach, right?

Thanks.

Testing them on tiddlywiki helps identify the issue.

Are any tiddlers becoming shadows as a result of your backup?

Testing on tiddlywiki.com is a bit different, since it probably has different plugins and settings as your wiki. If tw-com also fails to find the tiddler there is a bug in the core.

If it only fails with your wiki, it may be a additional core plugins, or 3rd party plugins that could cause the problem.

So testing with tw-com will help to find the problem. If you import tiddlers into tw-com, they will not be saved. Nothing leaves your device. Technically you import your tiddlers to a wiki in your browser. No data is sent to a server.

I understand. I’ll test on tw-com and get back with the results.

Thanks to all.

Ok, I imported a tiddler into tw-com and did the same search ‘resolv’. The imported tiddler shown in “all matches”.

So I guess this confirms the problem is with my own wiki but does this help to pinpoint the source of it?

Thanks.

So on your own wiki something is happening, perhaps to search perhaps to the tiddlers you are searching for. If you go to Advanced Search > Filter Tab > Dropdown > Overridden shadow tiddlers .

  • Except for $:/temp/advancedsearch are there other tiddlers with search in the title?
  • See if you can search for the tiddlers in advanced search that don’t appear in the sidebar.

See Customising Search results did you change something in the search?

If you are still stuck you need to follow the search process step by step, checking each related tiddler. Let me know if you cant share the wiki perhaps you can share screen and I can troubleshoot remotely.

  • Except for $:/temp/advancedsearch are there other tiddlers with search in the title?

No.

  • See if you can search for the tiddlers in advanced search that don’t appear in the sidebar.

I used the Standard tab of the advanced search (is it what you meant?) and searched for the same simple string resolv. I got the same 3 results that I get from the sidebar search.

I do have a customization to change the sort order of search, from this discussion. I removed it and test if it makes a difference and the answer is no. I even added it to my test wiki, the one that where the search works fine and it didn’t break it.

As my wiki contains some sensitive info I can’t share it but if you’re kind enough to do a screen sharing session with me I would be interested. In the interim if you have other suggestions to test please share with me.

Thank you for the help! :grinning:

That’s strange.

Can you have a second look at: Advanced Search > Filter Tab > Dropdown > Overridden shadow tiddlers and see, if there are 2 tiddlers with a similar name that modify the search dropdown.

May be an artefact of testing something?

Here is the output of

Advanced Search > Filter Tab > Dropdown > Overridden shadow tiddlers:

One more thing. I copied with a rsync command all the new/changed tiddlers from my prod wiki to my test one, restarted tiddlywiki test and the search still works fine on that one.
Command used for the copy: rsync -avrc mywiki/* Imacubuntu:docker/Tiddlywiki/mywiki/

Ahhh. Did you use rsync to make the backup? If you do that, you will need to restart the server. Otherwise it will not see new tiddlers.

I found something! :grinning:

Since this wiki has a large number of files I am using the root-tiddler=$:/core/save/lazy-all option in the systemd file to increase its initial loading, but only on the prod tw, not on the test one. This difference gave me a clue and I tested it without this option and this is positive, the search is now working fine!

That being said does anyone know a workaround that would make the search work with the lazy-all option enabled?

Thank you.

No. That’s the problem with lazy-loading. The text field is not loaded at startup. It only loads the fields.