Maybe this can help: Introducing the debug-log[] filter
1 Like
I just think with a consistent wikitext language and a small core (as database), every one can programming with TiddlyWiki. And user only need to validate, AI will do the programming part. Just need to make sure user can debug what AI write.
Database in TiddlyWiki is already there, don’t need to “create database”, but you are right about creating interface for that database. But I believe that will be automated soon.
3 Likes
I am using TW for business and private purpose in so many different use cases.
Now I am at a point that the inconsistency is blocking me more than helping.
The next days I will try to move to MWS and hope that the usage of SQLITE will help me to solve the projects I have in my pipeline.
The future? I really hope that there will be a clear break, may be in version 6, to leave everything behind of old and backwards combability. Yes, my expectation is to have a tool what will highlight all the incombability to help me to solve them but not more.
More and more I realize in all my applications that I need a server based solution more than a local single file solution. So I really hope that in the future TW will also offer an out of the box edition for a raspberry pi. And if I write our of the box than really an edition what is doing nothing else the TW. Download it to the sd card, plug it in the raspberry pi connect it to my router, start it and I can use it. We all have at home enough bandwidth.
And finally, I fully agree with @linonetwo . The future will have more AI interfaces. The searching line will be more and more also the line to order TW to write code. Something like: "Get the first chapter of tiddler A, make a table of all fields of tiddlers with tag abc, sort them descending by field name and filter only … and so on.
Unfortunately I cannot support here in writing code but if you need test results from the field I can support.
1 Like
I think there is a great discrepancy between what TW per se can do in the hands of intermediately-to-highly technical users and how accessible and practical it is to a non-technical user.
I wish we had a hosting service on-par with competition, which would: be easy to set up, accessible over web without installing software/extensions, handle many/large attachments, be encrypted/private by default, have granular sharing options, reliable backups, ability to move between online/offline use. None of the currently available solutions for TW has it all (to be honest, neither does its competition, afaik).
This would go well with a compatible reasonable local way of hosting/saving. TiddlyDesktop seems a big burden to maintain, producing drawbacks of using TW not-though-a-browser, while not really offering much benefit.
Another point is UI/UX. On desktop, one would wish a lot more were possible with keyboard shortcuts. On small and touch screens, TW looses a lot of its usability – workarounds like Notebook theme make it a bit better, but e.g. drag-and-drop reordering of tags is out of reach.
There are surely many other similar things, e.g. WYSIWYG or syntax highlighting/suggesting editor, as already mentioned by @Ittayd.
My main point is, making TW great in itself, and improving it, in “lab conditions” is just as important as “delivering it”: making sure it can be used by non-tech users, on any device, to its whole potential, without worrying about the technical side of saving/backups/attachment sync.
3 Likes
On macOS TiddlyDesktop is a superb tool for managing files and projects, doing what TW in a browser cannot. There are tools to improve the macOS Finder, like PathFinder which I used for several years; but the TW/TiddlyDesktop combination is far superior.
3 Likes
I stand corrected about usefulness of TD then, I didn’t realize it could be useful this way. I hope my main point is understandable nevertheless.
Also, if you have a problem with JS, there are tons of resources. But almost none for TW. Also, parts of TW still lag behind JS. In particular, the filter operators for dates are almost non-existent. The further you live away from Greenwich time, the more you notice this.
I was prompted to take a look back at TiddlyWikiClassic to remember your motivations to launch TW5. Surprisingly I find its still well maintained site with tiiddlers being added even today. So a few points come to my mind:
- Break compatibility if you feel you must (and looking at some commenst so far I think you may need to). Others will bridge the gap by maintaining TW5 as they have TWC.
- That said - maybe add some focus at the conversion or plugins needed to consolidate content into the new TWX. Your community of supporters may be split into these different dialects and hence not giving you the scale of a single community needed to keep driving forward as easily.
- Some analytics for knowing what features are being used and how big your community is may be helpful in driving conversion funcion priorities and keeping the core lightweight (i.e what might be better moved to plugin libraries)
- As with TWC - I think others will step into maintaining each project you mentioned if you want to step back from ‘so many fronts’ (which is understandable) … However, what is needed most from you is a vision for what those projects are and what the goals of TWX is.
- Just to be controversial - would you start to commercialise an application while still providing a free/open source tier… Looking briefly at Obsidian - it seems like far less flexible in the markup (e.g. no widgets) and plugins (only via javascript). Is this maybe a MVP for a free version ?
- I remember at TW5 launch - JQuery was a inspring new tech that helped shape the direction… Now we have more tech like React, JSX ( which could help inspire how to simplify syntax IMHO) and aybe help with building desktop and mobile apps.
3 Likes
I think it worthwhile to update the javascript dialect used by the core, so that we can replace some obsolete code and implement features like regex sticky flag. For backward capability, we had better drop support IE in v5.4.0.
… yes! to all that @Bob_Jansen says, especially about Apple HyperCard (and before that, Xerox PARC NoteCards) … and yes! to all that @jeremyruston and everyone else says!
… and from a user-not-developer TiddlyWiki viewpoint (my personal perspective), it might be valuable to gather and share simple “User Stories” to help inspire bits of the future TWX – e.g.:
- “As a writer, I want to create a new deck of cards with links between them, so that i can organize and share a network of ideas with my readers.”
- “As a reader, I want to search for cards that mention specific items, so that I can find answers to my questions.”
- “As a collaborator, I want to add comments and pictures and links to pre-existing decks of cards, so that I can enhance the value of those decks.”
- “As a novice-level developer, I want to add simple automated features to pre-existing decks of cards, so that I can perform well-defined boring mechanical repetitive actions (such as jumping to a random card with certain characteristics, or counting how many cards have certain characteristics).”
etc, etc – all super-obvious stuff to developers, and all “magical powers” to 99% of the future TiddlyWiki user base! 
3 Likes
As an ordinary user, I hope that the editing functions can be enhanced. Currently, most note-taking software is evolving towards being more like an editor, allowing users to start editing notes immediately upon opening the software. However, when we open TiddlyWiki, we still need to click the edit button to enter the editing mode. Don’t think that just one extra step doesn’t matter; it can actually be quite annoying. In other words, TiddlyWiki might need to consider this aspect. Because this could potentially be the real issue that breaks TiddlyWiki’s backward compatibility.
Another feature I’m looking forward to is that when we can directly start editing as soon as we open TiddlyWiki, we should be able to write our wikitext, especially macro code, in the editing area, and then have the corresponding functions generated automatically. Just like what Obsidian does now, when you use # followed by some content, you can create a tag, and then a tag button will be generated. When you click on this content, a search interface will pop up immediately, showing other entries that have this tag. I don’t mean that we have to replicate this exact feature. In fact, it’s not difficult to implement such a function with a macro. The challenge lies in achieving this effect within the editing area. In other words, we need a more hybrid editing approach, a way that incorporates the presentation of interface content into the editing process. I think this is why outline note-taking software like logseq or others are becoming popular.
There is also another aspect: we can further reduce the user’s learning cost. No one doubts the power of TiddlyWiki, but its learning cost is really too high, which makes it difficult for other users to stay with it. Using TiddlyWiki is like entering a high-level school for these users. They go through a lot of hardship, learn some skills, and finally leave for other products to shine. I think this is rather strange.
An important aspect of improving the editing method is to optimize the long-form content editing experience. I understand that the product concept of TiddlyWiki is to write content as a combination of different notes. But there is still a wide demand for writing long articles. Currently, I don’t use TiddlyWiki to write long articles. The article I posted on the forum last time was written using Siyuan Notes, not TiddlyWiki.
3 Likes
@dongrentianyu’s comments on writing chunks of text took me back to my AI research days . I got a wonderful book,
Mapping Hypertext: analysis, linkage and display of knowledge for the next generation of on-line text and graphics by Robert Horn from the Lexington Institute, 1989.
The book is written as a hypertext, pages and pages of chunks of text and graphics, all hyperlinked by textual links to other chunks of stuff.
Completely unreadable!
Random access a chunk and follow links, OK, but ‘reading’ as we know it, a waste of time. You get lost in hyperspace very quickly. The undoubted knowledge embedded in the content is scrambled and gets lost very quickly.
TW suffers from this as well as you can see by trying to find stuff in the documentation except the authors have tried very hard to organise the content to varying degrees of success.
Got the book out of my bookshelf today and openened it again to a wonderful world of reminiscing.
If we are anticipating a new version of TW, it might pay the designers to have a look at this book. IT does contain lost of useful snippets related to writing and structuring content, ways that might for a basis for content organisation facilities in the new version.
Still available, seemingly, from Amazon, $461
bobj
Internet Archive has a version available for browsing here: https://archive.org/details/mappinghypertext0000horn
Looks interesting, I’ll give it a look.
TWX in 2036
I rediscovered TiddlyWiki back in December while looking for a platform or framework to make simple data-driven applications. I am in love with it. It meets almost all my needs. If we are thinking about TWX in only 11 years, here’s what I would want to see:
- Better handling of structured data: I am planning to spend some time with MWS and its SQLite backend. I would love to have SQLite power accessible if possible, either a core function of the framework or via a plugin. That could remove the need for data tiddlers, which @jeremyruston is on record saying were probably a bad idea.
- Simplify metaphors: mentioned above, there is some cruft around procedures and macros that can be a little confusing. Simplify the fundamental data types and components of the framework as much as possible.
- Better support for collaboration and external media: MWS is promising and I hope the ideas being tested there are part of TWX. I also saw a thread about embedding external media playback with annotation. I think that’s extremely powerful and would love to see that as a first-class feature
All in all, if TWX never comes to be I’m very happy with what TW5 provides. Here’s to another 25 years!
If we’re talking about breaking compatibility, then the first suggestion from me is either shifting to Markdown as the default markup language, or adding support for Markdown as an fully functional alternative to WikiText.
1 Like
I think this is a topic where TW’s flexibility is both a boon and a bane; which user-base should the future be geared towards?
Developers, from what I can glean as a non-programmer, want something that is more similar to other software solutions.
Product Users who want a mostly ready to use product would benefit from a more modern UI and a little more “linearity” but I think the problem with both is that they can mean different things to different users.
Tinkerers are the most likely to roll with TW’s quirks regardless. My biased view as a tinkerer is that this is the only tool that exists for those without full on developer skills but are still interested in building and not just using, so keeping things open to non-developers is important.
I was alive in the 90’s when the internet came about and remember the chatter about what it could be used for, and then seeing what it turned out to be. I hear the chatter about AI now and I see how the early usage by the general public (non-tech people) is already veering from what the tech people think AI is going to be used like. Your average person isn’t going to be integrating AI with TW for their needs, they’re going to grab a premade fully finished product, possibly one made with TW, but at that point the tinkering and flexibility of TW isn’t what they were looking for in the first place.
My day job is in metal fabrication. I work with everything from modern machining to processes that are fundamentally the same as they were when discovered in The Bronze Age. Even as a non-programmer, I can see that AI in programming is yet another tool and not a means to an end.
Your average person can’t be bothered to run a home 3D printer despite technology being as cheap and easy as it is nowadays, but they will use Amazon Alexa to do shopping. They’re not going to bother with AI beyond finished consumer applications. I think hypothesizing about that potential user-base to attract misses the point of what makes TW unique.
7 Likes
100% agreed to this.
My first TW usage was 2009 with TW Classic, and the doubleclick-to-edit made for a very low barrier (at the time) to move between reading/editing.
In the last few years, my note taking has mainly been in tomboy/gnote, which does as you describe - provide a richly formatted visual output in the window which is editable at any time. There is no distinction between a reading and editing mode.
Returning to TW in the last year and picking up TW5, the loss of doubleclick-to-edit I was originally disappointed with, though there is a plugin which implements it and I’ve only set it on one of the several TW I have. The problem being that sometimes I want to doubleclick-to-select, so adds frustration in another direction. (“doubleclick = edit only if no text is selected” is an idea I’ve thought of, but I need to learn JS coding before seeing if I can tweak the existing for that)
Anyway, for my taste, tomboy/gnote style “the viewer IS the editor at all times” distinction would be wonderful - and keep a dedicated “edit the markup directly” mode for the power user gurus who want to get their hands that little bit dirtier!
(I do think an always-an-editor mode needs a more powerful undo/view-old-revisions history though, since the chance of accidentally “I typed in the wrong window and didn’t realise it till later” is much higher. I use TW via node so I get tiddlers as individual files, and shovel the whole thing into local git, but a more integrated solution would be great (and indeed, some of David Bovill’s demonstration (on the "Hitchhikers TiddlyWiki All-Nighter) of running local shell code via TW feels like a potential great step in that direction)
1 Like
That’s how my TWs work, for the most part.
Edit your tiddlers through another tiddler[1] – call it your “master editor”. Let it navigate through your tiddlers, selecting them for editing. Viewing them in the story, they update “live” as you type in your editor.
Whoever it was that said, “the only limit is your imagination,” was dead right. Stop looking at the way TW is presented on tiddlywiki .com as “the only way”. TW is not hardware – it was built to be modified. TiddlyWiki puts the soft back in software.
[1] Take great care modifying macros and css live. And by "great care" I mean don't do it.
1 Like
Correct me if I’m wrong, but what you describe sounds like the editor is still separate to the display though, but instead of needing a preview pane to the editor, the edits are reflected live instantly? It definitely sounds neat and I’m interested to know how you did that, but it’s not what I imagine as the ideal.
Many of the comments here make good points. Things I’d like to see TiddlyWiki improve on going forward:
- Live WYSIWIG editing like @linonetwo’s slate-write. This is “table stakes” for apps in this category today.
- A more official shared / community plugin repository system. The TiddlyWiki plugin repository could point to CPL, Relink, Kookma, Fibbles, EvidentlyCube, etc. - the plugin repositories that contain so many handy utilities. Maybe some of these could become “Recommended” by the core (Relink or TW-Commander, for instance).
- Document and extend the
tiddlywikicommand line interface. Give examples, and simplify common operations (for example, rendering a tiddler or filter for a single-line wiki should be as simple astiddlywiki my_wiki.html --render "Index"and write tostdout).- Blur the line between single file and NodeJS wikis. It’d be great if I could trivially “explode” a single file wiki, edit the files, and then “implode” it back.
I’d also like many of the features that have open PRs - dark mode customization, AI integration, AST node serialization - to land, but I know that this takes time.
To import a single file wiki into a NodeJS one, you can do
$ tiddlywiki newwiki --load path/to/file.html
It works even if the single file wiki is password protected:
$ tiddlywiki newwiki --password 123 --load path/to/file.html
I have created an older thread regarding this months ago, expressing my concern that this leaves the plain text password in the shell history file though.
To export it back, after editing the files, you can do
$ tiddlywiki newwiki --build index
Am I misunderstanding this part and you mean something else?