How to batch insert new tiddler into TiddlyWiki?

papiche · May 9, 2022, 12:48am

Hi,

I would like to build a common TW made from multiple TW sources.
Every user is a publisher, then a moderator extract interesting content to centralize them on a “central” common TW

For now “admin” uses manual export / import function,

Using diff, it is possible to see and extract changes…
Anyone knows any "sed / grep / jq bash command to insert tiddlers in batch mode?

Thanks for your help

papiche · May 9, 2022, 1:10am

It seems I found a solution…
https://tiddlywiki.com/dev/#Data%20Storage%20in%20Single%20File%20TiddlyWiki

<script class="tiddlywiki-tiddler-store" type="application/json">[
{"created":"20210525212411223","text":"This is some test text","tags":"[[test tag]] [[another tag]]","title":"My new tiddler to insert","modified":"20210525212430577"}
]</script>
<!doctype html>
...

I am still interesting in getting contact with any advance user here.

linonetwo · May 9, 2022, 9:21am

Hi, you can see how Links and CPL works, especially their github repo.

Basic idea is downloading other tiddlywiki’s HTML

github.com

tiddly-gittly/TiddlyWiki-CPL/blob/7cc3b9e7dbfac251e0076c3faadccfe64b56022a/scripts/index.js#L243

    
      
          // https://mklauber.github.io/tw5-plugins/library/index.html
          function _importLibrary(uri) {
            let distDir = "dist/library";
            const tmp = uri.split("/");
            tmp.pop();
            const baseUri = tmp.join("/");
          
          
  try {
              // 下载JSON文件，包含插件的信息
              shellI(
                `wget '${baseUri}'/recipes/library/tiddlers.json -O ${distDir}/tmp/tiddlers.json`
              );
              let pluginsJson = fs.readFileSync(`${distDir}/tmp/tiddlers.json`, "utf-8");
              pluginsJson = JSON.parse(pluginsJson);
              pluginsJson.forEach((plugin) => {
                if ("title" in plugin) {
                  _importPlugin(
                    `${baseUri}/recipes/library/tiddlers/${encodeURIComponent(
                      encodeURIComponent(plugin.title)
                    )}.json`,
                    plugin.title

And import the content to a local wiki, and publish that wiki. And this happened in the github action every 1 hour. The links site may use slightly different but similar approach, because the CPL site is learnt from the links site.

amreus · May 9, 2022, 11:37am

The answers depend on how the users are using TW. Single-file or server? How are the users saving their wikis? Are the wikis stored in a central location or distributed on the network?