Jeremy, Great work. So the data extraction is possible. My test of export google groups did also generate an MBOX file.
I will follow your steps eventually to see what the tiddlywiki results looks like. Once in tiddler form, that is when my skills can click in to see how we can engineer a useful resource, to then "mine the history" for useful information. However If you have the opportunity to do a fresh export from the GG, convert to tiddlywiki and share (Privately fine), perhaps via a cloud share, I can look into this further, perhaps at least a historical wiki if we abandon GG. I imagine we may be able to strip previous replies content lower down in the email to reduce the size substantially. I am interested in how searchable the result will be, how we can curate and extract meaningful information, if re-export to other tools becomes possible etc... As usual I expect ultimately we will need a hosted wiki, possibly on node/bob so we can use lazy loading and multi-user/access models unless other solutions are on the horizon? Regards Tones On Wednesday, 2 June 2021 at 19:03:17 UTC+10 Jeremy Ruston wrote: > I was just reviewing the concept of exit strategy. I am running a test on > a group I own. Google permits you to export most information they hold for > you and this seems to include ALL mail in a google group. It would most > likely be "big data" but it can be done it seems. Then with this available > it may be possible to algorithmically or crowd source curation of the data > for the backbone of a new solution. The key issue is separating content > inside emails, such as with reply and forwarding where a whole or part of > the conversation accrues in the text of each email but it is not > insurmountable. It may also be possible to get something out of the mail > archive. > > I am not pretending this is easy, and a concerted effort and project would > need to be mounted. > > > The way I have approached this is to use my email client to copy all the > TiddlyWiki Google Groups messages to a new “mbox” file, and then use a > little tool I wrote a couple of years ago to convert the “mbox” file into > tiddlers (most email clients apart from Outlook store messages in mbox > files). > > https://github.com/Jermolene/mbox-to-tiddlers > > A wiki I made in July 2019 with all the messages thus far to the main > TiddlyWiki group is 17.7MB, and contains just under 7,000 tiddlers. > > Best wishes > > Jeremy. > -- You received this message because you are subscribed to the Google Groups "TiddlyWiki" group. To unsubscribe from this group and stop receiving emails from it, send an email to tiddlywiki+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/tiddlywiki/10b07271-0989-4019-9d92-c0284a655ba9n%40googlegroups.com.
