Re: [tw] Building a scraper service for TW5
Ok, Andreas, I *may* support Xpath, just not now yet. On Thursday, January 18, 2018 at 11:06:59 PM UTC+3, Andreas Hahn wrote: > > Hi Abraham, > > that sounds pretty interesting, I've had some thoughts about that in the > past too, but I've never tried to do it. Are you (planning on) using the > Browser messaging mechanism that plugin libraries also use to inject the > scraped tiddlers into the TW? Will the scraping support XPATH requests? > (that would be really cool) > > I look forward to your finished version, I'd definitely use it. > > /Andreas > -- You received this message because you are subscribed to the Google Groups "TiddlyWiki" group. To unsubscribe from this group and stop receiving emails from it, send an email to tiddlywiki+unsubscr...@googlegroups.com. To post to this group, send email to tiddlywiki@googlegroups.com. Visit this group at https://groups.google.com/group/tiddlywiki. To view this discussion on the web visit https://groups.google.com/d/msgid/tiddlywiki/e887bb31-44d6-4ef4-9dba-7da8e50332bd%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
Re: [tw] Building a scraper service for TW5
Thanks for your interest Andreas. Xpath will not be supported for now. And no, everything is parsed by the server before returning it to your wiki. No browser messaging used. Spares me of worrying about future browser vendor support ;-) Another reason for this design choice is: 1. You can possibly do bulk scraping operations across the web (the server will do most of the hardwork for you) 2. Simplicity (just drop the url that points to the resource to scrape) 3. Accessible to mobile phones because not everyone uses Firefox for mobile phones. So no add-ons there. On Thursday, January 18, 2018 at 11:06:59 PM UTC+3, Andreas Hahn wrote: > > Hi Abraham, > > that sounds pretty interesting, I've had some thoughts about that in the > past too, but I've never tried to do it. Are you (planning on) using the > Browser messaging mechanism that plugin libraries also use to inject the > scraped tiddlers into the TW? Will the scraping support XPATH requests? > (that would be really cool) > > I look forward to your finished version, I'd definitely use it. > > /Andreas > -- You received this message because you are subscribed to the Google Groups "TiddlyWiki" group. To unsubscribe from this group and stop receiving emails from it, send an email to tiddlywiki+unsubscr...@googlegroups.com. To post to this group, send email to tiddlywiki@googlegroups.com. Visit this group at https://groups.google.com/group/tiddlywiki. To view this discussion on the web visit https://groups.google.com/d/msgid/tiddlywiki/6fa3fa57-19af-410b-9ea9-a0cfc9abc5fc%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
Re: [tw] Building a scraper service for TW5
Hi Abraham, that sounds pretty interesting, I've had some thoughts about that in the past too, but I've never tried to do it. Are you (planning on) using the Browser messaging mechanism that plugin libraries also use to inject the scraped tiddlers into the TW? Will the scraping support XPATH requests? (that would be really cool) I look forward to your finished version, I'd definitely use it. /Andreas -- You received this message because you are subscribed to the Google Groups "TiddlyWiki" group. To unsubscribe from this group and stop receiving emails from it, send an email to tiddlywiki+unsubscr...@googlegroups.com. To post to this group, send email to tiddlywiki@googlegroups.com. Visit this group at https://groups.google.com/group/tiddlywiki. To view this discussion on the web visit https://groups.google.com/d/msgid/tiddlywiki/eafb6239-abac-f648-410d-4bd739a8dafd%40googlemail.com. For more options, visit https://groups.google.com/d/optout.
[tw] Building a scraper service for TW5
Hello all, Recently I have been experimenting with building an external service for scraping and converting web articles into readable versions that can be added into a tiddlywiki. For those who use Firefox's Pocket app, it is the same concept, just for TW5 instead. I believe this would benefit a lot of folks who read around a lot but find it difficult to copy and paste entire articles into TW5. The wiki becomes a kind of human-run archiving system for the web. The API works quite well. All that's left is to integrate it with TW5. I hope to share a demo with you all when it is done. Opinions and suggestions are welcomed. In the meantime, have a good one. -- You received this message because you are subscribed to the Google Groups "TiddlyWiki" group. To unsubscribe from this group and stop receiving emails from it, send an email to tiddlywiki+unsubscr...@googlegroups.com. To post to this group, send email to tiddlywiki@googlegroups.com. Visit this group at https://groups.google.com/group/tiddlywiki. To view this discussion on the web visit https://groups.google.com/d/msgid/tiddlywiki/2edfa7a9-7b34-44b5-a75c-bb4f8c53a9cf%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
