epugh commented on PR #2479: URL: https://github.com/apache/solr/pull/2479#issuecomment-2149443128
Thanks for sharing the feedback @gerlowskija ! I think the value of the tool is only there if your second comment about being able to run a streaming expression locally is valid, and then having it do what yoru first comment highlights falls out easy, otherwise it really is a thin wrapper/duplication of the `bin/solr api` call. Especially without any special value add in formatting tuples or error handling etc. I do believe the second part is the really cool thing, that I can run a streaming expression locally and use it to process some data. We clearly need some way of specifying where the processing is happening, in the cluster or locally. I was trying to think if we have any other places in Solr where we define "Where am I doing work" that might provide a name for a parameter. `bin/solr stream --environment cluster BLAH` ? The `search()` expression has a `qt` parameter.. `bin/solr stream -qt=/stream BLAH` ? Reading through docs more, we have the `parralel()` and it refers to workers. Maybe the command should be something like `bin/solr stream --workers=local BLAH` which would run on your laptop, and if you don't specify --workers then it runs on the cluster via `/stream`? I have found that lots of streaming expressions don't require a Solr connection, especially during development. I'm just iterating on the logic, and I'm starting and ending iwth tuples.. it's only later when I get the mappings etc working that I then move to adding in my `search()` or `update()` clauses. Also, as far as docs go, we have a LONG way to go in Streaming expressions. It's both the best docuemnted code, with all the howtos and guides, but also, I find a million expressions that exist but don't show up in our reference docs ;-). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@solr.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@solr.apache.org For additional commands, e-mail: issues-h...@solr.apache.org
