scovich commented on issue #7715: URL: https://github.com/apache/arrow-rs/issues/7715#issuecomment-3059345717
> I don't think it should be a JSON path representation. `variant_get` in databricks only supports a subset of JSON path. Specifically only field accesses (`$.fieldName` or `$['fieldName']`) and array indexing (`$[0]`) are supported. Here's the [reference](https://docs.databricks.com/aws/en/sql/language-manual/sql-ref-json-path-expression) (look for variant) for this. I'm not sure I follow this argument? If Databricks only supports a subset, that just means it would never send other types of JSON paths. Is there some harm if the underlying variant library supports more? Or is this an argument that the Databricks-supported subset is "good enough" and there's no need to go fancier? Anyway tho, this seems like another reason to be cautious about variant paths in general -- different engines will likely have different (maybe even conflicting) expectations and abilities when it comes to pathing. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@arrow.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
