Re: UDFClassLoader isolation leaking

2018-09-14 Thread Jason Gerlowski
Hi Gopal, Thanks for taking a look, and for the workaround suggestion. Your workaround worked for the original SerDe we encountered this issue with. With the stub StorageHandler mentioned above it produced a different error (https://pastebin.com/iu0hh21C). But I suspect that's a problem with

UDFClassLoader isolation leaking

2018-09-13 Thread Jason Gerlowski
Hi all, Wanted to let you know of a potential bug I've run into when loading custom jar's dynamically (i.e. "ADD JAR /path/to/jar"). Hopefully someone can tell me if this is a bug, expected behavior, or something I'm causing myself :) We have a custom StorageHandler that we're updating from

Re: Queries to custom serde return 'NULL' until hiveserver2 restart

2018-09-11 Thread Jason Gerlowski
Hi all, Thanks for the suggestion Gopal. It turns out the error occurs on both "SELECT *" and "SELECT col" queries. The only sort of query that seems safe are those with aggregations or other things that cause them to be run as mr tasks (e.g. "SELECT SUM(price_f) FROM my_external_table").

Queries to custom serde return 'NULL' until hiveserver2 restart

2018-09-10 Thread Jason Gerlowski
Hi all, Hive Version: 3.0.0 Hadoop Version: 3.1.0 Tez Version: 0.9.1 I help to maintain a Hive SerDe connecting Hive to Apache Solr. We've let our custom SerDe lag quite a bit behind in Hive releases (1.2.1), but we've recently started updating the code to work with Hive 3.0.0. After updating