[jira] Commented: (HIVE-322) cannot create temporary udf dynamically, with a ClassNotFoundException
[ https://issues.apache.org/jira/browse/HIVE-322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12682003#action_12682003 ] Min Zhou commented on HIVE-322: --- Hi Joydeep, pls check out this jira https://issues.apache.org/jira/browse/HIVE-338 It supports add file/jar on both cli thriftserver now. cannot create temporary udf dynamically, with a ClassNotFoundException --- Key: HIVE-322 URL: https://issues.apache.org/jira/browse/HIVE-322 Project: Hadoop Hive Issue Type: Bug Components: Query Processor Affects Versions: 0.3.0 Reporter: Min Zhou Priority: Blocker Attachments: registerjars-v3.patch, registerjars1.patch, registerjars2.patch I found the ClassLoader cannot load my UDF when doing FunctionTask, because the ClassLoader hasnot append its classpaths on-the-fly yet. The ExecDriver' s addToClassPath(String[] newPaths) method is the only entry for ClassLoader dynamically append its classhpaths (besides hadoop's GenericOptionsParser). But that function wasnot called before FunctionTask getting my UDF class by class name. I think this is the reason why I came across that failure. scenario description: I set a peroperty in hive-site.xml to configure the classpath of my udf. property namehive.aux.jars.path/name value/home/hadoop/hdpsoft/hive-auxs/zhoumin.jar/value /property but failed to register it with a ClassNotFoundException when creating udf through the sql command. CREATE TEMPORARY FUNCTION strlen AS 'hadoop.hive.udf.UdfStringLength' I'll make a patch soon. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (HIVE-322) cannot create temporary udf dynamically, with a ClassNotFoundException
[ https://issues.apache.org/jira/browse/HIVE-322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12681906#action_12681906 ] Joydeep Sen Sarma commented on HIVE-322: Hi Min - are you going to resubmit this as a 'add jar' cli command. should be very easy to do. meanwhile i will review the thriftserver code. cannot create temporary udf dynamically, with a ClassNotFoundException --- Key: HIVE-322 URL: https://issues.apache.org/jira/browse/HIVE-322 Project: Hadoop Hive Issue Type: Bug Components: Query Processor Affects Versions: 0.3.0 Reporter: Min Zhou Priority: Blocker Attachments: registerjars-v3.patch, registerjars1.patch, registerjars2.patch I found the ClassLoader cannot load my UDF when doing FunctionTask, because the ClassLoader hasnot append its classpaths on-the-fly yet. The ExecDriver' s addToClassPath(String[] newPaths) method is the only entry for ClassLoader dynamically append its classhpaths (besides hadoop's GenericOptionsParser). But that function wasnot called before FunctionTask getting my UDF class by class name. I think this is the reason why I came across that failure. scenario description: I set a peroperty in hive-site.xml to configure the classpath of my udf. property namehive.aux.jars.path/name value/home/hadoop/hdpsoft/hive-auxs/zhoumin.jar/value /property but failed to register it with a ClassNotFoundException when creating udf through the sql command. CREATE TEMPORARY FUNCTION strlen AS 'hadoop.hive.udf.UdfStringLength' I'll make a patch soon. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (HIVE-322) cannot create temporary udf dynamically, with a ClassNotFoundException
[ https://issues.apache.org/jira/browse/HIVE-322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12680726#action_12680726 ] Min Zhou commented on HIVE-322: --- Files reside in tmpfiles, Jars in tmpjars of hadoop system. My thrift server support add/delete file/jar, set, and normal HSQL query now , and the other commands I think is no need for thrift server. I've created another jar, let's move there. https://issues.apache.org/jira/browse/HIVE-338 cannot create temporary udf dynamically, with a ClassNotFoundException --- Key: HIVE-322 URL: https://issues.apache.org/jira/browse/HIVE-322 Project: Hadoop Hive Issue Type: Bug Components: Query Processor Affects Versions: 0.3.0 Reporter: Min Zhou Priority: Blocker Attachments: registerjars-v3.patch, registerjars1.patch, registerjars2.patch I found the ClassLoader cannot load my UDF when doing FunctionTask, because the ClassLoader hasnot append its classpaths on-the-fly yet. The ExecDriver' s addToClassPath(String[] newPaths) method is the only entry for ClassLoader dynamically append its classhpaths (besides hadoop's GenericOptionsParser). But that function wasnot called before FunctionTask getting my UDF class by class name. I think this is the reason why I came across that failure. scenario description: I set a peroperty in hive-site.xml to configure the classpath of my udf. property namehive.aux.jars.path/name value/home/hadoop/hdpsoft/hive-auxs/zhoumin.jar/value /property but failed to register it with a ClassNotFoundException when creating udf through the sql command. CREATE TEMPORARY FUNCTION strlen AS 'hadoop.hive.udf.UdfStringLength' I'll make a patch soon. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (HIVE-322) cannot create temporary udf dynamically, with a ClassNotFoundException
[ https://issues.apache.org/jira/browse/HIVE-322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12680131#action_12680131 ] Min Zhou commented on HIVE-322: --- The add/delete/list resource ...' command is only supported by CLI mode right now. It puts a file path into a map, then be retrieved and added into hadoop's tmpfiles by ExecDriver's initialize method, but you know, this method won't be called by Thrift Server mode. Have you considered adding this feature to Thrift Server mode? cannot create temporary udf dynamically, with a ClassNotFoundException --- Key: HIVE-322 URL: https://issues.apache.org/jira/browse/HIVE-322 Project: Hadoop Hive Issue Type: Bug Components: Query Processor Affects Versions: 0.3.0 Reporter: Min Zhou Priority: Blocker Attachments: registerjars-v3.patch, registerjars1.patch, registerjars2.patch I found the ClassLoader cannot load my UDF when doing FunctionTask, because the ClassLoader hasnot append its classpaths on-the-fly yet. The ExecDriver' s addToClassPath(String[] newPaths) method is the only entry for ClassLoader dynamically append its classhpaths (besides hadoop's GenericOptionsParser). But that function wasnot called before FunctionTask getting my UDF class by class name. I think this is the reason why I came across that failure. scenario description: I set a peroperty in hive-site.xml to configure the classpath of my udf. property namehive.aux.jars.path/name value/home/hadoop/hdpsoft/hive-auxs/zhoumin.jar/value /property but failed to register it with a ClassNotFoundException when creating udf through the sql command. CREATE TEMPORARY FUNCTION strlen AS 'hadoop.hive.udf.UdfStringLength' I'll make a patch soon. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (HIVE-322) cannot create temporary udf dynamically, with a ClassNotFoundException
[ https://issues.apache.org/jira/browse/HIVE-322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12680030#action_12680030 ] Min Zhou commented on HIVE-322: --- Hey Joydeep, I'll try to implement it, however, we will make our UDFs temporarily on Thrift Server mode, not CLI. That a great feature you mentioned! cannot create temporary udf dynamically, with a ClassNotFoundException --- Key: HIVE-322 URL: https://issues.apache.org/jira/browse/HIVE-322 Project: Hadoop Hive Issue Type: Bug Components: Query Processor Affects Versions: 0.3.0 Reporter: Min Zhou Priority: Blocker Attachments: registerjars-v3.patch, registerjars1.patch, registerjars2.patch I found the ClassLoader cannot load my UDF when doing FunctionTask, because the ClassLoader hasnot append its classpaths on-the-fly yet. The ExecDriver' s addToClassPath(String[] newPaths) method is the only entry for ClassLoader dynamically append its classhpaths (besides hadoop's GenericOptionsParser). But that function wasnot called before FunctionTask getting my UDF class by class name. I think this is the reason why I came across that failure. scenario description: I set a peroperty in hive-site.xml to configure the classpath of my udf. property namehive.aux.jars.path/name value/home/hadoop/hdpsoft/hive-auxs/zhoumin.jar/value /property but failed to register it with a ClassNotFoundException when creating udf through the sql command. CREATE TEMPORARY FUNCTION strlen AS 'hadoop.hive.udf.UdfStringLength' I'll make a patch soon. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (HIVE-322) cannot create temporary udf dynamically, with a ClassNotFoundException
[ https://issues.apache.org/jira/browse/HIVE-322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12678635#action_12678635 ] Min Zhou commented on HIVE-322: --- I am considering adding a register statement for registering a jar to classpath. Agree? cannot create temporary udf dynamically, with a ClassNotFoundException --- Key: HIVE-322 URL: https://issues.apache.org/jira/browse/HIVE-322 Project: Hadoop Hive Issue Type: Bug Components: Query Processor Affects Versions: 0.3.0 Reporter: Min Zhou Priority: Blocker I found the ClassLoader cannot load my UDF when doing FunctionTask, because the ClassLoader hasnot append its classpaths on-the-fly yet. The ExecDriver' s addToClassPath(String[] newPaths) method is the only entry for ClassLoader dynamically append its classhpaths (besides hadoop's GenericOptionsParser). But that function wasnot called before FunctionTask getting my UDF class by class name. I think this is the reason why I came across that failure. scenario description: I set a peroperty in hive-site.xml to configure the classpath of my udf. property namehive.aux.jars.path/name value/home/hadoop/hdpsoft/hive-auxs/zhoumin.jar/value /property but failed to register it with a ClassNotFoundException when creating udf through the sql command. CREATE TEMPORARY FUNCTION strlen AS 'hadoop.hive.udf.UdfStringLength' I'll make a patch soon. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
