[GitHub] spark pull request: [SPARK-6392][SQL]Minor fix ClassNotFound excep...
Github user jeanlyn closed the pull request at: https://github.com/apache/spark/pull/5079 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6392][SQL]Minor fix ClassNotFound excep...
Github user jeanlyn commented on the pull request: https://github.com/apache/spark/pull/5079#issuecomment-85085332 After communicated with @adrian-wang offline. I realized this PR still leave some class loader problem.So i close this one. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6392][SQL]Minor fix ClassNotFound excep...
Github user jeanlyn commented on the pull request:
https://github.com/apache/spark/pull/5079#issuecomment-83383402
I also don't have CHAR in `mapjoin_addjar.q`. I only find one
`mapjoin_addjar.q`,and the path of my file is
sql/hive/src/test/resources/ql/src/test/queries/clientpositive/mapjoin_addjar.q
```sql
set hive.auto.convert.join=true;
set hive.auto.convert.join.use.nonstaged=false;
add jar
${system:maven.local.repository}/org/apache/hive/hcatalog/hive-hcatalog-core/${system:hive.version}/hive-hcatalog-core-${system:hive.version}.jar;
CREATE TABLE t1 (a string, b string)
ROW FORMAT SERDE 'org.apache.hive.hcatalog.data.JsonSerDe'
;
LOAD DATA LOCAL INPATH "../../data/files/sample.json" INTO TABLE t1;
select * from src join t1 on src.key =t1.a;
drop table t1;
set hive.auto.convert.join=false;
```
May be we can discuss this offline?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6392][SQL]Minor fix ClassNotFound excep...
Github user adrian-wang commented on the pull request: https://github.com/apache/spark/pull/5079#issuecomment-83372666 @jeanlyn we are not getting same thing. Even our .q file differs. I don't have CHAR in my .q file. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6392][SQL]Minor fix ClassNotFound excep...
Github user jeanlyn commented on the pull request:
https://github.com/apache/spark/pull/5079#issuecomment-83372419
@chenghao-intel my full code is
```java
import org.apache.hadoop.hive.ql.exec.UDF;
public class hello extends UDF {
public String evaluate(String str) {
try {
return "hello " + str;
} catch (Exception e) {
return null;
}
}
}
```
@adrian-wang ,I also test the `mapjoin_addjar.q` in `spark-sql`.
I got the exception when `CREATE TABLE `
```
15/03/19 14:41:36 ERROR DDLTask: java.lang.NoSuchFieldError: CHAR
at org.apache.spark.sql.hive.HiveContext.runHive(HiveContext.scala:310)
at
org.apache.spark.sql.hive.HiveContext.runSqlHive(HiveContext.scala:277)
at
org.apache.spark.sql.hive.execution.NativeCommand.sideEffectResult$lzycompute(NativeCommand.scala:35)
at
org.apache.spark.sql.hive.execution.NativeCommand.sideEffectResult(NativeCommand.scala:35)
```
But it seems that not the load jar problem.Because when i not run the
```
add jar
${system:maven.local.repository}/org/apache/hive/hcatalog/hive-hcatalog-core/${system:hive.version}/hive-hcatalog-core-${system:hive.version}.jar;
```
I got the follow exception
```
15/03/19 14:54:51 ERROR DDLTask:
org.apache.hadoop.hive.ql.metadata.HiveException: Cannot validate serde:
org.apache.hive.hcatalog.data.JsonSerDe
at
org.apache.hadoop.hive.ql.exec.DDLTask.validateSerDe(DDLTask.java:3423)
at org.apache.hadoop.hive.ql.exec.DDLTask.createTable(DDLTask.java:3553)
at org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:252)
```
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6392][SQL]Minor fix ClassNotFound excep...
Github user chenghao-intel commented on the pull request: https://github.com/apache/spark/pull/5079#issuecomment-83359940 The tests in 2 PRs are different, this PR is about the UDF jar, but #4586 is the SerDe jar. They may be loaded by difference class loader. @jeanlyn can you paste the full code for the UDF function? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6392][SQL]Minor fix ClassNotFound excep...
Github user adrian-wang commented on the pull request: https://github.com/apache/spark/pull/5079#issuecomment-83349543 @jeanlyn you can just try execute ` mapjoin_addjar.q` in `spark-sql`. Note you need to find a valid jar position. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6392][SQL]Minor fix ClassNotFound excep...
Github user jeanlyn commented on the pull request: https://github.com/apache/spark/pull/5079#issuecomment-83348085 @adrian-wang ,I had tested in `spark-sql` ,and get result correctly with my test case. Can you provide your test case?By the way,when i debug this issue i found in the `thrifter-server` mode,it also reuse the `SparkContext.addJar`. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6392][SQL]Minor fix ClassNotFound excep...
Github user adrian-wang commented on the pull request: https://github.com/apache/spark/pull/5079#issuecomment-83329608 I double checked your code with latest master, the problem still persists. Considered this is just a dup of #4586 maybe we should close this one. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6392][SQL]Minor fix ClassNotFound excep...
Github user adrian-wang commented on the pull request: https://github.com/apache/spark/pull/5079#issuecomment-83312186 @jeanlyn have you tried clean assembly and run it in `spark-sql`? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6392][SQL]Minor fix ClassNotFound excep...
Github user jeanlyn commented on the pull request: https://github.com/apache/spark/pull/5079#issuecomment-83299775 @adrian-wang You mean not work in `spark-shell` ? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6392][SQL]Minor fix ClassNotFound excep...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5079#issuecomment-83281417 [Test build #28849 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/28849/consoleFull) for PR 5079 at commit [`2de3945`](https://github.com/apache/spark/commit/2de3945607a91a825aa8df9ed960f437bb6cb9b3). * This patch **passes all tests**. * This patch merges cleanly. * This patch adds no public classes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6392][SQL]Minor fix ClassNotFound excep...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5079#issuecomment-83281487 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/28849/ Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6392][SQL]Minor fix ClassNotFound excep...
Github user adrian-wang commented on the pull request: https://github.com/apache/spark/pull/5079#issuecomment-83275475 Actually I tried this method before and it would work in unit test but not ok with shell. I'll double check this in the afternoon. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6392][SQL]Minor fix ClassNotFound excep...
Github user jeanlyn commented on the pull request: https://github.com/apache/spark/pull/5079#issuecomment-83267913 @chenghao-intel I am not clear what problem #4586 try to fix.If #4586 try to fix the problem as I mentioned.I think we can reuse the `SparkContext.addJar` is enough to fix the class loading/unloading problem.Right? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6392][SQL]Minor fix ClassNotFound excep...
Github user chenghao-intel commented on the pull request: https://github.com/apache/spark/pull/5079#issuecomment-83265743 Same issue with #4586 ? Actually we are quite headache with the class loading/unloading problem. @adrian-wang can you review this also? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6392][SQL]Minor fix ClassNotFound excep...
Github user jeanlyn commented on the pull request:
https://github.com/apache/spark/pull/5079#issuecomment-83254407
@yhuai ,There is a simple functions
```java
public String evaluate(String str) {
try {
return "hello " + str;
} catch (Exception e) {
return null;
}
}
```
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6392][SQL]Minor fix ClassNotFound excep...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5079#issuecomment-83252541 [Test build #28849 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/28849/consoleFull) for PR 5079 at commit [`2de3945`](https://github.com/apache/spark/commit/2de3945607a91a825aa8df9ed960f437bb6cb9b3). * This patch merges cleanly. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6392][SQL]Minor fix ClassNotFound excep...
Github user yhuai commented on the pull request: https://github.com/apache/spark/pull/5079#issuecomment-83039875 Will it be better if we put the jar in `sql/hive-thriftserver/src/test/resources/jar` (not in `data`)? Also, what is in that jar? A hello world function? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6392][SQL]Minor fix ClassNotFound excep...
Github user jeanlyn commented on the pull request: https://github.com/apache/spark/pull/5079#issuecomment-82976538 Ok. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6392][SQL]Minor fix ClassNotFound excep...
Github user liancheng commented on the pull request: https://github.com/apache/spark/pull/5079#issuecomment-82972253 Your test case itself makes sense. Let's wait for more comments first :) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6392][SQL]Minor fix ClassNotFound excep...
Github user jeanlyn commented on the pull request: https://github.com/apache/spark/pull/5079#issuecomment-82970359 Thanks @liancheng for explain.You are right,it need consider more about it.So,should i remove the test? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6392][SQL]Minor fix ClassNotFound excep...
Github user liancheng commented on the pull request: https://github.com/apache/spark/pull/5079#issuecomment-82967018 Hm, the problem is that we should also add the source code of `hello.jar` (probably after renaming it to `TestUdf.jar`). But I'm not quite sure where to put it for now. That's why I said we can merge the fix first, and later add the test in a proper way. In Hive, there is separate Maven module [`itest/test-serde`] [1], which results in a similar `TestSerDe.jar` solely for testing purposes. I wonder is there a simpler way to handle this. Adding a module seems to be an overkill. /cc @marmbrus @yhuai @pwendell [1]: https://github.com/apache/hive/tree/release-0.13.1/itests/test-serde --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6392][SQL]Minor fix ClassNotFound excep...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5079#issuecomment-82935967 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/28792/ Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6392][SQL]Minor fix ClassNotFound excep...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5079#issuecomment-82935924 [Test build #28792 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/28792/consoleFull) for PR 5079 at commit [`ca78d72`](https://github.com/apache/spark/commit/ca78d7285b9bfe79550d553b40ff7ff3fe1152e9). * This patch **passes all tests**. * This patch merges cleanly. * This patch adds no public classes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6392][SQL]Minor fix ClassNotFound excep...
Github user jeanlyn commented on the pull request: https://github.com/apache/spark/pull/5079#issuecomment-82908034 Updated, @liancheng @marmbrus I had tried to add a test for this patch,could you take a look for the test? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6392][SQL]Minor fix ClassNotFound excep...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5079#issuecomment-82888519 [Test build #28792 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/28792/consoleFull) for PR 5079 at commit [`ca78d72`](https://github.com/apache/spark/commit/ca78d7285b9bfe79550d553b40ff7ff3fe1152e9). * This patch merges cleanly. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6392][SQL]Minor fix ClassNotFound excep...
Github user liancheng commented on the pull request: https://github.com/apache/spark/pull/5079#issuecomment-82798459 @marmbrus We can merge this PR first, I'm trying to write a test case for this PR. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6392][SQL]Minor fix ClassNotFound excep...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5079#issuecomment-82730035 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/28764/ Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6392][SQL]Minor fix ClassNotFound excep...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5079#issuecomment-82730032 [Test build #28764 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/28764/consoleFull) for PR 5079 at commit [`ca95849`](https://github.com/apache/spark/commit/ca958493957e7cc5f49dc318bcbf213793a991c0). * This patch **passes all tests**. * This patch merges cleanly. * This patch adds no public classes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6392][SQL]Minor fix ClassNotFound excep...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5079#issuecomment-82697008 [Test build #28764 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/28764/consoleFull) for PR 5079 at commit [`ca95849`](https://github.com/apache/spark/commit/ca958493957e7cc5f49dc318bcbf213793a991c0). * This patch merges cleanly. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6392][SQL]Minor fix ClassNotFound excep...
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/5079#issuecomment-82695190 Would it be possible to add a test case in the CLI suite? /cc @liancheng --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6392][SQL]Minor fix ClassNotFound excep...
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/5079#issuecomment-82695129 ok to test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6392][SQL]Minor fix ClassNotFound excep...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5079#issuecomment-82689590 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6392][SQL]Minor fix ClassNotFound excep...
GitHub user jeanlyn opened a pull request: https://github.com/apache/spark/pull/5079 [SPARK-6392][SQL]Minor fix ClassNotFound exception when use spark cli to add jar When we use spark cli to add jar dynamic,we will get the `java.lang.ClassNotFoundException` when we use the class of jar to create udf.For example: ```sql spark-sql> add jar /home/jeanlyn/hello.jar; spark-sql>create temporary function hello as 'hello'; spark-sql>select hello(name) from person; Job aborted due to stage failure: Task 0 in stage 1.0 failed 1 times, most recent failure: Lost task 0.0 in stage 1.0 (TID 1, localhost): java.lang.ClassNotFoundException: hello ``` we can use the spark physical plan to fix this problem You can merge this pull request into a Git repository by running: $ git pull https://github.com/jeanlyn/spark SPARK-6392 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/spark/pull/5079.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #5079 commit ca958493957e7cc5f49dc318bcbf213793a991c0 Author: jeanlyn Date: 2015-03-18T02:02:35Z use spark physical plan when add jar --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
