[GitHub] spark pull request: [SparkSQL] allow UDF on struct
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/796 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] spark pull request: [SparkSQL] allow UDF on struct
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/796#issuecomment-46294743 Thanks! I've merged this into master and 1.0 as https://issues.apache.org/jira/browse/SPARK-2164 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] spark pull request: [SparkSQL] allow UDF on struct
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/796#issuecomment-46250174 Jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] spark pull request: [SparkSQL] allow UDF on struct
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/796#issuecomment-46250182 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] spark pull request: [SparkSQL] allow UDF on struct
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/796#issuecomment-46250191 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] spark pull request: [SparkSQL] allow UDF on struct
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/796#issuecomment-46255778 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/15830/ --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] spark pull request: [SparkSQL] allow UDF on struct
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/796#issuecomment-46255777 Merged build finished. All automated tests passed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] spark pull request: [SparkSQL] allow UDF on struct
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/796#issuecomment-46076365 test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] spark pull request: [SparkSQL] allow UDF on struct
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/796#issuecomment-46076489 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] spark pull request: [SparkSQL] allow UDF on struct
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/796#issuecomment-46076499 Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/15780/ --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] spark pull request: [SparkSQL] allow UDF on struct
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/796#issuecomment-46076498 Merged build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] spark pull request: [SparkSQL] allow UDF on struct
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/796#issuecomment-46076494 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] spark pull request: [SparkSQL] allow UDF on struct
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/796#issuecomment-46076522 test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] spark pull request: [SparkSQL] allow UDF on struct
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/796#issuecomment-46076619 Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/15781/ --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] spark pull request: [SparkSQL] allow UDF on struct
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/796#issuecomment-46076613 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] spark pull request: [SparkSQL] allow UDF on struct
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/796#issuecomment-46076616 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] spark pull request: [SparkSQL] allow UDF on struct
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/796#issuecomment-46076618 Merged build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] spark pull request: [SparkSQL] allow UDF on struct
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/796#issuecomment-46076862 @pwendell, any idea what is going on here? I keep getting: ``` Building remotely on Ubuntu 14.04 on EC2 6 (ec2) in workspace /home/ubuntu/workspace/SparkPullRequestBuilder java.io.IOException: remote file operation failed: /home/ubuntu/workspace/SparkPullRequestBuilder at hudson.remoting.Channel@7291f33e:Ubuntu 14.04 on EC2 6 at hudson.FilePath.act(FilePath.java:916) at hudson.FilePath.act(FilePath.java:893) at org.jenkinsci.plugins.gitclient.Git.getClient(Git.java:66) at hudson.plugins.git.GitSCM.createClient(GitSCM.java:566) at hudson.plugins.git.GitSCM.createClient(GitSCM.java:558) at hudson.plugins.git.GitSCM.checkout(GitSCM.java:874) at hudson.model.AbstractProject.checkout(AbstractProject.java:1252) at hudson.model.AbstractBuild$AbstractBuildExecution.defaultCheckout(AbstractBuild.java:615) at jenkins.scm.SCMCheckoutStrategy.checkout(SCMCheckoutStrategy.java:86) at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:524) at hudson.model.Run.execute(Run.java:1710) at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43) at hudson.model.ResourceController.execute(ResourceController.java:88) at hudson.model.Executor.run(Executor.java:234) Caused by: java.io.IOException: Remote call on Ubuntu 14.04 on EC2 6 failed at hudson.remoting.Channel.call(Channel.java:748) at hudson.FilePath.act(FilePath.java:909) ... 13 more Caused by: java.lang.NoClassDefFoundError: Could not initialize class com.sun.proxy.$Proxy8 at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:526) at java.lang.reflect.Proxy.newInstance(Proxy.java:748) at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:739) at hudson.remoting.RemoteInvocationHandler.wrap(RemoteInvocationHandler.java:100) at hudson.remoting.Channel.export(Channel.java:584) at hudson.remoting.Channel.export(Channel.java:553) at org.jenkinsci.plugins.gitclient.LegacyCompatibleGitAPIImpl.writeReplace(LegacyCompatibleGitAPIImpl.java:161) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at java.io.ObjectStreamClass.invokeWriteReplace(ObjectStreamClass.java:1075) at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1134) at java.io.ObjectOutputStream.writeObject(ObjectOutputStream.java:347) at hudson.remoting.UserRequest._serialize(UserRequest.java:155) at hudson.remoting.UserRequest.serialize(UserRequest.java:164) at hudson.remoting.UserRequest.perform(UserRequest.java:126) at hudson.remoting.UserRequest.perform(UserRequest.java:48) at hudson.remoting.Request$2.run(Request.java:328) at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:72) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:744) Recording test results Finished: FAILURE ``` --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] spark pull request: [SparkSQL] allow UDF on struct
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/796#issuecomment-46076874 test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] spark pull request: [SparkSQL] allow UDF on struct
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/796#issuecomment-46076885 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] spark pull request: [SparkSQL] allow UDF on struct
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/796#issuecomment-46076890 Merged build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] spark pull request: [SparkSQL] allow UDF on struct
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/796#issuecomment-46076888 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] spark pull request: [SparkSQL] allow UDF on struct
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/796#issuecomment-46076891 Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/15782/ --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] spark pull request: [SparkSQL] allow UDF on struct
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/796#issuecomment-44756553 test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] spark pull request: [SparkSQL] allow UDF on struct
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/796#issuecomment-44756643 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] spark pull request: [SparkSQL] allow UDF on struct
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/796#issuecomment-44756639 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] spark pull request: [SparkSQL] allow UDF on struct
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/796#issuecomment-44758567 Merged build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] spark pull request: [SparkSQL] allow UDF on struct
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/796#issuecomment-44758568 Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/15324/ --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] spark pull request: [SparkSQL] allow UDF on struct
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/796#issuecomment-44760575 Thanks for working on this! Looks like adding the extra function is breaking the `show_functions` test. Maybe cleanup by deleting that new UDF at the end of your test? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] spark pull request: [SparkSQL] allow UDF on struct
Github user xiliu82 commented on the pull request: https://github.com/apache/spark/pull/796#issuecomment-43568364 I have a test but it has too much application information, so I will try to write a minimum test. Unfortunately named_struct also failed to work because it is expecting WritableConstantStringObjectInspector, and catalyst returned JavaStringObjectInspector, I am not sure I want to change that yet. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] spark pull request: [SparkSQL] allow UDF on struct
Github user xiliu82 commented on the pull request: https://github.com/apache/spark/pull/796#issuecomment-43260264 This is to fix a bug where apply Hive UDF on a struct, it will throw NoMatch exception. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] spark pull request: [SparkSQL] allow UDF on struct
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/796#issuecomment-43269860 Can you add a test case? Or maybe find a HiveTest case that can be whitelisted in HiveCompatibilitySuite? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] spark pull request: [SparkSQL] allow UDF on struct
GitHub user xiliu82 opened a pull request: https://github.com/apache/spark/pull/796 [SparkSQL] allow UDF on struct You can merge this pull request into a Git repository by running: $ git pull https://github.com/xiliu82/spark sqlbug Alternatively you can review and apply these changes as the patch at: https://github.com/apache/spark/pull/796.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #796 commit 8fc6f51e3fce3abf761e68e792e993dac4a96910 Author: Xi Liu x...@conviva.com Date: 2014-05-15T20:06:22Z [SparkSQL] allow UDF on struct --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] spark pull request: [SparkSQL] allow UDF on struct
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/796#issuecomment-43260613 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
