[jira] [Comment Edited] (SPARK-18278) Support native submission of spark jobs to a kubernetes cluster

[ https://issues.apache.org/jira/browse/SPARK-18278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15642858#comment-15642858 ] William Benton edited comment on SPARK-18278 at 11/7/16 2:27 AM: -

[jira] [Commented] (SPARK-18278) Support native submission of spark jobs to a kubernetes cluster

[ https://issues.apache.org/jira/browse/SPARK-18278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15642858#comment-15642858 ] William Benton commented on SPARK-18278: [~srowen] Currently {{ExternalClusterManager}} is

[jira] [Created] (SPARK-17595) Inefficient selection in Word2VecModel.findSynonyms

William Benton created SPARK-17595: -- Summary: Inefficient selection in Word2VecModel.findSynonyms Key: SPARK-17595 URL: https://issues.apache.org/jira/browse/SPARK-17595 Project: Spark

[jira] [Created] (SPARK-17548) Word2VecModel.findSynonyms can spuriously reject the best match when invoked with a vector

William Benton created SPARK-17548: -- Summary: Word2VecModel.findSynonyms can spuriously reject the best match when invoked with a vector Key: SPARK-17548 URL: https://issues.apache.org/jira/browse/SPARK-17548

[jira] [Commented] (SPARK-5281) Registering table on RDD is giving MissingRequirementError

[ https://issues.apache.org/jira/browse/SPARK-5281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14482291#comment-14482291 ] William Benton commented on SPARK-5281: --- As [~marmbrus] recently pointed out on the

[jira] [Commented] (SPARK-4867) UDF clean up

[ https://issues.apache.org/jira/browse/SPARK-4867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14253579#comment-14253579 ] William Benton commented on SPARK-4867: --- [~marmbrus] I actually think exposing an

[jira] [Commented] (SPARK-4867) UDF clean up

[ https://issues.apache.org/jira/browse/SPARK-4867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14251822#comment-14251822 ] William Benton commented on SPARK-4867: --- I think in general it's a great idea to

[jira] [Commented] (SPARK-4185) JSON schema inference failed when dealing with type conflicts in arrays

[ https://issues.apache.org/jira/browse/SPARK-4185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14193491#comment-14193491 ] William Benton commented on SPARK-4185: --- I'm actually not sure this is a bug! My

[jira] [Created] (SPARK-4190) Allow users to provide transformation rules at JSON ingest

William Benton created SPARK-4190: - Summary: Allow users to provide transformation rules at JSON ingest Key: SPARK-4190 URL: https://issues.apache.org/jira/browse/SPARK-4190 Project: Spark

[jira] [Commented] (SPARK-4190) Allow users to provide transformation rules at JSON ingest

[ https://issues.apache.org/jira/browse/SPARK-4190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14193573#comment-14193573 ] William Benton commented on SPARK-4190: --- I'll take this, since I'm interested in

[jira] [Commented] (SPARK-2863) Emulate Hive type coercion in native reimplementations of Hive functions

[ https://issues.apache.org/jira/browse/SPARK-2863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14168403#comment-14168403 ] William Benton commented on SPARK-2863: --- I submitted a PR for this issue this

[jira] [Created] (SPARK-3699) sbt console tasks don't clean up SparkContext

William Benton created SPARK-3699: - Summary: sbt console tasks don't clean up SparkContext Key: SPARK-3699 URL: https://issues.apache.org/jira/browse/SPARK-3699 Project: Spark Issue Type:

[jira] [Created] (SPARK-3423) Implement BETWEEN support for regular SQL parser

William Benton created SPARK-3423: - Summary: Implement BETWEEN support for regular SQL parser Key: SPARK-3423 URL: https://issues.apache.org/jira/browse/SPARK-3423 Project: Spark Issue Type:

[jira] [Commented] (SPARK-3423) Implement BETWEEN support for regular SQL parser

[ https://issues.apache.org/jira/browse/SPARK-3423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14123814#comment-14123814 ] William Benton commented on SPARK-3423: --- (PR is here:

[jira] [Created] (SPARK-3329) HiveQuerySuite SET tests depend on map orderings

William Benton created SPARK-3329: - Summary: HiveQuerySuite SET tests depend on map orderings Key: SPARK-3329 URL: https://issues.apache.org/jira/browse/SPARK-3329 Project: Spark Issue Type:

[jira] [Commented] (SPARK-2863) Emulate Hive type coercion in native reimplementations of Hive functions

[ https://issues.apache.org/jira/browse/SPARK-2863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14105537#comment-14105537 ] William Benton commented on SPARK-2863: --- I wrote up how Hive handles type coercions

[jira] [Created] (SPARK-2863) Emulate Hive type coercion in native reimplementations of Hive UDFs

William Benton created SPARK-2863: - Summary: Emulate Hive type coercion in native reimplementations of Hive UDFs Key: SPARK-2863 URL: https://issues.apache.org/jira/browse/SPARK-2863 Project: Spark

[jira] [Created] (SPARK-2813) Implement SQRT() directly in Catalyst

William Benton created SPARK-2813: - Summary: Implement SQRT() directly in Catalyst Key: SPARK-2813 URL: https://issues.apache.org/jira/browse/SPARK-2813 Project: Spark Issue Type:

[jira] [Updated] (SPARK-2813) Implement SQRT() directly in Spark SQL

[ https://issues.apache.org/jira/browse/SPARK-2813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] William Benton updated SPARK-2813: -- Summary: Implement SQRT() directly in Spark SQL (was: Implement SQRT() directly in Spark SQP)

[jira] [Updated] (SPARK-2813) Implement SQRT() directly in Spark SQP

[ https://issues.apache.org/jira/browse/SPARK-2813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] William Benton updated SPARK-2813: -- Summary: Implement SQRT() directly in Spark SQP (was: Implement SQRT() directly in Catalyst)

[jira] [Commented] (SPARK-2226) HAVING should be able to contain aggregate expressions that don't appear in the aggregation list.

[ https://issues.apache.org/jira/browse/SPARK-2226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14067503#comment-14067503 ] William Benton commented on SPARK-2226: --- [~rxin], yes, and I'm mostly done. I'll

[jira] [Created] (SPARK-2486) Utils.getCallSite can crash under JVMTI profilers

William Benton created SPARK-2486: - Summary: Utils.getCallSite can crash under JVMTI profilers Key: SPARK-2486 URL: https://issues.apache.org/jira/browse/SPARK-2486 Project: Spark Issue

[jira] [Commented] (SPARK-2486) Utils.getCallSite can crash under JVMTI profilers

[ https://issues.apache.org/jira/browse/SPARK-2486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14061625#comment-14061625 ] William Benton commented on SPARK-2486: --- A (trivial but functional) workaround is

[jira] [Commented] (SPARK-2407) Implement SQL SUBSTR() directly in Catalyst

[ https://issues.apache.org/jira/browse/SPARK-2407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14057725#comment-14057725 ] William Benton commented on SPARK-2407: --- Here's the PR:

[jira] [Created] (SPARK-2407) Implement SQL SUBSTR() directly in Catalyst

William Benton created SPARK-2407: - Summary: Implement SQL SUBSTR() directly in Catalyst Key: SPARK-2407 URL: https://issues.apache.org/jira/browse/SPARK-2407 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-2407) Implement SQL SUBSTR() directly in Catalyst

[ https://issues.apache.org/jira/browse/SPARK-2407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14055232#comment-14055232 ] William Benton commented on SPARK-2407: --- I have this on a branch and will submit a

[jira] [Commented] (SPARK-2226) HAVING should be able to contain aggregate expressions that don't appear in the aggregation list.

[ https://issues.apache.org/jira/browse/SPARK-2226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14055499#comment-14055499 ] William Benton commented on SPARK-2226: --- Thanks, [~marmbrus], this makes sense!

[jira] [Commented] (SPARK-2225) Turn HAVING without GROUP BY into WHERE

[ https://issues.apache.org/jira/browse/SPARK-2225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14039335#comment-14039335 ] William Benton commented on SPARK-2225: --- So the Hive test suite treats HAVING

[jira] [Commented] (SPARK-2180) HiveQL doesn't support GROUP BY with HAVING clauses

[ https://issues.apache.org/jira/browse/SPARK-2180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14037697#comment-14037697 ] William Benton commented on SPARK-2180: --- PR is here:

[jira] [Commented] (SPARK-2180) HiveQL doesn't support GROUP BY with HAVING clauses

[ https://issues.apache.org/jira/browse/SPARK-2180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14035907#comment-14035907 ] William Benton commented on SPARK-2180: --- (I'm working on a fix and will submit a PR

[jira] [Commented] (SPARK-571) Forbid return statements when cleaning closures

[ https://issues.apache.org/jira/browse/SPARK-571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13993919#comment-13993919 ] William Benton commented on SPARK-571: -- I have a patch for this and will submit a PR

[jira] [Commented] (SPARK-1807) Modify SPARK_EXECUTOR_URI to allow for script execution in Mesos.

[ https://issues.apache.org/jira/browse/SPARK-1807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13995469#comment-13995469 ] William Benton commented on SPARK-1807: --- I'll be working on some related things this

[jira] [Commented] (SPARK-1789) Multiple versions of Netty dependencies cause FlumeStreamSuite failure

[ https://issues.apache.org/jira/browse/SPARK-1789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13995560#comment-13995560 ] William Benton commented on SPARK-1789: --- Sean, we're currently building against Akka

[jira] [Commented] (SPARK-1781) Generalized validity checking for configuration parameters

[ https://issues.apache.org/jira/browse/SPARK-1781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13993893#comment-13993893 ] William Benton commented on SPARK-1781: --- Could someone assign this issue to me?

[jira] [Commented] (SPARK-729) Closures not always serialized at capture time

[ https://issues.apache.org/jira/browse/SPARK-729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13990729#comment-13990729 ] William Benton commented on SPARK-729: -- So the straightforward approach (immediately

[jira] [Commented] (SPARK-1501) Assertions in Graph.apply test are never executed

[ https://issues.apache.org/jira/browse/SPARK-1501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13969652#comment-13969652 ] William Benton commented on SPARK-1501: --- Here's the PR: