[jira] [Commented] (SPARK-15917) Define the number of executors in standalone mode with an easy-to-use property

2016-07-31 Thread Jonathan Taws (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15401600#comment-15401600 ] Jonathan Taws commented on SPARK-15917: --- I'd really like to move forward on this is

[jira] [Created] (SPARK-16830) Executors Keep Trying to Fetch Blocks from a Bad Host

2016-07-31 Thread Renxia Wang (JIRA)
Renxia Wang created SPARK-16830: --- Summary: Executors Keep Trying to Fetch Blocks from a Bad Host Key: SPARK-16830 URL: https://issues.apache.org/jira/browse/SPARK-16830 Project: Spark Issue Typ

[jira] [Commented] (SPARK-16601) Spark2.0 fail in creating table using sql statement "create table `db.tableName` xxx" while spark1.6 supports

2016-07-31 Thread marymwu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15401599#comment-15401599 ] marymwu commented on SPARK-16601: - Got it, thanks.BTW, some grammar changes in spark2.0 c

[jira] [Commented] (SPARK-16603) Spark2.0 fail in executing the sql statement which field name begins with number,like "d.30_day_loss_user" while spark1.6 supports

2016-07-31 Thread marymwu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15401598#comment-15401598 ] marymwu commented on SPARK-16603: - ok,got it,thanks > Spark2.0 fail in executing the sql

[jira] [Commented] (SPARK-16605) Spark2.0 cannot "select" data from a table stored as an orc file which has been created by hive while hive or spark1.6 supports

2016-07-31 Thread marymwu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15401597#comment-15401597 ] marymwu commented on SPARK-16605: - I see,thanks! > Spark2.0 cannot "select" data from a

[jira] [Assigned] (SPARK-16828) remove MaxOf and MinOf

2016-07-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16828: Assignee: Wenchen Fan (was: Apache Spark) > remove MaxOf and MinOf >

[jira] [Commented] (SPARK-16828) remove MaxOf and MinOf

2016-07-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15401591#comment-15401591 ] Apache Spark commented on SPARK-16828: -- User 'cloud-fan' has created a pull request

[jira] [Assigned] (SPARK-16828) remove MaxOf and MinOf

2016-07-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16828: Assignee: Apache Spark (was: Wenchen Fan) > remove MaxOf and MinOf >

[jira] [Assigned] (SPARK-16829) sparkR sc.setLogLevel doesn't work

2016-07-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16829: Assignee: Apache Spark > sparkR sc.setLogLevel doesn't work >

[jira] [Assigned] (SPARK-16829) sparkR sc.setLogLevel doesn't work

2016-07-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16829: Assignee: (was: Apache Spark) > sparkR sc.setLogLevel doesn't work > -

[jira] [Commented] (SPARK-16829) sparkR sc.setLogLevel doesn't work

2016-07-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15401581#comment-15401581 ] Apache Spark commented on SPARK-16829: -- User 'wangmiao1981' has created a pull reque

[jira] [Created] (SPARK-16829) sparkR sc.setLogLevel doesn't work

2016-07-31 Thread Miao Wang (JIRA)
Miao Wang created SPARK-16829: - Summary: sparkR sc.setLogLevel doesn't work Key: SPARK-16829 URL: https://issues.apache.org/jira/browse/SPARK-16829 Project: Spark Issue Type: Bug Repo

[jira] [Created] (SPARK-16828) remove MaxOf and MinOf

2016-07-31 Thread Wenchen Fan (JIRA)
Wenchen Fan created SPARK-16828: --- Summary: remove MaxOf and MinOf Key: SPARK-16828 URL: https://issues.apache.org/jira/browse/SPARK-16828 Project: Spark Issue Type: Improvement Compon

[jira] [Comment Edited] (SPARK-16815) Dataset[List[T]] leads to ArrayStoreException

2016-07-31 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15401566#comment-15401566 ] Saisai Shao edited comment on SPARK-16815 at 8/1/16 6:01 AM: -

[jira] [Commented] (SPARK-16815) Dataset[List[T]] leads to ArrayStoreException

2016-07-31 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15401566#comment-15401566 ] Saisai Shao commented on SPARK-16815: - >From my understanding you can use {code} sp

[jira] [Assigned] (SPARK-16765) Add Pipeline API example for KMeans

2016-07-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16765: Assignee: (was: Apache Spark) > Add Pipeline API example for KMeans >

[jira] [Commented] (SPARK-16765) Add Pipeline API example for KMeans

2016-07-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15401559#comment-15401559 ] Apache Spark commented on SPARK-16765: -- User 'manishatGit' has created a pull reques

[jira] [Commented] (SPARK-16765) Add Pipeline API example for KMeans

2016-07-31 Thread Manish Mishra (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15401560#comment-15401560 ] Manish Mishra commented on SPARK-16765: --- You are right [~bryanc] There was one use

[jira] [Assigned] (SPARK-16765) Add Pipeline API example for KMeans

2016-07-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16765: Assignee: Apache Spark > Add Pipeline API example for KMeans > ---

[jira] [Commented] (SPARK-16827) Query with Join produces excessive amount of shuffle data

2016-07-31 Thread Sital Kedia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15401523#comment-15401523 ] Sital Kedia commented on SPARK-16827: - Actually it seems like this is a bug in shuffl

[jira] [Commented] (SPARK-14559) Netty RPC didn't check channel is active before sending message

2016-07-31 Thread Tao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15401456#comment-15401456 ] Tao Wang commented on SPARK-14559: -- Hi, we have same issues, along with another error se

[jira] [Commented] (SPARK-16817) Enable storing of shuffle data in Alluxio

2016-07-31 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15401432#comment-15401432 ] Saisai Shao commented on SPARK-16817: - What's difference compared to use ramdisk to s

[jira] [Resolved] (SPARK-16805) Log timezone when query result does not match

2016-07-31 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-16805. -- Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 Issue resolved by pull request 1

[jira] [Resolved] (SPARK-16731) use StructType in CatalogTable and remove CatalogColumn

2016-07-31 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-16731. -- Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 14363 [https://github.com/

[jira] [Commented] (SPARK-16761) Fix doc link in docs/ml-guide.md

2016-07-31 Thread Dapeng Sun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15401419#comment-15401419 ] Dapeng Sun commented on SPARK-16761: Thank [~srowen] for your commit. > Fix doc link

[jira] [Commented] (SPARK-16775) Reduce internal warnings from deprecated accumulator API

2016-07-31 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15401417#comment-15401417 ] holdenk commented on SPARK-16775: - I'm going to get started on this one tomorrow unless s

[jira] [Assigned] (SPARK-16258) Automatically append the grouping keys in SparkR's gapply

2016-07-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16258: Assignee: (was: Apache Spark) > Automatically append the grouping keys in SparkR's gap

[jira] [Assigned] (SPARK-16258) Automatically append the grouping keys in SparkR's gapply

2016-07-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16258: Assignee: Apache Spark > Automatically append the grouping keys in SparkR's gapply > -

[jira] [Commented] (SPARK-16258) Automatically append the grouping keys in SparkR's gapply

2016-07-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15401414#comment-15401414 ] Apache Spark commented on SPARK-16258: -- User 'NarineK' has created a pull request fo

[jira] [Comment Edited] (SPARK-16827) Query with Join produces excessive amount of shuffle data

2016-07-31 Thread Sital Kedia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15401413#comment-15401413 ] Sital Kedia edited comment on SPARK-16827 at 8/1/16 12:52 AM: -

[jira] [Commented] (SPARK-16827) Query with Join produces excessive amount of shuffle data

2016-07-31 Thread Sital Kedia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15401413#comment-15401413 ] Sital Kedia commented on SPARK-16827: - That is not the case. There is no broadcast jo

[jira] [Updated] (SPARK-16827) Query with Join produces excessive amount of shuffle data

2016-07-31 Thread Sital Kedia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sital Kedia updated SPARK-16827: Description: One of our hive job which looks like this - {code} SELECT userid FROM table1

[jira] [Commented] (SPARK-16827) Query with Join produces excessive amount of shuffle data

2016-07-31 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15401407#comment-15401407 ] Reynold Xin commented on SPARK-16827: - Did the plan in Spark 1.6 use a broadcast join

[jira] [Commented] (SPARK-16827) Query with Join produces excessive amount of shuffle data

2016-07-31 Thread Sital Kedia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15401405#comment-15401405 ] Sital Kedia commented on SPARK-16827: - [~rxin] - Any idea how to debug this issue? >

[jira] [Updated] (SPARK-16827) Query with Join produces excessive shuffle data

2016-07-31 Thread Sital Kedia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sital Kedia updated SPARK-16827: Description: One of our hive job which looks like this - {code} SELECT userid FROM table1

[jira] [Updated] (SPARK-16827) Query with Join produces excessive amount of shuffle data

2016-07-31 Thread Sital Kedia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sital Kedia updated SPARK-16827: Summary: Query with Join produces excessive amount of shuffle data (was: Query with Join produces

[jira] [Updated] (SPARK-16827) Query with Join produces excessive shuffle data

2016-07-31 Thread Sital Kedia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sital Kedia updated SPARK-16827: Description: One of our hive job which looks like this - {code] SELECT userid FROM table1

[jira] [Created] (SPARK-16827) Query with Join produces excessive shuffle data

2016-07-31 Thread Sital Kedia (JIRA)
Sital Kedia created SPARK-16827: --- Summary: Query with Join produces excessive shuffle data Key: SPARK-16827 URL: https://issues.apache.org/jira/browse/SPARK-16827 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-16826) java.util.Hashtable limits the throughput of PARSE_URL()

2016-07-31 Thread Sylvain Zimmer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sylvain Zimmer updated SPARK-16826: --- Description: Hello! I'm using {{c4.8xlarge}} instances on EC2 with 36 cores and doing lots o

[jira] [Updated] (SPARK-16826) java.util.Hashtable limits the throughput of PARSE_URL()

2016-07-31 Thread Sylvain Zimmer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sylvain Zimmer updated SPARK-16826: --- Description: Hello! I'm using {{c4.8xlarge}} instances on EC2 with 36 cores and doing lots o

[jira] [Updated] (SPARK-16826) java.util.Hashtable limits the throughput of PARSE_URL()

2016-07-31 Thread Sylvain Zimmer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sylvain Zimmer updated SPARK-16826: --- Description: Hello! I'm using {{c4.8xlarge}} instances on EC2 with 36 cores and doing lots o

[jira] [Created] (SPARK-16826) java.util.Hashtable limits the throughput of PARSE_URL()

2016-07-31 Thread Sylvain Zimmer (JIRA)
Sylvain Zimmer created SPARK-16826: -- Summary: java.util.Hashtable limits the throughput of PARSE_URL() Key: SPARK-16826 URL: https://issues.apache.org/jira/browse/SPARK-16826 Project: Spark

[jira] [Updated] (SPARK-16825) Replace hive.default.fileformat by spark.sql.default.fileformat

2016-07-31 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-16825: Description: Currently, we are using hive.default.fileformat for specifying the default file format in CRE

[jira] [Assigned] (SPARK-16825) Replace hive.default.fileformat by spark.sql.default.fileformat

2016-07-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16825: Assignee: Apache Spark > Replace hive.default.fileformat by spark.sql.default.fileformat >

[jira] [Created] (SPARK-16825) Replace hive.default.fileformat by spark.sql.default.fileformat

2016-07-31 Thread Xiao Li (JIRA)
Xiao Li created SPARK-16825: --- Summary: Replace hive.default.fileformat by spark.sql.default.fileformat Key: SPARK-16825 URL: https://issues.apache.org/jira/browse/SPARK-16825 Project: Spark Issue

[jira] [Commented] (SPARK-16825) Replace hive.default.fileformat by spark.sql.default.fileformat

2016-07-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15401350#comment-15401350 ] Apache Spark commented on SPARK-16825: -- User 'gatorsmile' has created a pull request

[jira] [Assigned] (SPARK-16825) Replace hive.default.fileformat by spark.sql.default.fileformat

2016-07-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16825: Assignee: (was: Apache Spark) > Replace hive.default.fileformat by spark.sql.default.f

[jira] [Resolved] (SPARK-16811) spark streaming-Exception in thread “submit-job-thread-pool-40”

2016-07-31 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-16811. --- Resolution: Invalid Read https://cwiki.apache.org/confluence/display/SPARK/Contributing+to+Spark fir

[jira] [Updated] (SPARK-16816) Add documentation to create JavaSparkContext from SparkSession

2016-07-31 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-16816: -- Target Version/s: (was: 2.0.0) Labels: (was: documentation patch) Priority

[jira] [Updated] (SPARK-16813) Remove private[sql] and private[spark] from catalyst package

2016-07-31 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16813: Fix Version/s: 2.0.1 > Remove private[sql] and private[spark] from catalyst package > -

[jira] [Commented] (SPARK-16534) Kafka 0.10 Python support

2016-07-31 Thread Cody Koeninger (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15401208#comment-15401208 ] Cody Koeninger commented on SPARK-16534: It's on the PR. Yes, one comitter veto

[jira] [Updated] (SPARK-16816) Add documentation to create JavaSparkContext from SparkSession

2016-07-31 Thread sandeep purohit (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sandeep purohit updated SPARK-16816: Labels: documentation patch (was: patch) Description: In this issue the user can

[jira] [Updated] (SPARK-16816) Add documentation to create JavaSparkContext from SparkSession

2016-07-31 Thread sandeep purohit (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sandeep purohit updated SPARK-16816: Summary: Add documentation to create JavaSparkContext from SparkSession (was: Add api to g

[jira] [Commented] (SPARK-12157) Support numpy types as return values of Python UDFs

2016-07-31 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15401198#comment-15401198 ] Nicholas Chammas commented on SPARK-12157: -- OK. I've raised the issue of documen

[jira] [Commented] (SPARK-16824) Add API docs for VectorUDT

2016-07-31 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15401197#comment-15401197 ] Nicholas Chammas commented on SPARK-16824: -- cc [~josephkb] [~mengxr] - Should th

[jira] [Created] (SPARK-16824) Add API docs for VectorUDT

2016-07-31 Thread Nicholas Chammas (JIRA)
Nicholas Chammas created SPARK-16824: Summary: Add API docs for VectorUDT Key: SPARK-16824 URL: https://issues.apache.org/jira/browse/SPARK-16824 Project: Spark Issue Type: Improvement

[jira] [Comment Edited] (SPARK-16534) Kafka 0.10 Python support

2016-07-31 Thread Jacek Laskowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15401192#comment-15401192 ] Jacek Laskowski edited comment on SPARK-16534 at 7/31/16 3:22 PM: -

[jira] [Commented] (SPARK-16534) Kafka 0.10 Python support

2016-07-31 Thread Jacek Laskowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15401192#comment-15401192 ] Jacek Laskowski commented on SPARK-16534: - Ming posting the -1 from [~rxin] ad ac

[jira] [Commented] (SPARK-12157) Support numpy types as return values of Python UDFs

2016-07-31 Thread Maciej Szymkiewicz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15401190#comment-15401190 ] Maciej Szymkiewicz commented on SPARK-12157: Well, it is alpha component (see

[jira] [Created] (SPARK-16823) One dimensional typed select on DataFrame does not work as expected

2016-07-31 Thread TobiasP (JIRA)
TobiasP created SPARK-16823: --- Summary: One dimensional typed select on DataFrame does not work as expected Key: SPARK-16823 URL: https://issues.apache.org/jira/browse/SPARK-16823 Project: Spark Is

[jira] [Commented] (SPARK-12157) Support numpy types as return values of Python UDFs

2016-07-31 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15401179#comment-15401179 ] Nicholas Chammas commented on SPARK-12157: -- Thanks for the pointer, Maciej. It a

[jira] [Updated] (SPARK-16811) spark streaming-Exception in thread “submit-job-thread-pool-40”

2016-07-31 Thread BinXu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BinXu updated SPARK-16811: -- Remaining Estimate: 1,176h (was: 4h) Original Estimate: 1,176h (was: 4h) > spark streaming-Exception in

[jira] [Commented] (SPARK-14155) Hide UserDefinedType in Spark 2.0

2016-07-31 Thread Maciej Szymkiewicz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15401156#comment-15401156 ] Maciej Szymkiewicz commented on SPARK-14155: [~rxin] Is there any progress on

[jira] [Commented] (SPARK-12157) Support numpy types as return values of Python UDFs

2016-07-31 Thread Maciej Szymkiewicz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15401153#comment-15401153 ] Maciej Szymkiewicz commented on SPARK-12157: [~nchammas]You're using incorrec

[jira] [Assigned] (SPARK-16770) Spark shell not usable with german keyboard due to JLine version

2016-07-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16770: Assignee: (was: Apache Spark) > Spark shell not usable with german keyboard due to JLi

[jira] [Commented] (SPARK-16770) Spark shell not usable with german keyboard due to JLine version

2016-07-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15401151#comment-15401151 ] Apache Spark commented on SPARK-16770: -- User 'stsc-pentasys' has created a pull requ

[jira] [Assigned] (SPARK-16770) Spark shell not usable with german keyboard due to JLine version

2016-07-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16770: Assignee: Apache Spark > Spark shell not usable with german keyboard due to JLine version

[jira] [Commented] (SPARK-16822) Support latex in scaladoc with MathJax

2016-07-31 Thread Shuai Lin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15401145#comment-15401145 ] Shuai Lin commented on SPARK-16822: --- I'm working on it and will post a PR soon. > Supp

[jira] [Created] (SPARK-16822) Support latex in scaladoc with MathJax

2016-07-31 Thread Shuai Lin (JIRA)
Shuai Lin created SPARK-16822: - Summary: Support latex in scaladoc with MathJax Key: SPARK-16822 URL: https://issues.apache.org/jira/browse/SPARK-16822 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-16820) Sparse - Sparse matrix multiplication

2016-07-31 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15401135#comment-15401135 ] Sean Owen commented on SPARK-16820: --- I think it depends a lot on how big the benefit is

[jira] [Commented] (SPARK-16821) GraphX MCL algorithm

2016-07-31 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15401134#comment-15401134 ] Sean Owen commented on SPARK-16821: --- Generally these don't go into Spark but are made a

[jira] [Resolved] (SPARK-16819) Exception in thread “main” org.apache.spark.SparkException: Application application finished with failed status

2016-07-31 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-16819. --- Resolution: Invalid Questions should go to u...@spark.apache.org, not JIRA. However I'd also say tha

[jira] [Commented] (SPARK-6305) Add support for log4j 2.x to Spark

2016-07-31 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15401129#comment-15401129 ] Sean Owen commented on SPARK-6305: -- Yeah, I tried making Spark use log4j 2 and it was alm

[jira] [Commented] (SPARK-16534) Kafka 0.10 Python support

2016-07-31 Thread Cody Koeninger (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15401128#comment-15401128 ] Cody Koeninger commented on SPARK-16534: This idea got a -1 from Reynold, so unle

[jira] [Commented] (SPARK-16810) Refactor registerSinks with multiple constructos

2016-07-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15401062#comment-15401062 ] Apache Spark commented on SPARK-16810: -- User 'lovexi' has created a pull request for

[jira] [Resolved] (SPARK-16813) Remove private[sql] and private[spark] from catalyst package

2016-07-31 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-16813. - Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 14418 [https://githu

[jira] [Commented] (SPARK-16820) Sparse - Sparse matrix multiplication

2016-07-31 Thread Ohad Raviv (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15401039#comment-15401039 ] Ohad Raviv commented on SPARK-16820: I will create a PR soon with a suggested fix, bu

[jira] [Created] (SPARK-16821) GraphX MCL algorithm

2016-07-31 Thread Ohad Raviv (JIRA)
Ohad Raviv created SPARK-16821: -- Summary: GraphX MCL algorithm Key: SPARK-16821 URL: https://issues.apache.org/jira/browse/SPARK-16821 Project: Spark Issue Type: New Feature Components

[jira] [Created] (SPARK-16820) Sparse - Sparse matrix multiplication

2016-07-31 Thread Ohad Raviv (JIRA)
Ohad Raviv created SPARK-16820: -- Summary: Sparse - Sparse matrix multiplication Key: SPARK-16820 URL: https://issues.apache.org/jira/browse/SPARK-16820 Project: Spark Issue Type: New Feature