[jira] [Resolved] (SPARK-12491) UDAF result differs in SQL if alias is used

2015-12-28 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-12491. -- Resolution: Duplicate Fix Version/s: 1.6.0 1.5.3 > UDAF result differs in

[jira] [Commented] (SPARK-12491) UDAF result differs in SQL if alias is used

2015-12-28 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15073146#comment-15073146 ] Herman van Hovell commented on SPARK-12491: --- I just tried the latest 1.5 branch on a spark

[jira] [Closed] (SPARK-12531) Add median and mode to Summary statistics

2015-12-28 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley closed SPARK-12531. - Resolution: Duplicate > Add median and mode to Summary statistics >

[jira] [Commented] (SPARK-12531) Add median and mode to Summary statistics

2015-12-28 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15073159#comment-15073159 ] Joseph K. Bradley commented on SPARK-12531: --- [~gauravkumar37] The current plan for these stats

[jira] [Commented] (SPARK-12488) LDA describeTopics() Generates Invalid Term IDs

2015-12-28 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15073187#comment-15073187 ] Joseph K. Bradley commented on SPARK-12488: --- I don't see what could be causing this yet, but

[jira] [Closed] (SPARK-5742) Network over RDMA

2015-12-28 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin closed SPARK-5742. -- Resolution: Later This is something excellent to explore. However, I'm going to close the ticket as

[jira] [Resolved] (SPARK-12522) Add the missing the document string for the SQL configuration

2015-12-28 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-12522. - Resolution: Fixed Assignee: Xiao Li Fix Version/s: 2.0.0 > Add the missing the

[jira] [Commented] (SPARK-12239) ​SparkR - Not distributing SparkR module in YARN

2015-12-28 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15073341#comment-15073341 ] Sun Rui commented on SPARK-12239: - Instead of case-by-case fix, I would prefer the latter approach.

[jira] [Reopened] (SPARK-12493) Can't open "details" span of ExecutionsPage in IE11

2015-12-28 Thread meiyoula (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] meiyoula reopened SPARK-12493: -- > Can't open "details" span of ExecutionsPage in IE11 >

[jira] [Commented] (SPARK-12493) Can't open "details" span of ExecutionsPage in IE11

2015-12-28 Thread meiyoula (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15073342#comment-15073342 ] meiyoula commented on SPARK-12493: -- [~sowen]I think it's simply to reproduce this problem. I don't know

[jira] [Comment Edited] (SPARK-12511) streaming driver with checkpointing unable to finalize leading to OOM

2015-12-28 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15073344#comment-15073344 ] Shixiong Zhu edited comment on SPARK-12511 at 12/29/15 1:33 AM: Has not

[jira] [Commented] (SPARK-12511) streaming driver with checkpointing unable to finalize leading to OOM

2015-12-28 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15073344#comment-15073344 ] Shixiong Zhu commented on SPARK-12511: -- Has not yet figured out the root cause. Here are my found

[jira] [Comment Edited] (SPARK-12493) Can't open "details" span of ExecutionsPage in IE11

2015-12-28 Thread meiyoula (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15073342#comment-15073342 ] meiyoula edited comment on SPARK-12493 at 12/29/15 1:31 AM: [~sowen], I think

[jira] [Commented] (SPARK-12511) streaming driver with checkpointing unable to finalize leading to OOM

2015-12-28 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15073349#comment-15073349 ] Shixiong Zhu commented on SPARK-12511: -- Is it possible that your sending loop prevents the Py4j's

[jira] [Updated] (SPARK-12493) Can't open "details" span of ExecutionsPage in IE11

2015-12-28 Thread meiyoula (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] meiyoula updated SPARK-12493: - Description: Reproduce steps: 1. sbin/start-thriftserver.sh 2. Beeline connect to thriftserver, and run

[jira] [Updated] (SPARK-12493) Can't open "details" span of ExecutionsPage in IE11

2015-12-28 Thread meiyoula (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] meiyoula updated SPARK-12493: - Attachment: IE version.png > Can't open "details" span of ExecutionsPage in IE11 >

[jira] [Reopened] (SPARK-12492) SQL page of Spark-sql is always blank

2015-12-28 Thread meiyoula (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] meiyoula reopened SPARK-12492: -- Still has this problem > SQL page of Spark-sql is always blank > --

[jira] [Assigned] (SPARK-12512) WithColumn does not work on multiple column with special character

2015-12-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12512: Assignee: Apache Spark > WithColumn does not work on multiple column with special

[jira] [Commented] (SPARK-12492) SQL page of Spark-sql is always blank

2015-12-28 Thread meiyoula (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15073378#comment-15073378 ] meiyoula commented on SPARK-12492: -- [~srowen], I still met this problem using the latest master branch.

[jira] [Comment Edited] (SPARK-12196) Store blocks in different speed storage devices by hierarchy way

2015-12-28 Thread wei wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15073386#comment-15073386 ] wei wu edited comment on SPARK-12196 at 12/29/15 2:31 AM: -- Yes, Hao. The local

[jira] [Commented] (SPARK-12196) Store blocks in different speed storage devices by hierarchy way

2015-12-28 Thread wei wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15073386#comment-15073386 ] wei wu commented on SPARK-12196: Yes, Hao. The local dir path format "[SSD]file:///") may be not

[jira] [Created] (SPARK-12547) Tighten scala style checker enforcement for UDF registration

2015-12-28 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-12547: --- Summary: Tighten scala style checker enforcement for UDF registration Key: SPARK-12547 URL: https://issues.apache.org/jira/browse/SPARK-12547 Project: Spark

[jira] [Updated] (SPARK-11193) Spark 1.5+ Kinesis Streaming - ClassCastException when starting KinesisReceiver

2015-12-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11193: -- Assignee: Jean-Baptiste Onofré > Spark 1.5+ Kinesis Streaming - ClassCastException when starting >

[jira] [Assigned] (SPARK-12536) Fix the Explain Outputs of Empty LocalRelation and LocalTableScan

2015-12-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12536: Assignee: Apache Spark > Fix the Explain Outputs of Empty LocalRelation and

[jira] [Resolved] (SPARK-12535) Generating scaladoc using sbt fails for network-common and catalyst modules

2015-12-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-12535. --- Resolution: Duplicate > Generating scaladoc using sbt fails for network-common and catalyst modules

[jira] [Commented] (SPARK-12531) Add median and mode to Summary statistics

2015-12-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15072582#comment-15072582 ] Sean Owen commented on SPARK-12531: --- That wasn't my point -- you can't compute them exactly and

[jira] [Comment Edited] (SPARK-12506) Push down WHERE clause arithmetic operator to JDBC layer

2015-12-28 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15072575#comment-15072575 ] Hyukjin Kwon edited comment on SPARK-12506 at 12/28/15 9:54 AM:

[jira] [Comment Edited] (SPARK-12420) Have a built-in CSV data source implementation

2015-12-28 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15072580#comment-15072580 ] Hyukjin Kwon edited comment on SPARK-12420 at 12/28/15 10:05 AM: - +1, I

[jira] [Resolved] (SPARK-12492) SQL page of Spark-sql is always blank

2015-12-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-12492. --- Resolution: Cannot Reproduce > SQL page of Spark-sql is always blank >

[jira] [Resolved] (SPARK-12493) Can't open "details" span of ExecutionsPage in IE11

2015-12-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-12493. --- Resolution: Cannot Reproduce > Can't open "details" span of ExecutionsPage in IE11 >

[jira] [Updated] (SPARK-12536) Fix the Explain Outputs of Empty LocalRelation and LocalTableScan

2015-12-28 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-12536: Description: The filter Filter (False) generates an empty LocalRelation in SimplifyFilters. In the

[jira] [Commented] (SPARK-12502) Script /dev/run-tests fails when IBM Java is used

2015-12-28 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15072565#comment-15072565 ] Kousuke Saruta commented on SPARK-12502: Oh, [~srowen] has already modified the Fix Version/s

[jira] [Issue Comment Deleted] (SPARK-12196) Store blocks in different speed storage devices by hierarchy way

2015-12-28 Thread Zhang, Liye (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhang, Liye updated SPARK-12196: Comment: was deleted (was: I am out of office with limited email access from 12/21/2015 to

[jira] [Commented] (SPARK-11559) Make `runs` no effect in k-means

2015-12-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15072572#comment-15072572 ] Apache Spark commented on SPARK-11559: -- User 'yanboliang' has created a pull request for this issue:

[jira] [Commented] (SPARK-12196) Store blocks in different speed storage devices by hierarchy way

2015-12-28 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15072634#comment-15072634 ] Cheng Hao commented on SPARK-12196: --- Thank you wei wu to support this feature! However, we're trying

[jira] [Created] (SPARK-12536) Fix the Explain Outputs of Empty LocalRelation and LocalTableScan

2015-12-28 Thread Xiao Li (JIRA)
Xiao Li created SPARK-12536: --- Summary: Fix the Explain Outputs of Empty LocalRelation and LocalTableScan Key: SPARK-12536 URL: https://issues.apache.org/jira/browse/SPARK-12536 Project: Spark

[jira] [Commented] (SPARK-12420) Have a built-in CSV data source implementation

2015-12-28 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15072580#comment-15072580 ] Hyukjin Kwon commented on SPARK-12420: -- +1, I was wondering why it has been staying third party. >

[jira] [Updated] (SPARK-12353) wrong output for countByValue and countByValueAndWindow

2015-12-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12353: -- Assignee: Saisai Shao > wrong output for countByValue and countByValueAndWindow >

[jira] [Resolved] (SPARK-12353) wrong output for countByValue and countByValueAndWindow

2015-12-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-12353. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10350

[jira] [Commented] (SPARK-12196) Store blocks in different speed storage devices by hierarchy way

2015-12-28 Thread wei wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15072567#comment-15072567 ] wei wu commented on SPARK-12196: We also have the similar idea about Spark supported SSD for Block

[jira] [Commented] (SPARK-12534) Document missing command line options to Spark properties mapping

2015-12-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15072587#comment-15072587 ] Sean Owen commented on SPARK-12534: --- I don't think this info is worth maintaining redundantly in the

[jira] [Resolved] (SPARK-12515) Minor clarification on DataFrameReader.jdbc doc

2015-12-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-12515. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10465

[jira] [Assigned] (SPARK-12224) R support for JDBC source

2015-12-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12224: Assignee: Apache Spark > R support for JDBC source > - > >

[jira] [Assigned] (SPARK-12224) R support for JDBC source

2015-12-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12224: Assignee: (was: Apache Spark) > R support for JDBC source > -

[jira] [Commented] (SPARK-12506) Push down WHERE clause arithmetic operator to JDBC layer

2015-12-28 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15072575#comment-15072575 ] Hyukjin Kwon commented on SPARK-12506: -- [~huaxing] Maybe we should do this one first

[jira] [Commented] (SPARK-11600) Spark MLlib 1.6 QA umbrella

2015-12-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15072584#comment-15072584 ] Sean Owen commented on SPARK-11600: --- Shouldn't these be resolved as of 1.6.0? the unfinished children

[jira] [Updated] (SPARK-12515) Minor clarification on DataFrameReader.jdbc doc

2015-12-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12515: -- Assignee: Felix Cheung (was: Apache Spark) Priority: Trivial (was: Minor) Component/s:

[jira] [Assigned] (SPARK-12224) R support for JDBC source

2015-12-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12224: Assignee: Apache Spark > R support for JDBC source > - > >

[jira] [Commented] (SPARK-12537) Add option to accept quoting of all character backslash quoting mechanism

2015-12-28 Thread Cazen Lee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15072730#comment-15072730 ] Cazen Lee commented on SPARK-12537: --- I misunderstood. recreate pull request(10497) > Add option to

[jira] [Updated] (SPARK-12538) bucketed table support

2015-12-28 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-12538: Description: cc [~nongli] , please attach the design doc. > bucketed table support >

[jira] [Created] (SPARK-12539) support writing bucketed table

2015-12-28 Thread Wenchen Fan (JIRA)
Wenchen Fan created SPARK-12539: --- Summary: support writing bucketed table Key: SPARK-12539 URL: https://issues.apache.org/jira/browse/SPARK-12539 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-12538) bucketed table support

2015-12-28 Thread Wenchen Fan (JIRA)
Wenchen Fan created SPARK-12538: --- Summary: bucketed table support Key: SPARK-12538 URL: https://issues.apache.org/jira/browse/SPARK-12538 Project: Spark Issue Type: New Feature

[jira] [Assigned] (SPARK-12539) support writing bucketed table

2015-12-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12539: Assignee: Apache Spark > support writing bucketed table > --

[jira] [Updated] (SPARK-12537) Add option to accept quoting of all character backslash quoting mechanism

2015-12-28 Thread Cazen Lee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cazen Lee updated SPARK-12537: -- Description: We can provides the option to choose JSON parser can be enabled to accept quoting of all

[jira] [Commented] (SPARK-12537) Add option to accept quoting of all character backslash quoting mechanism

2015-12-28 Thread Cazen Lee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15072715#comment-15072715 ] Cazen Lee commented on SPARK-12537: --- Good Day Owen! This is Cazen The Problem is character with

[jira] [Commented] (SPARK-12537) Add option to accept quoting of all character backslash quoting mechanism

2015-12-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15072725#comment-15072725 ] Apache Spark commented on SPARK-12537: -- User 'Cazen' has created a pull request for this issue:

[jira] [Commented] (SPARK-12537) Add option to accept quoting of all character backslash quoting mechanism

2015-12-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15072733#comment-15072733 ] Sean Owen commented on SPARK-12537: --- I understand that. I'm wondering when such JSON would come up in

[jira] [Updated] (SPARK-12537) Add option to accept quoting of all character backslash quoting mechanism

2015-12-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12537: -- Priority: Minor (was: Major) Can you be more specific about what the problem is in practice? what

[jira] [Updated] (SPARK-12537) Add option to accept quoting of all character backslash quoting mechanism

2015-12-28 Thread Cazen Lee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cazen Lee updated SPARK-12537: -- Priority: Major (was: Minor) Description: We can provides the option to choose JSON parser can

[jira] [Updated] (SPARK-12537) Add option to accept quoting of all character backslash quoting mechanism

2015-12-28 Thread Cazen Lee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cazen Lee updated SPARK-12537: -- Description: We can provides the option to choose JSON parser can be enabled to accept quoting of all

[jira] [Commented] (SPARK-8616) SQLContext doesn't handle tricky column names when loading from JDBC

2015-12-28 Thread PJ Fanning (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15072697#comment-15072697 ] PJ Fanning commented on SPARK-8616: --- Seems to duplicate the 'In Progress' task, SPARK-12437. >

[jira] [Commented] (SPARK-12537) Add option to accept quoting of all character backslash quoting mechanism

2015-12-28 Thread Cazen Lee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15072779#comment-15072779 ] Cazen Lee commented on SPARK-12537: --- Hmm I hope that this example is a good description.. Assume that

[jira] [Commented] (SPARK-12537) Add option to accept quoting of all character backslash quoting mechanism

2015-12-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15072802#comment-15072802 ] Sean Owen commented on SPARK-12537: --- According to the JSON spec at http://json.org/, "John D\oe" is not

[jira] [Resolved] (SPARK-9505) DataFrames : Mysql JDBC not support column names with special characters

2015-12-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-9505. -- Resolution: Duplicate > DataFrames : Mysql JDBC not support column names with special characters >

[jira] [Updated] (SPARK-9505) DataFrames : Mysql JDBC not support column names with special characters

2015-12-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-9505: - Priority: Major (was: Blocker) > DataFrames : Mysql JDBC not support column names with special

[jira] [Commented] (SPARK-12539) support writing bucketed table

2015-12-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15072766#comment-15072766 ] Apache Spark commented on SPARK-12539: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Created] (SPARK-12537) Add option to accept quoting of all character backslash quoting mechanism

2015-12-28 Thread Cazen Lee (JIRA)
Cazen Lee created SPARK-12537: - Summary: Add option to accept quoting of all character backslash quoting mechanism Key: SPARK-12537 URL: https://issues.apache.org/jira/browse/SPARK-12537 Project: Spark

[jira] [Assigned] (SPARK-12537) Add option to accept quoting of all character backslash quoting mechanism

2015-12-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12537: Assignee: Apache Spark > Add option to accept quoting of all character backslash quoting

[jira] [Commented] (SPARK-12218) Invalid splitting of nested AND expressions in Data Source filter API

2015-12-28 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15072901#comment-15072901 ] Yin Huai commented on SPARK-12218: -- Just a note. https://github.com/apache/spark/pull/10377 is a

[jira] [Commented] (SPARK-12491) UDAF result differs in SQL if alias is used

2015-12-28 Thread Tristan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15072902#comment-15072902 ] Tristan commented on SPARK-12491: - REPL with logical plans: {code:None|borderStyle=solid} scala> import

[jira] [Updated] (SPARK-12491) UDAF result differs in SQL if alias is used

2015-12-28 Thread Tristan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tristan updated SPARK-12491: Description: Using the GeometricMean UDAF example

[jira] [Comment Edited] (SPARK-10873) can't sort columns on history page

2015-12-28 Thread Zhuo Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15062794#comment-15062794 ] Zhuo Liu edited comment on SPARK-10873 at 12/28/15 3:51 PM: Hi Alex, I

[jira] [Commented] (SPARK-11185) Add more task metrics to the "all Stages Page"

2015-12-28 Thread Derek Dagit (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15072870#comment-15072870 ] Derek Dagit commented on SPARK-11185: - [~pwendell], [~kayousterhout], [~andrewor14], [~irashid]

[jira] [Commented] (SPARK-12319) Address endian specific problems surfaced in 1.6

2015-12-28 Thread Tim Preece (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15073145#comment-15073145 ] Tim Preece commented on SPARK-12319: Hi, The failing test is already checked in. It is:

[jira] [Resolved] (SPARK-12441) Fixing missingInput in all Logical/Physical operators

2015-12-28 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-12441. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10393

[jira] [Updated] (SPARK-12494) Array out of bound Exception in KMeans Yarn Mode

2015-12-28 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-12494: -- Priority: Major (was: Blocker) > Array out of bound Exception in KMeans Yarn Mode >

[jira] [Assigned] (SPARK-12486) Executors are not always terminated successfully by the worker.

2015-12-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12486: Assignee: Apache Spark > Executors are not always terminated successfully by the worker.

[jira] [Commented] (SPARK-12491) UDAF result differs in SQL if alias is used

2015-12-28 Thread Tristan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15073191#comment-15073191 ] Tristan commented on SPARK-12491: - 1.6.0rc4 works in cluster mode also. Thank you! > UDAF result differs

[jira] [Commented] (SPARK-10789) Cluster mode SparkSubmit classpath only includes Spark assembly

2015-12-28 Thread Jonathan Kelly (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15073193#comment-15073193 ] Jonathan Kelly commented on SPARK-10789: Here's another patch that can be applied to v1.6.0:

[jira] [Updated] (SPARK-10789) Cluster mode SparkSubmit classpath only includes Spark assembly

2015-12-28 Thread Jonathan Kelly (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Kelly updated SPARK-10789: --- Attachment: SPARK-10789.v1.6.0.diff Here's another patch that can be applied to v1.6.0. >

[jira] [Issue Comment Deleted] (SPARK-10789) Cluster mode SparkSubmit classpath only includes Spark assembly

2015-12-28 Thread Jonathan Kelly (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Kelly updated SPARK-10789: --- Comment: was deleted (was: Here's another patch that can be applied to v1.6.0.) > Cluster

[jira] [Commented] (SPARK-10789) Cluster mode SparkSubmit classpath only includes Spark assembly

2015-12-28 Thread Jonathan Kelly (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15073194#comment-15073194 ] Jonathan Kelly commented on SPARK-10789: An alternative to this change could be to have another

[jira] [Updated] (SPARK-12494) Array out of bound Exception in KMeans Yarn Mode

2015-12-28 Thread Anandraj (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anandraj updated SPARK-12494: - Attachment: vectors1.tar.gz Sample data for reproducing the K-Means error in yarn cluster mode. Program

[jira] [Comment Edited] (SPARK-12494) Array out of bound Exception in KMeans Yarn Mode

2015-12-28 Thread Anandraj (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15073246#comment-15073246 ] Anandraj edited comment on SPARK-12494 at 12/28/15 11:11 PM: - I couldn't

[jira] [Assigned] (SPARK-12525) Fix compiler warnings in Kinesis ASL module due to @transient annotations

2015-12-28 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen reassigned SPARK-12525: -- Assignee: Josh Rosen (was: Apache Spark) > Fix compiler warnings in Kinesis ASL module due

[jira] [Resolved] (SPARK-12525) Fix compiler warnings in Kinesis ASL module due to @transient annotations

2015-12-28 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-12525. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10479

[jira] [Commented] (SPARK-12488) LDA describeTopics() Generates Invalid Term IDs

2015-12-28 Thread Ilya Ganelin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15073236#comment-15073236 ] Ilya Ganelin commented on SPARK-12488: -- I'll submit a dataset that causes this when I have a moment.

[jira] [Resolved] (SPARK-12489) Fix minor issues found by Findbugs

2015-12-28 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-12489. -- Resolution: Fixed Assignee: Shixiong Zhu > Fix minor issues found by Findbugs >

[jira] [Updated] (SPARK-12489) Fix minor issues found by Findbugs

2015-12-28 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-12489: - Affects Version/s: 1.6.0 > Fix minor issues found by Findbugs >

[jira] [Updated] (SPARK-12489) Fix minor issues found by Findbugs

2015-12-28 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-12489: - Fix Version/s: 2.0.0 1.6.1 > Fix minor issues found by Findbugs >

[jira] [Updated] (SPARK-12491) UDAF result differs in SQL if alias is used

2015-12-28 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-12491: -- Attachment: UDAF_GM.zip Code for the attached .jar. > UDAF result differs in SQL if

[jira] [Commented] (SPARK-12177) Update KafkaDStreams to new Kafka 0.9 Consumer API

2015-12-28 Thread Mario Briggs (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15073035#comment-15073035 ] Mario Briggs commented on SPARK-12177: -- On the issue of lots of duplicate code from the original, 1

[jira] [Commented] (SPARK-10625) Spark SQL JDBC read/write is unable to handle JDBC Drivers that adds unserializable objects into connection properties

2015-12-28 Thread Peng Cheng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15073036#comment-15073036 ] Peng Cheng commented on SPARK-10625: I think the pull request has been merged. Can it be closed now?

[jira] [Commented] (SPARK-10625) Spark SQL JDBC read/write is unable to handle JDBC Drivers that adds unserializable objects into connection properties

2015-12-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15073046#comment-15073046 ] Sean Owen commented on SPARK-10625: --- It has not been merged. https://github.com/apache/spark/pull/8785

[jira] [Assigned] (SPARK-12527) Add private val after @transient for kinesis-asl module

2015-12-28 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen reassigned SPARK-12527: -- Assignee: Josh Rosen (was: Apache Spark) > Add private val after @transient for kinesis-asl

[jira] [Commented] (SPARK-11460) Locality waits should be based on task set creation time, not last launch time

2015-12-28 Thread Casimir IV Jagiellon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15073091#comment-15073091 ] Casimir IV Jagiellon commented on SPARK-11460: -- Sorry, I accidentally put 11460 in my PR

[jira] [Resolved] (SPARK-12231) Failed to generate predicate Error when using dropna

2015-12-28 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-12231. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10388

[jira] [Updated] (SPARK-12231) Failed to generate predicate Error when using dropna

2015-12-28 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-12231: - Assignee: kevin yu > Failed to generate predicate Error when using dropna >

[jira] [Updated] (SPARK-12517) No default RDD name for ones created by sc.textFile

2015-12-28 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-12517: --- Target Version/s: 1.6.1, 2.0.0 (was: 1.5.1, 1.5.2) > No default RDD name for ones created

[jira] [Commented] (SPARK-5885) Add VectorAssembler

2015-12-28 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15073123#comment-15073123 ] Joseph K. Bradley commented on SPARK-5885: -- I'd currently recommend using DataFrame operations to

  1   2   >