[jira] [Updated] (SPARK-12196) Store blocks in storage devices with hierarchy way

[ https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yucai updated SPARK-12196: -- Description: *Problem* Nowadays, users have both SSDs and HDDs. SSDs have great performance, but capacity is

[jira] [Commented] (SPARK-12231) Failed to generate predicate Error when using dropna

[ https://issues.apache.org/jira/browse/SPARK-12231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048260#comment-15048260 ] yahsuan, chang commented on SPARK-12231: the following code won't throw exception on my

[jira] [Commented] (SPARK-12225) Support adding or replacing multiple columns at once in DataFrame API

[ https://issues.apache.org/jira/browse/SPARK-12225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048286#comment-15048286 ] Reynold Xin commented on SPARK-12225: - Why is this necessary? It seems difficult to design an API for

[jira] [Commented] (SPARK-12225) Support adding or replacing multiple columns at once in DataFrame API

[ https://issues.apache.org/jira/browse/SPARK-12225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048432#comment-15048432 ] Sun Rui commented on SPARK-12225: - [~r...@databricks.com] This comes from supporting mutate() function

[jira] [Closed] (SPARK-11621) ORC filter pushdown not working properly after new unhandled filter interface.

[ https://issues.apache.org/jira/browse/SPARK-11621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon closed SPARK-11621. Resolution: Fixed Fix Version/s: 1.6.0 > ORC filter pushdown not working properly after new

[jira] [Commented] (SPARK-8338) Ganglia fails to start

[ https://issues.apache.org/jira/browse/SPARK-8338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048294#comment-15048294 ] Michael Reilly commented on SPARK-8338: --- This issue appears to have resurfaced in 1.5.2. I'm

[jira] [Updated] (SPARK-12196) Store blocks in storage devices with hierarchy way

[ https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yucai updated SPARK-12196: -- Description: *Problem*: Nowadays, users have both SSDs and HDDs. SSDs have great performance, but capacity is

[jira] [Assigned] (SPARK-12238) s/Advanced sources/External Sources in docs.

[ https://issues.apache.org/jira/browse/SPARK-12238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12238: Assignee: (was: Apache Spark) > s/Advanced sources/External Sources in docs. >

[jira] [Updated] (SPARK-12196) Store blocks in storage devices with hierarchy way

[ https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yucai updated SPARK-12196: -- Description: *Problem*: Nowadays, users have both SSDs and HDDs. SSDs have great performance, but capacity is

[jira] [Commented] (SPARK-12238) s/Advanced sources/External Sources in docs.

[ https://issues.apache.org/jira/browse/SPARK-12238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048365#comment-15048365 ] Apache Spark commented on SPARK-12238: -- User 'ScrapCodes' has created a pull request for this issue:

[jira] [Created] (SPARK-12237) Unsupported message RpcMessage causes message retries

Jacek Laskowski created SPARK-12237: --- Summary: Unsupported message RpcMessage causes message retries Key: SPARK-12237 URL: https://issues.apache.org/jira/browse/SPARK-12237 Project: Spark

[jira] [Closed] (SPARK-12233) Cannot specify a data frame column during join

[ https://issues.apache.org/jira/browse/SPARK-12233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fengdong Yu closed SPARK-12233. --- Resolution: Not A Problem > Cannot specify a data frame column during join >

[jira] [Issue Comment Deleted] (SPARK-12233) Cannot specify a data frame column during join

[ https://issues.apache.org/jira/browse/SPARK-12233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fengdong Yu updated SPARK-12233: Comment: was deleted (was: I am using : select(df4("int"), df4("str1"), df4("str2"),

[jira] [Commented] (SPARK-12172) Consider removing SparkR internal RDD APIs

[ https://issues.apache.org/jira/browse/SPARK-12172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048312#comment-15048312 ] Alok Singh commented on SPARK-12172: +1 San Rui having RDD api in sparkR 1) lets people do low level

[jira] [Commented] (SPARK-11965) Update user guide for RFormula feature interactions

[ https://issues.apache.org/jira/browse/SPARK-11965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048283#comment-15048283 ] Apache Spark commented on SPARK-11965: -- User 'yanboliang' has created a pull request for this issue:

[jira] [Assigned] (SPARK-11965) Update user guide for RFormula feature interactions

[ https://issues.apache.org/jira/browse/SPARK-11965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11965: Assignee: (was: Apache Spark) > Update user guide for RFormula feature interactions >

[jira] [Assigned] (SPARK-11965) Update user guide for RFormula feature interactions

[ https://issues.apache.org/jira/browse/SPARK-11965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11965: Assignee: Apache Spark > Update user guide for RFormula feature interactions >

[jira] [Assigned] (SPARK-12238) s/Advanced sources/External Sources in docs.

[ https://issues.apache.org/jira/browse/SPARK-12238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12238: Assignee: Apache Spark > s/Advanced sources/External Sources in docs. >

[jira] [Created] (SPARK-12239) ​SparkR - Not distributing SparkR module in YARN

Sebastian YEPES FERNANDEZ created SPARK-12239: - Summary: ​SparkR - Not distributing SparkR module in YARN Key: SPARK-12239 URL: https://issues.apache.org/jira/browse/SPARK-12239 Project:

[jira] [Commented] (SPARK-12218) Boolean logic in sql does not work "not (A and B)" is not the same as "(not A) or (not B)"

[ https://issues.apache.org/jira/browse/SPARK-12218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048256#comment-15048256 ] Xiao Li commented on SPARK-12218: - That is what I did in my environment. {code} val df1 = Seq(1, 2,

[jira] [Commented] (SPARK-12233) Cannot specify a data frame column during join

[ https://issues.apache.org/jira/browse/SPARK-12233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048262#comment-15048262 ] Fengdong Yu commented on SPARK-12233: - I am using : select(df4("int"), df4("str1"), df4("str2"),

[jira] [Commented] (SPARK-12233) Cannot specify a data frame column during join

[ https://issues.apache.org/jira/browse/SPARK-12233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048264#comment-15048264 ] Fengdong Yu commented on SPARK-12233: - I am using : select(df4("int"), df4("str1"), df4("str2"),

[jira] [Issue Comment Deleted] (SPARK-12233) Cannot specify a data frame column during join

[ https://issues.apache.org/jira/browse/SPARK-12233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fengdong Yu updated SPARK-12233: Comment: was deleted (was: I am using : select(df4("int"), df4("str1"), df4("str2"),

[jira] [Commented] (SPARK-12233) Cannot specify a data frame column during join

[ https://issues.apache.org/jira/browse/SPARK-12233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048265#comment-15048265 ] Fengdong Yu commented on SPARK-12233: - I am using : select(df4("int"), df4("str1"), df4("str2"),

[jira] [Issue Comment Deleted] (SPARK-12233) Cannot specify a data frame column during join

[ https://issues.apache.org/jira/browse/SPARK-12233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fengdong Yu updated SPARK-12233: Comment: was deleted (was: I am using : select(df4("int"), df4("str1"), df4("str2"),

[jira] [Commented] (SPARK-12232) Consider exporting read.table in R

[ https://issues.apache.org/jira/browse/SPARK-12232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048261#comment-15048261 ] Sun Rui commented on SPARK-12232: - +1 [~yanboliang] Since we already have table(), we can change it to

[jira] [Commented] (SPARK-12233) Cannot specify a data frame column during join

[ https://issues.apache.org/jira/browse/SPARK-12233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048263#comment-15048263 ] Fengdong Yu commented on SPARK-12233: - I am using : select(df4("int"), df4("str1"), df4("str2"),

[jira] [Updated] (SPARK-12196) Store blocks in storage devices with hierarchy way

[ https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yucai updated SPARK-12196: -- Description: *Problem*: Nowadays, users have both SSDs and HDDs. SSDs have great performance, but capacity is

[jira] [Created] (SPARK-12238) s/Advanced sources/External Sources in docs.

Prashant Sharma created SPARK-12238: --- Summary: s/Advanced sources/External Sources in docs. Key: SPARK-12238 URL: https://issues.apache.org/jira/browse/SPARK-12238 Project: Spark Issue

[jira] [Commented] (SPARK-12179) Spark SQL get different result with the same code

[ https://issues.apache.org/jira/browse/SPARK-12179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048496#comment-15048496 ] Tao Li commented on SPARK-12179: I try to use spark internal Row_Number() udf, but still has the problem.

[jira] [Issue Comment Deleted] (SPARK-12196) Store blocks in storage devices with hierarchy way

[ https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yucai updated SPARK-12196: -- Comment: was deleted (was: Sorry, I have to delete this PR because of my wrong github operation, I will send

[jira] [Updated] (SPARK-12196) Store blocks in storage devices with hierarchy way

[ https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yucai updated SPARK-12196: -- Description: *Problem* Nowadays, users have both SSDs and HDDs. SSDs have great performance, but capacity is

[jira] [Commented] (SPARK-11630) ClosureCleaner incorrectly warns for class based closures

[ https://issues.apache.org/jira/browse/SPARK-11630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048518#comment-15048518 ] W.H. commented on SPARK-11630: -- +1 > ClosureCleaner incorrectly warns for class based closures >

[jira] [Updated] (SPARK-12196) Store blocks in storage devices with hierarchy way

[ https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yucai updated SPARK-12196: -- Description: *Problem* Nowadays, users have both SSDs and HDDs. SSDs have great performance, but capacity is

[jira] [Comment Edited] (SPARK-9858) Introduce an ExchangeCoordinator to estimate the number of post-shuffle partitions.

[ https://issues.apache.org/jira/browse/SPARK-9858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048636#comment-15048636 ] Adam Roberts edited comment on SPARK-9858 at 12/9/15 1:07 PM: -- Thanks for the

[jira] [Commented] (SPARK-12237) Unsupported message RpcMessage causes message retries

[ https://issues.apache.org/jira/browse/SPARK-12237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048651#comment-15048651 ] Nan Zhu commented on SPARK-12237: - may I ask how you found this issue? It seems that Master received

[jira] [Commented] (SPARK-12196) Store blocks in storage devices with hierarchy way

[ https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048574#comment-15048574 ] yucai commented on SPARK-12196: --- Sorry, I have to delete this PR because of my wrong github operation, I

[jira] [Commented] (SPARK-12196) Store blocks in storage devices with hierarchy way

[ https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048579#comment-15048579 ] yucai commented on SPARK-12196: --- Sorry, I have to delete this PR because of my wrong github operation, I

[jira] [Commented] (SPARK-12196) Store blocks in storage devices with hierarchy way

[ https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048572#comment-15048572 ] yucai commented on SPARK-12196: --- Sorry, I have to delete this PR because of my wrong github operation, I

[jira] [Commented] (SPARK-12196) Store blocks in storage devices with hierarchy way

[ https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048576#comment-15048576 ] yucai commented on SPARK-12196: --- Sorry, I have to delete this PR because of my wrong github operation, I

[jira] [Commented] (SPARK-12196) Store blocks in storage devices with hierarchy way

[ https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048571#comment-15048571 ] yucai commented on SPARK-12196: --- Sorry, I have to delete this PR because of my wrong github operation, I

[jira] [Commented] (SPARK-12196) Store blocks in storage devices with hierarchy way

[ https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048577#comment-15048577 ] yucai commented on SPARK-12196: --- Sorry, I have to delete this PR because of my wrong github operation, I

[jira] [Commented] (SPARK-12196) Store blocks in storage devices with hierarchy way

[ https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048570#comment-15048570 ] yucai commented on SPARK-12196: --- Sorry, I have to delete this PR because of my wrong github operation, I

[jira] [Commented] (SPARK-12196) Store blocks in storage devices with hierarchy way

[ https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048575#comment-15048575 ] yucai commented on SPARK-12196: --- Sorry, I have to delete this PR because of my wrong github operation, I

[jira] [Commented] (SPARK-12196) Store blocks in storage devices with hierarchy way

[ https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048573#comment-15048573 ] yucai commented on SPARK-12196: --- Sorry, I have to delete this PR because of my wrong github operation, I

[jira] [Commented] (SPARK-12196) Store blocks in storage devices with hierarchy way

[ https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048578#comment-15048578 ] yucai commented on SPARK-12196: --- Sorry, I have to delete this PR because of my wrong github operation, I

[jira] [Issue Comment Deleted] (SPARK-12196) Store blocks in storage devices with hierarchy way

[ https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yucai updated SPARK-12196: -- Comment: was deleted (was: Sorry, I have to delete this PR because of my wrong github operation, I will send

[jira] [Issue Comment Deleted] (SPARK-12196) Store blocks in storage devices with hierarchy way

[ https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yucai updated SPARK-12196: -- Comment: was deleted (was: Sorry, I have to delete this PR because of my wrong github operation, I will send

[jira] [Updated] (SPARK-12196) Store blocks in storage devices with hierarchy way

[ https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yucai updated SPARK-12196: -- Description: *Problem* Nowadays, users have both SSDs and HDDs. SSDs have great performance, but capacity is

[jira] [Commented] (SPARK-3461) Support external groupByKey using repartitionAndSortWithinPartitions

[ https://issues.apache.org/jira/browse/SPARK-3461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048609#comment-15048609 ] Pere Ferrera Bertran commented on SPARK-3461: - What's the status of this? We provided a hack

[jira] [Updated] (SPARK-12196) Store blocks in storage devices with hierarchy way

[ https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yucai updated SPARK-12196: -- Description: *Problem* Nowadays, users have both SSDs and HDDs. SSDs have great performance, but capacity is

[jira] [Updated] (SPARK-12196) Store blocks in storage devices with hierarchy way

[ https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yucai updated SPARK-12196: -- Description: *Problem* Nowadays, users have both SSDs and HDDs. SSDs have great performance, but capacity is

[jira] [Issue Comment Deleted] (SPARK-12196) Store blocks in storage devices with hierarchy way

[ https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yucai updated SPARK-12196: -- Comment: was deleted (was: Sorry, I have to delete this PR because of my wrong github operation, I will send

[jira] [Issue Comment Deleted] (SPARK-12196) Store blocks in storage devices with hierarchy way

[ https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yucai updated SPARK-12196: -- Comment: was deleted (was: Sorry, I have to delete this PR because of my wrong github operation, I will send

[jira] [Issue Comment Deleted] (SPARK-12196) Store blocks in storage devices with hierarchy way

[ https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yucai updated SPARK-12196: -- Comment: was deleted (was: Sorry, I have to delete this PR because of my wrong github operation, I will send

[jira] [Issue Comment Deleted] (SPARK-12196) Store blocks in storage devices with hierarchy way

[ https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yucai updated SPARK-12196: -- Comment: was deleted (was: Sorry, I have to delete this PR because of my wrong github operation, I will send

[jira] [Commented] (SPARK-12218) Boolean logic in sql does not work "not (A and B)" is not the same as "(not A) or (not B)"

[ https://issues.apache.org/jira/browse/SPARK-12218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048619#comment-15048619 ] Irakli Machabeli commented on SPARK-12218: -- I'm afraid I don't really know what that means,

[jira] [Commented] (SPARK-9858) Introduce an ExchangeCoordinator to estimate the number of post-shuffle partitions.

[ https://issues.apache.org/jira/browse/SPARK-9858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048636#comment-15048636 ] Adam Roberts commented on SPARK-9858: - Thanks for the prompt reply, rowBuffer is a variable in

[jira] [Commented] (SPARK-12196) Store blocks in storage devices with hierarchy way

[ https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048642#comment-15048642 ] Apache Spark commented on SPARK-12196: -- User 'yucai' has created a pull request for this issue:

[jira] [Commented] (SPARK-12229) How to Perform spark submit of application written in scala from Node js

[ https://issues.apache.org/jira/browse/SPARK-12229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048663#comment-15048663 ] Nan Zhu commented on SPARK-12229: - https://github.com/spark-jobserver/spark-jobserver might be a good

[jira] [Created] (SPARK-12240) FileNotFoundException: (Too many open files) when using multiple groupby on DataFrames

Shubhanshu Mishra created SPARK-12240: - Summary: FileNotFoundException: (Too many open files) when using multiple groupby on DataFrames Key: SPARK-12240 URL: https://issues.apache.org/jira/browse/SPARK-12240

[jira] [Issue Comment Deleted] (SPARK-12196) Store blocks in storage devices with hierarchy way

[ https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yucai updated SPARK-12196: -- Comment: was deleted (was: Sorry, I have to delete this PR because of my wrong github operation, I will send

[jira] [Issue Comment Deleted] (SPARK-12196) Store blocks in storage devices with hierarchy way

[ https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yucai updated SPARK-12196: -- Comment: was deleted (was: Sorry, I have to delete this PR because of my wrong github operation, I will send

[jira] [Comment Edited] (SPARK-12218) Boolean logic in sql does not work "not (A and B)" is not the same as "(not A) or (not B)"

[ https://issues.apache.org/jira/browse/SPARK-12218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048619#comment-15048619 ] Irakli Machabeli edited comment on SPARK-12218 at 12/9/15 2:28 PM: ---

[jira] [Comment Edited] (SPARK-12218) Boolean logic in sql does not work "not (A and B)" is not the same as "(not A) or (not B)"

[ https://issues.apache.org/jira/browse/SPARK-12218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048619#comment-15048619 ] Irakli Machabeli edited comment on SPARK-12218 at 12/9/15 2:40 PM: ---

[jira] [Commented] (SPARK-3461) Support external groupByKey using repartitionAndSortWithinPartitions

[ https://issues.apache.org/jira/browse/SPARK-3461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048802#comment-15048802 ] Reynold Xin commented on SPARK-3461: I'm going to close this one since this API is now available in

[jira] [Updated] (SPARK-12217) Document invalid handling for StringIndexer

[ https://issues.apache.org/jira/browse/SPARK-12217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12217: -- Target Version/s: (was: 1.6.0) Fix Version/s: (was: 1.6.1) (was:

[jira] [Commented] (SPARK-12219) Spark 1.5.2 code does not build on Scala 2.11.7 with SBT assembly

[ https://issues.apache.org/jira/browse/SPARK-12219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048807#comment-15048807 ] Sean Owen commented on SPARK-12219: --- Can you provide more detail? what exactly is the error and how are

[jira] [Resolved] (SPARK-12207) "org.datanucleus" is already registered

[ https://issues.apache.org/jira/browse/SPARK-12207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-12207. --- Resolution: Invalid I don't think is appropriate as a JIRA; you're not narrowing down the problem

[jira] [Resolved] (SPARK-12031) Integer overflow when do sampling.

[ https://issues.apache.org/jira/browse/SPARK-12031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-12031. --- Resolution: Fixed Fix Version/s: 1.6.1 2.0.0 Issue resolved by pull

[jira] [Updated] (SPARK-12195) Adding BigDecimal, Date and Timestamp into Encoder

[ https://issues.apache.org/jira/browse/SPARK-12195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12195: -- Assignee: Xiao Li > Adding BigDecimal, Date and Timestamp into Encoder >

[jira] [Updated] (SPARK-12201) add type coercion rule for greatest/least

[ https://issues.apache.org/jira/browse/SPARK-12201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12201: -- Assignee: Wenchen Fan > add type coercion rule for greatest/least >

[jira] [Comment Edited] (SPARK-12218) Boolean logic in sql does not work "not (A and B)" is not the same as "(not A) or (not B)"

[ https://issues.apache.org/jira/browse/SPARK-12218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048619#comment-15048619 ] Irakli Machabeli edited comment on SPARK-12218 at 12/9/15 2:27 PM: ---

[jira] [Created] (SPARK-12241) Improve failure reporting in Yarn client obtainTokenForHBase()

Steve Loughran created SPARK-12241: -- Summary: Improve failure reporting in Yarn client obtainTokenForHBase() Key: SPARK-12241 URL: https://issues.apache.org/jira/browse/SPARK-12241 Project: Spark

[jira] [Created] (SPARK-12242) DataFrame.transform function

Reynold Xin created SPARK-12242: --- Summary: DataFrame.transform function Key: SPARK-12242 URL: https://issues.apache.org/jira/browse/SPARK-12242 Project: Spark Issue Type: New Feature

[jira] [Commented] (SPARK-12242) DataFrame.transform function

[ https://issues.apache.org/jira/browse/SPARK-12242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048818#comment-15048818 ] Apache Spark commented on SPARK-12242: -- User 'rxin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-12242) DataFrame.transform function

[ https://issues.apache.org/jira/browse/SPARK-12242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12242: Assignee: Reynold Xin (was: Apache Spark) > DataFrame.transform function >

[jira] [Updated] (SPARK-12196) Store blocks in storage devices with hierarchy way

[ https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yucai updated SPARK-12196: -- Description: *Problem* Nowadays, users have both SSDs and HDDs. SSDs have great performance, but capacity is

[jira] [Resolved] (SPARK-12229) How to Perform spark submit of application written in scala from Node js

[ https://issues.apache.org/jira/browse/SPARK-12229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-12229. --- Resolution: Invalid Target Version/s: (was: 1.3.1) [~himanshu.techsk...@gmail.com] as I

[jira] [Updated] (SPARK-12216) Spark failed to delete temp directory

[ https://issues.apache.org/jira/browse/SPARK-12216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12216: -- Priority: Minor (was: Major) Component/s: Spark Shell [~skypickle] have a look at

[jira] [Resolved] (SPARK-6929) Alias for more complex expression causes attribute not been able to resolve

[ https://issues.apache.org/jira/browse/SPARK-6929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-6929. -- Resolution: Duplicate > Alias for more complex expression causes attribute not been able to resolve >

[jira] [Comment Edited] (SPARK-12218) Boolean logic in sql does not work "not (A and B)" is not the same as "(not A) or (not B)"

[ https://issues.apache.org/jira/browse/SPARK-12218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048619#comment-15048619 ] Irakli Machabeli edited comment on SPARK-12218 at 12/9/15 1:47 PM: --- In

[jira] [Commented] (SPARK-2280) Java & Scala reference docs should describe function reference behavior.

[ https://issues.apache.org/jira/browse/SPARK-2280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048750#comment-15048750 ] Sean Owen commented on SPARK-2280: -- I think it's still a reasonable improvement to the docs. I'd restrict

[jira] [Updated] (SPARK-12208) Abstract the examples into a common place

[ https://issues.apache.org/jira/browse/SPARK-12208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12208: -- Target Version/s: (was: 1.6.0) Priority: Minor (was: Major) > Abstract the examples

[jira] [Updated] (SPARK-12031) Integer overflow when do sampling.

[ https://issues.apache.org/jira/browse/SPARK-12031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12031: -- Assignee: uncleGen Priority: Major (was: Critical) > Integer overflow when do sampling. >

[jira] [Resolved] (SPARK-3461) Support external groupByKey using repartitionAndSortWithinPartitions

[ https://issues.apache.org/jira/browse/SPARK-3461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-3461. Resolution: Implemented Assignee: Reynold Xin (was: Sandy Ryza) Fix Version/s:

[jira] [Comment Edited] (SPARK-12218) Boolean logic in sql does not work "not (A and B)" is not the same as "(not A) or (not B)"

[ https://issues.apache.org/jira/browse/SPARK-12218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048619#comment-15048619 ] Irakli Machabeli edited comment on SPARK-12218 at 12/9/15 2:22 PM: ---

[jira] [Comment Edited] (SPARK-12218) Boolean logic in sql does not work "not (A and B)" is not the same as "(not A) or (not B)"

[ https://issues.apache.org/jira/browse/SPARK-12218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048619#comment-15048619 ] Irakli Machabeli edited comment on SPARK-12218 at 12/9/15 2:25 PM: ---

[jira] [Comment Edited] (SPARK-9858) Introduce an ExchangeCoordinator to estimate the number of post-shuffle partitions.

[ https://issues.apache.org/jira/browse/SPARK-9858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048636#comment-15048636 ] Adam Roberts edited comment on SPARK-9858 at 12/9/15 2:35 PM: -- Thanks for the

[jira] [Commented] (SPARK-6918) Secure HBase with Kerberos does not work over YARN

[ https://issues.apache.org/jira/browse/SPARK-6918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048799#comment-15048799 ] Pierre Beauvois commented on SPARK-6918: Hi, I aslo have the issue on my platform. Here are my

[jira] [Updated] (SPARK-12188) [SQL] Code refactoring and comment correction in Dataset APIs

[ https://issues.apache.org/jira/browse/SPARK-12188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12188: -- Assignee: Xiao Li > [SQL] Code refactoring and comment correction in Dataset APIs >

[jira] [Updated] (SPARK-12222) deserialize RoaringBitmap using Kryo serializer throw Buffer underflow exception

[ https://issues.apache.org/jira/browse/SPARK-1?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-1: -- Assignee: Fei Wang > deserialize RoaringBitmap using Kryo serializer throw Buffer underflow >

[jira] [Reopened] (SPARK-11621) ORC filter pushdown not working properly after new unhandled filter interface.

[ https://issues.apache.org/jira/browse/SPARK-11621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reopened SPARK-11621: --- > ORC filter pushdown not working properly after new unhandled filter interface. >

[jira] [Updated] (SPARK-12213) Query with only one distinct should not having on expand

[ https://issues.apache.org/jira/browse/SPARK-12213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12213: -- Component/s: SQL > Query with only one distinct should not having on expand >

[jira] [Resolved] (SPARK-11621) ORC filter pushdown not working properly after new unhandled filter interface.

[ https://issues.apache.org/jira/browse/SPARK-11621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-11621. --- Resolution: Duplicate Fix Version/s: (was: 1.6.0) > ORC filter pushdown not working

[jira] [Commented] (SPARK-10109) NPE when saving Parquet To HDFS

[ https://issues.apache.org/jira/browse/SPARK-10109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048821#comment-15048821 ] Paul Zaczkieiwcz commented on SPARK-10109: -- Still seeing this in 1.5.1. My use case is the same.

[jira] [Commented] (SPARK-2388) Streaming from multiple different Kafka topics is problematic

[ https://issues.apache.org/jira/browse/SPARK-2388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048885#comment-15048885 ] Dan Dutrow commented on SPARK-2388: --- The Kafka Direct API lets you insert a callback function that gives

[jira] [Assigned] (SPARK-12241) Improve failure reporting in Yarn client obtainTokenForHBase()

[ https://issues.apache.org/jira/browse/SPARK-12241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12241: Assignee: Apache Spark > Improve failure reporting in Yarn client obtainTokenForHBase() >

[jira] [Resolved] (SPARK-9059) Update Python Direct Kafka Word count examples to show the use of HasOffsetRanges

[ https://issues.apache.org/jira/browse/SPARK-9059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-9059. -- Resolution: Not A Problem > Update Python Direct Kafka Word count examples to show the use of >

[jira] [Closed] (SPARK-12203) Add KafkaDirectInputDStream that directly pulls messages from Kafka Brokers using receivers

[ https://issues.apache.org/jira/browse/SPARK-12203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang-Chi Hsieh closed SPARK-12203. --- Resolution: Won't Fix > Add KafkaDirectInputDStream that directly pulls messages from Kafka

  1   2   3   4   >