[
https://issues.apache.org/jira/browse/SPARK-18911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-18911.
-
Resolution: Fixed
Assignee: Zhenhua Wang
Fix Version/s: 2.2.0
> Decouple Statisti
[
https://issues.apache.org/jira/browse/SPARK-18994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-18994:
Assignee: Apache Spark
> worker clean up app directory block the heartbeat sending
>
[
https://issues.apache.org/jira/browse/SPARK-18994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-18994:
Assignee: (was: Apache Spark)
> worker clean up app directory block the heartbeat send
[
https://issues.apache.org/jira/browse/SPARK-18994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15774460#comment-15774460
]
Apache Spark commented on SPARK-18994:
--
User 'liujianhuiouc' has created a pull requ
[
https://issues.apache.org/jira/browse/SPARK-18995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiaochen Ouyang updated SPARK-18995:
Summary: spark-asseambly-*.jar is seperated into many little jars (was:
spark-asseambly-
Xiaochen Ouyang created SPARK-18995:
---
Summary: spark-asseambly-*.jar is seperated to many little jars
Key: SPARK-18995
URL: https://issues.apache.org/jira/browse/SPARK-18995
Project: Spark
liujianhui created SPARK-18994:
--
Summary: worker clean up app directory block the heartbeat sending
Key: SPARK-18994
URL: https://issues.apache.org/jira/browse/SPARK-18994
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-17075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-17075:
Assignee: Apache Spark
> Cardinality Estimation of Predicate Expressions
> ---
[
https://issues.apache.org/jira/browse/SPARK-17075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15774180#comment-15774180
]
Apache Spark commented on SPARK-17075:
--
User 'ron8hu' has created a pull request for
[
https://issues.apache.org/jira/browse/SPARK-17075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-17075:
Assignee: (was: Apache Spark)
> Cardinality Estimation of Predicate Expressions
>
[
https://issues.apache.org/jira/browse/SPARK-18981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15774102#comment-15774102
]
Apache Spark commented on SPARK-18981:
--
User 'zhaorongsheng' has created a pull requ
[
https://issues.apache.org/jira/browse/SPARK-18991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shixiong Zhu updated SPARK-18991:
-
Description: Right now `ContextCleaner.referenceBuffer` is
ConcurrentLinkedQueue and the time com
[
https://issues.apache.org/jira/browse/SPARK-18993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li updated SPARK-18993:
Description:
After https://github.com/apache/spark/pull/16311 is merged, I am unable to
build it in my Int
[
https://issues.apache.org/jira/browse/SPARK-18993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li updated SPARK-18993:
Issue Type: Bug (was: Improvement)
> Unable to build/compile Spark in IntelliJ
> -
[
https://issues.apache.org/jira/browse/SPARK-18993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li updated SPARK-18993:
Affects Version/s: (was: 2.2.0)
> Unable to build/compile Spark in IntelliJ
> -
[
https://issues.apache.org/jira/browse/SPARK-18993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li updated SPARK-18993:
Priority: Critical (was: Major)
> Unable to build/compile Spark in IntelliJ
>
[
https://issues.apache.org/jira/browse/SPARK-18993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li updated SPARK-18993:
Summary: Unable to build/compile Spark in IntelliJ (was: Unable to build
Spark in IntelliJ)
> Unable to b
[
https://issues.apache.org/jira/browse/SPARK-18993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-18993:
Assignee: Apache Spark
> Unable to build Spark in IntelliJ
> -
[
https://issues.apache.org/jira/browse/SPARK-18993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15773937#comment-15773937
]
Apache Spark commented on SPARK-18993:
--
User 'gatorsmile' has created a pull request
[
https://issues.apache.org/jira/browse/SPARK-18993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-18993:
Assignee: (was: Apache Spark)
> Unable to build Spark in IntelliJ
> --
Xiao Li created SPARK-18993:
---
Summary: Unable to build Spark in IntelliJ
Key: SPARK-18993
URL: https://issues.apache.org/jira/browse/SPARK-18993
Project: Spark
Issue Type: Improvement
Com
[
https://issues.apache.org/jira/browse/SPARK-18991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shixiong Zhu resolved SPARK-18991.
--
Resolution: Fixed
Fix Version/s: 2.2.0
2.1.1
> Change ContextCleaner.
[
https://issues.apache.org/jira/browse/SPARK-18379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15773765#comment-15773765
]
Adam Budde edited comment on SPARK-18379 at 12/23/16 10:04 PM:
[
https://issues.apache.org/jira/browse/SPARK-18988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin resolved SPARK-18988.
Resolution: Duplicate
This will not happen. See previous bugs for the same thing that have
[
https://issues.apache.org/jira/browse/SPARK-18379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15773765#comment-15773765
]
Adam Budde edited comment on SPARK-18379 at 12/23/16 9:59 PM:
-
[
https://issues.apache.org/jira/browse/SPARK-18379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15773765#comment-15773765
]
Adam Budde commented on SPARK-18379:
For tables with a number of files under defaultP
[
https://issues.apache.org/jira/browse/SPARK-18992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-18992:
Assignee: Xiao Li (was: Apache Spark)
> Move spark.sql.hive.thriftServer.singleSession to
[
https://issues.apache.org/jira/browse/SPARK-18992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15773714#comment-15773714
]
Apache Spark commented on SPARK-18992:
--
User 'gatorsmile' has created a pull request
[
https://issues.apache.org/jira/browse/SPARK-18992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-18992:
Assignee: Apache Spark (was: Xiao Li)
> Move spark.sql.hive.thriftServer.singleSession to
Xiao Li created SPARK-18992:
---
Summary: Move spark.sql.hive.thriftServer.singleSession to SQLConf
Key: SPARK-18992
URL: https://issues.apache.org/jira/browse/SPARK-18992
Project: Spark
Issue Type: I
[
https://issues.apache.org/jira/browse/SPARK-18379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15773668#comment-15773668
]
Sean Owen commented on SPARK-18379:
---
Seems OK to me as it doesn't change the default be
[
https://issues.apache.org/jira/browse/SPARK-18379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15773629#comment-15773629
]
Adam Budde edited comment on SPARK-18379 at 12/23/16 8:44 PM:
-
[
https://issues.apache.org/jira/browse/SPARK-18379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15773629#comment-15773629
]
Adam Budde edited comment on SPARK-18379 at 12/23/16 8:32 PM:
-
[
https://issues.apache.org/jira/browse/SPARK-18379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15773629#comment-15773629
]
Adam Budde commented on SPARK-18379:
Is there any reason this can't be pulled into a
[
https://issues.apache.org/jira/browse/SPARK-18988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15773602#comment-15773602
]
Sean Owen commented on SPARK-18988:
---
I don't think it is created automatically. I don't
[
https://issues.apache.org/jira/browse/SPARK-18988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15773594#comment-15773594
]
Chen He edited comment on SPARK-18988 at 12/23/16 8:06 PM:
---
The
[
https://issues.apache.org/jira/browse/SPARK-18988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15773594#comment-15773594
]
Chen He commented on SPARK-18988:
-
The "automatically" means HistoryServer will create it
[
https://issues.apache.org/jira/browse/SPARK-18988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15773373#comment-15773373
]
Sean Owen commented on SPARK-18988:
---
Why do you say that fs.logDirectory is created aut
[
https://issues.apache.org/jira/browse/SPARK-18990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-18990:
Assignee: Apache Spark (was: Wenchen Fan)
> make DatasetBenchmark fairer for Dataset
> --
[
https://issues.apache.org/jira/browse/SPARK-18990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15773352#comment-15773352
]
Apache Spark commented on SPARK-18990:
--
User 'cloud-fan' has created a pull request
[
https://issues.apache.org/jira/browse/SPARK-18990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-18990:
Assignee: Wenchen Fan (was: Apache Spark)
> make DatasetBenchmark fairer for Dataset
> --
[
https://issues.apache.org/jira/browse/SPARK-18991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-18991:
Assignee: Apache Spark (was: Shixiong Zhu)
> Change ContextCleaner.referenceBuffer to Con
[
https://issues.apache.org/jira/browse/SPARK-18991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-18991:
Assignee: Shixiong Zhu (was: Apache Spark)
> Change ContextCleaner.referenceBuffer to Con
[
https://issues.apache.org/jira/browse/SPARK-18991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15773339#comment-15773339
]
Apache Spark commented on SPARK-18991:
--
User 'zsxwing' has created a pull request fo
Shixiong Zhu created SPARK-18991:
Summary: Change ContextCleaner.referenceBuffer to
ConcurrentHashMap to make it faster
Key: SPARK-18991
URL: https://issues.apache.org/jira/browse/SPARK-18991
Project:
Wenchen Fan created SPARK-18990:
---
Summary: make DatasetBenchmark fairer for Dataset
Key: SPARK-18990
URL: https://issues.apache.org/jira/browse/SPARK-18990
Project: Spark
Issue Type: Improvemen
[
https://issues.apache.org/jira/browse/SPARK-18981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-18981:
Assignee: (was: Apache Spark)
> The last job hung when speculation is on
> ---
[
https://issues.apache.org/jira/browse/SPARK-18981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15773291#comment-15773291
]
Apache Spark commented on SPARK-18981:
--
User 'zhaorongsheng' has created a pull requ
[
https://issues.apache.org/jira/browse/SPARK-18981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-18981:
Assignee: Apache Spark
> The last job hung when speculation is on
> --
[
https://issues.apache.org/jira/browse/SPARK-18988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15773186#comment-15773186
]
Chen He edited comment on SPARK-18988 at 12/23/16 4:18 PM:
---
OK,
[
https://issues.apache.org/jira/browse/SPARK-18988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15773186#comment-15773186
]
Chen He edited comment on SPARK-18988 at 12/23/16 4:16 PM:
---
OK,
[
https://issues.apache.org/jira/browse/SPARK-18988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15773186#comment-15773186
]
Chen He edited comment on SPARK-18988 at 12/23/16 4:10 PM:
---
OK,
[
https://issues.apache.org/jira/browse/SPARK-18988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chen He reopened SPARK-18988:
-
> Spark "spark.eventLog.dir" dir should create the directory if it is different
> from "spark.history.fs.log
[
https://issues.apache.org/jira/browse/SPARK-18988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15773186#comment-15773186
]
Chen He commented on SPARK-18988:
-
OK, if this is reasonable, why "spark.history.fs.logDi
[
https://issues.apache.org/jira/browse/SPARK-18978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15772989#comment-15772989
]
Keltoum BOUQOUROU commented on SPARK-18978:
---
I'll try to update to spark 2, and
[
https://issues.apache.org/jira/browse/SPARK-18989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-18989:
Assignee: Apache Spark (was: Wenchen Fan)
> DESC TABLE should not fail with format class
[
https://issues.apache.org/jira/browse/SPARK-18989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15772944#comment-15772944
]
Apache Spark commented on SPARK-18989:
--
User 'cloud-fan' has created a pull request
[
https://issues.apache.org/jira/browse/SPARK-18989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-18989:
Assignee: Wenchen Fan (was: Apache Spark)
> DESC TABLE should not fail with format class
Wenchen Fan created SPARK-18989:
---
Summary: DESC TABLE should not fail with format class not found
Key: SPARK-18989
URL: https://issues.apache.org/jira/browse/SPARK-18989
Project: Spark
Issue Ty
[
https://issues.apache.org/jira/browse/SPARK-18786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-18786.
---
Resolution: Not A Problem
> pySpark SQLContext.getOrCreate(sc) take stopped sparkContext
> --
[
https://issues.apache.org/jira/browse/SPARK-18879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-18879.
---
Resolution: Not A Problem
To my understanding, this is not a function that Spark supports.
> Spark S
[
https://issues.apache.org/jira/browse/SPARK-18957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-18957.
---
Resolution: Not A Problem
> when WAL time out, loss data
>
>
>
[
https://issues.apache.org/jira/browse/SPARK-18964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-18964.
---
Resolution: Not A Problem
Yes, I don't think these _Hive_ functions are supported in 1.x. Windowing
[
https://issues.apache.org/jira/browse/SPARK-18607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-18607.
---
Resolution: Won't Fix
> give a result on a percent of the tasks succeed
> --
[
https://issues.apache.org/jira/browse/SPARK-18916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-18916.
---
Resolution: Not A Problem
> Possible bug in Pregel / mergeMsg with hashmaps
> ---
[
https://issues.apache.org/jira/browse/SPARK-18926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-18926.
---
Resolution: Not A Problem
> run-example SparkPi terminates with error message
>
[
https://issues.apache.org/jira/browse/SPARK-18978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15772790#comment-15772790
]
Sean Owen commented on SPARK-18978:
---
I think that if this only affects 1.x, it's unlike
[
https://issues.apache.org/jira/browse/SPARK-18988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-18988.
---
Resolution: Not A Problem
The behavior is on purpose. You must ensure that the directory you want Spa
[
https://issues.apache.org/jira/browse/SPARK-18963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-18963:
--
Assignee: Pete Robbins
> Test Failuire on big endian;
> o.a.s.unsafe.types.UTF8StringSuite.writeToOutp
[
https://issues.apache.org/jira/browse/SPARK-18963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-18963.
---
Resolution: Fixed
Fix Version/s: 2.2.0
Issue resolved by pull request 16375
[https://github.co
[
https://issues.apache.org/jira/browse/SPARK-18984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-18984.
---
Resolution: Duplicate
> Concat with ds.write.text() throw exception if column contains null data
> --
[
https://issues.apache.org/jira/browse/SPARK-18987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-18987.
---
Resolution: Invalid
Target Version/s: (was: 1.5.1)
Please read http://spark.apache.org/co
[
https://issues.apache.org/jira/browse/SPARK-18988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chen He updated SPARK-18988:
Affects Version/s: 2.1.0
> Spark "spark.eventLog.dir" dir should create the directory if it is different
>
[
https://issues.apache.org/jira/browse/SPARK-18941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15772365#comment-15772365
]
Dongjoon Hyun commented on SPARK-18941:
---
+1 for adding some comments.
> Spark thri
[
https://issues.apache.org/jira/browse/SPARK-18978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15772344#comment-15772344
]
Keltoum BOUQOUROU edited comment on SPARK-18978 at 12/23/16 8:55 AM:
--
[
https://issues.apache.org/jira/browse/SPARK-18978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15772344#comment-15772344
]
Keltoum BOUQOUROU commented on SPARK-18978:
---
Yes, I work with spark-1.5.2
> S
[
https://issues.apache.org/jira/browse/SPARK-18974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15772329#comment-15772329
]
Adam Wang commented on SPARK-18974:
---
Same problem :
http://stackoverflow.com/questions
[
https://issues.apache.org/jira/browse/SPARK-18988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15772317#comment-15772317
]
Chen He commented on SPARK-18988:
-
It should be like:
{code}
if (!fileSystem.getFileStat
[
https://issues.apache.org/jira/browse/SPARK-18988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chen He updated SPARK-18988:
Description:
When set "spark.history.fs.logDirectory" to be hdfs:///spark-history but set
"spark.eventLog.
[
https://issues.apache.org/jira/browse/SPARK-18988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chen He updated SPARK-18988:
Description:
When set "spark.history.fs.logDirectory" to be hdfs:///spark-history but set
"spark.eventLog.
Chen He created SPARK-18988:
---
Summary: Spark "spark.eventLog.dir" dir should create the
directory if it is different from "spark.history.fs.logDirectory"
Key: SPARK-18988
URL: https://issues.apache.org/jira/browse/SPARK
81 matches
Mail list logo
