[
https://issues.apache.org/jira/browse/SPARK-22273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li resolved SPARK-22273.
-
Resolution: Fixed
Assignee: Takuya Ueshin
Fix Version/s: 2.3.0
2.2.1
[
https://issues.apache.org/jira/browse/SPARK-21549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16204504#comment-16204504
]
Apache Spark commented on SPARK-21549:
--
User 'mridulm' has created a pull request fo
[
https://issues.apache.org/jira/browse/SPARK-21762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li resolved SPARK-21762.
-
Resolution: Fixed
Assignee: Steve Loughran
Fix Version/s: 2.3.0
> FileFormatWriter/BasicW
[
https://issues.apache.org/jira/browse/SPARK-22271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-22271:
Assignee: Apache Spark
> Describe results in "null" for the value of "mean" of a numeric v
[
https://issues.apache.org/jira/browse/SPARK-22271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16204487#comment-16204487
]
Apache Spark commented on SPARK-22271:
--
User 'huaxingao' has created a pull request
[
https://issues.apache.org/jira/browse/SPARK-22271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-22271:
Assignee: (was: Apache Spark)
> Describe results in "null" for the value of "mean" of
[
https://issues.apache.org/jira/browse/SPARK-20883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16204414#comment-16204414
]
Jayesh lalwani commented on SPARK-20883:
Is this fix planned to go into 2.2.1?
>
[
https://issues.apache.org/jira/browse/SPARK-22278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16204384#comment-16204384
]
Apache Spark commented on SPARK-22278:
--
User 'tdas' has created a pull request for t
[
https://issues.apache.org/jira/browse/SPARK-22278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-22278:
Assignee: Apache Spark (was: Tathagata Das)
> Expose current event time watermark and cur
[
https://issues.apache.org/jira/browse/SPARK-22278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-22278:
Assignee: Tathagata Das (was: Apache Spark)
> Expose current event time watermark and cur
[
https://issues.apache.org/jira/browse/SPARK-11034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin resolved SPARK-11034.
Resolution: Fixed
Assignee: Devaraj K
Fix Version/s: 2.3.0
> Launcher: add
Tathagata Das created SPARK-22278:
-
Summary: Expose current event time watermark and current
processing time in GroupState
Key: SPARK-22278
URL: https://issues.apache.org/jira/browse/SPARK-22278
Proje
[
https://issues.apache.org/jira/browse/SPARK-22187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tathagata Das reassigned SPARK-22187:
-
Assignee: Tathagata Das
> Update unsaferow format for saved state such that we can set t
[
https://issues.apache.org/jira/browse/SPARK-22262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
rohit verma resolved SPARK-22262.
-
Resolution: Invalid
Invalid..
> Failed to recover Spark Structured Streaming job from checkpoint
[
https://issues.apache.org/jira/browse/SPARK-22232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bago Amirbekian updated SPARK-22232:
Component/s: SQL
> Row objects in pyspark created using the `Row(**kwars)` syntax do not ge
[
https://issues.apache.org/jira/browse/SPARK-22271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16204281#comment-16204281
]
Huaxin Gao edited comment on SPARK-22271 at 10/13/17 10:34 PM:
[
https://issues.apache.org/jira/browse/SPARK-22271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16204281#comment-16204281
]
Huaxin Gao commented on SPARK-22271:
I looked the code, in Average.scala, it has
```
Cheburakshu created SPARK-22277:
---
Summary: Chi Square selector garbling Vector content.
Key: SPARK-22277
URL: https://issues.apache.org/jira/browse/SPARK-22277
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-22136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tathagata Das reassigned SPARK-22136:
-
Assignee: Jose Torres
> Implement stream-stream outer joins in append mode
> ---
Fernando Pereira created SPARK-22276:
Summary: Unnecessary repartitioning
Key: SPARK-22276
URL: https://issues.apache.org/jira/browse/SPARK-22276
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-22250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16204059#comment-16204059
]
Fernando Pereira edited comment on SPARK-22250 at 10/13/17 7:28 PM:
---
[
https://issues.apache.org/jira/browse/SPARK-22250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16204059#comment-16204059
]
Fernando Pereira commented on SPARK-22250:
--
I have to admit I was not aware of t
[
https://issues.apache.org/jira/browse/SPARK-9?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16204041#comment-16204041
]
Yuval Degani commented on SPARK-9:
--
[~jerryshao], thanks for clearing your point
[
https://issues.apache.org/jira/browse/SPARK-22240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16204019#comment-16204019
]
Hyukjin Kwon commented on SPARK-22240:
--
Here, I could reproduce the issue in the JIR
[
https://issues.apache.org/jira/browse/SPARK-22240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16203966#comment-16203966
]
Steve Loughran commented on SPARK-22240:
Point me at a simple test suite for the
[
https://issues.apache.org/jira/browse/SPARK-22269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16203902#comment-16203902
]
Sean Owen commented on SPARK-22269:
---
Sure, maybe it's possible to run through SBT. That
[
https://issues.apache.org/jira/browse/SPARK-22275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin updated SPARK-22275:
---
Summary: SparkContext doesn't clean up after itself when "fatal" errors
occur (was: ReplayLi
[
https://issues.apache.org/jira/browse/SPARK-22275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin updated SPARK-22275:
---
Component/s: Spark Core
> SparkContext doesn't clean up after itself when "fatal" errors occu
[
https://issues.apache.org/jira/browse/SPARK-22275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16203887#comment-16203887
]
Marcelo Vanzin commented on SPARK-22275:
Actually this is caused by the exception
[
https://issues.apache.org/jira/browse/SPARK-20144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16203882#comment-16203882
]
sam commented on SPARK-20144:
-
I think this is a regression. We used to be able to easily co
[
https://issues.apache.org/jira/browse/SPARK-17998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16203877#comment-16203877
]
sam commented on SPARK-17998:
-
[~lwlin] I think this is a regression. We used to be able to
[
https://issues.apache.org/jira/browse/SPARK-22269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16203873#comment-16203873
]
Marcelo Vanzin commented on SPARK-22269:
I'm saying that we should at least inves
[
https://issues.apache.org/jira/browse/SPARK-22269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16203865#comment-16203865
]
Sean Owen commented on SPARK-22269:
---
You're saying we could have a separate Jenkins job
Marcelo Vanzin created SPARK-22275:
--
Summary: ReplayListenerSuite doesn't clean up properly after itself
Key: SPARK-22275
URL: https://issues.apache.org/jira/browse/SPARK-22275
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-21247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-21247:
---
Assignee: Dongjoon Hyun
> Type comparision should respect case-sensitive SQL conf
>
[
https://issues.apache.org/jira/browse/SPARK-21247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-21247.
-
Resolution: Fixed
Fix Version/s: 2.3.0
Issue resolved by pull request 18460
[https://githu
[
https://issues.apache.org/jira/browse/SPARK-22269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin reopened SPARK-22269:
This is not a duplicate of that bug. If there's a bug about enabling lint-java
in the PR build
[
https://issues.apache.org/jira/browse/SPARK-22181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sathiya Kumar updated SPARK-22181:
--
Summary: ReplaceExceptWithFilter if one or both of the datasets are fully
derived out of Filter
[
https://issues.apache.org/jira/browse/SPARK-22181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sathiya Kumar updated SPARK-22181:
--
Description:
While applying Except operator between two datasets, if one or both of the
datase
[
https://issues.apache.org/jira/browse/SPARK-22240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16203771#comment-16203771
]
Hyukjin Kwon commented on SPARK-22240:
--
Yea, this problem exists when {{multiLine}}.
[
https://issues.apache.org/jira/browse/SPARK-22249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-22249:
Assignee: Apache Spark
> UnsupportedOperationException: empty.reduceLeft when caching a da
[
https://issues.apache.org/jira/browse/SPARK-22249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16203751#comment-16203751
]
Apache Spark commented on SPARK-22249:
--
User 'mgaido91' has created a pull request f
[
https://issues.apache.org/jira/browse/SPARK-22249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-22249:
Assignee: (was: Apache Spark)
> UnsupportedOperationException: empty.reduceLeft when c
[
https://issues.apache.org/jira/browse/SPARK-22247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16203716#comment-16203716
]
Patrick Duin commented on SPARK-22247:
--
I think this is a related issue SPARK-20331,
[
https://issues.apache.org/jira/browse/SPARK-22240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16203709#comment-16203709
]
Steve Loughran commented on SPARK-22240:
[~hyukjin.kwon]: we now see that on s3a,
[
https://issues.apache.org/jira/browse/SPARK-18355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-18355:
---
Assignee: Dongjoon Hyun
> Spark SQL fails to read data from a ORC hive table that has a new
[
https://issues.apache.org/jira/browse/SPARK-16628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-16628.
-
Resolution: Fixed
Fix Version/s: 2.3.0
2.2.1
Issue resolved by pull req
[
https://issues.apache.org/jira/browse/SPARK-16628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-16628:
---
Assignee: Dongjoon Hyun
> OrcConversions should not convert an ORC table represented by
> M
[
https://issues.apache.org/jira/browse/SPARK-18355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-18355.
-
Resolution: Fixed
Fix Version/s: 2.3.0
2.2.1
Issue resolved by pull req
[
https://issues.apache.org/jira/browse/SPARK-14387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-14387:
---
Assignee: Dongjoon Hyun
> Enable Hive-1.x ORC compatibility with spark.sql.hive.convertMetas
[
https://issues.apache.org/jira/browse/SPARK-14387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-14387.
-
Resolution: Fixed
Fix Version/s: 2.3.0
2.2.1
Issue resolved by pull req
[
https://issues.apache.org/jira/browse/SPARK-22252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16203683#comment-16203683
]
Apache Spark commented on SPARK-22252:
--
User 'cloud-fan' has created a pull request
[
https://issues.apache.org/jira/browse/SPARK-22274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Li Jin updated SPARK-22274:
---
Description:
This function doesn't implement partial aggregation and shuffles all data. A
uadf that supports
[
https://issues.apache.org/jira/browse/SPARK-22240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16203600#comment-16203600
]
Hyukjin Kwon commented on SPARK-22240:
--
I am sorry for late response.
{quote}
If i
Li Jin created SPARK-22274:
--
Summary: Used-defined aggregation functions with pandas udf
Key: SPARK-22274
URL: https://issues.apache.org/jira/browse/SPARK-22274
Project: Spark
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/SPARK-8?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16203506#comment-16203506
]
Apache Spark commented on SPARK-8:
--
User 'mgaido91' has created a pull request f
[
https://issues.apache.org/jira/browse/SPARK-8?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-8:
Assignee: (was: Apache Spark)
> Add support for Array so from_json can parse
> ---
[
https://issues.apache.org/jira/browse/SPARK-8?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-8:
Assignee: Apache Spark
> Add support for Array so from_json can parse
> --
[
https://issues.apache.org/jira/browse/SPARK-22240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16203495#comment-16203495
]
Steve Loughran commented on SPARK-22240:
We've got a test in HADOOP-14943 which l
[
https://issues.apache.org/jira/browse/SPARK-22242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16203419#comment-16203419
]
Sean Owen commented on SPARK-22242:
---
[~jerryshao] were you suggesting this is already r
Takuya Ueshin created SPARK-22273:
-
Summary: Fix key/value schema field names in HashMapGenerators.
Key: SPARK-22273
URL: https://issues.apache.org/jira/browse/SPARK-22273
Project: Spark
Issu
[
https://issues.apache.org/jira/browse/SPARK-22273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16203277#comment-16203277
]
Apache Spark commented on SPARK-22273:
--
User 'ueshin' has created a pull request for
[
https://issues.apache.org/jira/browse/SPARK-22273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-22273:
Assignee: Apache Spark
> Fix key/value schema field names in HashMapGenerators.
>
[
https://issues.apache.org/jira/browse/SPARK-22273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-22273:
Assignee: (was: Apache Spark)
> Fix key/value schema field names in HashMapGenerators.
[
https://issues.apache.org/jira/browse/SPARK-22272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16203264#comment-16203264
]
roncenzhao commented on SPARK-22272:
The jdk bug is not resolved yet.
If spark does n
[
https://issues.apache.org/jira/browse/SPARK-22272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16203199#comment-16203199
]
Sean Owen commented on SPARK-22272:
---
This is long since fixed in the JDK though. Does s
[
https://issues.apache.org/jira/browse/SPARK-22272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
roncenzhao updated SPARK-22272:
---
Description:
JVM bug: http://bugs.java.com/bugdatabase/view_bug.do?bug_id=8132693
We kill the task u
[
https://issues.apache.org/jira/browse/SPARK-22272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
roncenzhao updated SPARK-22272:
---
Attachment: 26883.jstack
> killing task may cause the executor progress hang because of the JVM bug
>
[
https://issues.apache.org/jira/browse/SPARK-22272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
roncenzhao updated SPARK-22272:
---
Attachment: screenshot-1.png
> killing task may cause the executor progress hang because of the JVM b
[
https://issues.apache.org/jira/browse/SPARK-22272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
roncenzhao updated SPARK-22272:
---
Attachment: screenshot-2.png
> killing task may cause the executor progress hang because of the JVM b
roncenzhao created SPARK-22272:
--
Summary: killing task may cause the executor progress hang because
of the JVM bug
Key: SPARK-22272
URL: https://issues.apache.org/jira/browse/SPARK-22272
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-22269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16203161#comment-16203161
]
Sean Owen commented on SPARK-22269:
---
https://issues.apache.org/jira/browse/SPARK-22066
72 matches
Mail list logo