[
https://issues.apache.org/jira/browse/SPARK-17910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yin Huai updated SPARK-17910:
-
Description: Right now, once a user set the comment of a column with create
table command, he/she cannot
Seth Hendrickson created SPARK-17941:
Summary: Logistic regression test suites should use weights when
comparing to glmnet
Key: SPARK-17941
URL: https://issues.apache.org/jira/browse/SPARK-17941
[
https://issues.apache.org/jira/browse/SPARK-17910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yin Huai updated SPARK-17910:
-
Target Version/s: 2.1.0
> Allow users to update the comment of a column
>
[
https://issues.apache.org/jira/browse/SPARK-17940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-17940:
Assignee: Apache Spark
> Typo in LAST function error message
>
[
https://issues.apache.org/jira/browse/SPARK-17940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15575694#comment-15575694
]
Apache Spark commented on SPARK-17940:
--
User 'lins05' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-17940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-17940:
Assignee: (was: Apache Spark)
> Typo in LAST function error message
>
Shuai Lin created SPARK-17940:
-
Summary: Typo in LAST function error message
Key: SPARK-17940
URL: https://issues.apache.org/jira/browse/SPARK-17940
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-17624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15575683#comment-15575683
]
Adam Roberts commented on SPARK-17624:
--
Having another look at this now as it still fails
[
https://issues.apache.org/jira/browse/SPARK-17624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Adam Roberts updated SPARK-17624:
-
Affects Version/s: 2.1.0
> Flaky test? StateStoreSuite maintenance
>
[
https://issues.apache.org/jira/browse/SPARK-17937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cody Koeninger updated SPARK-17937:
---
Description:
Possible events for which offsets are needed:
# New partition is discovered
#
[
https://issues.apache.org/jira/browse/SPARK-17937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cody Koeninger updated SPARK-17937:
---
Description:
Possible events for which offsets are needed:
# New partition is discovered
#
[
https://issues.apache.org/jira/browse/SPARK-17937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cody Koeninger updated SPARK-17937:
---
Description:
Possible events for which offsets are needed:
# New partition is discovered
#
[
https://issues.apache.org/jira/browse/SPARK-17937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cody Koeninger updated SPARK-17937:
---
Description:
Possible events for which offsets are needed:
# *New partition* is discovered
#
[
https://issues.apache.org/jira/browse/SPARK-17937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cody Koeninger updated SPARK-17937:
---
Description:
Possible events for which offsets are needed:
# *New partition* is discovered
#
[
https://issues.apache.org/jira/browse/SPARK-17937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cody Koeninger updated SPARK-17937:
---
Description:
Possible events for which offsets are needed:
# New partition is discovered
#
[
https://issues.apache.org/jira/browse/SPARK-17939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15575599#comment-15575599
]
Aleksander Eskilson commented on SPARK-17939:
-
[~marmbrus] suggested the opening of this
[
https://issues.apache.org/jira/browse/SPARK-17937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cody Koeninger updated SPARK-17937:
---
Description:
Possible events for which offsets are needed:
# New partition is discovered
#
[
https://issues.apache.org/jira/browse/SPARK-17904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15575553#comment-15575553
]
Yanbo Liang edited comment on SPARK-17904 at 10/14/16 2:49 PM:
---
[
https://issues.apache.org/jira/browse/SPARK-17939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aleksander Eskilson updated SPARK-17939:
Description:
The notion of Nullability of of StructFields in DataFrames and
[
https://issues.apache.org/jira/browse/SPARK-17904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15575553#comment-15575553
]
Yanbo Liang commented on SPARK-17904:
-
[~felixcheung] I think the proposal I made in this JIRA is
[
https://issues.apache.org/jira/browse/SPARK-17939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aleksander Eskilson updated SPARK-17939:
Description:
The notion of Nullability of of StructFields in DataFrames and
Aleksander Eskilson created SPARK-17939:
---
Summary: Spark-SQL Nullability: Optimizations vs. Enforcement
Clarification
Key: SPARK-17939
URL: https://issues.apache.org/jira/browse/SPARK-17939
Samy Dindane created SPARK-17938:
Summary: Backpressure rate not adjusting
Key: SPARK-17938
URL: https://issues.apache.org/jira/browse/SPARK-17938
Project: Spark
Issue Type: Bug
Cody Koeninger created SPARK-17937:
--
Summary: Clarify Kafka offset semantics for Structured Streaming
Key: SPARK-17937
URL: https://issues.apache.org/jira/browse/SPARK-17937
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-17936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Justin Miller reopened SPARK-17936:
---
I don't believe this is a duplicate. This occurs while trying to write to
parquet (with very
[
https://issues.apache.org/jira/browse/SPARK-17936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15575494#comment-15575494
]
Justin Miller commented on SPARK-17936:
---
It's just strange that the issue seems to effect previous
[
https://issues.apache.org/jira/browse/SPARK-17936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15575476#comment-15575476
]
Sean Owen commented on SPARK-17936:
---
I doubt it is a different cause given it is the same type of error
[
https://issues.apache.org/jira/browse/SPARK-17936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Justin Miller updated SPARK-17936:
--
Comment: was deleted
(was: I did look through them and I don't think they're related. Note
[
https://issues.apache.org/jira/browse/SPARK-17936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15575471#comment-15575471
]
Justin Miller commented on SPARK-17936:
---
I'd also note this wasn't an issue in Spark 1.6.2. The
[
https://issues.apache.org/jira/browse/SPARK-17936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15575452#comment-15575452
]
Justin Miller commented on SPARK-17936:
---
I did look through them and I don't think they're related.
[
https://issues.apache.org/jira/browse/SPARK-16845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15575421#comment-15575421
]
Harish commented on SPARK-16845:
I have posted a scenario in stack overflow
[
https://issues.apache.org/jira/browse/SPARK-17868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-17868:
Assignee: Apache Spark
> Do not use bitmasks during parsing and analysis of
[
https://issues.apache.org/jira/browse/SPARK-17868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15575400#comment-15575400
]
Apache Spark commented on SPARK-17868:
--
User 'jiangxb1987' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-17868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-17868:
Assignee: (was: Apache Spark)
> Do not use bitmasks during parsing and analysis of
[
https://issues.apache.org/jira/browse/SPARK-17936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-17936.
---
Resolution: Duplicate
Duplicate of several JIRAs -- have a look through first.
> "CodeGenerator -
Justin Miller created SPARK-17936:
-
Summary: "CodeGenerator - failed to compile:
org.codehaus.janino.JaninoRuntimeException: Code of" method Error
Key: SPARK-17936
URL:
[
https://issues.apache.org/jira/browse/SPARK-17935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-17935:
--
Target Version/s: (was: 2.0.0)
Fix Version/s: (was: 2.0.0)
> Add KafkaForeachWriter in
[
https://issues.apache.org/jira/browse/SPARK-17933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15575232#comment-15575232
]
Frank Rosner commented on SPARK-17933:
--
Thanks [~srowen]. I know a lot of discussions about the
[
https://issues.apache.org/jira/browse/SPARK-17933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Frank Rosner updated SPARK-17933:
-
Attachment: (was: screenshot-1.png)
> Shuffle fails when driver is on one of the same
[
https://issues.apache.org/jira/browse/SPARK-17933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Frank Rosner updated SPARK-17933:
-
Attachment: screenshot-1.png
> Shuffle fails when driver is on one of the same machines as
[
https://issues.apache.org/jira/browse/SPARK-17787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-17787.
---
Resolution: Not A Problem
> spark submit throws error while using kafka Appender log4j:ERROR Could
[
https://issues.apache.org/jira/browse/SPARK-1?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-1.
---
Resolution: Not A Problem
> Spark Scheduler Hangs Indefinitely
> --
[
https://issues.apache.org/jira/browse/SPARK-10954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-10954.
---
Resolution: Not A Problem
> Parquet version in the "created_by" metadata field of Parquet files
[
https://issues.apache.org/jira/browse/SPARK-10681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-10681.
---
Resolution: Not A Problem
> DateTimeUtils needs a method to parse string to SQL's timestamp value
>
[
https://issues.apache.org/jira/browse/SPARK-17930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15575123#comment-15575123
]
Sean Owen commented on SPARK-17930:
---
But this code is only ever called once per object. Reuse doesn't
[
https://issues.apache.org/jira/browse/SPARK-17855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-17855:
--
Assignee: Hao Ren
> Spark worker throw Exception when uber jar's http url contains query string
>
[
https://issues.apache.org/jira/browse/SPARK-17855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-17855.
---
Resolution: Fixed
Fix Version/s: 2.1.0
Issue resolved by pull request 15420
[
https://issues.apache.org/jira/browse/SPARK-17870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-17870:
--
Assignee: Peng Meng
> ML/MLLIB: ChiSquareSelector based on Statistics.chiSqTest(RDD) is wrong
>
[
https://issues.apache.org/jira/browse/SPARK-17870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-17870.
---
Resolution: Fixed
Fix Version/s: 2.1.0
Issue resolved by pull request 15444
[
https://issues.apache.org/jira/browse/SPARK-14634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yanbo Liang resolved SPARK-14634.
-
Resolution: Fixed
Assignee: zhengruifeng
Fix Version/s: 2.1.0
> Add
[
https://issues.apache.org/jira/browse/SPARK-15402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yanbo Liang resolved SPARK-15402.
-
Resolution: Fixed
Assignee: Yanbo Liang
Fix Version/s: 2.1.0
> PySpark
[
https://issues.apache.org/jira/browse/SPARK-636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15575005#comment-15575005
]
Luis Ramos edited comment on SPARK-636 at 10/14/16 11:11 AM:
-
I feel like the
[
https://issues.apache.org/jira/browse/SPARK-636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15575005#comment-15575005
]
Luis Ramos edited comment on SPARK-636 at 10/14/16 11:07 AM:
-
I feel like the
[
https://issues.apache.org/jira/browse/SPARK-17935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zhangxinyu updated SPARK-17935:
---
Description:
Now spark already supports kafkaInputStream. It would be useful that we add
[
https://issues.apache.org/jira/browse/SPARK-17935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15575007#comment-15575007
]
Apache Spark commented on SPARK-17935:
--
User 'zhangxinyu1' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-17935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-17935:
Assignee: Apache Spark
> Add KafkaForeachWriter in external kafka-0.8.0 for structured
[
https://issues.apache.org/jira/browse/SPARK-636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15575005#comment-15575005
]
Luis Ramos commented on SPARK-636:
--
I feel like the broadcasting mechanism doesn't get me "close" enough
[
https://issues.apache.org/jira/browse/SPARK-17935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-17935:
Assignee: (was: Apache Spark)
> Add KafkaForeachWriter in external kafka-0.8.0 for
[
https://issues.apache.org/jira/browse/SPARK-17935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zhangxinyu updated SPARK-17935:
---
External issue URL: (was: https://github.com/apache/spark/pull/15483)
> Add KafkaForeachWriter in
[
https://issues.apache.org/jira/browse/SPARK-17935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zhangxinyu updated SPARK-17935:
---
External issue URL: https://github.com/apache/spark/pull/15483
> Add KafkaForeachWriter in external
zhangxinyu created SPARK-17935:
--
Summary: Add KafkaForeachWriter in external kafka-0.8.0 for
structured streaming module
Key: SPARK-17935
URL: https://issues.apache.org/jira/browse/SPARK-17935
Project:
[
https://issues.apache.org/jira/browse/SPARK-17555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-17555.
---
Resolution: Not A Problem
> ExternalShuffleBlockResolver fails randomly with External Shuffle
[
https://issues.apache.org/jira/browse/SPARK-16720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-16720.
---
Resolution: Not A Problem
> Loading CSV file with 2k+ columns fails during attribute resolution on
[
https://issues.apache.org/jira/browse/SPARK-650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-650.
-
Resolution: Duplicate
> Add a "setup hook" API for running initialization code on each executor
>
[
https://issues.apache.org/jira/browse/SPARK-17572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-17572.
---
Resolution: Not A Problem
> Write.df is failing on spark cluster
>
[
https://issues.apache.org/jira/browse/SPARK-17898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-17898.
---
Resolution: Not A Problem
These are Gradle questions, really. It should be perfectly possible to
[
https://issues.apache.org/jira/browse/SPARK-17933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15574802#comment-15574802
]
Sean Owen commented on SPARK-17933:
---
I think this is related to a lot of existing JIRAs concerning the
[
https://issues.apache.org/jira/browse/SPARK-17929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-17929:
Assignee: Apache Spark
> Deadlock when AM restart and send RemoveExecutor on reset
>
[
https://issues.apache.org/jira/browse/SPARK-17929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15574801#comment-15574801
]
Apache Spark commented on SPARK-17929:
--
User 'scwf' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-17929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-17929:
Assignee: (was: Apache Spark)
> Deadlock when AM restart and send RemoveExecutor on
[
https://issues.apache.org/jira/browse/SPARK-5113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-5113.
--
Resolution: Won't Fix
> Audit and document use of hostnames and IP addresses in Spark
>
[
https://issues.apache.org/jira/browse/SPARK-4257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-4257.
--
Resolution: Not A Problem
> Spark master can only be accessed by hostname
>
[
https://issues.apache.org/jira/browse/SPARK-17934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15574787#comment-15574787
]
Sean Owen commented on SPARK-17934:
---
This might be on the border of things that are widely used enough
Lei Wang created SPARK-17934:
Summary: Support percentile scale in ml.feature
Key: SPARK-17934
URL: https://issues.apache.org/jira/browse/SPARK-17934
Project: Spark
Issue Type: New Feature
[
https://issues.apache.org/jira/browse/SPARK-17933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Frank Rosner updated SPARK-17933:
-
Description:
h4. Problem
When I run a job that requires some shuffle, some tasks fail because
[
https://issues.apache.org/jira/browse/SPARK-17933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Frank Rosner updated SPARK-17933:
-
Description:
h4. Problem
When I run a job that requires some shuffle, some tasks fail because
Frank Rosner created SPARK-17933:
Summary: Shuffle fails when driver is on one of the same machines
as executor
Key: SPARK-17933
URL: https://issues.apache.org/jira/browse/SPARK-17933
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-17933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Frank Rosner updated SPARK-17933:
-
Attachment: screenshot-2.png
screenshot-1.png
> Shuffle fails when driver is on
[
https://issues.apache.org/jira/browse/SPARK-10872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-10872.
---
Resolution: Not A Problem
I don't think this is something to be fixed if I understand it correctly,
[
https://issues.apache.org/jira/browse/SPARK-16575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15572950#comment-15572950
]
Tarun Kumar edited comment on SPARK-16575 at 10/14/16 8:38 AM:
---
[~rxin] I
[
https://issues.apache.org/jira/browse/SPARK-17917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15574639#comment-15574639
]
Mario Briggs commented on SPARK-17917:
--
>>
I don't have a strong feeling on this partly because I'm
[
https://issues.apache.org/jira/browse/SPARK-17903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-17903.
-
Resolution: Fixed
Fix Version/s: 2.1.0
> MetastoreRelation should talk to external
[
https://issues.apache.org/jira/browse/SPARK-16845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15574540#comment-15574540
]
Apache Spark commented on SPARK-16845:
--
User 'lw-lin' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-13747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15574502#comment-15574502
]
Low Chin Wei commented on SPARK-13747:
--
I encounter this in 2.0.1, is there any workaround like
[
https://issues.apache.org/jira/browse/SPARK-17932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
pin_zhang updated SPARK-17932:
--
Description:
SQL "show table extended like table_name " doesn't work in spark 2.0.0
that works in
[
https://issues.apache.org/jira/browse/SPARK-17925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-17925.
-
Resolution: Fixed
Fix Version/s: 2.1.0
Issue resolved by pull request 15473
101 - 186 of 186 matches
Mail list logo
