[
https://issues.apache.org/jira/browse/SPARK-37980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17485215#comment-17485215
]
Cheng Lian commented on SPARK-37980:
[~prakharjain09], as you've mentioned, it's not super
[
https://issues.apache.org/jira/browse/SPARK-31935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cheng Lian updated SPARK-31935:
---
Affects Version/s: (was: 3.0.1)
(was: 3.1.0)
[
https://issues.apache.org/jira/browse/SPARK-26352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cheng Lian updated SPARK-26352:
---
Summary: Join reordering should not change the order of output attributes
(was: join reordering
[
https://issues.apache.org/jira/browse/SPARK-29667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cheng Lian updated SPARK-29667:
---
Environment: (was: spark-2.4.3-bin-dbr-5.5-snapshot-9833d0f)
> implicitly convert mismatched
[
https://issues.apache.org/jira/browse/SPARK-29667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16963305#comment-16963305
]
Cheng Lian commented on SPARK-29667:
Reproduced this with the following snippet:
{code}
[
https://issues.apache.org/jira/browse/SPARK-26806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cheng Lian updated SPARK-26806:
---
Reporter: Cheng Lian (was: liancheng)
> EventTimeStats.merge doesn't handle "zero.merge(zero)"
[
https://issues.apache.org/jira/browse/SPARK-26806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cheng Lian updated SPARK-26806:
---
Description:
Right now, EventTimeStats.merge doesn't handle "zero.merge(zero)". This will
make
[
https://issues.apache.org/jira/browse/SPARK-27369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cheng Lian reassigned SPARK-27369:
--
Assignee: wuyi
> Standalone worker can load resource conf and discover resources
>
[
https://issues.apache.org/jira/browse/SPARK-27611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cheng Lian reassigned SPARK-27611:
--
Assignee: Cheng Lian
> Redundant javax.activation dependencies in the Maven build
>
Cheng Lian created SPARK-27611:
--
Summary: Redundant javax.activation dependencies in the Maven build
Key: SPARK-27611
URL: https://issues.apache.org/jira/browse/SPARK-27611
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-25966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16678595#comment-16678595
]
Cheng Lian commented on SPARK-25966:
[~andrioni], just realized that I might misunderstand this part
[
https://issues.apache.org/jira/browse/SPARK-25966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16678542#comment-16678542
]
Cheng Lian edited comment on SPARK-25966 at 11/7/18 5:34 PM:
-
Hey,
[
https://issues.apache.org/jira/browse/SPARK-25966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16678542#comment-16678542
]
Cheng Lian edited comment on SPARK-25966 at 11/7/18 5:34 PM:
-
Hey,
[
https://issues.apache.org/jira/browse/SPARK-25966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16678542#comment-16678542
]
Cheng Lian commented on SPARK-25966:
Hey, [~andrioni], if you still have the original (potentially)
[
https://issues.apache.org/jira/browse/SPARK-24927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cheng Lian reassigned SPARK-24927:
--
Assignee: Cheng Lian
> The hadoop-provided profile doesn't play well with Snappy-compressed
[
https://issues.apache.org/jira/browse/SPARK-24927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cheng Lian updated SPARK-24927:
---
Description:
Reproduction:
{noformat}
wget
[
https://issues.apache.org/jira/browse/SPARK-24927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16557603#comment-16557603
]
Cheng Lian commented on SPARK-24927:
Downgraded from blocker to major, since it's not a regression.
[
https://issues.apache.org/jira/browse/SPARK-24927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cheng Lian updated SPARK-24927:
---
Priority: Major (was: Blocker)
> The hadoop-provided profile doesn't play well with
Cheng Lian created SPARK-24927:
--
Summary: The hadoop-provided profile doesn't play well with
Snappy-compressed Parquet files
Key: SPARK-24927
URL: https://issues.apache.org/jira/browse/SPARK-24927
[
https://issues.apache.org/jira/browse/SPARK-24895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cheng Lian reassigned SPARK-24895:
--
Assignee: Eric Chang
> Spark 2.4.0 Snapshot artifacts has broken metadata due to mismatched
[
https://issues.apache.org/jira/browse/SPARK-24895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cheng Lian updated SPARK-24895:
---
Description:
Spark 2.4.0 has Maven build errors because artifacts uploaded to apache maven
repo
[
https://issues.apache.org/jira/browse/SPARK-19737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16372289#comment-16372289
]
Cheng Lian commented on SPARK-19737:
[~LANDAIS Christophe], I filed SPARK-23486 for this. Should be
[
https://issues.apache.org/jira/browse/SPARK-23486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cheng Lian updated SPARK-23486:
---
Labels: starter (was: )
> LookupFunctions should not check the same function name more than once
>
[
https://issues.apache.org/jira/browse/SPARK-23486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16372285#comment-16372285
]
Cheng Lian commented on SPARK-23486:
Please refer to [this
Cheng Lian created SPARK-23486:
--
Summary: LookupFunctions should not check the same function name
more than once
Key: SPARK-23486
URL: https://issues.apache.org/jira/browse/SPARK-23486
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-22951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cheng Lian resolved SPARK-22951.
Resolution: Fixed
Fix Version/s: 2.3.0
Issue resolved by pull request 20174
[
https://issues.apache.org/jira/browse/SPARK-22951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cheng Lian reassigned SPARK-22951:
--
Assignee: Feng Liu
> count() after dropDuplicates() on emptyDataFrame returns incorrect value
[
https://issues.apache.org/jira/browse/SPARK-22951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cheng Lian updated SPARK-22951:
---
Target Version/s: 2.3.0
> count() after dropDuplicates() on emptyDataFrame returns incorrect value
>
[
https://issues.apache.org/jira/browse/SPARK-22951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cheng Lian updated SPARK-22951:
---
Labels: correctness (was: )
> count() after dropDuplicates() on emptyDataFrame returns incorrect
[
https://issues.apache.org/jira/browse/SPARK-9686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cheng Lian reassigned SPARK-9686:
-
Assignee: (was: Cheng Lian)
> Spark Thrift server doesn't return correct JDBC metadata
>
[
https://issues.apache.org/jira/browse/SPARK-20958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16043478#comment-16043478
]
Cheng Lian commented on SPARK-20958:
[~marmbrus], here is the draft release note entry:
{quote}
[
https://issues.apache.org/jira/browse/SPARK-20958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cheng Lian updated SPARK-20958:
---
Labels: release-notes release_notes releasenotes (was: release-notes)
> Roll back parquet-mr 1.8.2
[
https://issues.apache.org/jira/browse/SPARK-20958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035149#comment-16035149
]
Cheng Lian commented on SPARK-20958:
Thanks [~rdblue]! I'm also reluctant to roll it back considering
[
https://issues.apache.org/jira/browse/SPARK-20958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16034310#comment-16034310
]
Cheng Lian commented on SPARK-20958:
[~rdblue] I think the root cause here is we cherry-picked
[
https://issues.apache.org/jira/browse/SPARK-20958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cheng Lian updated SPARK-20958:
---
Description:
We recently realized that parquet-mr 1.8.2 used by Spark 2.2.0-rc2 depends on
avro
Cheng Lian created SPARK-20958:
--
Summary: Roll back parquet-mr 1.8.2 to parquet-1.8.1
Key: SPARK-20958
URL: https://issues.apache.org/jira/browse/SPARK-20958
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-20132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cheng Lian updated SPARK-20132:
---
Fix Version/s: 2.2.0
> Add documentation for column string functions
>
[
https://issues.apache.org/jira/browse/SPARK-20246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cheng Lian updated SPARK-20246:
---
Labels: correctness (was: )
> Should check determinism when pushing predicates down through
[
https://issues.apache.org/jira/browse/SPARK-20246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15959946#comment-15959946
]
Cheng Lian commented on SPARK-20246:
[This
[
https://issues.apache.org/jira/browse/SPARK-19716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cheng Lian updated SPARK-19716:
---
Fix Version/s: (was: 2.3.0)
2.2.0
> Dataset should allow by-name resolution
[
https://issues.apache.org/jira/browse/SPARK-19716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cheng Lian resolved SPARK-19716.
Resolution: Fixed
Fix Version/s: 2.3.0
Issue resolved by pull request 17398
[
https://issues.apache.org/jira/browse/SPARK-19716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cheng Lian reassigned SPARK-19716:
--
Assignee: Wenchen Fan
> Dataset should allow by-name resolution for struct type elements in
[
https://issues.apache.org/jira/browse/SPARK-19912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cheng Lian updated SPARK-19912:
---
Summary: String literals are not escaped while performing Hive metastore
level partition pruning
[
https://issues.apache.org/jira/browse/SPARK-19912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cheng Lian updated SPARK-19912:
---
Description:
{{Shim_v0_13.convertFilters()}} doesn't escape string literals while generating
Hive
[
https://issues.apache.org/jira/browse/SPARK-19887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cheng Lian updated SPARK-19887:
---
Labels: correctness (was: )
> __HIVE_DEFAULT_PARTITION__ is not interpreted as NULL partition value
Cheng Lian created SPARK-19912:
--
Summary: String literals are not escaped while performing
partition pruning at Hive metastore level
Key: SPARK-19912
URL: https://issues.apache.org/jira/browse/SPARK-19912
[
https://issues.apache.org/jira/browse/SPARK-19887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cheng Lian updated SPARK-19887:
---
Affects Version/s: 2.2.0
> __HIVE_DEFAULT_PARTITION__ is not interpreted as NULL partition value in
Cheng Lian created SPARK-19905:
--
Summary: Dataset.inputFiles is broken for Hive SerDe tables
Key: SPARK-19905
URL: https://issues.apache.org/jira/browse/SPARK-19905
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-19887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cheng Lian updated SPARK-19887:
---
Description:
The following Spark shell snippet under Spark 2.1 reproduces this issue:
{code}
val
[
https://issues.apache.org/jira/browse/SPARK-19887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cheng Lian updated SPARK-19887:
---
Description:
The following Spark shell snippet under Spark 2.1 reproduces this issue:
{code}
val
[
https://issues.apache.org/jira/browse/SPARK-19887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cheng Lian updated SPARK-19887:
---
Summary: __HIVE_DEFAULT_PARTITION__ is not interpreted as NULL partition
value in partitioned
Cheng Lian created SPARK-19887:
--
Summary: __HIVE_DEFAULT_PARTITION__ not interpreted as NULL
partition value in partitioned persisted tables
Key: SPARK-19887
URL: https://issues.apache.org/jira/browse/SPARK-19887
[
https://issues.apache.org/jira/browse/SPARK-19887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15903749#comment-15903749
]
Cheng Lian commented on SPARK-19887:
cc [~cloud_fan]
> __HIVE_DEFAULT_PARTITION__ not interpreted as
[
https://issues.apache.org/jira/browse/SPARK-19737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cheng Lian resolved SPARK-19737.
Resolution: Fixed
Issue resolved by pull request 17168
[
https://issues.apache.org/jira/browse/SPARK-19737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cheng Lian reassigned SPARK-19737:
--
Assignee: Cheng Lian
> New analysis rule for reporting unregistered functions without relying
[
https://issues.apache.org/jira/browse/SPARK-19737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cheng Lian updated SPARK-19737:
---
Description:
Let's consider the following simple SQL query that reference an undefined
function
[
https://issues.apache.org/jira/browse/SPARK-19737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cheng Lian updated SPARK-19737:
---
Description:
Let's consider the following simple SQL query that reference an undefined
function
[
https://issues.apache.org/jira/browse/SPARK-19737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cheng Lian updated SPARK-19737:
---
Description:
Let's consider the following simple SQL query that reference an invalid
function
[
https://issues.apache.org/jira/browse/SPARK-19737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cheng Lian updated SPARK-19737:
---
Description:
Let's consider the following simple SQL query that reference an invalid
function
Cheng Lian created SPARK-19737:
--
Summary: New analysis rule for reporting unregistered functions
without relying on relation resolution
Key: SPARK-19737
URL: https://issues.apache.org/jira/browse/SPARK-19737
[
https://issues.apache.org/jira/browse/SPARK-19529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cheng Lian updated SPARK-19529:
---
Target Version/s: 1.6.3, 2.0.3, 2.1.1, 2.2.0 (was: 2.0.3, 2.1.1, 2.2.0)
>
[
https://issues.apache.org/jira/browse/SPARK-19529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cheng Lian updated SPARK-19529:
---
Target Version/s: 2.0.3, 2.1.1, 2.2.0 (was: 2.0.3, 2.1.1)
> TransportClientFactory.createClient()
[
https://issues.apache.org/jira/browse/SPARK-18717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cheng Lian updated SPARK-18717:
---
Fix Version/s: 2.1.1
> Datasets - crash (compile exception) when mapping to immutable scala map
>
[
https://issues.apache.org/jira/browse/SPARK-18717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cheng Lian updated SPARK-18717:
---
Affects Version/s: 2.1.0
> Datasets - crash (compile exception) when mapping to immutable scala map
[
https://issues.apache.org/jira/browse/SPARK-17714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15856638#comment-15856638
]
Cheng Lian commented on SPARK-17714:
Although I've no idea why this error occurs, it seems that
[
https://issues.apache.org/jira/browse/SPARK-18539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cheng Lian resolved SPARK-18539.
Resolution: Fixed
Assignee: Dongjoon Hyun
Target Version/s: 2.2.0
> Cannot
[
https://issues.apache.org/jira/browse/SPARK-18539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15851965#comment-15851965
]
Cheng Lian commented on SPARK-18539:
SPARK-19409 upgrades parquet-mr to 1.8.2 and fixed this issue.
[
https://issues.apache.org/jira/browse/SPARK-18539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15840186#comment-15840186
]
Cheng Lian commented on SPARK-18539:
[~viirya], sorry for the (super) late reply. What I mentioned
[
https://issues.apache.org/jira/browse/SPARK-19016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cheng Lian resolved SPARK-19016.
Resolution: Fixed
Fix Version/s: 2.2.0
2.1.1
Issue resolved by pull
Cheng Lian created SPARK-19016:
--
Summary: Document scalable partition handling feature in the
programming guide
Key: SPARK-19016
URL: https://issues.apache.org/jira/browse/SPARK-19016
Project: Spark
Cheng Lian created SPARK-18956:
--
Summary: Python API should reuse existing SparkSession while
creating new SQLContext instances
Key: SPARK-18956
URL: https://issues.apache.org/jira/browse/SPARK-18956
[
https://issues.apache.org/jira/browse/SPARK-18950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cheng Lian updated SPARK-18950:
---
Labels: starter (was: )
> Report conflicting fields when merging two StructTypes.
>
Cheng Lian created SPARK-18950:
--
Summary: Report conflicting fields when merging two StructTypes.
Key: SPARK-18950
URL: https://issues.apache.org/jira/browse/SPARK-18950
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-18753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cheng Lian updated SPARK-18753:
---
Fix Version/s: 2.2.0
> Inconsistent behavior after writing to parquet files
>
[
https://issues.apache.org/jira/browse/SPARK-18753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cheng Lian updated SPARK-18753:
---
Assignee: Hyukjin Kwon
> Inconsistent behavior after writing to parquet files
>
[
https://issues.apache.org/jira/browse/SPARK-18753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cheng Lian resolved SPARK-18753.
Resolution: Fixed
Fix Version/s: 2.1.0
Issue resolved by pull request 16184
[
https://issues.apache.org/jira/browse/SPARK-18712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15724381#comment-15724381
]
Cheng Lian edited comment on SPARK-18712 at 12/6/16 5:10 AM:
-
I think the
[
https://issues.apache.org/jira/browse/SPARK-18712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15724381#comment-15724381
]
Cheng Lian commented on SPARK-18712:
I think the contract here is that for a DataFrame {{df}} and 1
[
https://issues.apache.org/jira/browse/SPARK-18539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15724013#comment-15724013
]
Cheng Lian commented on SPARK-18539:
[~xwu0226], thanks for the new use case!
[~viirya], I do think
[
https://issues.apache.org/jira/browse/SPARK-18730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cheng Lian updated SPARK-18730:
---
Priority: Minor (was: Major)
> Ask the build script to link to Jenkins test report page instead of
Cheng Lian created SPARK-18730:
--
Summary: Ask the build script to link to Jenkins test report page
instead of full console output page when posting to GitHub
Key: SPARK-18730
URL:
[
https://issues.apache.org/jira/browse/SPARK-18539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15723781#comment-15723781
]
Cheng Lian commented on SPARK-18539:
Please remind me if I missed anything important, otherwise, we
[
https://issues.apache.org/jira/browse/SPARK-18539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15723747#comment-15723747
]
Cheng Lian edited comment on SPARK-18539 at 12/5/16 11:43 PM:
--
[
https://issues.apache.org/jira/browse/SPARK-18539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15723747#comment-15723747
]
Cheng Lian commented on SPARK-18539:
[~v-gerasimov], [~smilegator], and [~xwu0226], after some
[
https://issues.apache.org/jira/browse/SPARK-18539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15723718#comment-15723718
]
Cheng Lian commented on SPARK-18539:
As commented on GitHub, there're two issues right now:
# This
[
https://issues.apache.org/jira/browse/SPARK-18539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15722891#comment-15722891
]
Cheng Lian commented on SPARK-18539:
Haven't looked deeply into this issue, but my hunch is that this
[
https://issues.apache.org/jira/browse/SPARK-17213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cheng Lian reassigned SPARK-17213:
--
Assignee: Cheng Lian
> Parquet String Pushdown for Non-Eq Comparisons Broken
>
[
https://issues.apache.org/jira/browse/SPARK-17213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15712707#comment-15712707
]
Cheng Lian commented on SPARK-17213:
Agree that we should disable string and binary filter push down
[
https://issues.apache.org/jira/browse/SPARK-9876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cheng Lian resolved SPARK-9876.
---
Resolution: Fixed
Fix Version/s: 2.1.0
> Upgrade parquet-mr to 1.8.1
>
[
https://issues.apache.org/jira/browse/SPARK-18251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15709869#comment-15709869
]
Cheng Lian commented on SPARK-18251:
One more comment about why we shouldn't allow a {{Option\[T <:
[
https://issues.apache.org/jira/browse/SPARK-18251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cheng Lian updated SPARK-18251:
---
Assignee: Wenchen Fan
> DataSet API | RuntimeException: Null value appeared in non-nullable field
>
[
https://issues.apache.org/jira/browse/SPARK-18251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cheng Lian resolved SPARK-18251.
Resolution: Fixed
Fix Version/s: 2.2.0
Issue resolved by pull request 15979
[
https://issues.apache.org/jira/browse/SPARK-18403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15684659#comment-15684659
]
Cheng Lian edited comment on SPARK-18403 at 11/22/16 6:54 AM:
--
Here is a
[
https://issues.apache.org/jira/browse/SPARK-18403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15685389#comment-15685389
]
Cheng Lian commented on SPARK-18403:
Figured it out. It's caused by a false sharing issue inside
[
https://issues.apache.org/jira/browse/SPARK-18403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15684659#comment-15684659
]
Cheng Lian commented on SPARK-18403:
Here is a minimal test case (add it to
[
https://issues.apache.org/jira/browse/SPARK-11785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15677469#comment-15677469
]
Cheng Lian commented on SPARK-11785:
But I'm not sure which PR fixes this issue, though.
> When
[
https://issues.apache.org/jira/browse/SPARK-11785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15677468#comment-15677468
]
Cheng Lian commented on SPARK-11785:
Confirmed that this is no longer an issue for 2.1
> When
[
https://issues.apache.org/jira/browse/SPARK-18251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15677396#comment-15677396
]
Cheng Lian edited comment on SPARK-18251 at 11/18/16 6:38 PM:
--
I'd prefer
[
https://issues.apache.org/jira/browse/SPARK-18251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15677396#comment-15677396
]
Cheng Lian edited comment on SPARK-18251 at 11/18/16 6:37 PM:
--
I'd prefer
[
https://issues.apache.org/jira/browse/SPARK-18251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15677396#comment-15677396
]
Cheng Lian commented on SPARK-18251:
I'd prefer option 1 because of consistency of the semantics, and
1 - 100 of 1920 matches
Mail list logo
