[
https://issues.apache.org/jira/browse/SPARK-25055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
DENG FEI resolved SPARK-25055.
--
Resolution: Duplicate
> MessageWithHeader transfer ByteBuffer from Netty's CompositeByteBuf many times
[
https://issues.apache.org/jira/browse/SPARK-25058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takuya Ueshin resolved SPARK-25058.
---
Resolution: Fixed
Assignee: Takuya Ueshin
Fix Version/s: 2.4.0
Issue resolve
[
https://issues.apache.org/jira/browse/SPARK-23050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16574276#comment-16574276
]
Steve Loughran commented on SPARK-23050:
bq. Is there any way we can avoid happe
[
https://issues.apache.org/jira/browse/SPARK-25063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16574275#comment-16574275
]
Apache Spark commented on SPARK-25063:
--
User 'maryannxue' has created a pull reques
[
https://issues.apache.org/jira/browse/SPARK-25063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-25063:
Assignee: Apache Spark
> Rename class KnowNotNull to KnownNotNull
> -
[
https://issues.apache.org/jira/browse/SPARK-25063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-25063:
Assignee: (was: Apache Spark)
> Rename class KnowNotNull to KnownNotNull
> --
[
https://issues.apache.org/jira/browse/SPARK-25063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Maryann Xue updated SPARK-25063:
Description: It's a class name typo checked in through SPARK-24891 (was:
It's a class name typo c
Maryann Xue created SPARK-25063:
---
Summary: Rename class KnowNotNull to KnownNotNull
Key: SPARK-25063
URL: https://issues.apache.org/jira/browse/SPARK-25063
Project: Spark
Issue Type: Task
[
https://issues.apache.org/jira/browse/SPARK-25013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16574259#comment-16574259
]
Takeshi Yamamuro commented on SPARK-25013:
--
yea, we can by registering a new di
[
https://issues.apache.org/jira/browse/SPARK-23596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-23596.
--
Resolution: Fixed
Fix Version/s: 2.4.0
Issue resolved by pull request 21535
[https://gi
[
https://issues.apache.org/jira/browse/SPARK-23596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-23596:
Assignee: Liang-Chi Hsieh
> Modify Dataset test harness to include interpreted execution
[
https://issues.apache.org/jira/browse/SPARK-25062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
andrzej.stankev...@gmail.com updated SPARK-25062:
-
Description:
When Spark lists collection of files it does it on
[
https://issues.apache.org/jira/browse/SPARK-25062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
andrzej.stankev...@gmail.com updated SPARK-25062:
-
Description:
When Spark lists collection of files it does it on
[
https://issues.apache.org/jira/browse/SPARK-25062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
andrzej.stankev...@gmail.com updated SPARK-25062:
-
Description:
When Spark lists collection of files it does it on
andrzej.stankev...@gmail.com created SPARK-25062:
Summary: Clean up BlockLocations in FileStatus objects
Key: SPARK-25062
URL: https://issues.apache.org/jira/browse/SPARK-25062
Project:
[
https://issues.apache.org/jira/browse/SPARK-25051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16573898#comment-16573898
]
MIK edited comment on SPARK-25051 at 8/8/18 9:32 PM:
-
df1 and df2, b
[
https://issues.apache.org/jira/browse/SPARK-25060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16573914#comment-16573914
]
Ryan Blue commented on SPARK-25060:
---
I don't think that's quite the same thing since t
[
https://issues.apache.org/jira/browse/SPARK-25051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16573915#comment-16573915
]
MIK commented on SPARK-25051:
-
I have added a sample program which shows this issue:
Works
[
https://issues.apache.org/jira/browse/SPARK-25061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16573911#comment-16573911
]
Zineng Yuan commented on SPARK-25061:
-
A further investigation starting from thrift
[
https://issues.apache.org/jira/browse/SPARK-25061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zineng Yuan updated SPARK-25061:
Description:
Spark thrift server should use passing parameter value and overwrites the same
conf
[
https://issues.apache.org/jira/browse/SPARK-25051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16573898#comment-16573898
]
MIK commented on SPARK-25051:
-
df1 and df2, both are reading from S3 files
df1 = spark.read
Zineng Yuan created SPARK-25061:
---
Summary: Spark SQL Thrift Server fails to not pick up hiveconf
passing parameter
Key: SPARK-25061
URL: https://issues.apache.org/jira/browse/SPARK-25061
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-25060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16573866#comment-16573866
]
Bryan Cutler edited comment on SPARK-25060 at 8/8/18 9:03 PM:
[
https://issues.apache.org/jira/browse/SPARK-25060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16573866#comment-16573866
]
Bryan Cutler commented on SPARK-25060:
--
I believe this was brought up here
https:/
[
https://issues.apache.org/jira/browse/SPARK-25060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16573834#comment-16573834
]
Ryan Blue commented on SPARK-25060:
---
[~bryanc], [~holdenkarau], any ideas for how to f
Ryan Blue created SPARK-25060:
-
Summary: PySpark UDF in case statement is always run
Key: SPARK-25060
URL: https://issues.apache.org/jira/browse/SPARK-25060
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-25059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kunal Goswami updated SPARK-25059:
--
External issue URL: https://issues.apache.org/jira/browse/SPARK-16845
> Exception while execut
[
https://issues.apache.org/jira/browse/SPARK-25059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kunal Goswami updated SPARK-25059:
--
External issue URL: (was:
https://issues.apache.org/jira/browse/SPARK-16845)
> Exception wh
Kunal Goswami created SPARK-25059:
-
Summary: Exception while executing an action on DataFrame that
read Json
Key: SPARK-25059
URL: https://issues.apache.org/jira/browse/SPARK-25059
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-19851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16573785#comment-16573785
]
Apache Spark commented on SPARK-19851:
--
User 'dilipbiswal' has created a pull reque
[
https://issues.apache.org/jira/browse/SPARK-23940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-23940:
Assignee: Apache Spark
> High-order function: transform_values(map, function) →
> map
>
[
https://issues.apache.org/jira/browse/SPARK-23940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-23940:
Assignee: (was: Apache Spark)
> High-order function: transform_values(map, function)
[
https://issues.apache.org/jira/browse/SPARK-23940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16573764#comment-16573764
]
Apache Spark commented on SPARK-23940:
--
User 'codeatri' has created a pull request
[
https://issues.apache.org/jira/browse/SPARK-23939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16573747#comment-16573747
]
Apache Spark commented on SPARK-23939:
--
User 'codeatri' has created a pull request
[
https://issues.apache.org/jira/browse/SPARK-23050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16573700#comment-16573700
]
bharath kumar avusherla edited comment on SPARK-23050 at 8/8/18 6:51 PM:
-
[
https://issues.apache.org/jira/browse/SPARK-23050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16573700#comment-16573700
]
bharath kumar avusherla commented on SPARK-23050:
-
Is there any way we c
[
https://issues.apache.org/jira/browse/SPARK-23912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16573699#comment-16573699
]
Apache Spark commented on SPARK-23912:
--
User 'kiszk' has created a pull request for
[
https://issues.apache.org/jira/browse/SPARK-24251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16573684#comment-16573684
]
Apache Spark commented on SPARK-24251:
--
User 'rdblue' has created a pull request fo
[
https://issues.apache.org/jira/browse/SPARK-25005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-25005:
Assignee: (was: Apache Spark)
> Structured streaming doesn't support kafka transactio
[
https://issues.apache.org/jira/browse/SPARK-25005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16573585#comment-16573585
]
Apache Spark commented on SPARK-25005:
--
User 'zsxwing' has created a pull request f
[
https://issues.apache.org/jira/browse/SPARK-25005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-25005:
Assignee: Apache Spark
> Structured streaming doesn't support kafka transaction (creating
[
https://issues.apache.org/jira/browse/SPARK-25044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16573570#comment-16573570
]
Lukas Rytz commented on SPARK-25044:
This problem relates to what had to be solved f
[
https://issues.apache.org/jira/browse/SPARK-25058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-25058:
Assignee: (was: Apache Spark)
> Use Block.isEmpty/nonEmpty to check whether the code
[
https://issues.apache.org/jira/browse/SPARK-25058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-25058:
Assignee: Apache Spark
> Use Block.isEmpty/nonEmpty to check whether the code is empty or
[
https://issues.apache.org/jira/browse/SPARK-25058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16573526#comment-16573526
]
Apache Spark commented on SPARK-25058:
--
User 'ueshin' has created a pull request fo
Takuya Ueshin created SPARK-25058:
-
Summary: Use Block.isEmpty/nonEmpty to check whether the code is
empty or not.
Key: SPARK-25058
URL: https://issues.apache.org/jira/browse/SPARK-25058
Project: Spar
[
https://issues.apache.org/jira/browse/SPARK-25044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16573513#comment-16573513
]
Sean Owen commented on SPARK-25044:
---
Yep, that's the crux of the issue here – not clea
[
https://issues.apache.org/jira/browse/SPARK-25036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16573508#comment-16573508
]
Apache Spark commented on SPARK-25036:
--
User 'ueshin' has created a pull request fo
[
https://issues.apache.org/jira/browse/SPARK-25029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16573503#comment-16573503
]
Sean Owen commented on SPARK-25029:
---
I don't think it'll come to that; looks like some
[
https://issues.apache.org/jira/browse/SPARK-25029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16573495#comment-16573495
]
shane knapp commented on SPARK-25029:
-
i really don't like the thought of resorting
[
https://issues.apache.org/jira/browse/SPARK-25044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16573493#comment-16573493
]
Wenchen Fan commented on SPARK-25044:
-
Sorry I've not read all the comments here, bu
Shivam Gupta created SPARK-25057:
Summary: Unable to start spark on master URL
Key: SPARK-25057
URL: https://issues.apache.org/jira/browse/SPARK-25057
Project: Spark
Issue Type: Question
[
https://issues.apache.org/jira/browse/SPARK-25044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16573400#comment-16573400
]
Sean Owen commented on SPARK-25044:
---
I dug into this, and found that you can't directl
[
https://issues.apache.org/jira/browse/SPARK-25056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-25056:
Assignee: Apache Spark
> Unify the InConversion and BinaryComparison behaviour when InCon
[
https://issues.apache.org/jira/browse/SPARK-25056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-25056:
Assignee: (was: Apache Spark)
> Unify the InConversion and BinaryComparison behaviour
[
https://issues.apache.org/jira/browse/SPARK-25056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16573394#comment-16573394
]
Apache Spark commented on SPARK-25056:
--
User 'wangyum' has created a pull request f
Yuming Wang created SPARK-25056:
---
Summary: Unify the InConversion and BinaryComparison behaviour
when InConversion's list only contains one datatype
Key: SPARK-25056
URL: https://issues.apache.org/jira/browse/SPARK-
[
https://issues.apache.org/jira/browse/SPARK-25031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16573299#comment-16573299
]
Marco Gaido commented on SPARK-25031:
-
[~smilegator] shall this be resolved as
http
[
https://issues.apache.org/jira/browse/SPARK-24774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-24774:
Assignee: Apache Spark
> support reading AVRO logical types - Decimal
> -
[
https://issues.apache.org/jira/browse/SPARK-24774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16573235#comment-16573235
]
Apache Spark commented on SPARK-24774:
--
User 'gengliangwang' has created a pull req
[
https://issues.apache.org/jira/browse/SPARK-24774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-24774:
Assignee: (was: Apache Spark)
> support reading AVRO logical types - Decimal
> --
[
https://issues.apache.org/jira/browse/SPARK-24774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gengliang Wang updated SPARK-24774:
---
Summary: support reading AVRO logical types - Decimal (was: support
reading AVRO logical ty
[
https://issues.apache.org/jira/browse/SPARK-24772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gengliang Wang updated SPARK-24772:
---
Summary: support reading AVRO logical types - Date (was: support reading
AVRO logical types
[
https://issues.apache.org/jira/browse/SPARK-24924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16573221#comment-16573221
]
Thomas Graves commented on SPARK-24924:
---
| There was a discussion about why we sho
[
https://issues.apache.org/jira/browse/SPARK-24502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16573175#comment-16573175
]
Wenchen Fan commented on SPARK-24502:
-
Mostly you don't need to care about it. But w
[
https://issues.apache.org/jira/browse/SPARK-25044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16573160#comment-16573160
]
Sean Owen commented on SPARK-25044:
---
I see, it sounds like the code needs to look for
[
https://issues.apache.org/jira/browse/SPARK-25047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16573158#comment-16573158
]
Sean Owen commented on SPARK-25047:
---
Thanks [~lrytz] – sounds like it is at least outs
[
https://issues.apache.org/jira/browse/SPARK-25055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16573154#comment-16573154
]
DENG FEI commented on SPARK-25055:
--
{code:java}
private int copyByteBuf(ByteBuf buf, Wr
[
https://issues.apache.org/jira/browse/SPARK-24502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16573149#comment-16573149
]
Paul Praet commented on SPARK-24502:
[~cloud_fan] Does this mean users also have to
DENG FEI created SPARK-25055:
Summary: MessageWithHeader transfer ByteBuffer from Netty's
CompositeByteBuf many times
Key: SPARK-25055
URL: https://issues.apache.org/jira/browse/SPARK-25055
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-25028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-25028:
Assignee: (was: Apache Spark)
> AnalyzePartitionCommand failed with NPE if value is n
[
https://issues.apache.org/jira/browse/SPARK-25028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-25028:
Assignee: Apache Spark
> AnalyzePartitionCommand failed with NPE if value is null
> -
[
https://issues.apache.org/jira/browse/SPARK-25028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16573120#comment-16573120
]
Apache Spark commented on SPARK-25028:
--
User 'mgaido91' has created a pull request
[
https://issues.apache.org/jira/browse/SPARK-25028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Izek Greenfield updated SPARK-25028:
Description:
on line 143: val partitionColumnValues =
partitionColumns.indices.map(r.get(
[
https://issues.apache.org/jira/browse/SPARK-25028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Izek Greenfield reopened SPARK-25028:
-
Add sample code
> AnalyzePartitionCommand failed with NPE if value is null
> --
[
https://issues.apache.org/jira/browse/SPARK-25028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Izek Greenfield updated SPARK-25028:
Description:
on line 143: val partitionColumnValues =
partitionColumns.indices.map(r.get(
[
https://issues.apache.org/jira/browse/SPARK-23911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16572871#comment-16572871
]
Apache Spark commented on SPARK-23911:
--
User 'ueshin' has created a pull request fo
[
https://issues.apache.org/jira/browse/SPARK-24918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16572850#comment-16572850
]
Luca Canali commented on SPARK-24918:
-
[~irashid] I agree that the proposal should b
78 matches
Mail list logo