[
https://issues.apache.org/jira/browse/SPARK-21358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
chie hayashida updated SPARK-21358:
---
Summary: Argument of repartitionandsortwithinpartitions at pyspark (was:
variable of
chie hayashida created SPARK-21358:
--
Summary: variable of repartitionandsortwithinpartitions at pyspark
Key: SPARK-21358
URL: https://issues.apache.org/jira/browse/SPARK-21358
Project: Spark
dadazheng created SPARK-21357:
-
Summary: FileInputDStream not remove out of date RDD
Key: SPARK-21357
URL: https://issues.apache.org/jira/browse/SPARK-21357
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-21083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan updated SPARK-21083:
Fix Version/s: 2.1.2
> Store zero size and row count after analyzing empty table
>
[
https://issues.apache.org/jira/browse/SPARK-21337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
fengchaoge updated SPARK-21337:
---
Comment: was deleted
(was: !http://example.com/image.png!)
> SQL which has large ‘case when’
[
https://issues.apache.org/jira/browse/SPARK-21337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
fengchaoge updated SPARK-21337:
---
Attachment: test2.JPG
> SQL which has large ‘case when’ expressions may cause code generation beyond
[
https://issues.apache.org/jira/browse/SPARK-21337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16079799#comment-16079799
]
fengchaoge commented on SPARK-21337:
OK i will have a try. thank you very much.
> SQL which has
[
https://issues.apache.org/jira/browse/SPARK-21337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16079795#comment-16079795
]
Hyukjin Kwon commented on SPARK-21337:
--
Probably, I think it would be nicer to narrow down via
[
https://issues.apache.org/jira/browse/SPARK-21356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-21356.
--
Resolution: Invalid
I am resolving this as the workaround looks so easy and I am not sure if
[
https://issues.apache.org/jira/browse/SPARK-21337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16079773#comment-16079773
]
fengchaoge commented on SPARK-21337:
1. create database GBD_DM_PAC_SAFE;
2. use GBD_DM_PAC_SAFE;
3.
[
https://issues.apache.org/jira/browse/SPARK-21337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16079790#comment-16079790
]
fengchaoge commented on SPARK-21337:
Attachments actually happened i have no idea about code
[
https://issues.apache.org/jira/browse/SPARK-21355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-21355.
--
Resolution: Invalid
I am resolving this per https://stackoverflow.com/a/42073.
{quote}
This
[
https://issues.apache.org/jira/browse/SPARK-21337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16079785#comment-16079785
]
fengchaoge commented on SPARK-21337:
thank you very much, what should i do for next? Thank you for
[
https://issues.apache.org/jira/browse/SPARK-21337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
fengchaoge updated SPARK-21337:
---
Attachment: test1.JPG
test.JPG
> SQL which has large ‘case when’ expressions may
[
https://issues.apache.org/jira/browse/SPARK-19659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shixiong Zhu resolved SPARK-19659.
--
Resolution: Fixed
Fix Version/s: 2.2.0
The major work is done in 2.2.0. But it's
[
https://issues.apache.org/jira/browse/SPARK-21337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16079776#comment-16079776
]
Hyukjin Kwon commented on SPARK-21337:
--
No, just copying and pasting the SQL without a further
Hyukjin Kwon created SPARK-21355:
Summary: JSON datasource failed to parse a value having newline in
its value
Key: SPARK-21355
URL: https://issues.apache.org/jira/browse/SPARK-21355
Project: Spark
Hyukjin Kwon created SPARK-21356:
Summary: CSV datasource failed to parse a value having newline in
its value
Key: SPARK-21356
URL: https://issues.apache.org/jira/browse/SPARK-21356
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-21354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-21354:
Assignee: Xiao Li (was: Apache Spark)
> INPUT FILE related functions do not support more
[
https://issues.apache.org/jira/browse/SPARK-21354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16079743#comment-16079743
]
Apache Spark commented on SPARK-21354:
--
User 'gatorsmile' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-21349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16079751#comment-16079751
]
Dongjoon Hyun edited comment on SPARK-21349 at 7/9/17 11:29 PM:
This
[
https://issues.apache.org/jira/browse/SPARK-21349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16079751#comment-16079751
]
Dongjoon Hyun edited comment on SPARK-21349 at 7/9/17 11:28 PM:
This
[
https://issues.apache.org/jira/browse/SPARK-21349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16079751#comment-16079751
]
Dongjoon Hyun commented on SPARK-21349:
---
This issue is not about blindly raising the threashold,
[
https://issues.apache.org/jira/browse/SPARK-21349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16079746#comment-16079746
]
Kay Ousterhout commented on SPARK-21349:
Does that mean we should just raise this threshold for
[
https://issues.apache.org/jira/browse/SPARK-21354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li updated SPARK-21354:
Description:
{noformat}
hive> select *, INPUT__FILE__NAME FROM t1, t2;
FAILED: SemanticException Column
[
https://issues.apache.org/jira/browse/SPARK-21354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-21354:
Assignee: Apache Spark (was: Xiao Li)
> INPUT FILE related functions do not support more
Xiao Li created SPARK-21354:
---
Summary: INPUT FILE related functions do not support more than one
sources
Key: SPARK-21354
URL: https://issues.apache.org/jira/browse/SPARK-21354
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-21349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-21349:
--
Description:
Since Spark 1.1.0, Spark emits warning when task size exceeds a threshold,
[
https://issues.apache.org/jira/browse/SPARK-21349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16079728#comment-16079728
]
Dongjoon Hyun commented on SPARK-21349:
---
Thank you for advice, [~kayousterhout]!
For usability, we
[
https://issues.apache.org/jira/browse/SPARK-21349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16079724#comment-16079724
]
Kay Ousterhout commented on SPARK-21349:
Is this a major usability issue (and what's the use case
[
https://issues.apache.org/jira/browse/SPARK-21349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-21349:
--
Description: Since Spark 1.1.0, Spark emits warning when task size exceeds
a threshold,
[
https://issues.apache.org/jira/browse/SPARK-21353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16079633#comment-16079633
]
Apache Spark commented on SPARK-21353:
--
User 'heary-cao' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-21353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-21353:
Assignee: Apache Spark
> add checkValue in spark.internal.config about how to correctly
[
https://issues.apache.org/jira/browse/SPARK-21353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-21353:
Assignee: (was: Apache Spark)
> add checkValue in spark.internal.config about how to
caoxuewen created SPARK-21353:
-
Summary: add checkValue in spark.internal.config about how to
correctly set configurations
Key: SPARK-21353
URL: https://issues.apache.org/jira/browse/SPARK-21353
Project:
[
https://issues.apache.org/jira/browse/SPARK-21352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen reopened SPARK-21352:
---
> Memory Usage in Spark Streaming
> ---
>
> Key: SPARK-21352
[
https://issues.apache.org/jira/browse/SPARK-21352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen closed SPARK-21352.
-
> Memory Usage in Spark Streaming
> ---
>
> Key: SPARK-21352
>
[
https://issues.apache.org/jira/browse/SPARK-21352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-21352.
---
Resolution: Invalid
> Memory Usage in Spark Streaming
> ---
>
>
[
https://issues.apache.org/jira/browse/SPARK-21352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-21352.
---
Resolution: Fixed
That does not imply this is the right place. This is for proposing changes and
[
https://issues.apache.org/jira/browse/SPARK-21352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shubham Gupta updated SPARK-21352:
--
Description:
I am trying to figure out the memory used by executors for a Spark Streaming
[
https://issues.apache.org/jira/browse/SPARK-21352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shubham Gupta reopened SPARK-21352:
---
There is no solution provided for the problem and neither stack overflow helping
> Memory
[
https://issues.apache.org/jira/browse/SPARK-21083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan updated SPARK-21083:
Fix Version/s: 2.2.1
> Store zero size and row count after analyzing empty table
>
[
https://issues.apache.org/jira/browse/SPARK-18016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16079543#comment-16079543
]
Apache Spark commented on SPARK-18016:
--
User 'cloud-fan' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-21352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-21352.
---
Resolution: Invalid
Please point questions to StackOverflow or the mailing list.
> Memory Usage in
[
https://issues.apache.org/jira/browse/SPARK-21332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16079525#comment-16079525
]
Anton Okolnychyi commented on SPARK-21332:
--
I know the root cause and will submit a PR soon.
>
[
https://issues.apache.org/jira/browse/SPARK-21352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shubham Gupta updated SPARK-21352:
--
Issue Type: Improvement (was: Bug)
> Memory Usage in Spark Streaming
>
Shubham Gupta created SPARK-21352:
-
Summary: Memory Usage in Spark Streaming
Key: SPARK-21352
URL: https://issues.apache.org/jira/browse/SPARK-21352
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-21341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16079507#comment-16079507
]
Yan Facai (颜发才) commented on SPARK-21341:
-
Yes, [~sowen] is right. Why not to use save and load
[
https://issues.apache.org/jira/browse/SPARK-21083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16079493#comment-16079493
]
Apache Spark commented on SPARK-21083:
--
User 'wzhfy' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-21351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-21351:
Assignee: (was: Apache Spark)
> Update nullability based on children's output in
[
https://issues.apache.org/jira/browse/SPARK-21351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-21351:
Assignee: Apache Spark
> Update nullability based on children's output in optimized
[
https://issues.apache.org/jira/browse/SPARK-21351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16079480#comment-16079480
]
Apache Spark commented on SPARK-21351:
--
User 'maropu' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-21083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16079474#comment-16079474
]
Apache Spark commented on SPARK-21083:
--
User 'wzhfy' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-21351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takeshi Yamamuro updated SPARK-21351:
-
Description:
In the master, optimized plans do not respect the nullability that `Filter`
Takeshi Yamamuro created SPARK-21351:
Summary: Update nullability based on children's output in
optimized logical plan
Key: SPARK-21351
URL: https://issues.apache.org/jira/browse/SPARK-21351
55 matches
Mail list logo
