Zhong Wang created SPARK-13704:
--
Summary: TaskSchedulerImpl.createTaskSetManager can be expensive,
and result in lost executors due to blocked heartbeats
Key: SPARK-13704
URL:
[
https://issues.apache.org/jira/browse/SPARK-13699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15182031#comment-15182031
]
Dhaval Modi commented on SPARK-13699:
-
TGT_TABLE DDL:
CREATE TABLE IF NOT EXISTS tgt_table (col1
[
https://issues.apache.org/jira/browse/SPARK-13396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15182029#comment-15182029
]
Apache Spark commented on SPARK-13396:
--
User 'GayathriMurali' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-13396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-13396:
Assignee: (was: Apache Spark)
> Stop using our internal deprecated .metrics on
[
https://issues.apache.org/jira/browse/SPARK-13396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-13396:
Assignee: Apache Spark
> Stop using our internal deprecated .metrics on ExceptionFailure
[
https://issues.apache.org/jira/browse/SPARK-12718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15181967#comment-15181967
]
Xiao Li edited comment on SPARK-12718 at 3/6/16 3:33 AM:
-
{code}
select key,
[
https://issues.apache.org/jira/browse/SPARK-12718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15181967#comment-15181967
]
Xiao Li edited comment on SPARK-12718 at 3/6/16 3:28 AM:
-
{code}
select key,
[
https://issues.apache.org/jira/browse/SPARK-12718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15181973#comment-15181973
]
Xiao Li commented on SPARK-12718:
-
Just confirmed that no optimizer rule needs to be added.
{code}
[
https://issues.apache.org/jira/browse/SPARK-12718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15181967#comment-15181967
]
Xiao Li commented on SPARK-12718:
-
select key, value, avg(c_int) over (partition by key), sum(c_float)
[
https://issues.apache.org/jira/browse/SPARK-12718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15181967#comment-15181967
]
Xiao Li edited comment on SPARK-12718 at 3/6/16 2:59 AM:
-
{code}
select key,
[
https://issues.apache.org/jira/browse/SPARK-10380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15181942#comment-15181942
]
Apache Spark commented on SPARK-10380:
--
User 'GayathriMurali' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-13703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-13703:
Assignee: Apache Spark
> Remove obsolete scala-2.10 source files
>
[
https://issues.apache.org/jira/browse/SPARK-13703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-13703:
Assignee: (was: Apache Spark)
> Remove obsolete scala-2.10 source files
>
[
https://issues.apache.org/jira/browse/SPARK-13703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15181929#comment-15181929
]
Apache Spark commented on SPARK-13703:
--
User 'lresende' has created a pull request for this issue:
Luciano Resende created SPARK-13703:
---
Summary: Remove obsolete scala-2.10 source files
Key: SPARK-13703
URL: https://issues.apache.org/jira/browse/SPARK-13703
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-13701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15181921#comment-15181921
]
Santiago M. Mola commented on SPARK-13701:
--
This is probably just gfortran not being installed?
[
https://issues.apache.org/jira/browse/SPARK-13699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15181916#comment-15181916
]
Xiao Li commented on SPARK-13699:
-
[~mysti] Could you show the script how you create the original
[
https://issues.apache.org/jira/browse/SPARK-13702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-13702:
Assignee: Apache Spark
> Use diamond operator for generic instance creation in Java code
[
https://issues.apache.org/jira/browse/SPARK-13702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15181913#comment-15181913
]
Apache Spark commented on SPARK-13702:
--
User 'dongjoon-hyun' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-13702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-13702:
Assignee: (was: Apache Spark)
> Use diamond operator for generic instance creation in
[
https://issues.apache.org/jira/browse/SPARK-13702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-13702:
--
Description:
Java 7 or higher supports `diamond` operator which replaces the type arguments
Dongjoon Hyun created SPARK-13702:
-
Summary: Use diamond operator for generic instance creation in
Java code
Key: SPARK-13702
URL: https://issues.apache.org/jira/browse/SPARK-13702
Project: Spark
Santiago M. Mola created SPARK-13701:
Summary: MLlib ALS fails on arm64 (java.lang.UnsatisfiedLinkError:
org.jblas.NativeBlas.dgemm))
Key: SPARK-13701
URL: https://issues.apache.org/jira/browse/SPARK-13701
[
https://issues.apache.org/jira/browse/SPARK-13693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shixiong Zhu resolved SPARK-13693.
--
Resolution: Fixed
Fix Version/s: 2.0.0
> Flaky test: o.a.s.streaming.MapWithStateSuite
[
https://issues.apache.org/jira/browse/SPARK-13641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15181872#comment-15181872
]
Xusen Yin commented on SPARK-13641:
---
You can checkout code from
[
https://issues.apache.org/jira/browse/SPARK-3151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-3151:
--
Component/s: Block Manager
> DiskStore attempts to map any size BlockId without checking
[
https://issues.apache.org/jira/browse/SPARK-8790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-8790:
--
Component/s: Block Manager
> BlockManager.reregister cause OOM
> -
>
>
[
https://issues.apache.org/jira/browse/SPARK-1762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-1762:
--
Component/s: Block Manager
> Add functionality to pin RDDs in cache
>
[
https://issues.apache.org/jira/browse/SPARK-12076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-12076:
---
Component/s: (was: Spark Core)
SQL
> countDistinct behaves inconsistently
>
[
https://issues.apache.org/jira/browse/SPARK-13365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15181827#comment-15181827
]
Josh Rosen commented on SPARK-13365:
If coalesce is called with {{shuffle == true}} then we might
[
https://issues.apache.org/jira/browse/SPARK-13352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-13352:
---
Component/s: Block Manager
> BlockFetch does not scale well on large block
>
[
https://issues.apache.org/jira/browse/SPARK-13700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-13700:
---
Target Version/s: (was: 1.6.0)
> Rdd.mapAsync(): Easily mix Spark and asynchroneous transformation
[
https://issues.apache.org/jira/browse/SPARK-13700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-13700:
---
Affects Version/s: (was: 1.6.0)
> Rdd.mapAsync(): Easily mix Spark and asynchroneous
[
https://issues.apache.org/jira/browse/SPARK-13641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15181819#comment-15181819
]
Gayathri Murali commented on SPARK-13641:
-
[~xusen] Can you list the steps to reproduce the bug?
[
https://issues.apache.org/jira/browse/SPARK-13700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Paulo Costa updated SPARK-13700:
Description:
Spark is great for synchronous operations.
But sometimes I need to call a
Paulo Costa created SPARK-13700:
---
Summary: Rdd.mapAsync(): Easily mix Spark and asynchroneous
transformation
Key: SPARK-13700
URL: https://issues.apache.org/jira/browse/SPARK-13700
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-13699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15181804#comment-15181804
]
Xiao Li commented on SPARK-13699:
-
After a research, we can NOT truncate the table if the table is
[
https://issues.apache.org/jira/browse/SPARK-13699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15181791#comment-15181791
]
Xiao Li commented on SPARK-13699:
-
Now, I see your points. Will take a look at it. Thanks!
> Spark SQL
[
https://issues.apache.org/jira/browse/SPARK-13230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15181790#comment-15181790
]
Łukasz Gieroń commented on SPARK-13230:
---
A good workaround is to use Kryo serializer. I've checked
[
https://issues.apache.org/jira/browse/SPARK-13699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15181780#comment-15181780
]
Dhaval Modi edited comment on SPARK-13699 at 3/5/16 5:30 PM:
-
[
https://issues.apache.org/jira/browse/SPARK-13699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15181780#comment-15181780
]
Dhaval Modi edited comment on SPARK-13699 at 3/5/16 5:30 PM:
-
[
https://issues.apache.org/jira/browse/SPARK-13699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15181780#comment-15181780
]
Dhaval Modi edited comment on SPARK-13699 at 3/5/16 5:29 PM:
-
[
https://issues.apache.org/jira/browse/SPARK-13699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15181780#comment-15181780
]
Dhaval Modi commented on SPARK-13699:
-
== Code Snippet
[
https://issues.apache.org/jira/browse/SPARK-13699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15181777#comment-15181777
]
Dhaval Modi commented on SPARK-13699:
-
This should be a bug, as it fails to overwrite the table,
[
https://issues.apache.org/jira/browse/SPARK-13699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dhaval Modi updated SPARK-13699:
Attachment: stackTrace.txt
> Spark SQL drops the table in "overwrite" mode while writing into
[
https://issues.apache.org/jira/browse/SPARK-13699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dhaval Modi updated SPARK-13699:
Description:
Hi,
While writing the dataframe to HIVE table with "SaveMode.Overwrite" option.
[
https://issues.apache.org/jira/browse/SPARK-7505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15181776#comment-15181776
]
Nicholas Chammas commented on SPARK-7505:
-
I believe items 1, 3, and 4 still apply. They're minor
[
https://issues.apache.org/jira/browse/SPARK-13699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li updated SPARK-13699:
Issue Type: Improvement (was: Bug)
> Spark SQL drops the HIVE table in "overwrite" mode while writing
[
https://issues.apache.org/jira/browse/SPARK-13699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li updated SPARK-13699:
Summary: Spark SQL drops the table in "overwrite" mode while writing into
table (was: Spark SQL drops the
[
https://issues.apache.org/jira/browse/SPARK-13699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li updated SPARK-13699:
Priority: Major (was: Blocker)
> Spark SQL drops the HIVE table in "overwrite" mode while writing into
[
https://issues.apache.org/jira/browse/SPARK-13699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15181752#comment-15181752
]
Xiao Li commented on SPARK-13699:
-
So far, this is by design. Thus, it is hard to say it is a bug.
[
https://issues.apache.org/jira/browse/SPARK-13699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li updated SPARK-13699:
Comment: was deleted
(was: In RDBMS, I know truncate is much faster than drop-and-then-recreate due
to
[
https://issues.apache.org/jira/browse/SPARK-13699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15181750#comment-15181750
]
Xiao Li commented on SPARK-13699:
-
In RDBMS, I know truncate is much faster than drop-and-then-recreate
[
https://issues.apache.org/jira/browse/SPARK-13699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dhaval Modi updated SPARK-13699:
Summary: Spark SQL drops the HIVE table in "overwrite" mode while writing
into table (was: Spark
Dhaval Modi created SPARK-13699:
---
Summary: Spark SQL drop the table in "overwrite" mode while
writing into table
Key: SPARK-13699
URL: https://issues.apache.org/jira/browse/SPARK-13699
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-13692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-13692:
--
Description:
This issue fixes the following potential bugs and Java coding style detected by
[
https://issues.apache.org/jira/browse/SPARK-12720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cheng Lian updated SPARK-12720:
---
Fix Version/s: 2.0.0
> SQL generation support for cube, rollup, and grouping set
>
[
https://issues.apache.org/jira/browse/SPARK-12720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cheng Lian resolved SPARK-12720.
Resolution: Fixed
Resolved by https://github.com/apache/spark/pull/11283
> SQL generation support
[
https://issues.apache.org/jira/browse/SPARK-13616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15181674#comment-15181674
]
Apache Spark commented on SPARK-13616:
--
User 'liancheng' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-13698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-13698:
Assignee: Apache Spark
> Fix Analysis Exceptions when Using Backticks in Generate
>
[
https://issues.apache.org/jira/browse/SPARK-13698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15181657#comment-15181657
]
Apache Spark commented on SPARK-13698:
--
User 'dilipbiswal' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-13698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-13698:
Assignee: (was: Apache Spark)
> Fix Analysis Exceptions when Using Backticks in
Dilip Biswal created SPARK-13698:
Summary: Fix Analysis Exceptions when Using Backticks in Generate
Key: SPARK-13698
URL: https://issues.apache.org/jira/browse/SPARK-13698
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-13616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15181651#comment-15181651
]
Apache Spark commented on SPARK-13616:
--
User 'viirya' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-13629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-13629:
Assignee: (was: Apache Spark)
> Add binary toggle Param to CountVectorizer
>
[
https://issues.apache.org/jira/browse/SPARK-13629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15181648#comment-15181648
]
Apache Spark commented on SPARK-13629:
--
User 'hhbyyh' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-13629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-13629:
Assignee: Apache Spark
> Add binary toggle Param to CountVectorizer
>
[
https://issues.apache.org/jira/browse/SPARK-13684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15181647#comment-15181647
]
Sean Owen commented on SPARK-13684:
---
Hm OK this turns out to be a non-issue. I guess I think it's worth
[
https://issues.apache.org/jira/browse/SPARK-13691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15181640#comment-15181640
]
Sean Owen commented on SPARK-13691:
---
I think this is just a language difference? Although changing it
[
https://issues.apache.org/jira/browse/SPARK-13697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shixiong Zhu reassigned SPARK-13697:
Assignee: Shixiong Zhu
> TransformFunctionSerializer.loads doesn't restore the function's
[
https://issues.apache.org/jira/browse/SPARK-13523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Davies Liu reopened SPARK-13523:
SPARK-11838 is different than this, that is about cache fragment across queries.
> Reuse the
[
https://issues.apache.org/jira/browse/SPARK-13523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Davies Liu reassigned SPARK-13523:
--
Assignee: Davies Liu
> Reuse the exchanges in a query
> --
>
>
[
https://issues.apache.org/jira/browse/SPARK-13697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-13697:
Assignee: (was: Apache Spark)
> TransformFunctionSerializer.loads doesn't restore the
[
https://issues.apache.org/jira/browse/SPARK-13697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-13697:
Assignee: Apache Spark
> TransformFunctionSerializer.loads doesn't restore the function's
[
https://issues.apache.org/jira/browse/SPARK-13697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15181632#comment-15181632
]
Apache Spark commented on SPARK-13697:
--
User 'zsxwing' has created a pull request for this issue:
Shixiong Zhu created SPARK-13697:
Summary: TransformFunctionSerializer.loads doesn't restore the
function's module name if it's '__main__'
Key: SPARK-13697
URL: https://issues.apache.org/jira/browse/SPARK-13697
76 matches
Mail list logo