[
https://issues.apache.org/jira/browse/SPARK-2061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14028874#comment-14028874
]
Anant Daksh Asthana commented on SPARK-2061:
Proposed fixed can be found at :
[
https://issues.apache.org/jira/browse/SPARK-1964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust reopened SPARK-1964:
-
> Timestamp missing from HiveMetastore types parser
> ---
[
https://issues.apache.org/jira/browse/SPARK-2127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14028854#comment-14028854
]
Rahul Singhal commented on SPARK-2127:
--
A PR is in the works.
> Use application spec
Rahul Singhal created SPARK-2127:
Summary: Use application specific folders to dump metrics via
CsvSink
Key: SPARK-2127
URL: https://issues.apache.org/jira/browse/SPARK-2127
Project: Spark
I
[
https://issues.apache.org/jira/browse/SPARK-2125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14028833#comment-14028833
]
Saisai Shao commented on SPARK-2125:
Hi Matei, for moving sort into hash shuffle imple
Matei Zaharia created SPARK-2126:
Summary: Move MapOutputTracker behind ShuffleManager interface
Key: SPARK-2126
URL: https://issues.apache.org/jira/browse/SPARK-2126
Project: Spark
Issue Typ
[
https://issues.apache.org/jira/browse/SPARK-2123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Matei Zaharia resolved SPARK-2123.
--
Resolution: Fixed
Resolved in https://github.com/apache/spark/pull/1009
> Basic pluggable inte
[
https://issues.apache.org/jira/browse/SPARK-2124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Matei Zaharia updated SPARK-2124:
-
Assignee: Saisai Shao
> Move aggregation into ShuffleManager implementations
> --
Matei Zaharia created SPARK-2125:
Summary: Add sorting flag to ShuffleManager, and implement it in
HashShuffleManager
Key: SPARK-2125
URL: https://issues.apache.org/jira/browse/SPARK-2125
Project: Spa
Matei Zaharia created SPARK-2124:
Summary: Move aggregation into ShuffleManager implementations
Key: SPARK-2124
URL: https://issues.apache.org/jira/browse/SPARK-2124
Project: Spark
Issue Type
Matei Zaharia created SPARK-2123:
Summary: Basic pluggable interface for shuffle
Key: SPARK-2123
URL: https://issues.apache.org/jira/browse/SPARK-2123
Project: Spark
Issue Type: Sub-task
Saisai Shao created SPARK-2122:
--
Summary: Move aggregation into shuffle implementation
Key: SPARK-2122
URL: https://issues.apache.org/jira/browse/SPARK-2122
Project: Spark
Issue Type: Improvemen
[
https://issues.apache.org/jira/browse/SPARK-983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14028715#comment-14028715
]
Madhu Siddalingaiah edited comment on SPARK-983 at 6/12/14 1:52 AM:
-
[
https://issues.apache.org/jira/browse/SPARK-983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14028715#comment-14028715
]
Madhu Siddalingaiah commented on SPARK-983:
---
[Aaron
Davidson|https://issues.apac
[
https://issues.apache.org/jira/browse/SPARK-2120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shuo Xiang closed SPARK-2120.
-
Resolution: Duplicate
> Not fully cached when there is enough memory
> --
Shuo Xiang created SPARK-2121:
-
Summary: Not fully cached when there is enough memory
Key: SPARK-2121
URL: https://issues.apache.org/jira/browse/SPARK-2121
Project: Spark
Issue Type: Bug
Shuo Xiang created SPARK-2120:
-
Summary: Not fully cached when there is enough memory
Key: SPARK-2120
URL: https://issues.apache.org/jira/browse/SPARK-2120
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-2106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14028709#comment-14028709
]
Michael Armbrust commented on SPARK-2106:
-
SchemaRDD has a method `queryExecution`
Michael Armbrust created SPARK-2119:
---
Summary: Reading Parquet InputSplits dominates query execution
time when reading off S3
Key: SPARK-2119
URL: https://issues.apache.org/jira/browse/SPARK-2119
Pr
[
https://issues.apache.org/jira/browse/SPARK-2106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14028705#comment-14028705
]
Cheng Hao commented on SPARK-2106:
--
BTW, call hql(...).collect() is a good way to retriev
[
https://issues.apache.org/jira/browse/SPARK-2106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14028699#comment-14028699
]
Cheng Hao commented on SPARK-2106:
--
Oh, I see your point.
Actually I was suggesting is we
[
https://issues.apache.org/jira/browse/SPARK-1672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiangrui Meng closed SPARK-1672.
Resolution: Implemented
Assignee: Tor Myklebust
PR: https://github.com/apache/spark/pull/1014
[
https://issues.apache.org/jira/browse/SPARK-2099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14028681#comment-14028681
]
Sandy Ryza commented on SPARK-2099:
---
https://github.com/apache/spark/pull/1056
> Report
[
https://issues.apache.org/jira/browse/SPARK-2052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust resolved SPARK-2052.
-
Resolution: Fixed
> Add optimization for CaseConversionExpression's.
> --
[
https://issues.apache.org/jira/browse/SPARK-2118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell updated SPARK-2118:
---
Issue Type: Sub-task (was: Improvement)
Parent: SPARK-2069
> If tools jar is not pre
Patrick Wendell created SPARK-2118:
--
Summary: If tools jar is not present, MIMA build should exit with
an exception
Key: SPARK-2118
URL: https://issues.apache.org/jira/browse/SPARK-2118
Project: Spar
[
https://issues.apache.org/jira/browse/SPARK-2117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust resolved SPARK-2117.
-
Resolution: Won't Fix
i realized this was actually an issue with the CSV reader.
> UTF8
[
https://issues.apache.org/jira/browse/SPARK-2018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14028649#comment-14028649
]
Yanjie Gao commented on SPARK-2018:
---
Thanks a lot.
Now I have some new detection.
(1)
[
https://issues.apache.org/jira/browse/SPARK-2114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sandy Ryza updated SPARK-2114:
--
Summary: groupByKey and joins on raw data (was: Aggregations on raw data)
> groupByKey and joins on ra
[
https://issues.apache.org/jira/browse/SPARK-2114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sandy Ryza updated SPARK-2114:
--
Description:
For groupByKey and join transformations, Spark tasks on the reduce side
deserialize every
Michael Armbrust created SPARK-2117:
---
Summary: UTF8 Characters Break PySpark
Key: SPARK-2117
URL: https://issues.apache.org/jira/browse/SPARK-2117
Project: Spark
Issue Type: Bug
C
[
https://issues.apache.org/jira/browse/SPARK-2116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Albert Chu updated SPARK-2116:
--
Attachment: SPARK-2116.patch
> Load spark-defaults.conf from directory specified by SPARK_CONF_DIR
> --
Albert Chu created SPARK-2116:
-
Summary: Load spark-defaults.conf from directory specified by
SPARK_CONF_DIR
Key: SPARK-2116
URL: https://issues.apache.org/jira/browse/SPARK-2116
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-2115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Nicholas Chammas updated SPARK-2115:
Attachment: Accident-prone kill link.png
Safe and user-friendly kill link.pn
Nicholas Chammas created SPARK-2115:
---
Summary: Stage kill link is too close to stage details link
Key: SPARK-2115
URL: https://issues.apache.org/jira/browse/SPARK-2115
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-2053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14028541#comment-14028541
]
Zongheng Yang commented on SPARK-2053:
--
Submitted pull request: https://github.com/ap
[
https://issues.apache.org/jira/browse/SPARK-2114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sandy Ryza updated SPARK-2114:
--
Description:
For all the ByKey transformations, Spark tasks on the reduce side deserialize
every recor
[
https://issues.apache.org/jira/browse/SPARK-2081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust updated SPARK-2081:
Assignee: Cheng Lian (was: Zongheng Yang)
> Undefine output() from the abstract class Comm
[
https://issues.apache.org/jira/browse/SPARK-2088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell updated SPARK-2088:
---
Priority: Critical (was: Major)
> NPE in toString when creationSiteInfo is null after deseri
[
https://issues.apache.org/jira/browse/SPARK-2081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14028245#comment-14028245
]
Cheng Lian commented on SPARK-2081:
---
[~marmbrus] Just found out that I happened to solve
[
https://issues.apache.org/jira/browse/SPARK-2081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14028245#comment-14028245
]
Cheng Lian edited comment on SPARK-2081 at 6/11/14 7:12 PM:
To
[
https://issues.apache.org/jira/browse/SPARK-2042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust resolved SPARK-2042.
-
Resolution: Fixed
Fix Version/s: 1.1.0
1.0.1
https://github.com
[
https://issues.apache.org/jira/browse/SPARK-2106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14028233#comment-14028233
]
Michael Armbrust commented on SPARK-2106:
-
Regarding the first point, I actually t
Sandy Ryza created SPARK-2114:
-
Summary: Aggregations on raw data
Key: SPARK-2114
URL: https://issues.apache.org/jira/browse/SPARK-2114
Project: Spark
Issue Type: New Feature
Components
[
https://issues.apache.org/jira/browse/SPARK-2061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14028128#comment-14028128
]
Patrick Wendell commented on SPARK-2061:
Go for it!
> Deprecate `splits` in JavaR
[
https://issues.apache.org/jira/browse/SPARK-2100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14028133#comment-14028133
]
Patrick Wendell commented on SPARK-2100:
Could you elaborate a bit more on the exa
[
https://issues.apache.org/jira/browse/SPARK-2061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell updated SPARK-2061:
---
Assignee: Anant Daksh Asthana (was: Patrick Wendell)
> Deprecate `splits` in JavaRDDLike and
[
https://issues.apache.org/jira/browse/SPARK-2061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell reassigned SPARK-2061:
--
Assignee: Patrick Wendell
> Deprecate `splits` in JavaRDDLike and add `partitions`
> --
[
https://issues.apache.org/jira/browse/SPARK-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell resolved SPARK-2113.
Resolution: Fixed
Fixed by:
https://github.com/apache/spark/pull/1001
> awaitTermination()
Patrick Wendell created SPARK-2113:
--
Summary: awaitTermination() after stop() will hang in Spark
Stremaing
Key: SPARK-2113
URL: https://issues.apache.org/jira/browse/SPARK-2113
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-2108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell resolved SPARK-2108.
Resolution: Fixed
Fix Version/s: 1.1.0
1.0.1
Issue resolved by pu
[
https://issues.apache.org/jira/browse/SPARK-2071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell resolved SPARK-2071.
Resolution: Fixed
Fixed by:
https://github.com/apache/spark/pull/1021
> Package private cl
[
https://issues.apache.org/jira/browse/SPARK-2070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell resolved SPARK-2070.
Resolution: Fixed
Fixed by:
https://github.com/apache/spark/pull/1021
> Package private me
Michael Armbrust created SPARK-2112:
---
Summary: ParquetTypesConverter should not create its own conf
Key: SPARK-2112
URL: https://issues.apache.org/jira/browse/SPARK-2112
Project: Spark
Issu
[
https://issues.apache.org/jira/browse/SPARK-2061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14027978#comment-14027978
]
Anant Daksh Asthana commented on SPARK-2061:
Could I be added as the Assignee
[
https://issues.apache.org/jira/browse/SPARK-1699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Guoqiang Li closed SPARK-1699.
--
Resolution: Unresolved
> Python relative should be independence from the core, becomes subprojects
> --
Thomas Graves created SPARK-2111:
Summary: pyspark errors when SPARK_PRINT_LAUNCH_COMMAND=1
Key: SPARK-2111
URL: https://issues.apache.org/jira/browse/SPARK-2111
Project: Spark
Issue Type: Bu
[
https://issues.apache.org/jira/browse/SPARK-2018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14027819#comment-14027819
]
Gireesh Punathil commented on SPARK-2018:
-
Mridul,
Thanks for responding.
1. As
[
https://issues.apache.org/jira/browse/SPARK-2018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14027808#comment-14027808
]
Mridul Muralidharan commented on SPARK-2018:
Ah ! This is an interesting bug.
[
https://issues.apache.org/jira/browse/SPARK-2018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14027753#comment-14027753
]
Gireesh Punathil commented on SPARK-2018:
-
I face this same issue for a different
[
https://issues.apache.org/jira/browse/SPARK-1639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves resolved SPARK-1639.
--
Resolution: Fixed
Fix Version/s: 1.1.0
> Some tidying of Spark on YARN code
> --
[
https://issues.apache.org/jira/browse/SPARK-2021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Prashant Sharma reassigned SPARK-2021:
--
Assignee: Prashant Sharma
> External hashing in PySpark
> ---
>
[
https://issues.apache.org/jira/browse/SPARK-2032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Prashant Sharma reassigned SPARK-2032:
--
Assignee: Prashant Sharma
> Add an RDD.samplePartitions method for partition-level samp
Prashant Sharma created SPARK-2110:
--
Summary: Misleading help displayed for interactive mode pyspark
--help
Key: SPARK-2110
URL: https://issues.apache.org/jira/browse/SPARK-2110
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-2109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Prashant Sharma reassigned SPARK-2109:
--
Assignee: Prashant Sharma
> Setting SPARK_MEM for bin/pyspark does not work.
> ---
[
https://issues.apache.org/jira/browse/SPARK-2109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14027600#comment-14027600
]
Prashant Sharma commented on SPARK-2109:
https://github.com/apache/spark/pull/1050
[
https://issues.apache.org/jira/browse/SPARK-2109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Prashant Sharma updated SPARK-2109:
---
Affects Version/s: 1.0.0
> Setting SPARK_MEM for bin/pyspark does not work.
> --
[
https://issues.apache.org/jira/browse/SPARK-2109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Prashant Sharma updated SPARK-2109:
---
Description:
prashant@sc:~/work/spark$ SPARK_MEM=10G bin/pyspark
Python 2.7.6 (default, Mar
[
https://issues.apache.org/jira/browse/SPARK-2109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Prashant Sharma updated SPARK-2109:
---
Fix Version/s: 1.1.0
1.0.1
> Setting SPARK_MEM for bin/pyspark does not wo
Prashant Sharma created SPARK-2109:
--
Summary: Setting SPARK_MEM for bin/pyspark does not work.
Key: SPARK-2109
URL: https://issues.apache.org/jira/browse/SPARK-2109
Project: Spark
Issue Typ
[
https://issues.apache.org/jira/browse/SPARK-2091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiangrui Meng resolved SPARK-2091.
--
Resolution: Fixed
Fix Version/s: 1.0.1
> pyspark/mllib is not compatible with numpy-1.4
[
https://issues.apache.org/jira/browse/SPARK-2107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Reynold Xin updated SPARK-2107:
---
Fix Version/s: 1.1.0
1.0.1
> FilterPushdownSuite imports Junit and leads to compil
[
https://issues.apache.org/jira/browse/SPARK-2107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust resolved SPARK-2107.
-
Resolution: Fixed
> FilterPushdownSuite imports Junit and leads to compilation error
> --
[
https://issues.apache.org/jira/browse/SPARK-2107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust updated SPARK-2107:
Component/s: SQL
> FilterPushdownSuite imports Junit and leads to compilation error
> -
[
https://issues.apache.org/jira/browse/SPARK-1968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust resolved SPARK-1968.
-
Resolution: Fixed
Fix Version/s: 1.1.0
1.0.1
> SQL commands for
75 matches
Mail list logo