[
https://issues.apache.org/jira/browse/SPARK-7141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14525120#comment-14525120
]
Eric O. LEBIGOT (EOL) edited comment on SPARK-7141 at 5/2/15 8:10 AM:
[
https://issues.apache.org/jira/browse/SPARK-7149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14525096#comment-14525096
]
haiyang commented on SPARK-7149:
If we give no alias to a function in project,the
Reynold Xin created SPARK-7321:
--
Summary: Add Column expression for conditional statements (if,
case)
Key: SPARK-7321
URL: https://issues.apache.org/jira/browse/SPARK-7321
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-7247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Reynold Xin closed SPARK-7247.
--
Resolution: Won't Fix
Add Pandas' shift method to the Dataframe API
[
https://issues.apache.org/jira/browse/SPARK-7247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14525111#comment-14525111
]
Reynold Xin commented on SPARK-7247:
I'm going to close this in favor of doing it as
[
https://issues.apache.org/jira/browse/SPARK-7141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eric O. LEBIGOT (EOL) updated SPARK-7141:
-
Description:
Using {{saveAsTextFile(s3://bucket/prefix)}} actually adds an empty
[
https://issues.apache.org/jira/browse/SPARK-7247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14525119#comment-14525119
]
Olivier Girardot commented on SPARK-7247:
-
Ok thanks !
Add Pandas' shift method
[
https://issues.apache.org/jira/browse/SPARK-7141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14525120#comment-14525120
]
Eric O. LEBIGOT (EOL) commented on SPARK-7141:
--
Alright: switching to s3n://
[
https://issues.apache.org/jira/browse/SPARK-7141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14525120#comment-14525120
]
Eric O. LEBIGOT (EOL) edited comment on SPARK-7141 at 5/2/15 8:09 AM:
[
https://issues.apache.org/jira/browse/SPARK-6954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-6954:
-
Labels: yarn (was: backport-needed yarn)
ExecutorAllocationManager can end up requesting a negative
[
https://issues.apache.org/jira/browse/SPARK-7302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-7302:
---
Assignee: Apache Spark
SPARK building documentation still mentions building for yarn 0.23
[
https://issues.apache.org/jira/browse/SPARK-7319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Reynold Xin updated SPARK-7319:
---
Labels: starter (was: )
Improve the output from DataFrame.show()
Reynold Xin created SPARK-7319:
--
Summary: Improve the output from DataFrame.show()
Key: SPARK-7319
URL: https://issues.apache.org/jira/browse/SPARK-7319
Project: Spark
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/SPARK-7320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Reynold Xin updated SPARK-7320:
---
Labels: starter (was: )
Add rollup and cube support to DataFrame DSL
[
https://issues.apache.org/jira/browse/SPARK-7323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mridul Muralidharan reassigned SPARK-7323:
--
Assignee: Mridul Muralidharan
Use insertAll instead of individual insert
[
https://issues.apache.org/jira/browse/SPARK-7323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14525110#comment-14525110
]
Apache Spark commented on SPARK-7323:
-
User 'mridulm' has created a pull request for
[
https://issues.apache.org/jira/browse/SPARK-3133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Reynold Xin closed SPARK-3133.
--
Resolution: Not A Problem
Closing the ticket for now. Will reopen if it is needed.
Piggyback get
[
https://issues.apache.org/jira/browse/SPARK-7324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Reynold Xin updated SPARK-7324:
---
Description:
Similar to
[
https://issues.apache.org/jira/browse/SPARK-7315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tathagata Das resolved SPARK-7315.
--
Resolution: Fixed
Fix Version/s: 1.4.0
Flaky Test: WriteAheadLogBackedBlockRDDSuite
[
https://issues.apache.org/jira/browse/SPARK-7302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14525177#comment-14525177
]
Apache Spark commented on SPARK-7302:
-
User 'srowen' has created a pull request for
[
https://issues.apache.org/jira/browse/SPARK-7302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-7302:
---
Assignee: (was: Apache Spark)
SPARK building documentation still mentions building for
[
https://issues.apache.org/jira/browse/SPARK-7270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-7270:
---
Assignee: (was: Apache Spark)
StringType dynamic partition cast to DecimalType in Spark
[
https://issues.apache.org/jira/browse/SPARK-7270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14525185#comment-14525185
]
Apache Spark commented on SPARK-7270:
-
User 'viirya' has created a pull request for
[
https://issues.apache.org/jira/browse/SPARK-7270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-7270:
---
Assignee: Apache Spark
StringType dynamic partition cast to DecimalType in Spark Sql Hive
[
https://issues.apache.org/jira/browse/SPARK-7121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell resolved SPARK-7121.
Resolution: Fixed
Fix Version/s: 1.4.0
ClosureCleaner does not handle nesting
Reynold Xin created SPARK-7320:
--
Summary: Add rollup and cube support to DataFrame DSL
Key: SPARK-7320
URL: https://issues.apache.org/jira/browse/SPARK-7320
Project: Spark
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/SPARK-7120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell resolved SPARK-7120.
Resolution: Fixed
Fix Version/s: 1.4.0
ClosureCleaner lacks documentation
[
https://issues.apache.org/jira/browse/SPARK-7323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-7323:
---
Assignee: Apache Spark
Use insertAll instead of individual insert while merging combiners
[
https://issues.apache.org/jira/browse/SPARK-7323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-7323:
---
Assignee: (was: Apache Spark)
Use insertAll instead of individual insert while merging
Mridul Muralidharan created SPARK-7323:
--
Summary: Use insertAll instead of individual insert while merging
combiners
Key: SPARK-7323
URL: https://issues.apache.org/jira/browse/SPARK-7323
[
https://issues.apache.org/jira/browse/SPARK-7049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-7049.
--
Resolution: Not A Problem
Given the discussion, looks like this was a question of a TTL that was too
Reynold Xin created SPARK-7322:
--
Summary: Add DataFrame DSL for window function support
Key: SPARK-7322
URL: https://issues.apache.org/jira/browse/SPARK-7322
Project: Spark
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/SPARK-7321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Reynold Xin updated SPARK-7321:
---
Description: A good reference implementation is
Reynold Xin created SPARK-7324:
--
Summary: Add DataFrame.dropDuplicates
Key: SPARK-7324
URL: https://issues.apache.org/jira/browse/SPARK-7324
Project: Spark
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/SPARK-7319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-7319:
---
Assignee: (was: Apache Spark)
Improve the output from DataFrame.show()
[
https://issues.apache.org/jira/browse/SPARK-7319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14525251#comment-14525251
]
Apache Spark commented on SPARK-7319:
-
User 'kaka1992' has created a pull request for
[
https://issues.apache.org/jira/browse/SPARK-7319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-7319:
---
Assignee: Apache Spark
Improve the output from DataFrame.show()
[
https://issues.apache.org/jira/browse/SPARK-6069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14525267#comment-14525267
]
Pat Ferrel commented on SPARK-6069:
---
Same with Mahout where we were using Guava. Using
[
https://issues.apache.org/jira/browse/SPARK-3444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14525334#comment-14525334
]
Apache Spark commented on SPARK-3444:
-
User 'deanchen' has created a pull request for
[
https://issues.apache.org/jira/browse/SPARK-7242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Reynold Xin resolved SPARK-7242.
Resolution: Fixed
Fix Version/s: 1.4.0
Frequent items for DataFrames
[
https://issues.apache.org/jira/browse/SPARK-6116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Reynold Xin reassigned SPARK-6116:
--
Assignee: Reynold Xin
Making DataFrame API non-experimental
[
https://issues.apache.org/jira/browse/SPARK-7141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eric O. LEBIGOT (EOL) updated SPARK-7141:
-
Description:
Using {{saveAsTextFile(s3://bucket/prefix)}} actually adds an empty
[
https://issues.apache.org/jira/browse/SPARK-7141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eric O. LEBIGOT (EOL) updated SPARK-7141:
-
Description:
Using {{saveAsTextFile(s3://bucket/prefix}} actually adds an empty
[
https://issues.apache.org/jira/browse/SPARK-7322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14525131#comment-14525131
]
Olivier Girardot commented on SPARK-7322:
-
With this it would be possible to
[
https://issues.apache.org/jira/browse/SPARK-6954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-6954.
--
Resolution: Fixed
Fix Version/s: 1.3.2
ExecutorAllocationManager can end up requesting a
Olivier Girardot created SPARK-7325:
---
Summary: Dataframe should support partitioned JSON Relation
Key: SPARK-7325
URL: https://issues.apache.org/jira/browse/SPARK-7325
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-7295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-7295:
---
Assignee: (was: Apache Spark)
Add bitwise operations to DataFrame DSL
[
https://issues.apache.org/jira/browse/SPARK-7294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14525492#comment-14525492
]
Shiti Saxena commented on SPARK-7294:
-
There was a typo in the pull-request. It was
[
https://issues.apache.org/jira/browse/SPARK-7294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14525487#comment-14525487
]
Apache Spark commented on SPARK-7294:
-
User 'Shiti' has created a pull request for
[
https://issues.apache.org/jira/browse/SPARK-7295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-7295:
---
Assignee: Apache Spark
Add bitwise operations to DataFrame DSL
[
https://issues.apache.org/jira/browse/SPARK-7295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14525488#comment-14525488
]
Apache Spark commented on SPARK-7295:
-
User 'Shiti' has created a pull request for
[
https://issues.apache.org/jira/browse/SPARK-4231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14525545#comment-14525545
]
Apache Spark commented on SPARK-4231:
-
User 'debasish83' has created a pull request
[
https://issues.apache.org/jira/browse/SPARK-6505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-6505:
-
Assignee: Cheng Lian
Remove the reflection call in HiveFunctionWrapper
[
https://issues.apache.org/jira/browse/SPARK-6999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-6999:
-
Assignee: Cheng Hao
infinite recursion with createDataFrame(JavaRDD[Row], java.util.List[String])
[
https://issues.apache.org/jira/browse/SPARK-7323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-7323.
--
Resolution: Fixed
Fix Version/s: 1.4.0
1.3.2
Issue resolved by pull request
[
https://issues.apache.org/jira/browse/SPARK-7323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-7323:
-
Description: Currently we invoke combiners.insert() for each tuple in
Aggregator - which results in
[
https://issues.apache.org/jira/browse/SPARK-3533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-3533.
--
Resolution: Won't Fix
Target Version/s: (was: 1.4.0)
I think this is not at all a crazy
[
https://issues.apache.org/jira/browse/SPARK-7081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-7081:
---
Assignee: Josh Rosen (was: Apache Spark)
Faster sort-based shuffle path using binary
[
https://issues.apache.org/jira/browse/SPARK-7311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-7311:
---
Assignee: Apache Spark (was: Sandy Ryza)
Enable in-memory serialized map-side shuffle to
[
https://issues.apache.org/jira/browse/SPARK-7078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-7078:
---
Assignee: Apache Spark (was: Josh Rosen)
Cache-aware binary processing in-memory sort
[
https://issues.apache.org/jira/browse/SPARK-4231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Debasish Das updated SPARK-4231:
Affects Version/s: (was: 1.2.0)
1.4.0
Add RankingMetrics to
[
https://issues.apache.org/jira/browse/SPARK-4231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Debasish Das reopened SPARK-4231:
-
The code was not part of SPARK-3066 and so reopening...
Add RankingMetrics to examples.MovieLensALS
[
https://issues.apache.org/jira/browse/SPARK-7306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-7306:
-
Assignee: Patrick Wendell
SPARK-7224 broke build with jdk6
[
https://issues.apache.org/jira/browse/SPARK-7312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-7312:
-
Assignee: Yin Huai
SPARK-6913 broke jdk6 build
---
Key:
[
https://issues.apache.org/jira/browse/SPARK-7325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-7325:
-
Component/s: SQL
Dataframe should support partitioned JSON Relation
[
https://issues.apache.org/jira/browse/SPARK-6030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-6030.
--
Resolution: Fixed
Fix Version/s: 1.4.0
Issue resolved by pull request 4783
[
https://issues.apache.org/jira/browse/SPARK-6030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-6030:
-
Assignee: Xianjin YE
SizeEstimator gives wrong result for Integer object on 64bit JVM with
[
https://issues.apache.org/jira/browse/SPARK-5213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust resolved SPARK-5213.
-
Resolution: Fixed
Issue resolved by pull request 5827
[
https://issues.apache.org/jira/browse/SPARK-5213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust updated SPARK-5213:
Assignee: Cheng Hao
Pluggable SQL Parser Support
[
https://issues.apache.org/jira/browse/SPARK-7078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-7078:
---
Assignee: Josh Rosen (was: Apache Spark)
Cache-aware binary processing in-memory sort
[
https://issues.apache.org/jira/browse/SPARK-7081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-7081:
---
Assignee: Apache Spark (was: Josh Rosen)
Faster sort-based shuffle path using binary
[
https://issues.apache.org/jira/browse/SPARK-7311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-7311:
---
Assignee: Sandy Ryza (was: Apache Spark)
Enable in-memory serialized map-side shuffle to
[
https://issues.apache.org/jira/browse/SPARK-7081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14525529#comment-14525529
]
Apache Spark commented on SPARK-7081:
-
User 'JoshRosen' has created a pull request for
[
https://issues.apache.org/jira/browse/SPARK-7311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14525530#comment-14525530
]
Apache Spark commented on SPARK-7311:
-
User 'JoshRosen' has created a pull request for
[
https://issues.apache.org/jira/browse/SPARK-7078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14525528#comment-14525528
]
Apache Spark commented on SPARK-7078:
-
User 'JoshRosen' has created a pull request for
[
https://issues.apache.org/jira/browse/SPARK-7255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-7255.
--
Resolution: Fixed
Issue resolved by pull request 5808
[https://github.com/apache/spark/pull/5808]
[
https://issues.apache.org/jira/browse/SPARK-7031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-7031:
-
Assignee: Tao Wang
let thrift server take SPARK_DAEMON_MEMORY and SPARK_DAEMON_JAVA_OPTS
[
https://issues.apache.org/jira/browse/SPARK-7031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-7031.
--
Resolution: Fixed
Fix Version/s: 1.4.0
Issue resolved by pull request 5609
[
https://issues.apache.org/jira/browse/SPARK-7189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-7189.
--
Resolution: Not A Problem
OK then to my understanding, there's not a change to implement in Spark here.
[
https://issues.apache.org/jira/browse/SPARK-7154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-7154.
--
Resolution: Not A Problem
I think this isn't Spark-specific, so am not sure it needs documenting in
[
https://issues.apache.org/jira/browse/SPARK-7315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell updated SPARK-7315:
---
Component/s: Tests
Flaky Test: WriteAheadLogBackedBlockRDDSuite
81 matches
Mail list logo
