cynepia created SPARK-6802:
--
Summary: User Defined Aggregate Function Refactoring
Key: SPARK-6802
URL: https://issues.apache.org/jira/browse/SPARK-6802
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-6028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14487329#comment-14487329
]
Andrea Peruffo commented on SPARK-6028:
---
The main blocking problem in the
[
https://issues.apache.org/jira/browse/SPARK-6799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shivaram Venkataraman updated SPARK-6799:
-
Target Version/s: 1.4.0
Add dataframe examples for SparkR
[
https://issues.apache.org/jira/browse/SPARK-6772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14486853#comment-14486853
]
Aditya Parmar commented on SPARK-6772:
--
Please find the code below
import
[
https://issues.apache.org/jira/browse/SPARK-2352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-2352:
---
Assignee: Apache Spark (was: Bert Greevenbosch)
[MLLIB] Add Artificial Neural Network
[
https://issues.apache.org/jira/browse/SPARK-765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14487060#comment-14487060
]
Yu Ishikawa commented on SPARK-765:
---
I'm very sorry. I could run a test in
[
https://issues.apache.org/jira/browse/SPARK-6806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Davies Liu reassigned SPARK-6806:
-
Assignee: Davies Liu
SparkR examples in programming guide
[
https://issues.apache.org/jira/browse/SPARK-6801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-6801.
--
Resolution: Duplicate
spark-submit is not able to identify Alive Master in case of multiple master
[
https://issues.apache.org/jira/browse/SPARK-3947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14487093#comment-14487093
]
cynepia commented on SPARK-3947:
Can someone update on where do we stand on this issue?
[
https://issues.apache.org/jira/browse/SPARK-6811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shivaram Venkataraman updated SPARK-6811:
-
Target Version/s: 1.4.0
Building binary R packages for SparkR
[
https://issues.apache.org/jira/browse/SPARK-6804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-6804.
--
Resolution: Duplicate
System.exit(1) on error
---
Key:
Shivaram Venkataraman created SPARK-6811:
Summary: Building binary R packages for SparkR
Key: SPARK-6811
URL: https://issues.apache.org/jira/browse/SPARK-6811
Project: Spark
Issue
Davies Liu created SPARK-6812:
-
Summary: filter() on DataFrame does not work as expected
Key: SPARK-6812
URL: https://issues.apache.org/jira/browse/SPARK-6812
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-6229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14487934#comment-14487934
]
Marcelo Vanzin commented on SPARK-6229:
---
Hi Jeff,
Those kinds of differences are
[
https://issues.apache.org/jira/browse/SPARK-3947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14487222#comment-14487222
]
cynepia commented on SPARK-3947:
Hi Takeshi San,
Thanks for the quick response. I would
[
https://issues.apache.org/jira/browse/SPARK-6691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14487793#comment-14487793
]
Tathagata Das commented on SPARK-6691:
--
Yes, I complete agree to the motivation.
Shivaram Venkataraman created SPARK-6816:
Summary: Add SparkConf API to configure SparkR
Key: SPARK-6816
URL: https://issues.apache.org/jira/browse/SPARK-6816
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-6691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14486980#comment-14486980
]
Tathagata Das commented on SPARK-6691:
--
[~jerryshao] This is a very good attempt!
Shivaram Venkataraman created SPARK-6819:
Summary: Support nested types in SparkR DataFrame
Key: SPARK-6819
URL: https://issues.apache.org/jira/browse/SPARK-6819
Project: Spark
Issue
Shivaram Venkataraman created SPARK-6799:
Summary: Add dataframe examples for SparkR
Key: SPARK-6799
URL: https://issues.apache.org/jira/browse/SPARK-6799
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-2673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kousuke Saruta updated SPARK-2673:
--
Description:
In current implementation, we are difficult to attach debugger to each Executor
Hao created SPARK-6803:
--
Summary: Support SparkR Streaming
Key: SPARK-6803
URL: https://issues.apache.org/jira/browse/SPARK-6803
Project: Spark
Issue Type: New Feature
Components: SparkR,
[
https://issues.apache.org/jira/browse/SPARK-6803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14487872#comment-14487872
]
Tathagata Das commented on SPARK-6803:
--
I know of many use cases where python is
[
https://issues.apache.org/jira/browse/SPARK-2673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kousuke Saruta updated SPARK-2673:
--
Component/s: Web UI
Improve Enable to attach Debugger to Executors easily
Shivaram Venkataraman created SPARK-6823:
Summary: Add a model.matrix like capability to DataFrames
(modelDataFrame)
Key: SPARK-6823
URL: https://issues.apache.org/jira/browse/SPARK-6823
[
https://issues.apache.org/jira/browse/SPARK-2673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-2673:
---
Assignee: Apache Spark
Improve Enable to attach Debugger to Executors easily
[
https://issues.apache.org/jira/browse/SPARK-2673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14486897#comment-14486897
]
Apache Spark commented on SPARK-2673:
-
User 'sarutak' has created a pull request for
[
https://issues.apache.org/jira/browse/SPARK-2673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-2673:
---
Assignee: (was: Apache Spark)
Improve Enable to attach Debugger to Executors easily
Shivaram Venkataraman created SPARK-6822:
Summary: lapplyPartition passes empty list to function
Key: SPARK-6822
URL: https://issues.apache.org/jira/browse/SPARK-6822
Project: Spark
Xiangrui Meng created SPARK-6805:
Summary: ML Pipeline API in SparkR
Key: SPARK-6805
URL: https://issues.apache.org/jira/browse/SPARK-6805
Project: Spark
Issue Type: Umbrella
Shivaram Venkataraman created SPARK-6817:
Summary: DataFrame UDFs in R
Key: SPARK-6817
URL: https://issues.apache.org/jira/browse/SPARK-6817
Project: Spark
Issue Type: New Feature
[
https://issues.apache.org/jira/browse/SPARK-6767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-6767.
--
Resolution: Fixed
Fix Version/s: 1.4.0
1.3.2
Assignee: Tijo Thomas
[
https://issues.apache.org/jira/browse/SPARK-3276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-3276:
---
Assignee: (was: Apache Spark)
Provide a API to specify MIN_REMEMBER_DURATION for files
[
https://issues.apache.org/jira/browse/SPARK-3276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14487073#comment-14487073
]
Apache Spark commented on SPARK-3276:
-
User 'emres' has created a pull request for
Alberto created SPARK-6804:
--
Summary: System.exit(1) on error
Key: SPARK-6804
URL: https://issues.apache.org/jira/browse/SPARK-6804
Project: Spark
Issue Type: Improvement
Reporter:
[
https://issues.apache.org/jira/browse/SPARK-6803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hao updated SPARK-6803:
---
Summary: [SparkR] Support SparkR Streaming (was: Support SparkR Streaming)
[SparkR] Support SparkR Streaming
[
https://issues.apache.org/jira/browse/SPARK-6735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14487670#comment-14487670
]
Sandy Ryza commented on SPARK-6735:
---
Hi [~twinkle], can you submit the PR against the
[
https://issues.apache.org/jira/browse/SPARK-6735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14487670#comment-14487670
]
Sandy Ryza edited comment on SPARK-6735 at 4/9/15 5:06 PM:
---
Hi
Shivaram Venkataraman created SPARK-6821:
Summary: Refactor SerDe API in SparkR to be more developer friendly
Key: SPARK-6821
URL: https://issues.apache.org/jira/browse/SPARK-6821
Project:
Shivaram Venkataraman created SPARK-6813:
Summary: SparkR style guide
Key: SPARK-6813
URL: https://issues.apache.org/jira/browse/SPARK-6813
Project: Spark
Issue Type: New Feature
[
https://issues.apache.org/jira/browse/SPARK-6677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14487010#comment-14487010
]
Stefano Parmesan commented on SPARK-6677:
-
Uhm, don't know what to say. Let's try
[
https://issues.apache.org/jira/browse/SPARK-6803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14487800#comment-14487800
]
Shivaram Venkataraman commented on SPARK-6803:
--
Thanks [~hlin09]. The PySpark
[
https://issues.apache.org/jira/browse/SPARK-2673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kousuke Saruta updated SPARK-2673:
--
Summary: Improve Enable to attach Debugger to Executors easily (was:
Improve Spark so that we
[
https://issues.apache.org/jira/browse/SPARK-6229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14487878#comment-14487878
]
Jeffrey Turpin commented on SPARK-6229:
---
Hey Marcelo,
I have been working on
Shivaram Venkataraman created SPARK-6810:
Summary: Performance benchmarks for SparkR
Key: SPARK-6810
URL: https://issues.apache.org/jira/browse/SPARK-6810
Project: Spark
Issue Type:
Micael Capitão created SPARK-6800:
-
Summary: Reading from JDBC with SQLContext, using lower/upper
bounds and numPartitions gives incorrect results.
Key: SPARK-6800
URL:
[
https://issues.apache.org/jira/browse/SPARK-6229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14488104#comment-14488104
]
Jeffrey Turpin commented on SPARK-6229:
---
Hey Marcelo,
So what I have done is to
[
https://issues.apache.org/jira/browse/SPARK-6770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14486794#comment-14486794
]
yangping wu commented on SPARK-6770:
Ok, Thank you very much for your reply. I will
[
https://issues.apache.org/jira/browse/SPARK-6751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves resolved SPARK-6751.
--
Resolution: Duplicate
Dup of SPARK-4705
Spark History Server support multiple application
[
https://issues.apache.org/jira/browse/SPARK-5960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-5960:
---
Assignee: Apache Spark (was: Chris Fregly)
Allow AWS credentials to be passed to
Shivaram Venkataraman created SPARK-6820:
Summary: Convert NAs to null type in SparkR DataFrames
Key: SPARK-6820
URL: https://issues.apache.org/jira/browse/SPARK-6820
Project: Spark
Davies Liu created SPARK-6806:
-
Summary: SparkR examples in programming guide
Key: SPARK-6806
URL: https://issues.apache.org/jira/browse/SPARK-6806
Project: Spark
Issue Type: New Feature
Davies Liu created SPARK-6807:
-
Summary: Merge recent changes in SparkR-pkg into Spark
Key: SPARK-6807
URL: https://issues.apache.org/jira/browse/SPARK-6807
Project: Spark
Issue Type: New
[
https://issues.apache.org/jira/browse/SPARK-6636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14488245#comment-14488245
]
Nicholas Chammas commented on SPARK-6636:
-
[~aasted] - Can you elaborate on this?
[
https://issues.apache.org/jira/browse/SPARK-3947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14487278#comment-14487278
]
Takeshi Yamamuro commented on SPARK-3947:
-
Sorry, but Im not sure about the issue
[
https://issues.apache.org/jira/browse/SPARK-2451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14487386#comment-14487386
]
Andrea Peruffo commented on SPARK-2451:
---
As per:
[
https://issues.apache.org/jira/browse/SPARK-6804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Alberto updated SPARK-6804:
---
Description:
We are developing a web application that is using Spark under the hood. Testing
our app we have
[
https://issues.apache.org/jira/browse/SPARK-2352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-2352:
---
Assignee: Bert Greevenbosch (was: Apache Spark)
[MLLIB] Add Artificial Neural Network
[
https://issues.apache.org/jira/browse/SPARK-3937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14486810#comment-14486810
]
Guoqiang Li commented on SPARK-3937:
The bug seems to be caused by
[
https://issues.apache.org/jira/browse/SPARK-2205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yin Huai updated SPARK-2205:
Priority: Critical (was: Minor)
Unnecessary exchange operators in a join on multiple tables with the same
[
https://issues.apache.org/jira/browse/SPARK-6816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14488237#comment-14488237
]
Shivaram Venkataraman commented on SPARK-6816:
--
Comments from SparkR JIRA
[
https://issues.apache.org/jira/browse/SPARK-6770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14486782#comment-14486782
]
Saisai Shao commented on SPARK-6770:
From my understanding, the basic scenario of your
[
https://issues.apache.org/jira/browse/SPARK-2949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14487467#comment-14487467
]
Andrea Peruffo commented on SPARK-2949:
---
Which version of Spark?
ActorSystem has a
[
https://issues.apache.org/jira/browse/SPARK-6343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-6343.
--
Resolution: Fixed
Fix Version/s: 1.4.0
1.3.2
Issue resolved by pull request
Xinghao Pan created SPARK-6808:
--
Summary: Checkpointing after zipPartitions results in NODE_LOCAL
execution
Key: SPARK-6808
URL: https://issues.apache.org/jira/browse/SPARK-6808
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-3276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-3276:
---
Assignee: Apache Spark
Provide a API to specify MIN_REMEMBER_DURATION for files to consider
[
https://issues.apache.org/jira/browse/SPARK-6803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14488315#comment-14488315
]
Davies Liu commented on SPARK-6803:
---
After a quick look over the prototype, the callback
[
https://issues.apache.org/jira/browse/SPARK-6343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-6343:
-
Assignee: Peter Parente
Make doc more explicit regarding network connectivity requirements
[
https://issues.apache.org/jira/browse/SPARK-6691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14487323#comment-14487323
]
Saisai Shao commented on SPARK-6691:
Hi [~tdas], thanks a lot for your comments. I
[
https://issues.apache.org/jira/browse/SPARK-6646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14488225#comment-14488225
]
Marko Bonaci commented on SPARK-6646:
-
Wait a minute, don't postpone this one just
[
https://issues.apache.org/jira/browse/SPARK-5960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14487177#comment-14487177
]
Apache Spark commented on SPARK-5960:
-
User 'mce' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-5960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-5960:
---
Assignee: Chris Fregly (was: Apache Spark)
Allow AWS credentials to be passed to
Shivaram Venkataraman created SPARK-6814:
Summary: Support sorting for any data type in SparkR
Key: SPARK-6814
URL: https://issues.apache.org/jira/browse/SPARK-6814
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-6800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Micael Capitão updated SPARK-6800:
--
Description:
Having a Derby table with people info (id, name, age) defined like this:
{code}
[
https://issues.apache.org/jira/browse/SPARK-6772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aditya Parmar updated SPARK-6772:
-
Description:
Hi all ,
I am getting an Arrayoutboundsindex error when i try to run a simple
[
https://issues.apache.org/jira/browse/SPARK-6796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tathagata Das reassigned SPARK-6796:
Assignee: Shixiong Zhu
Add the batch list to StreamingPage
[
https://issues.apache.org/jira/browse/SPARK-6770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14487103#comment-14487103
]
Sean Owen commented on SPARK-6770:
--
That may be so, but it's not obvious that you simply
[
https://issues.apache.org/jira/browse/SPARK-6807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-6807:
---
Assignee: Davies Liu (was: Apache Spark)
Merge recent changes in SparkR-pkg into Spark
[
https://issues.apache.org/jira/browse/SPARK-6807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14487687#comment-14487687
]
Apache Spark commented on SPARK-6807:
-
User 'davies' has created a pull request for
[
https://issues.apache.org/jira/browse/SPARK-6807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-6807:
---
Assignee: Apache Spark (was: Davies Liu)
Merge recent changes in SparkR-pkg into Spark
[
https://issues.apache.org/jira/browse/SPARK-6812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14488128#comment-14488128
]
Shivaram Venkataraman commented on SPARK-6812:
--
Hmm - don't we have a unit
[
https://issues.apache.org/jira/browse/SPARK-3947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14487175#comment-14487175
]
Takeshi Yamamuro commented on SPARK-3947:
-
See SPARK-4233, we are refactoring the
82 matches
Mail list logo