[jira] [Updated] (SPARK-9857) Add expression functions into SparkR which conflict with the existing R's generic

2015-08-18 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-9857: - Target Version/s: 1.6.0, 1.5.1 (was: 1.5.0) > Add expression functions into Spark

[jira] [Updated] (SPARK-10079) Make `column` and `col` functions be S4 functions

2015-08-18 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-10079: -- Target Version/s: 1.6.0, 1.5.1 (was: 1.5.0) > Make `column` and `col` function

[jira] [Updated] (SPARK-6798) Fix Date serialization in SparkR

2015-08-18 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-6798: - Target Version/s: (was: 1.5.0) > Fix Date serialization in SparkR >

[jira] [Updated] (SPARK-9302) collect()/head() failed with JSON of some format

2015-08-18 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-9302: - Target Version/s: (was: 1.5.0) > collect()/head() failed with JSON of some forma

[jira] [Updated] (SPARK-9302) Handle complex JSON types in collect()/head()

2015-08-18 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-9302: - Summary: Handle complex JSON types in collect()/head() (was: collect()/head() fai

[jira] [Updated] (SPARK-9302) collect()/head() failed with JSON of some format

2015-08-18 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-9302: - Issue Type: Improvement (was: Bug) > collect()/head() failed with JSON of some fo

[jira] [Commented] (SPARK-9302) collect()/head() failed with JSON of some format

2015-08-18 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14702510#comment-14702510 ] Shivaram Venkataraman commented on SPARK-9302: -- There is a PR open that I thi

[jira] [Commented] (SPARK-10075) Add `when` expressino function in SparkR

2015-08-18 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14702382#comment-14702382 ] Shivaram Venkataraman commented on SPARK-10075: --- Resolved by https://github

[jira] [Resolved] (SPARK-10075) Add `when` expressino function in SparkR

2015-08-18 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-10075. --- Resolution: Fixed Fix Version/s: 1.5.0 > Add `when` expressino functio

[jira] [Updated] (SPARK-10075) Add `when` expressino function in SparkR

2015-08-18 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-10075: -- Assignee: Yu Ishikawa > Add `when` expressino function in SparkR >

[jira] [Commented] (SPARK-10079) Make `column` and `col` functions be S4 functions

2015-08-18 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14701898#comment-14701898 ] Shivaram Venkataraman commented on SPARK-10079: --- If we want to make it publ

[jira] [Resolved] (SPARK-8847) String concatination with column in SparkR

2015-08-18 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-8847. -- Resolution: Duplicate Fix Version/s: 1.5.0 > String concatination with co

[jira] [Updated] (SPARK-10007) Update `NAMESPACE` file in SparkR for simple parameters functions

2015-08-18 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-10007: -- Assignee: Yu Ishikawa > Update `NAMESPACE` file in SparkR for simple parameters

[jira] [Resolved] (SPARK-10007) Update `NAMESPACE` file in SparkR for simple parameters functions

2015-08-18 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-10007. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request

[jira] [Commented] (SPARK-10079) Make `column` and `col` functions be S4 functions

2015-08-17 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14700706#comment-14700706 ] Shivaram Venkataraman commented on SPARK-10079: --- [~yuu.ishik...@gmail.com]

[jira] [Commented] (SPARK-9427) Add expression functions in SparkR

2015-08-17 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14700058#comment-14700058 ] Shivaram Venkataraman commented on SPARK-9427: -- Well half of the functions ar

[jira] [Commented] (SPARK-10051) Support collecting data of StructType in DataFrame

2015-08-17 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14699864#comment-14699864 ] Shivaram Venkataraman commented on SPARK-10051: --- I think `StructType` maps

[jira] [Commented] (SPARK-10050) Support collecting data of MapType in DataFrame

2015-08-17 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14699863#comment-14699863 ] Shivaram Venkataraman commented on SPARK-10050: --- I think the comments in ht

[jira] [Commented] (SPARK-8847) String concatination with column in SparkR

2015-08-17 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14699824#comment-14699824 ] Shivaram Venkataraman commented on SPARK-8847: -- To add a bit more detail here

[jira] [Commented] (SPARK-9972) Add `struct`, `encode` and `decode` function in SparkR

2015-08-17 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14699823#comment-14699823 ] Shivaram Venkataraman commented on SPARK-9972: -- Ah that makes more sense. Whe

[jira] [Commented] (SPARK-9427) Add expression functions in SparkR

2015-08-16 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14699080#comment-14699080 ] Shivaram Venkataraman commented on SPARK-9427: -- Yeah I think the simplest thi

[jira] [Updated] (SPARK-9871) Add expression functions into SparkR which have a variable parameter

2015-08-16 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-9871: - Assignee: Yu Ishikawa > Add expression functions into SparkR which have a variable

[jira] [Resolved] (SPARK-9871) Add expression functions into SparkR which have a variable parameter

2015-08-16 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-9871. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 819

[jira] [Commented] (SPARK-10043) Add window functions into SparkR

2015-08-16 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14699032#comment-14699032 ] Shivaram Venkataraman commented on SPARK-10043: --- [~yuu.ishik...@gmail.com]

[jira] [Assigned] (SPARK-9760) SparkSubmit doesn't work with --packages when --repositories is not specified

2015-08-16 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman reassigned SPARK-9760: Assignee: Shivaram Venkataraman > SparkSubmit doesn't work with --packages

[jira] [Resolved] (SPARK-9760) SparkSubmit doesn't work with --packages when --repositories is not specified

2015-08-16 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-9760. -- Resolution: Fixed Fix Version/s: 1.5.0 > SparkSubmit doesn't work with --

[jira] [Resolved] (SPARK-8844) head/collect is broken in SparkR

2015-08-16 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-8844. -- Resolution: Fixed Fix Version/s: 1.5.0 > head/collect is broken in SparkR

[jira] [Updated] (SPARK-8844) head/collect is broken in SparkR

2015-08-16 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-8844: - Assignee: Sun Rui > head/collect is broken in SparkR > --

[jira] [Commented] (SPARK-8844) head/collect is broken in SparkR

2015-08-16 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14698564#comment-14698564 ] Shivaram Venkataraman commented on SPARK-8844: -- Resolved by https://github.co

[jira] [Commented] (SPARK-9972) Add `struct`, `encode` and `decode` function in SparkR

2015-08-14 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14698012#comment-14698012 ] Shivaram Venkataraman commented on SPARK-9972: -- [~yuu.ishik...@gmail.com] Why

[jira] [Commented] (SPARK-9972) Add `struct` function in SparkR

2015-08-14 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14697232#comment-14697232 ] Shivaram Venkataraman commented on SPARK-9972: -- Yeah this can be marked as be

[jira] [Updated] (SPARK-9916) Clear leftover sparkr.zip copies and creations (e.g. make-distribution.sh)

2015-08-12 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-9916: - Assignee: Burak Yavuz > Clear leftover sparkr.zip copies and creations (e.g. make-

[jira] [Resolved] (SPARK-9916) Clear leftover sparkr.zip copies and creations (e.g. make-distribution.sh)

2015-08-12 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-9916. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 814

[jira] [Updated] (SPARK-9855) Add expression functions into SparkR whose params are simple

2015-08-12 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-9855: - Assignee: Yu Ishikawa > Add expression functions into SparkR whose params are simp

[jira] [Resolved] (SPARK-9855) Add expression functions into SparkR whose params are simple

2015-08-12 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-9855. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 812

[jira] [Commented] (SPARK-9865) Flaky SparkR test: test_sparkSQL.R: sample on a DataFrame

2015-08-12 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14693814#comment-14693814 ] Shivaram Venkataraman commented on SPARK-9865: -- So we sample 10% in a DataFra

[jira] [Commented] (SPARK-9427) Add expression functions in SparkR

2015-08-11 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14692662#comment-14692662 ] Shivaram Venkataraman commented on SPARK-9427: -- [~yuu.ishik...@gmail.com] Bre

[jira] [Commented] (SPARK-8724) Need documentation on how to deploy or use SparkR in Spark 1.4.0+

2015-08-11 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14682219#comment-14682219 ] Shivaram Venkataraman commented on SPARK-8724: -- [~cantdutchthis] One thing we

[jira] [Resolved] (SPARK-9710) RPackageUtilsSuite fails if R is not installed

2015-08-10 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-9710. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 800

[jira] [Updated] (SPARK-9710) RPackageUtilsSuite fails if R is not installed

2015-08-10 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-9710: - Assignee: Marcelo Vanzin > RPackageUtilsSuite fails if R is not installed > --

[jira] [Updated] (SPARK-7420) Flaky test: o.a.s.streaming.JobGeneratorSuite "Do not clear received block data too soon"

2015-08-09 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-7420: - Labels: flaky-test (was: ) > Flaky test: o.a.s.streaming.JobGeneratorSuite "Do no

[jira] [Created] (SPARK-9760) SparkSubmit doesn't work with --packages when --repositories is not specified

2015-08-08 Thread Shivaram Venkataraman (JIRA)
Shivaram Venkataraman created SPARK-9760: Summary: SparkSubmit doesn't work with --packages when --repositories is not specified Key: SPARK-9760 URL: https://issues.apache.org/jira/browse/SPARK-9760

[jira] [Resolved] (SPARK-8313) Support Spark Packages containing R code with --packages

2015-08-04 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-8313. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 713

[jira] [Updated] (SPARK-8313) Support Spark Packages containing R code with --packages

2015-08-04 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-8313: - Assignee: Burak Yavuz > Support Spark Packages containing R code with --packages >

[jira] [Resolved] (SPARK-9605) SparkR installation error: Error: Invalid or corrupt jarfile sbt/sbt-launch-0.13.6.jar

2015-08-04 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-9605. -- Resolution: Not A Problem > SparkR installation error: Error: Invalid or corrupt

[jira] [Commented] (SPARK-9605) SparkR installation error: Error: Invalid or corrupt jarfile sbt/sbt-launch-0.13.6.jar

2015-08-04 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14654149#comment-14654149 ] Shivaram Venkataraman commented on SPARK-9605: -- You don't need to install Spa

[jira] [Commented] (SPARK-9605) SparkR installation error: Error: Invalid or corrupt jarfile sbt/sbt-launch-0.13.6.jar

2015-08-04 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14654073#comment-14654073 ] Shivaram Venkataraman commented on SPARK-9605: -- The amplab version of SparkR

[jira] [Updated] (SPARK-9603) Re-enable complex R package test in SparkSubmitSuite

2015-08-04 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-9603: - Component/s: SparkR > Re-enable complex R package test in SparkSubmitSuite > -

[jira] [Resolved] (SPARK-9562) Move spark-ec2 from mesos to amplab

2015-08-04 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-9562. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 789

[jira] [Assigned] (SPARK-9562) Move spark-ec2 from mesos to amplab

2015-08-04 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman reassigned SPARK-9562: Assignee: Shivaram Venkataraman > Move spark-ec2 from mesos to amplab > ---

[jira] [Created] (SPARK-9562) Move spark-ec2 from mesos to amplab

2015-08-03 Thread Shivaram Venkataraman (JIRA)
Shivaram Venkataraman created SPARK-9562: Summary: Move spark-ec2 from mesos to amplab Key: SPARK-9562 URL: https://issues.apache.org/jira/browse/SPARK-9562 Project: Spark Issue Type:

[jira] [Commented] (SPARK-8939) YARN EC2 default setting fails with IllegalArgumentException

2015-08-02 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14651436#comment-14651436 ] Shivaram Venkataraman commented on SPARK-8939: -- [~andrewor14] I ran into this

[jira] [Updated] (SPARK-6809) Make numPartitions optional in pairRDD APIs

2015-08-02 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-6809: - Target Version/s: (was: 1.5.0) > Make numPartitions optional in pairRDD APIs > -

[jira] [Commented] (SPARK-6798) Fix Date serialization in SparkR

2015-08-02 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14651199#comment-14651199 ] Shivaram Venkataraman commented on SPARK-6798: -- [~davies] Do you remember if

[jira] [Updated] (SPARK-8684) Update R version in Spark EC2 AMI

2015-08-02 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-8684: - Target Version/s: (was: 1.5.0) > Update R version in Spark EC2 AMI > ---

[jira] [Commented] (SPARK-6831) Document how to use external data sources

2015-08-02 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14651198#comment-14651198 ] Shivaram Venkataraman commented on SPARK-6831: -- [~yhuai] Is this something we

[jira] [Updated] (SPARK-6832) Handle partial reads in SparkR JVM to worker communication

2015-08-02 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-6832: - Target Version/s: (was: 1.5.0) > Handle partial reads in SparkR JVM to worker co

[jira] [Updated] (SPARK-6816) Add SparkConf API to configure SparkR

2015-08-02 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-6816: - Target Version/s: (was: 1.5.0) > Add SparkConf API to configure SparkR > ---

[jira] [Updated] (SPARK-6821) Refactor SerDe API in SparkR to be more developer friendly

2015-08-02 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-6821: - Target Version/s: (was: 1.5.0) > Refactor SerDe API in SparkR to be more develop

[jira] [Updated] (SPARK-8082) Functionality to Reset DF Schemas/Cast Multiple Columns

2015-08-02 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-8082: - Target Version/s: (was: 1.5.0) > Functionality to Reset DF Schemas/Cast Multiple

[jira] [Updated] (SPARK-6838) Explore using Reference Classes instead of S4 objects

2015-08-02 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-6838: - Target Version/s: (was: 1.5.0) > Explore using Reference Classes instead of S4 o

[jira] [Updated] (SPARK-6815) Support accumulators in R

2015-08-02 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-6815: - Target Version/s: (was: 1.5.0) > Support accumulators in R > ---

[jira] [Updated] (SPARK-6810) Performance benchmarks for SparkR

2015-08-02 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-6810: - Target Version/s: (was: 1.5.0) > Performance benchmarks for SparkR > ---

[jira] [Updated] (SPARK-6825) Data sources implementation to support `sequenceFile`

2015-08-02 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-6825: - Target Version/s: (was: 1.5.0) > Data sources implementation to support `sequenc

[jira] [Updated] (SPARK-6803) [SparkR] Support SparkR Streaming

2015-08-02 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-6803: - Target Version/s: (was: 1.5.0) > [SparkR] Support SparkR Streaming > ---

[jira] [Commented] (SPARK-6823) Add a model.matrix like capability to DataFrames (modelDataFrame)

2015-08-02 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14651196#comment-14651196 ] Shivaram Venkataraman commented on SPARK-6823: -- [~ekhliang] [~mengxr] Is this

[jira] [Commented] (SPARK-9319) Add support for setting column names, types

2015-08-02 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14651193#comment-14651193 ] Shivaram Venkataraman commented on SPARK-9319: -- [~falaki] I believe we alread

[jira] [Updated] (SPARK-9443) Expose sampleByKey in SparkR

2015-08-02 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-9443: - Summary: Expose sampleByKey in SparkR (was: Explose sampleByKey in SparkR) > Expo

[jira] [Resolved] (SPARK-9320) Add `summary` as a synonym for `describe`

2015-07-31 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-9320. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 780

[jira] [Updated] (SPARK-9320) Add `summary` as a synonym for `describe`

2015-07-31 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-9320: - Assignee: Hossein Falaki > Add `summary` as a synonym for `describe` > ---

[jira] [Updated] (SPARK-9318) Add `merge` as synonym for join

2015-07-31 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-9318: - Assignee: Hossein Falaki > Add `merge` as synonym for join > -

[jira] [Resolved] (SPARK-9318) Add `merge` as synonym for join

2015-07-31 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-9318. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 780

[jira] [Updated] (SPARK-9324) Add `unique` as a synonym for `distinct`

2015-07-31 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-9324: - Assignee: Hossein Falaki > Add `unique` as a synonym for `distinct` >

[jira] [Updated] (SPARK-9322) Add rbind as a synonym for `unionAll`

2015-07-31 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-9322: - Assignee: Hossein Falaki > Add rbind as a synonym for `unionAll` > ---

[jira] [Resolved] (SPARK-9321) Add nrow, ncol, dim for SparkR data frames

2015-07-31 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-9321. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 776

[jira] [Updated] (SPARK-9321) Add nrow, ncol, dim for SparkR data frames

2015-07-31 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-9321: - Assignee: Hossein Falaki > Add nrow, ncol, dim for SparkR data frames > --

[jira] [Resolved] (SPARK-9322) Add rbind as a synonym for `unionAll`

2015-07-31 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-9322. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 776

[jira] [Resolved] (SPARK-9324) Add `unique` as a synonym for `distinct`

2015-07-31 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-9324. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 776

[jira] [Assigned] (SPARK-9510) Fix remaining SparkR style violations

2015-07-31 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman reassigned SPARK-9510: Assignee: Shivaram Venkataraman > Fix remaining SparkR style violations > -

[jira] [Resolved] (SPARK-9510) Fix remaining SparkR style violations

2015-07-31 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-9510. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 783

[jira] [Created] (SPARK-9510) Fix remaining SparkR style violations

2015-07-31 Thread Shivaram Venkataraman (JIRA)
Shivaram Venkataraman created SPARK-9510: Summary: Fix remaining SparkR style violations Key: SPARK-9510 URL: https://issues.apache.org/jira/browse/SPARK-9510 Project: Spark Issue Typ

[jira] [Updated] (SPARK-9053) Fix spaces around parens, infix operators etc.

2015-07-31 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-9053: - Assignee: Yu Ishikawa > Fix spaces around parens, infix operators etc. > -

[jira] [Resolved] (SPARK-9053) Fix spaces around parens, infix operators etc.

2015-07-31 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-9053. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 758

[jira] [Updated] (SPARK-8742) Improve SparkR error messages for DataFrame API

2015-07-30 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-8742: - Assignee: Hossein Falaki > Improve SparkR error messages for DataFrame API > -

[jira] [Resolved] (SPARK-8742) Improve SparkR error messages for DataFrame API

2015-07-30 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-8742. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 774

[jira] [Commented] (SPARK-9437) SizeEstimator overflows for primitive arrays

2015-07-30 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648025#comment-14648025 ] Shivaram Venkataraman commented on SPARK-9437: -- Resolved by https://github.co

[jira] [Resolved] (SPARK-9437) SizeEstimator overflows for primitive arrays

2015-07-30 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-9437. -- Resolution: Fixed Fix Version/s: 1.5.0 > SizeEstimator overflows for prim

[jira] [Updated] (SPARK-9248) Closing curly-braces should always be on their own line

2015-07-30 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-9248: - Assignee: Yu Ishikawa > Closing curly-braces should always be on their own line >

[jira] [Resolved] (SPARK-9248) Closing curly-braces should always be on their own line

2015-07-30 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-9248. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 779

[jira] [Commented] (SPARK-9315) SparkR DataFrame improvements to be more R-friendly

2015-07-24 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14640968#comment-14640968 ] Shivaram Venkataraman commented on SPARK-9315: -- Minor note on coordination: T

[jira] [Created] (SPARK-9325) Support `collect` on DataFrame columns

2015-07-24 Thread Shivaram Venkataraman (JIRA)
Shivaram Venkataraman created SPARK-9325: Summary: Support `collect` on DataFrame columns Key: SPARK-9325 URL: https://issues.apache.org/jira/browse/SPARK-9325 Project: Spark Issue Ty

[jira] [Created] (SPARK-9324) Add `unique` as a synonym for `distinct`

2015-07-24 Thread Shivaram Venkataraman (JIRA)
Shivaram Venkataraman created SPARK-9324: Summary: Add `unique` as a synonym for `distinct` Key: SPARK-9324 URL: https://issues.apache.org/jira/browse/SPARK-9324 Project: Spark Issue

[jira] [Created] (SPARK-9322) Add rbind as a synonym for `unionAll`

2015-07-24 Thread Shivaram Venkataraman (JIRA)
Shivaram Venkataraman created SPARK-9322: Summary: Add rbind as a synonym for `unionAll` Key: SPARK-9322 URL: https://issues.apache.org/jira/browse/SPARK-9322 Project: Spark Issue Typ

[jira] [Created] (SPARK-9321) Add nrow, ncol, dim for SparkR data frames

2015-07-24 Thread Shivaram Venkataraman (JIRA)
Shivaram Venkataraman created SPARK-9321: Summary: Add nrow, ncol, dim for SparkR data frames Key: SPARK-9321 URL: https://issues.apache.org/jira/browse/SPARK-9321 Project: Spark Issu

[jira] [Created] (SPARK-9320) Add `summary` as a synonym for `describe`

2015-07-24 Thread Shivaram Venkataraman (JIRA)
Shivaram Venkataraman created SPARK-9320: Summary: Add `summary` as a synonym for `describe` Key: SPARK-9320 URL: https://issues.apache.org/jira/browse/SPARK-9320 Project: Spark Issue

[jira] [Created] (SPARK-9319) Add support for setting column names, types

2015-07-24 Thread Shivaram Venkataraman (JIRA)
Shivaram Venkataraman created SPARK-9319: Summary: Add support for setting column names, types Key: SPARK-9319 URL: https://issues.apache.org/jira/browse/SPARK-9319 Project: Spark Iss

[jira] [Created] (SPARK-9318) Add `merge` as synonym for join

2015-07-24 Thread Shivaram Venkataraman (JIRA)
Shivaram Venkataraman created SPARK-9318: Summary: Add `merge` as synonym for join Key: SPARK-9318 URL: https://issues.apache.org/jira/browse/SPARK-9318 Project: Spark Issue Type: Sub

[jira] [Created] (SPARK-9316) Add support for filtering using `[` (synonym for filter / select)

2015-07-24 Thread Shivaram Venkataraman (JIRA)
Shivaram Venkataraman created SPARK-9316: Summary: Add support for filtering using `[` (synonym for filter / select) Key: SPARK-9316 URL: https://issues.apache.org/jira/browse/SPARK-9316 Proje

[jira] [Created] (SPARK-9317) Change `show` to print DataFrame entries

2015-07-24 Thread Shivaram Venkataraman (JIRA)
Shivaram Venkataraman created SPARK-9317: Summary: Change `show` to print DataFrame entries Key: SPARK-9317 URL: https://issues.apache.org/jira/browse/SPARK-9317 Project: Spark Issue

[jira] [Created] (SPARK-9315) SparkR DataFrame improvements to be more R-friendly

2015-07-24 Thread Shivaram Venkataraman (JIRA)
Shivaram Venkataraman created SPARK-9315: Summary: SparkR DataFrame improvements to be more R-friendly Key: SPARK-9315 URL: https://issues.apache.org/jira/browse/SPARK-9315 Project: Spark

<    4   5   6   7   8   9   10   11   12   13   >