[jira] [Commented] (SPARK-15585) Don't use null in data source options to indicate default value

[ https://issues.apache.org/jira/browse/SPARK-15585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15304267#comment-15304267 ] Shivaram Venkataraman commented on SPARK-15585: --- [~maropu] Can you also add test cases in

[jira] [Commented] (SPARK-15585) Don't use null in data source options to indicate default value

[ https://issues.apache.org/jira/browse/SPARK-15585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15303523#comment-15303523 ] Shivaram Venkataraman commented on SPARK-15585: --- I am not sure i completely understand the

[jira] [Resolved] (SPARK-8603) In Windows,Not able to create a Spark context from R studio

[ https://issues.apache.org/jira/browse/SPARK-8603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-8603. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request

[jira] [Updated] (SPARK-8603) In Windows,Not able to create a Spark context from R studio

[ https://issues.apache.org/jira/browse/SPARK-8603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-8603: - Assignee: Hyukjin Kwon > In Windows,Not able to create a Spark context from R

[jira] [Resolved] (SPARK-10903) Simplify SQLContext method signatures and use a singleton

[ https://issues.apache.org/jira/browse/SPARK-10903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-10903. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request

[jira] [Updated] (SPARK-10903) Simplify SQLContext method signatures and use a singleton

[ https://issues.apache.org/jira/browse/SPARK-10903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-10903: -- Assignee: Felix Cheung > Simplify SQLContext method signatures and use a

[jira] [Commented] (SPARK-15439) Failed to run unit test in SparkR

[ https://issues.apache.org/jira/browse/SPARK-15439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15302525#comment-15302525 ] Shivaram Venkataraman commented on SPARK-15439: --- Hmm - I think the check needs to be

[jira] [Resolved] (SPARK-15439) Failed to run unit test in SparkR

[ https://issues.apache.org/jira/browse/SPARK-15439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-15439. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request

[jira] [Updated] (SPARK-15439) Failed to run unit test in SparkR

[ https://issues.apache.org/jira/browse/SPARK-15439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-15439: -- Assignee: Miao Wang > Failed to run unit test in SparkR >

[jira] [Resolved] (SPARK-12071) Programming guide should explain NULL in JVM translate to NA in R

[ https://issues.apache.org/jira/browse/SPARK-12071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-12071. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request

[jira] [Resolved] (SPARK-15412) Improve linear & isotonic regression methods PyDocs

[ https://issues.apache.org/jira/browse/SPARK-15412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-15412. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request

[jira] [Commented] (SPARK-15439) Failed to run unit test in SparkR

[ https://issues.apache.org/jira/browse/SPARK-15439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15298579#comment-15298579 ] Shivaram Venkataraman commented on SPARK-15439: --- I think the `maskedCompletely` failures

[jira] [Commented] (SPARK-12071) Programming guide should explain NULL in JVM translate to NA in R

[ https://issues.apache.org/jira/browse/SPARK-12071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15297245#comment-15297245 ] Shivaram Venkataraman commented on SPARK-12071: --- You can add it under the migration guide

[jira] [Commented] (SPARK-15439) Failed to run unit test in SparkR

[ https://issues.apache.org/jira/browse/SPARK-15439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15297176#comment-15297176 ] Shivaram Venkataraman commented on SPARK-15439: --- [~wm624] Any luck in figuring out why this

[jira] [Commented] (SPARK-12071) Programming guide should explain NULL in JVM translate to NA in R

[ https://issues.apache.org/jira/browse/SPARK-12071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15297162#comment-15297162 ] Shivaram Venkataraman commented on SPARK-12071: --- [~KrishnaKalyan3] Feel free to work on

[jira] [Commented] (SPARK-13525) SparkR: java.net.SocketTimeoutException: Accept timed out when running any dataframe function

[ https://issues.apache.org/jira/browse/SPARK-13525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15297159#comment-15297159 ] Shivaram Venkataraman commented on SPARK-13525: --- If the problem is on line 353 it means

[jira] [Commented] (SPARK-15294) Add pivot functionality to SparkR

[ https://issues.apache.org/jira/browse/SPARK-15294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15297146#comment-15297146 ] Shivaram Venkataraman commented on SPARK-15294: --- [~mhnatiuk] I think the code diff looks

[jira] [Resolved] (SPARK-15202) add dapplyCollect() method for DataFrame in SparkR

[ https://issues.apache.org/jira/browse/SPARK-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-15202. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request

[jira] [Updated] (SPARK-15202) add dapplyCollect() method for DataFrame in SparkR

[ https://issues.apache.org/jira/browse/SPARK-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-15202: -- Assignee: Sun Rui > add dapplyCollect() method for DataFrame in SparkR >

[jira] [Commented] (SPARK-15294) Add pivot functionality to SparkR

[ https://issues.apache.org/jira/browse/SPARK-15294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15281807#comment-15281807 ] Shivaram Venkataraman commented on SPARK-15294: --- [~mhnatiuk] Thanks for opening this. I

[jira] [Commented] (SPARK-14995) Add "since" tag in Roxygen documentation for SparkR API methods

[ https://issues.apache.org/jira/browse/SPARK-14995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15281746#comment-15281746 ] Shivaram Venkataraman commented on SPARK-14995: --- Technically entire SparkR component is

[jira] [Commented] (SPARK-14751) SparkR fails on Cassandra map with numeric key

[ https://issues.apache.org/jira/browse/SPARK-14751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15281700#comment-15281700 ] Shivaram Venkataraman commented on SPARK-14751: --- [~sunrui] That sounds fine to me. Can we

[jira] [Commented] (SPARK-12661) Drop Python 2.6 support in PySpark

[ https://issues.apache.org/jira/browse/SPARK-12661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15277473#comment-15277473 ] Shivaram Venkataraman commented on SPARK-12661: --- Yes - We will do a full round of AMI

[jira] [Updated] (SPARK-12479) sparkR collect on GroupedData throws R error "missing value where TRUE/FALSE needed"

[ https://issues.apache.org/jira/browse/SPARK-12479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-12479: -- Assignee: Sun Rui > sparkR collect on GroupedData throws R error "missing

[jira] [Resolved] (SPARK-12479) sparkR collect on GroupedData throws R error "missing value where TRUE/FALSE needed"

[ https://issues.apache.org/jira/browse/SPARK-12479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-12479. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request

[jira] [Resolved] (SPARK-11395) Support over and window specification in SparkR

[ https://issues.apache.org/jira/browse/SPARK-11395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-11395. --- Resolution: Fixed Assignee: Sun Rui Fix Version/s: 2.0.0

[jira] [Commented] (SPARK-10043) Add window functions into SparkR

[ https://issues.apache.org/jira/browse/SPARK-10043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15273475#comment-15273475 ] Shivaram Venkataraman commented on SPARK-10043: --- [~sunrui] Can we resolve this issue now ?

[jira] [Commented] (SPARK-15159) Remove usage of HiveContext in SparkR.

[ https://issues.apache.org/jira/browse/SPARK-15159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15273396#comment-15273396 ] Shivaram Venkataraman commented on SPARK-15159: --- Is it being removed or is it being

[jira] [Resolved] (SPARK-15091) Fix warnings and a failure in SparkR test cases with testthat version 1.0.1

[ https://issues.apache.org/jira/browse/SPARK-15091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-15091. --- Resolution: Fixed Assignee: Sun Rui Fix Version/s: 2.0.0

[jira] [Commented] (SPARK-6817) DataFrame UDFs in R

[ https://issues.apache.org/jira/browse/SPARK-6817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15264954#comment-15264954 ] Shivaram Venkataraman commented on SPARK-6817: -- I just merged

[jira] [Resolved] (SPARK-12919) Implement dapply() on DataFrame in SparkR

[ https://issues.apache.org/jira/browse/SPARK-12919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-12919. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request

[jira] [Updated] (SPARK-12919) Implement dapply() on DataFrame in SparkR

[ https://issues.apache.org/jira/browse/SPARK-12919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-12919: -- Assignee: Sun Rui > Implement dapply() on DataFrame in SparkR >

[jira] [Commented] (SPARK-14995) Add "since" tag in Roxygen documentation for SparkR API methods

[ https://issues.apache.org/jira/browse/SPARK-14995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15263549#comment-15263549 ] Shivaram Venkataraman commented on SPARK-14995: --- We could just use one of the existing

[jira] [Resolved] (SPARK-10894) Add 'drop' support for DataFrame's subset function

[ https://issues.apache.org/jira/browse/SPARK-10894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-10894. --- Resolution: Fixed > Add 'drop' support for DataFrame's subset function >

[jira] [Resolved] (SPARK-10346) SparkR mutate and transform should replace column with same name to match R data.frame behavior

[ https://issues.apache.org/jira/browse/SPARK-10346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-10346. --- Resolution: Fixed > SparkR mutate and transform should replace column with

[jira] [Updated] (SPARK-6817) DataFrame UDFs in R

[ https://issues.apache.org/jira/browse/SPARK-6817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-6817: - Target Version/s: 2.0.0 > DataFrame UDFs in R > --- > >

[jira] [Resolved] (SPARK-12235) Enhance mutate() to support replace existing columns

[ https://issues.apache.org/jira/browse/SPARK-12235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-12235. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request

[jira] [Updated] (SPARK-12235) Enhance mutate() to support replace existing columns

[ https://issues.apache.org/jira/browse/SPARK-12235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-12235: -- Assignee: Sun Rui > Enhance mutate() to support replace existing columns >

[jira] [Resolved] (SPARK-13436) Add parameter drop to subsetting operator [

[ https://issues.apache.org/jira/browse/SPARK-13436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-13436. --- Resolution: Fixed Assignee: Oscar D. Lara Yejas Fix

[jira] [Commented] (SPARK-14831) Make ML APIs in SparkR consistent

[ https://issues.apache.org/jira/browse/SPARK-14831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15261005#comment-15261005 ] Shivaram Venkataraman commented on SPARK-14831: --- +1 > Make ML APIs in SparkR consistent >

[jira] [Commented] (SPARK-12922) Implement gapply() on DataFrame in SparkR

[ https://issues.apache.org/jira/browse/SPARK-12922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15260626#comment-15260626 ] Shivaram Venkataraman commented on SPARK-12922: --- Could you post a WIP pull request using

[jira] [Commented] (SPARK-12922) Implement gapply() on DataFrame in SparkR

[ https://issues.apache.org/jira/browse/SPARK-12922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15260360#comment-15260360 ] Shivaram Venkataraman commented on SPARK-12922: --- [~Narine] Any update on this ? Would be

[jira] [Updated] (SPARK-13734) SparkR histogram

[ https://issues.apache.org/jira/browse/SPARK-13734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-13734: -- Assignee: Oscar D. Lara Yejas > SparkR histogram > > >

[jira] [Resolved] (SPARK-13734) SparkR histogram

[ https://issues.apache.org/jira/browse/SPARK-13734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-13734. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request

[jira] [Resolved] (SPARK-14883) Fix wrong R examples and make them up-to-date

[ https://issues.apache.org/jira/browse/SPARK-14883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-14883. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request

[jira] [Updated] (SPARK-14883) Fix wrong R examples and make them up-to-date

[ https://issues.apache.org/jira/browse/SPARK-14883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-14883: -- Assignee: Dongjoon Hyun > Fix wrong R examples and make them up-to-date >

[jira] [Updated] (SPARK-14594) Improve error messages for RDD API

[ https://issues.apache.org/jira/browse/SPARK-14594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-14594: -- Assignee: Felix Cheung > Improve error messages for RDD API >

[jira] [Resolved] (SPARK-14594) Improve error messages for RDD API

[ https://issues.apache.org/jira/browse/SPARK-14594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-14594. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request

[jira] [Commented] (SPARK-14831) Make ML APIs in SparkR consistent

[ https://issues.apache.org/jira/browse/SPARK-14831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15254551#comment-15254551 ] Shivaram Venkataraman commented on SPARK-14831: --- 1. Agree. I think a valid policy could be

[jira] [Commented] (SPARK-14831) Make ML APIs in SparkR consistent

[ https://issues.apache.org/jira/browse/SPARK-14831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15254447#comment-15254447 ] Shivaram Venkataraman commented on SPARK-14831: --- Yeah I think there are a couple of factors

[jira] [Updated] (SPARK-13178) RRDD faces with concurrency issue in case of rdd.zip(rdd).count()

[ https://issues.apache.org/jira/browse/SPARK-13178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-13178: -- Assignee: Sun Rui > RRDD faces with concurrency issue in case of

[jira] [Resolved] (SPARK-13178) RRDD faces with concurrency issue in case of rdd.zip(rdd).count()

[ https://issues.apache.org/jira/browse/SPARK-13178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-13178. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request

[jira] [Commented] (SPARK-14751) SparkR fails on Cassandra map with numeric key

[ https://issues.apache.org/jira/browse/SPARK-14751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15250385#comment-15250385 ] Shivaram Venkataraman commented on SPARK-14751: --- I think the problem here is that map types

[jira] [Commented] (SPARK-13178) RRDD faces with concurrency issue in case of rdd.zip(rdd).count()

[ https://issues.apache.org/jira/browse/SPARK-13178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15250268#comment-15250268 ] Shivaram Venkataraman commented on SPARK-13178: --- [~sunrui] [~yinxusen] Now that

[jira] [Commented] (SPARK-14746) Support transformations in R source code for Dataset/DataFrame

[ https://issues.apache.org/jira/browse/SPARK-14746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15250229#comment-15250229 ] Shivaram Venkataraman commented on SPARK-14746: --- Yeah I can see that RDD pipe is limited

[jira] [Commented] (SPARK-14742) Redirect spark-ec2 doc to new location

[ https://issues.apache.org/jira/browse/SPARK-14742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15250216#comment-15250216 ] Shivaram Venkataraman commented on SPARK-14742: --- Ah my bad - I forgot that docs/ is

[jira] [Resolved] (SPARK-13905) Change signature of as.data.frame() to be consistent with the R base package

[ https://issues.apache.org/jira/browse/SPARK-13905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-13905. --- Resolution: Fixed Assignee: Sun Rui Fix Version/s: 2.0.0

[jira] [Resolved] (SPARK-12224) R support for JDBC source

[ https://issues.apache.org/jira/browse/SPARK-12224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-12224. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request

[jira] [Updated] (SPARK-12224) R support for JDBC source

[ https://issues.apache.org/jira/browse/SPARK-12224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-12224: -- Assignee: Felix Cheung (was: Apache Spark) > R support for JDBC source >

[jira] [Commented] (SPARK-14037) count(df) is very slow for dataframe constrcuted using SparkR::createDataFrame

[ https://issues.apache.org/jira/browse/SPARK-14037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15248416#comment-15248416 ] Shivaram Venkataraman commented on SPARK-14037: --- Thanks [~samalexg] and [~sunrui] for

[jira] [Commented] (SPARK-14594) Improve error messages for RDD API

[ https://issues.apache.org/jira/browse/SPARK-14594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15248392#comment-15248392 ] Shivaram Venkataraman commented on SPARK-14594: --- I think this would be very useful to have

[jira] [Commented] (SPARK-14325) some strange name conflicts in `group_by`

[ https://issues.apache.org/jira/browse/SPARK-14325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15248374#comment-15248374 ] Shivaram Venkataraman commented on SPARK-14325: --- I think the problem might be related to

[jira] [Commented] (SPARK-14692) Error While Setting the path for R front end

[ https://issues.apache.org/jira/browse/SPARK-14692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15248363#comment-15248363 ] Shivaram Venkataraman commented on SPARK-14692: --- I think SparkR might not have been built ?

[jira] [Commented] (SPARK-14326) Can't specify "long" type in structField

[ https://issues.apache.org/jira/browse/SPARK-14326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15248335#comment-15248335 ] Shivaram Venkataraman commented on SPARK-14326: --- I think its fine to support this in

[jira] [Commented] (SPARK-14147) SparkR - ML predictors return features with vector datatype, however SparkR doesn't support it

[ https://issues.apache.org/jira/browse/SPARK-14147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15211394#comment-15211394 ] Shivaram Venkataraman commented on SPARK-14147: --- cc [~mengxr] > SparkR - ML predictors

[jira] [Commented] (SPARK-14074) Do not use install_github in SparkR build

[ https://issues.apache.org/jira/browse/SPARK-14074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15207866#comment-15207866 ] Shivaram Venkataraman commented on SPARK-14074: --- [~sunrui] Would you have a chance to check

[jira] [Commented] (SPARK-14074) Do not use install_github in SparkR build

[ https://issues.apache.org/jira/browse/SPARK-14074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15207152#comment-15207152 ] Shivaram Venkataraman commented on SPARK-14074: --- I think the last CRAN release when we

[jira] [Commented] (SPARK-14006) Builds of 1.6 branch fail R style check

[ https://issues.apache.org/jira/browse/SPARK-14006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15201894#comment-15201894 ] Shivaram Venkataraman commented on SPARK-14006: --- Ah we just updated our style check plugin

[jira] [Resolved] (SPARK-13812) Fix SparkR lint-r test errors

[ https://issues.apache.org/jira/browse/SPARK-13812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-13812. --- Resolution: Fixed Assignee: Sun Rui Fix Version/s: 2.0.0

[jira] [Resolved] (SPARK-13389) SparkR support first/last with ignore NAs

[ https://issues.apache.org/jira/browse/SPARK-13389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-13389. --- Resolution: Fixed Assignee: Yanbo Liang Fix Version/s: 2.0.0

[jira] [Resolved] (SPARK-13327) colnames()<- allows invalid column names

[ https://issues.apache.org/jira/browse/SPARK-13327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-13327. --- Resolution: Fixed Fix Version/s: 2.0.0 1.6.2

[jira] [Updated] (SPARK-13327) colnames()<- allows invalid column names

[ https://issues.apache.org/jira/browse/SPARK-13327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-13327: -- Assignee: Oscar D. Lara Yejas > colnames()<- allows invalid column names >

[jira] [Commented] (SPARK-13262) cannot coerce type 'environment' to vector of type 'list'

[ https://issues.apache.org/jira/browse/SPARK-13262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15141877#comment-15141877 ] Shivaram Venkataraman commented on SPARK-13262: --- Can you paste the code you ran that led to

[jira] [Resolved] (SPARK-13256) Strange Error

[ https://issues.apache.org/jira/browse/SPARK-13256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-13256. --- Resolution: Incomplete Please use the spark user mailing list / stack

[jira] [Commented] (SPARK-13178) RRDD faces with concurrency issue in case of rdd.zip(rdd).count()

[ https://issues.apache.org/jira/browse/SPARK-13178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15131436#comment-15131436 ] Shivaram Venkataraman commented on SPARK-13178: --- Hmm this is tricky to debug -- A higher

[jira] [Commented] (SPARK-13178) RRDD faces with concurrency issue in case of rdd.zip(rdd).count()

[ https://issues.apache.org/jira/browse/SPARK-13178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15131556#comment-15131556 ] Shivaram Venkataraman commented on SPARK-13178: --- Ah I see - so the problem is that

[jira] [Updated] (SPARK-12629) SparkR: DataFrame's saveAsTable method has issues with the signature and HiveContext

[ https://issues.apache.org/jira/browse/SPARK-12629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-12629: -- Fix Version/s: 1.6.1 > SparkR: DataFrame's saveAsTable method has issues with

[jira] [Commented] (SPARK-13119) SparkR Ser/De fail to handle "columns(df)"

[ https://issues.apache.org/jira/browse/SPARK-13119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127093#comment-15127093 ] Shivaram Venkataraman commented on SPARK-13119: --- cc [~sunrui] Thanks [~yinxusen] -- I'll

[jira] [Resolved] (SPARK-5331) Spark workers can't find tachyon master as spark-ec2 doesn't set spark.tachyonStore.url

[ https://issues.apache.org/jira/browse/SPARK-5331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-5331. -- Resolution: Fixed Fix Version/s: 1.4.0 Fixed by

[jira] [Resolved] (SPARK-10462) spark-ec2 not creating ephemeral volumes

[ https://issues.apache.org/jira/browse/SPARK-10462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-10462. --- Resolution: Won't Fix According to

[jira] [Resolved] (SPARK-9494) 'spark-ec2 launch' fails with anaconda python 3.4

[ https://issues.apache.org/jira/browse/SPARK-9494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-9494. -- Resolution: Duplicate Fix Version/s: 1.6.0 > 'spark-ec2 launch' fails

[jira] [Resolved] (SPARK-8980) Setup cluster with spark-ec2 scripts as non-root user

[ https://issues.apache.org/jira/browse/SPARK-8980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-8980. -- Resolution: Won't Fix Now tracked by

[jira] [Commented] (SPARK-5629) Add spark-ec2 action to return info about an existing cluster

[ https://issues.apache.org/jira/browse/SPARK-5629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15124613#comment-15124613 ] Shivaram Venkataraman commented on SPARK-5629: -- I manually cleaned up some of the issues and

[jira] [Resolved] (SPARK-9688) Improve spark-ec2 script to handle users that are not root

[ https://issues.apache.org/jira/browse/SPARK-9688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-9688. -- Resolution: Won't Fix Now tracked at

[jira] [Commented] (SPARK-12526) `ifelse`, `when`, `otherwise` unable to take Column as value

[ https://issues.apache.org/jira/browse/SPARK-12526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15122631#comment-15122631 ] Shivaram Venkataraman commented on SPARK-12526: --- Yeah this fix was checked in after 1.6.0

[jira] [Resolved] (SPARK-12903) Add covar_samp and covar_pop for SparkR

[ https://issues.apache.org/jira/browse/SPARK-12903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-12903. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request

[jira] [Updated] (SPARK-12903) Add covar_samp and covar_pop for SparkR

[ https://issues.apache.org/jira/browse/SPARK-12903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-12903: -- Assignee: Yanbo Liang > Add covar_samp and covar_pop for SparkR >

[jira] [Updated] (SPARK-12629) SparkR: DataFrame's saveAsTable method has issues with the signature and HiveContext

[ https://issues.apache.org/jira/browse/SPARK-12629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-12629: -- Assignee: Narine Kokhlikyan > SparkR: DataFrame's saveAsTable method has

[jira] [Resolved] (SPARK-12629) SparkR: DataFrame's saveAsTable method has issues with the signature and HiveContext

[ https://issues.apache.org/jira/browse/SPARK-12629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-12629. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by

[jira] [Commented] (SPARK-5629) Add spark-ec2 action to return info about an existing cluster

[ https://issues.apache.org/jira/browse/SPARK-5629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15111056#comment-15111056 ] Shivaram Venkataraman commented on SPARK-5629: -- Yes - though I think its beneficial to see if

[jira] [Resolved] (SPARK-12204) Implement drop method for DataFrame in SparkR

[ https://issues.apache.org/jira/browse/SPARK-12204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-12204. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request

[jira] [Updated] (SPARK-12204) Implement drop method for DataFrame in SparkR

[ https://issues.apache.org/jira/browse/SPARK-12204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-12204: -- Assignee: Sun Rui > Implement drop method for DataFrame in SparkR >

[jira] [Updated] (SPARK-12910) Support for specifying version of R to use while creating sparkR libraries

[ https://issues.apache.org/jira/browse/SPARK-12910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-12910: -- Assignee: Shubhanshu Mishra > Support for specifying version of R to use while

[jira] [Updated] (SPARK-12910) Support for specifying version of R to use while creating sparkR libraries

[ https://issues.apache.org/jira/browse/SPARK-12910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-12910: -- Shepherd: (was: Shivram Mani) > Support for specifying version of R to use

[jira] [Resolved] (SPARK-12910) Support for specifying version of R to use while creating sparkR libraries

[ https://issues.apache.org/jira/browse/SPARK-12910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-12910. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request

[jira] [Commented] (SPARK-6825) Data sources implementation to support `sequenceFile`

[ https://issues.apache.org/jira/browse/SPARK-6825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15109446#comment-15109446 ] Shivaram Venkataraman commented on SPARK-6825: -- No - you can go ahead and work on it. > Data

[jira] [Updated] (SPARK-12168) Need test for conflicted function in R

[ https://issues.apache.org/jira/browse/SPARK-12168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-12168: -- Assignee: Felix Cheung > Need test for conflicted function in R >

[jira] [Resolved] (SPARK-12168) Need test for conflicted function in R

[ https://issues.apache.org/jira/browse/SPARK-12168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-12168. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request

[jira] [Updated] (SPARK-12337) Implement dropDuplicates() method of DataFrame in SparkR

[ https://issues.apache.org/jira/browse/SPARK-12337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-12337: -- Assignee: Sun Rui > Implement dropDuplicates() method of DataFrame in SparkR >

[jira] [Commented] (SPARK-12635) More efficient (column batch) serialization for Python/R

[ https://issues.apache.org/jira/browse/SPARK-12635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15107860#comment-15107860 ] Shivaram Venkataraman commented on SPARK-12635: --- Just to clarify a couple of things - we

<    1   2   3   4   5   6   7   8   9   10   >