[jira] [Resolved] (SPARK-18875) Fix R API doc generation by adding `DESCRIPTION` file

2016-12-14 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-18875. --- Resolution: Fixed Fix Version/s: 2.1.0 2.0.3 Issue

[jira] [Commented] (SPARK-18823) Assignation by column name variable not available or bug?

2016-12-13 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15745633#comment-15745633 ] Shivaram Venkataraman commented on SPARK-18823: --- Thanks [~masip85] for verifying this. I

[jira] [Commented] (SPARK-18823) Assignation by column name variable not available or bug?

2016-12-13 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15744519#comment-15744519 ] Shivaram Venkataraman commented on SPARK-18823: --- Ah I see your point - `withColumn` does

[jira] [Commented] (SPARK-18823) Assignation by column name variable not available or bug?

2016-12-12 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15743648#comment-15743648 ] Shivaram Venkataraman commented on SPARK-18823: --- We don't support assigning to columns

[jira] [Created] (SPARK-18836) Serialize Task Metrics once per stage

2016-12-12 Thread Shivaram Venkataraman (JIRA)
Shivaram Venkataraman created SPARK-18836: - Summary: Serialize Task Metrics once per stage Key: SPARK-18836 URL: https://issues.apache.org/jira/browse/SPARK-18836 Project: Spark

[jira] [Resolved] (SPARK-18810) SparkR install.spark does not work for RCs, snapshots

2016-12-12 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-18810. --- Resolution: Fixed Fix Version/s: 2.2.0 2.1.1 Issue

[jira] [Commented] (SPARK-18825) Eliminate duplicate links in SparkR API doc index

2016-12-12 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15742601#comment-15742601 ] Shivaram Venkataraman commented on SPARK-18825: --- Yeah this is tricky because of CRAN

[jira] [Resolved] (SPARK-18807) Should suppress output print for calls to JVM methods with void return values

2016-12-09 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-18807. --- Resolution: Fixed Fix Version/s: 2.1.1 Resolved by

[jira] [Commented] (SPARK-18788) Add getNumPartitions() to SparkR

2016-12-09 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15737084#comment-15737084 ] Shivaram Venkataraman commented on SPARK-18788: --- Hmm I am not sure but I think the reason

[jira] [Commented] (SPARK-18788) Add getNumPartitions() to SparkR

2016-12-09 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736911#comment-15736911 ] Shivaram Venkataraman commented on SPARK-18788: --- Sorry I didn't complete the question - the

[jira] [Commented] (SPARK-18788) Add getNumPartitions() to SparkR

2016-12-09 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736907#comment-15736907 ] Shivaram Venkataraman commented on SPARK-18788: --- Is there an equivalent Scala or Python

[jira] [Commented] (SPARK-15799) Release SparkR on CRAN

2016-12-09 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736807#comment-15736807 ] Shivaram Venkataraman commented on SPARK-15799: --- Hmm I think I read it wrong. It does the

[jira] [Commented] (SPARK-15799) Release SparkR on CRAN

2016-12-09 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736801#comment-15736801 ] Shivaram Venkataraman commented on SPARK-15799: --- There is already some code which considers

[jira] [Commented] (SPARK-15799) Release SparkR on CRAN

2016-12-09 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736753#comment-15736753 ] Shivaram Venkataraman commented on SPARK-15799: --- Sure > Release SparkR on CRAN >

[jira] [Commented] (SPARK-15799) Release SparkR on CRAN

2016-12-09 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736671#comment-15736671 ] Shivaram Venkataraman commented on SPARK-15799: --- Sure - That will be great. > Release

[jira] [Commented] (SPARK-15799) Release SparkR on CRAN

2016-12-09 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736616#comment-15736616 ] Shivaram Venkataraman commented on SPARK-15799: --- I see - Looks like its controlled by this

[jira] [Commented] (SPARK-15799) Release SparkR on CRAN

2016-12-09 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736588#comment-15736588 ] Shivaram Venkataraman commented on SPARK-15799: --- Where does it get created right now ? We

[jira] [Commented] (SPARK-18810) SparkR install.spark does not work for RCs, snapshots

2016-12-09 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736233#comment-15736233 ] Shivaram Venkataraman commented on SPARK-18810: --- Yeah I think that sounds good. This need

[jira] [Commented] (SPARK-18810) SparkR install.spark does not work for RCs, snapshots

2016-12-09 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736182#comment-15736182 ] Shivaram Venkataraman commented on SPARK-18810: --- I think the snapshot case and the RC case

[jira] [Created] (SPARK-18810) SparkR install.spark does not work for RCs, snapshots

2016-12-09 Thread Shivaram Venkataraman (JIRA)
Shivaram Venkataraman created SPARK-18810: - Summary: SparkR install.spark does not work for RCs, snapshots Key: SPARK-18810 URL: https://issues.apache.org/jira/browse/SPARK-18810 Project:

[jira] [Resolved] (SPARK-18590) R - Include package vignettes and help pages, build source package in Spark distribution

2016-12-08 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-18590. --- Resolution: Fixed Fix Version/s: 2.1.1 Issue resolved by pull request

[jira] [Resolved] (SPARK-18713) using SparkR build step wise regression model (glm)

2016-12-05 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-18713. --- Resolution: Not A Problem > using SparkR build step wise regression model

[jira] [Commented] (SPARK-18713) using SparkR build step wise regression model (glm)

2016-12-05 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15722810#comment-15722810 ] Shivaram Venkataraman commented on SPARK-18713: --- I dont think we support step wise

[jira] [Resolved] (SPARK-18643) SparkR hangs at session start when installed as a package without SPARK_HOME set

2016-12-04 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-18643. --- Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request

[jira] [Commented] (SPARK-17608) Long type has incorrect serialization/deserialization

2016-11-30 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15709192#comment-15709192 ] Shivaram Venkataraman commented on SPARK-17608: --- [~iamthomaspowell] would you be able to

[jira] [Resolved] (SPARK-17965) Enable SparkR with Mesos cluster mode

2016-11-29 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-17965. --- Resolution: Fixed Assignee: Susan X. Huynh Fix Version/s:

[jira] [Commented] (SPARK-14742) Redirect spark-ec2 doc to new location

2016-11-23 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15690741#comment-15690741 ] Shivaram Venkataraman commented on SPARK-14742: --- [~srowen] It looks like this is broken

[jira] [Resolved] (SPARK-18264) Build and package R vignettes

2016-11-11 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-18264. --- Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request

[jira] [Updated] (SPARK-18264) Build and package R vignettes

2016-11-11 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-18264: -- Assignee: Felix Cheung > Build and package R vignettes >

[jira] [Commented] (SPARK-18131) Support returning Vector/Dense Vector from backend

2016-11-09 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15651711#comment-15651711 ] Shivaram Venkataraman commented on SPARK-18131: --- Yeah this could work. The main thing is to

[jira] [Commented] (SPARK-18347) Infra for R - need qpdf on Jenkins

2016-11-08 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15648144#comment-15648144 ] Shivaram Venkataraman commented on SPARK-18347: --- Thanks [~shaneknapp] - We'll see the test

[jira] [Commented] (SPARK-17822) JVMObjectTracker.objMap may leak JVM objects

2016-11-07 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15644875#comment-15644875 ] Shivaram Venkataraman commented on SPARK-17822: --- Yeah just to provide some more context,

[jira] [Commented] (SPARK-15799) Release SparkR on CRAN

2016-11-03 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15633932#comment-15633932 ] Shivaram Venkataraman commented on SPARK-15799: --- Yes - I think this is good to go. The only

[jira] [Commented] (SPARK-18190) Fix R version to not the latest in AppVeyor

2016-10-31 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15624176#comment-15624176 ] Shivaram Venkataraman commented on SPARK-18190: --- Yeah using a fixed version sounds good to

[jira] [Commented] (SPARK-18073) Migrate wiki to spark.apache.org web site

2016-10-24 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15602432#comment-15602432 ] Shivaram Venkataraman commented on SPARK-18073: --- I think most of the list looks good to me.

[jira] [Commented] (SPARK-17904) Add a wrapper function to install R packages on each executors.

2016-10-13 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15572741#comment-15572741 ] Shivaram Venkataraman commented on SPARK-17904: --- Thanks all - This is a good discussion

[jira] [Updated] (SPARK-17882) RBackendHandler swallowing errors

2016-10-13 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-17882: -- Assignee: James Shuster > RBackendHandler swallowing errors >

[jira] [Resolved] (SPARK-17882) RBackendHandler swallowing errors

2016-10-13 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-17882. --- Resolution: Fixed Fix Version/s: 2.1.0 2.0.2

[jira] [Commented] (SPARK-17902) collect() ignores stringsAsFactors

2016-10-13 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15572472#comment-15572472 ] Shivaram Venkataraman commented on SPARK-17902: --- Good catch - Looks like this was changed

[jira] [Commented] (SPARK-17904) Add a wrapper function to install R packages on each executors.

2016-10-13 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15572377#comment-15572377 ] Shivaram Venkataraman commented on SPARK-17904: --- +1 I think this sounds good [~yanboliang].

[jira] [Commented] (SPARK-17781) datetime is serialized as double inside dapply()

2016-10-11 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15566457#comment-15566457 ] Shivaram Venkataraman commented on SPARK-17781: --- [~falaki] I looked at this a bit more

[jira] [Commented] (SPARK-17781) datetime is serialized as double inside dapply()

2016-10-10 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15563862#comment-15563862 ] Shivaram Venkataraman commented on SPARK-17781: --- I'm not sure I follow. The class of the

[jira] [Commented] (SPARK-17608) Long type has incorrect serialization/deserialization

2016-10-04 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15546889#comment-15546889 ] Shivaram Venkataraman commented on SPARK-17608: --- I think the loss of precision is

[jira] [Commented] (SPARK-17634) Spark job hangs when using dapply

2016-10-04 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15546871#comment-15546871 ] Shivaram Venkataraman commented on SPARK-17634: --- [~iamthomaspowell] Thanks for the

[jira] [Commented] (SPARK-17774) Add support for head on DataFrame Column

2016-10-03 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15544189#comment-15544189 ] Shivaram Venkataraman commented on SPARK-17774: --- Could you explain why `head` is different

[jira] [Resolved] (SPARK-17752) Spark returns incorrect result when 'collect()'ing a cached Dataset with many columns

2016-10-03 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-17752. --- Resolution: Fixed > Spark returns incorrect result when 'collect()'ing a

[jira] [Commented] (SPARK-17752) Spark returns incorrect result when 'collect()'ing a cached Dataset with many columns

2016-10-03 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15543179#comment-15543179 ] Shivaram Venkataraman commented on SPARK-17752: --- I don't know what the plans are for 1.6.3

[jira] [Updated] (SPARK-17752) Spark returns incorrect result when 'collect()'ing a cached Dataset with many columns

2016-10-03 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-17752: -- Fix Version/s: 2.1.0 2.0.1 > Spark returns incorrect result

[jira] [Commented] (SPARK-17752) Spark returns incorrect result when 'collect()'ing a cached Dataset with many columns

2016-10-03 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15543008#comment-15543008 ] Shivaram Venkataraman commented on SPARK-17752: --- Thanks for the bug report - I can't seem

[jira] [Updated] (SPARK-17317) Add package vignette to SparkR

2016-09-13 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-17317: -- Assignee: Junyang Qian > Add package vignette to SparkR >

[jira] [Resolved] (SPARK-17317) Add package vignette to SparkR

2016-09-13 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-17317. --- Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request

[jira] [Commented] (SPARK-17428) SparkR executors/workers support virtualenv

2016-09-08 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15475943#comment-15475943 ] Shivaram Venkataraman commented on SPARK-17428: --- I think there are bunch of issues being

[jira] [Commented] (SPARK-17428) SparkR executors/workers support virtualenv

2016-09-08 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15474193#comment-15474193 ] Shivaram Venkataraman commented on SPARK-17428: --- I agree with [~sunrui] - Just to make it

[jira] [Updated] (SPARK-17200) Automate building and testing on Windows

2016-09-08 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-17200: -- Assignee: Hyukjin Kwon > Automate building and testing on Windows >

[jira] [Resolved] (SPARK-17200) Automate building and testing on Windows

2016-09-08 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-17200. --- Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request

[jira] [Resolved] (SPARK-17442) Additional arguments in write.df are not passed to data source

2016-09-08 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-17442. --- Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 Issue

[jira] [Updated] (SPARK-17442) Additional arguments in write.df are not passed to data source

2016-09-08 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-17442: -- Assignee: Felix Cheung > Additional arguments in write.df are not passed to

[jira] [Updated] (SPARK-17339) Fix SparkR tests on Windows

2016-09-07 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-17339: -- Fix Version/s: 2.0.1 > Fix SparkR tests on Windows >

[jira] [Commented] (SPARK-17442) Additional arguments in write.df are not passed to data source

2016-09-07 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15472174#comment-15472174 ] Shivaram Venkataraman commented on SPARK-17442: --- I think we missed passing the options

[jira] [Resolved] (SPARK-17420) Install rmarkdown R package on Jenkins machines

2016-09-07 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-17420. --- Resolution: Fixed > Install rmarkdown R package on Jenkins machines >

[jira] [Commented] (SPARK-17420) Install rmarkdown R package on Jenkins machines

2016-09-07 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15471330#comment-15471330 ] Shivaram Venkataraman commented on SPARK-17420: --- [~shaneknapp] The pandoc and

[jira] [Commented] (SPARK-17420) Install rmarkdown R package on Jenkins machines

2016-09-07 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15471119#comment-15471119 ] Shivaram Venkataraman commented on SPARK-17420: --- I guess the way to verify this would be to

[jira] [Reopened] (SPARK-17420) Install rmarkdown R package on Jenkins machines

2016-09-07 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman reopened SPARK-17420: --- > Install rmarkdown R package on Jenkins machines >

[jira] [Updated] (SPARK-17420) Install rmarkdown R package on Jenkins machines

2016-09-07 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-17420: -- Assignee: shane knapp > Install rmarkdown R package on Jenkins machines >

[jira] [Commented] (SPARK-17420) Install rmarkdown R package on Jenkins machines

2016-09-07 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15471103#comment-15471103 ] Shivaram Venkataraman commented on SPARK-17420: --- Thanks [~shaneknapp] - It turns out that

[jira] [Commented] (SPARK-17428) SparkR executors/workers support virtualenv

2016-09-07 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15471040#comment-15471040 ] Shivaram Venkataraman commented on SPARK-17428: --- Yeah so it should be relatively easy to

[jira] [Updated] (SPARK-16785) dapply doesn't return array or raw columns

2016-09-07 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-16785: -- Assignee: Clark Fitzgerald > dapply doesn't return array or raw columns >

[jira] [Resolved] (SPARK-16785) dapply doesn't return array or raw columns

2016-09-07 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-16785. --- Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 Issue

[jira] [Commented] (SPARK-17420) Install rmarkdown R package on Jenkins machines

2016-09-06 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15468539#comment-15468539 ] Shivaram Venkataraman commented on SPARK-17420: --- This came up in

[jira] [Created] (SPARK-17420) Install rmarkdown R package on Jenkins machines

2016-09-06 Thread Shivaram Venkataraman (JIRA)
Shivaram Venkataraman created SPARK-17420: - Summary: Install rmarkdown R package on Jenkins machines Key: SPARK-17420 URL: https://issues.apache.org/jira/browse/SPARK-17420 Project: Spark

[jira] [Resolved] (SPARK-17404) [BRANCH-1.6] Broken test: showDF in test_sparkSQL.R

2016-09-05 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-17404. --- Resolution: Fixed Assignee: Sun Rui Fix Version/s: 1.6.3

[jira] [Issue Comment Deleted] (SPARK-17404) [BRANCH-1.6] Broken test: showDF in test_sparkSQL.R

2016-09-05 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-17404: -- Comment: was deleted (was: I've kicked off

[jira] [Commented] (SPARK-17404) [BRANCH-1.6] Broken test: showDF in test_sparkSQL.R

2016-09-05 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15465927#comment-15465927 ] Shivaram Venkataraman commented on SPARK-17404: --- I've kicked off

[jira] [Commented] (SPARK-17404) [BRANCH-1.6] Broken test: showDF in test_sparkSQL.R

2016-09-05 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15465929#comment-15465929 ] Shivaram Venkataraman commented on SPARK-17404: --- I've kicked off

[jira] [Commented] (SPARK-17404) [BRANCH-1.6] Broken test: showDF in test_sparkSQL.R

2016-09-05 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15465915#comment-15465915 ] Shivaram Venkataraman commented on SPARK-17404: --- Hmm - we upgraded the version of testthat

[jira] [Commented] (SPARK-17339) Fix SparkR tests on Windows

2016-09-05 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15464244#comment-15464244 ] Shivaram Venkataraman commented on SPARK-17339: --- Thanks [~hyukjin.kwon] -- It will be great

[jira] [Commented] (SPARK-17339) Fix SparkR tests on Windows

2016-09-04 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15464154#comment-15464154 ] Shivaram Venkataraman commented on SPARK-17339: --- Specifically can we construct a Hadoop

[jira] [Commented] (SPARK-17339) Fix SparkR tests on Windows

2016-09-04 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15464144#comment-15464144 ] Shivaram Venkataraman commented on SPARK-17339: --- [~felixcheung] [~hyukjin.kwon] I looked

[jira] [Updated] (SPARK-16829) sparkR sc.setLogLevel doesn't work

2016-09-03 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-16829: -- Assignee: Miao Wang > sparkR sc.setLogLevel doesn't work >

[jira] [Resolved] (SPARK-16829) sparkR sc.setLogLevel doesn't work

2016-09-03 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-16829. --- Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request

[jira] [Updated] (SPARK-17376) Spark version should be available in R

2016-09-02 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-17376: -- Assignee: Felix Cheung > Spark version should be available in R >

[jira] [Resolved] (SPARK-17376) Spark version should be available in R

2016-09-02 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-17376. --- Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 Issue

[jira] [Updated] (SPARK-16883) SQL decimal type is not properly cast to number when collecting SparkDataFrame

2016-09-02 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-16883: -- Assignee: Miao Wang > SQL decimal type is not properly cast to number when

[jira] [Updated] (SPARK-15509) R MLlib algorithms should support input columns "features" and "label"

2016-09-02 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-15509: -- Assignee: Xin Ren > R MLlib algorithms should support input columns "features"

[jira] [Resolved] (SPARK-17241) SparkR spark.glm should have configurable regularization parameter

2016-08-31 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-17241. --- Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request

[jira] [Updated] (SPARK-17241) SparkR spark.glm should have configurable regularization parameter

2016-08-31 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-17241: -- Assignee: Xin Ren > SparkR spark.glm should have configurable regularization

[jira] [Updated] (SPARK-17349) Update testthat package on Jenkins

2016-08-31 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-17349: -- Assignee: shane knapp > Update testthat package on Jenkins >

[jira] [Commented] (SPARK-17349) Update testthat package on Jenkins

2016-08-31 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15453397#comment-15453397 ] Shivaram Venkataraman commented on SPARK-17349: --- [~shaneknapp] Could we upgrade the

[jira] [Resolved] (SPARK-17326) Tests with HiveContext in SparkR being skipped always

2016-08-31 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-17326. --- Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 Issue

[jira] [Updated] (SPARK-17326) Tests with HiveContext in SparkR being skipped always

2016-08-31 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-17326: -- Assignee: Hyukjin Kwon > Tests with HiveContext in SparkR being skipped always

[jira] [Created] (SPARK-17349) Update testthat package on Jenkins

2016-08-31 Thread Shivaram Venkataraman (JIRA)
Shivaram Venkataraman created SPARK-17349: - Summary: Update testthat package on Jenkins Key: SPARK-17349 URL: https://issues.apache.org/jira/browse/SPARK-17349 Project: Spark Issue

[jira] [Commented] (SPARK-17349) Update testthat package on Jenkins

2016-08-31 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15453349#comment-15453349 ] Shivaram Venkataraman commented on SPARK-17349: --- cc [~hyukjin.kwon] [~felixcheung] >

[jira] [Commented] (SPARK-17339) Fix SparkR tests on Windows

2016-08-31 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15453238#comment-15453238 ] Shivaram Venkataraman commented on SPARK-17339: --- Looking at the code my current guess is

[jira] [Commented] (SPARK-17339) Fix SparkR tests on Windows

2016-08-31 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15453139#comment-15453139 ] Shivaram Venkataraman commented on SPARK-17339: --- We are discussing automating Windows

[jira] [Commented] (SPARK-17339) Fix SparkR tests on Windows

2016-08-31 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15452671#comment-15452671 ] Shivaram Venkataraman commented on SPARK-17339: --- >From a cursory look, most of the errors

[jira] [Created] (SPARK-17339) Fix SparkR tests on Windows

2016-08-31 Thread Shivaram Venkataraman (JIRA)
Shivaram Venkataraman created SPARK-17339: - Summary: Fix SparkR tests on Windows Key: SPARK-17339 URL: https://issues.apache.org/jira/browse/SPARK-17339 Project: Spark Issue Type:

[jira] [Commented] (SPARK-14742) Redirect spark-ec2 doc to new location

2016-08-30 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15450632#comment-15450632 ] Shivaram Venkataraman commented on SPARK-14742: --- To follow up my guess was right - there is

[jira] [Commented] (SPARK-14742) Redirect spark-ec2 doc to new location

2016-08-30 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15450619#comment-15450619 ] Shivaram Venkataraman commented on SPARK-14742: --- Couple of things I noticed - It seems to

[jira] [Resolved] (SPARK-16581) Making JVM backend calling functions public

2016-08-29 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-16581. --- Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 Issue

[jira] [Assigned] (SPARK-16581) Making JVM backend calling functions public

2016-08-29 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman reassigned SPARK-16581: - Assignee: Shivaram Venkataraman > Making JVM backend calling functions

<    1   2   3   4   5   6   7   8   9   10   >