[jira] [Resolved] (SPARK-11717) Ignore R session and history files from git

[ https://issues.apache.org/jira/browse/SPARK-11717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-11717. --- Resolution: Fixed Assignee: Kai Sasaki Fix Version/s: 1.7.0

[jira] [Commented] (SPARK-11668) R style summary stats in GLM package SparkR

[ https://issues.apache.org/jira/browse/SPARK-11668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15001124#comment-15001124 ] Shivaram Venkataraman commented on SPARK-11668: --- I think this is already covered in

[jira] [Resolved] (SPARK-10863) Method coltypes() to return the R column types of a DataFrame

[ https://issues.apache.org/jira/browse/SPARK-10863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-10863. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request

[jira] [Updated] (SPARK-10863) Method coltypes() to return the R column types of a DataFrame

[ https://issues.apache.org/jira/browse/SPARK-10863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-10863: -- Assignee: Oscar D. Lara Yejas > Method coltypes() to return the R column types

[jira] [Resolved] (SPARK-11587) SparkR can not use summary.glm from base R

[ https://issues.apache.org/jira/browse/SPARK-11587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-11587. --- Resolution: Fixed Fix Version/s: 1.6.0 Resolved by

[jira] [Assigned] (SPARK-11587) SparkR can not use summary.glm from base R

[ https://issues.apache.org/jira/browse/SPARK-11587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman reassigned SPARK-11587: - Assignee: Shivaram Venkataraman > SparkR can not use summary.glm from

[jira] [Commented] (SPARK-11587) SparkR can not use summary.glm from base R

[ https://issues.apache.org/jira/browse/SPARK-11587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14997967#comment-14997967 ] Shivaram Venkataraman commented on SPARK-11587: --- [~yanboliang] Let me know if the fix works

[jira] [Updated] (SPARK-9865) Flaky SparkR test: test_sparkSQL.R: sample on a DataFrame

[ https://issues.apache.org/jira/browse/SPARK-9865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-9865: - Assignee: Felix Cheung > Flaky SparkR test: test_sparkSQL.R: sample on a

[jira] [Resolved] (SPARK-9865) Flaky SparkR test: test_sparkSQL.R: sample on a DataFrame

[ https://issues.apache.org/jira/browse/SPARK-9865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-9865. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request

[jira] [Commented] (SPARK-11587) SparkR can not use summary.glm from base R

[ https://issues.apache.org/jira/browse/SPARK-11587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14997035#comment-14997035 ] Shivaram Venkataraman commented on SPARK-11587: --- cc [~sunrui] We should fix this - We have

[jira] [Updated] (SPARK-11587) SparkR can not use summary.glm from base R

[ https://issues.apache.org/jira/browse/SPARK-11587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-11587: -- Component/s: SparkR > SparkR can not use summary.glm from base R >

[jira] [Commented] (SPARK-11339) Document the list of functions in R base package that are masked by functions with same name in SparkR

[ https://issues.apache.org/jira/browse/SPARK-11339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14997929#comment-14997929 ] Shivaram Venkataraman commented on SPARK-11339: --- Thanks [~felixcheung] -- This list looks

[jira] [Commented] (SPARK-11587) SparkR can not use summary.glm from base R

[ https://issues.apache.org/jira/browse/SPARK-11587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14997748#comment-14997748 ] Shivaram Venkataraman commented on SPARK-11587: --- I found the problem. Working on a PR >

[jira] [Updated] (SPARK-11260) Add 'with' API

[ https://issues.apache.org/jira/browse/SPARK-11260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-11260: -- Assignee: Weiqiang Zhuang > Add 'with' API > -- > >

[jira] [Resolved] (SPARK-11260) Add 'with' API

[ https://issues.apache.org/jira/browse/SPARK-11260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-11260. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request

[jira] [Updated] (SPARK-6834) Failed with error: ‘invalid package name’ Error in as.name(name) : attempt to use zero-length variable name

[ https://issues.apache.org/jira/browse/SPARK-6834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-6834: - Target Version/s: (was: 1.6.0) > Failed with error: ‘invalid package name’

[jira] [Updated] (SPARK-6837) SparkR failure in processClosure

[ https://issues.apache.org/jira/browse/SPARK-6837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-6837: - Target Version/s: (was: 1.6.0) > SparkR failure in processClosure >

[jira] [Resolved] (SPARK-11407) Add documentation on using SparkR from RStudio

[ https://issues.apache.org/jira/browse/SPARK-11407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-11407. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request

[jira] [Commented] (SPARK-11263) lintr Throws Warnings on Commented Code in Documentation

[ https://issues.apache.org/jira/browse/SPARK-11263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14988023#comment-14988023 ] Shivaram Venkataraman commented on SPARK-11263: --- I think the thing I'd like to try is to

[jira] [Updated] (SPARK-6840) SparkR: private package functions unavailable when using lapplyPartition in package

[ https://issues.apache.org/jira/browse/SPARK-6840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-6840: - Target Version/s: (was: 1.6.0) > SparkR: private package functions unavailable

[jira] [Updated] (SPARK-11407) Add documentation on using SparkR from RStudio

[ https://issues.apache.org/jira/browse/SPARK-11407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-11407: -- Assignee: Felix Cheung > Add documentation on using SparkR from RStudio >

[jira] [Resolved] (SPARK-6819) Support nested types in SparkR DataFrame

[ https://issues.apache.org/jira/browse/SPARK-6819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-6819. -- Resolution: Fixed Assignee: Sun Rui Fix Version/s: 1.6.0 >

[jira] [Updated] (SPARK-6817) DataFrame UDFs in R

[ https://issues.apache.org/jira/browse/SPARK-6817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-6817: - Target Version/s: (was: 1.6.0) > DataFrame UDFs in R > --- > >

[jira] [Updated] (SPARK-11340) Support setting driver properties when starting Spark from R programmatically or from RStudio

[ https://issues.apache.org/jira/browse/SPARK-11340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-11340: -- Assignee: Felix Cheung > Support setting driver properties when starting Spark

[jira] [Resolved] (SPARK-11340) Support setting driver properties when starting Spark from R programmatically or from RStudio

[ https://issues.apache.org/jira/browse/SPARK-11340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-11340. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request

[jira] [Commented] (SPARK-11340) Support setting driver properties when starting Spark from R programmatically or from RStudio

[ https://issues.apache.org/jira/browse/SPARK-11340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14983294#comment-14983294 ] Shivaram Venkataraman commented on SPARK-11340: --- [~felixcheung][~sunrui] It'll be great if

[jira] [Updated] (SPARK-11414) Forgot to update usage of "spark.sparkr.r.command" in RRDD in the PR for SPARK-10971

[ https://issues.apache.org/jira/browse/SPARK-11414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-11414: -- Assignee: Sun Rui > Forgot to update usage of "spark.sparkr.r.command" in RRDD

[jira] [Updated] (SPARK-11210) Add window functions into SparkR [step 2]

[ https://issues.apache.org/jira/browse/SPARK-11210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-11210: -- Assignee: Sun Rui > Add window functions into SparkR [step 2] >

[jira] [Resolved] (SPARK-11414) Forgot to update usage of "spark.sparkr.r.command" in RRDD in the PR for SPARK-10971

[ https://issues.apache.org/jira/browse/SPARK-11414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-11414. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request

[jira] [Resolved] (SPARK-11210) Add window functions into SparkR [step 2]

[ https://issues.apache.org/jira/browse/SPARK-11210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-11210. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request

[jira] [Commented] (SPARK-11407) Add documentation on using SparkR from RStudio

[ https://issues.apache.org/jira/browse/SPARK-11407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14981427#comment-14981427 ] Shivaram Venkataraman commented on SPARK-11407: --- Yeah - the two things listed above seem

[jira] [Resolved] (SPARK-11409) Enable url link in R doc for Persist

[ https://issues.apache.org/jira/browse/SPARK-11409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-11409. --- Resolution: Fixed Assignee: Felix Cheung Fix Version/s: 1.6.0

[jira] [Updated] (SPARK-11258) Converting a Spark DataFrame into an R data.frame is slow / requires a lot of memory

[ https://issues.apache.org/jira/browse/SPARK-11258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-11258: -- Assignee: Frank Rosner > Converting a Spark DataFrame into an R data.frame is

[jira] [Updated] (SPARK-10979) SparkR: Add merge to DataFrame

[ https://issues.apache.org/jira/browse/SPARK-10979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-10979: -- Assignee: Narine Kokhlikyan > SparkR: Add merge to DataFrame >

[jira] [Resolved] (SPARK-10979) SparkR: Add merge to DataFrame

[ https://issues.apache.org/jira/browse/SPARK-10979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-10979. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request

[jira] [Resolved] (SPARK-11258) Converting a Spark DataFrame into an R data.frame is slow / requires a lot of memory

[ https://issues.apache.org/jira/browse/SPARK-11258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-11258. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request

[jira] [Commented] (SPARK-11255) R Test build should run on R 3.1.1

[ https://issues.apache.org/jira/browse/SPARK-11255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14975715#comment-14975715 ] Shivaram Venkataraman commented on SPARK-11255: --- Yeah I think the point about having 3.1.1

[jira] [Resolved] (SPARK-11209) Add window functions into SparkR [step 1]

[ https://issues.apache.org/jira/browse/SPARK-11209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-11209. --- Resolution: Fixed Assignee: Sun Rui Fix Version/s: 1.6.0

[jira] [Commented] (SPARK-11283) List column gets additional level of nesting when converted to Spark DataFrame

[ https://issues.apache.org/jira/browse/SPARK-11283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14974507#comment-14974507 ] Shivaram Venkataraman commented on SPARK-11283: --- cc [~sunrui] > List column gets

[jira] [Updated] (SPARK-11294) Improve R doc for read.df, write.df, saveAsTable

[ https://issues.apache.org/jira/browse/SPARK-11294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-11294: -- Fix Version/s: (was: 1.5.2) 1.5.3 > Improve R doc for

[jira] [Commented] (SPARK-11255) R Test build should run on R 3.1.1

[ https://issues.apache.org/jira/browse/SPARK-11255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14972765#comment-14972765 ] Shivaram Venkataraman commented on SPARK-11255: --- cc [~shaneknapp] > R Test build should

[jira] [Updated] (SPARK-11294) Improve R doc for read.df, write.df, saveAsTable

[ https://issues.apache.org/jira/browse/SPARK-11294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-11294: -- Assignee: Felix Cheung > Improve R doc for read.df, write.df, saveAsTable >

[jira] [Resolved] (SPARK-11294) Improve R doc for read.df, write.df, saveAsTable

[ https://issues.apache.org/jira/browse/SPARK-11294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-11294. --- Resolution: Fixed Fix Version/s: 1.5.2 1.6.0 Issue

[jira] [Resolved] (SPARK-10971) sparkR: RRunner should allow setting path to Rscript

[ https://issues.apache.org/jira/browse/SPARK-10971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-10971. --- Resolution: Fixed Fix Version/s: 1.5.2 1.6.0 Issue

[jira] [Commented] (SPARK-10971) sparkR: RRunner should allow setting path to Rscript

[ https://issues.apache.org/jira/browse/SPARK-10971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14972377#comment-14972377 ] Shivaram Venkataraman commented on SPARK-10971: --- [~pwendell] I see a commit for cutting

[jira] [Updated] (SPARK-10971) sparkR: RRunner should allow setting path to Rscript

[ https://issues.apache.org/jira/browse/SPARK-10971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-10971: -- Assignee: Sun Rui > sparkR: RRunner should allow setting path to Rscript >

[jira] [Resolved] (SPARK-11244) sparkR.stop doesn't clean up .sparkRSQLsc in environment

[ https://issues.apache.org/jira/browse/SPARK-11244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-11244. --- Resolution: Fixed Fix Version/s: 1.5.2 1.6.0 Issue

[jira] [Updated] (SPARK-11244) sparkR.stop doesn't clean up .sparkRSQLsc in environment

[ https://issues.apache.org/jira/browse/SPARK-11244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-11244: -- Assignee: Sen Fang > sparkR.stop doesn't clean up .sparkRSQLsc in environment

[jira] [Commented] (SPARK-11231) join returns schema with duplicated and ambiguous join columns

[ https://issues.apache.org/jira/browse/SPARK-11231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14967364#comment-14967364 ] Shivaram Venkataraman commented on SPARK-11231: --- [~Narine] [~sunrui] Is this covered by

[jira] [Commented] (SPARK-11244) sparkR.stop doesn't clean up .sparkRSQLsc in environment

[ https://issues.apache.org/jira/browse/SPARK-11244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14967778#comment-14967778 ] Shivaram Venkataraman commented on SPARK-11244: --- Good catch -- Could you send a PR for this

[jira] [Commented] (SPARK-11238) SparkR: Documentation change for merge function

[ https://issues.apache.org/jira/browse/SPARK-11238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14967807#comment-14967807 ] Shivaram Venkataraman commented on SPARK-11238: --- Also on this we should mark this as a

[jira] [Commented] (SPARK-11190) SparkR support for cassandra collection types.

[ https://issues.apache.org/jira/browse/SPARK-11190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14967907#comment-14967907 ] Shivaram Venkataraman commented on SPARK-11190: --- You'll need to add the -Psparkr flag as

[jira] [Commented] (SPARK-11190) SparkR support for cassandra collection types.

[ https://issues.apache.org/jira/browse/SPARK-11190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14968085#comment-14968085 ] Shivaram Venkataraman commented on SPARK-11190: --- Environments can be used like a hash map

[jira] [Commented] (SPARK-11190) SparkR support for cassandra collection types.

[ https://issues.apache.org/jira/browse/SPARK-11190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14968031#comment-14968031 ] Shivaram Venkataraman commented on SPARK-11190: --- We do convert maps in Scala to

[jira] [Commented] (SPARK-11190) SparkR support for cassandra collection types.

[ https://issues.apache.org/jira/browse/SPARK-11190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14965327#comment-14965327 ] Shivaram Venkataraman commented on SPARK-11190: --- The changes I mentioned are not in 1.5.2.

[jira] [Resolved] (SPARK-11221) Fix R doc for DataFrame function `lit`

[ https://issues.apache.org/jira/browse/SPARK-11221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-11221. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request

[jira] [Updated] (SPARK-11221) Fix R doc for DataFrame function `lit`

[ https://issues.apache.org/jira/browse/SPARK-11221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-11221: -- Assignee: Felix Cheung > Fix R doc for DataFrame function `lit` >

[jira] [Commented] (SPARK-11190) SparkR support for cassandra collection types.

[ https://issues.apache.org/jira/browse/SPARK-11190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14964032#comment-14964032 ] Shivaram Venkataraman commented on SPARK-11190: --- cc [~sunrui] Could you try this on the

[jira] [Updated] (SPARK-10981) R semijoin leads to Java errors, R leftsemi leads to Spark errors

[ https://issues.apache.org/jira/browse/SPARK-10981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-10981: -- Assignee: Monica Liu > R semijoin leads to Java errors, R leftsemi leads to

[jira] [Resolved] (SPARK-10981) R semijoin leads to Java errors, R leftsemi leads to Spark errors

[ https://issues.apache.org/jira/browse/SPARK-10981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-10981. --- Resolution: Fixed Fix Version/s: 1.6.0 1.5.2

[jira] [Resolved] (SPARK-10996) Implement sampleBy() in DataFrameStatFunctions

[ https://issues.apache.org/jira/browse/SPARK-10996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-10996. --- Resolution: Fixed Assignee: Sun Rui Fix Version/s: 1.6.0

[jira] [Updated] (SPARK-10913) Add attach() function for DataFrame

[ https://issues.apache.org/jira/browse/SPARK-10913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-10913: -- Assignee: Weiqiang Zhuang > Add attach() function for DataFrame >

[jira] [Resolved] (SPARK-10888) Add as.DataFrame as a synonym for createDataFrame

[ https://issues.apache.org/jira/browse/SPARK-10888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-10888. --- Resolution: Fixed Assignee: Narine Kokhlikyan Fix Version/s:

[jira] [Resolved] (SPARK-10913) Add attach() function for DataFrame

[ https://issues.apache.org/jira/browse/SPARK-10913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-10913. --- Resolution: Fixed Fix Version/s: 1.6.0 Resolved by

[jira] [Commented] (SPARK-11086) createDataFrame should dropFactor column-wise not cell-wise

[ https://issues.apache.org/jira/browse/SPARK-11086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14955336#comment-14955336 ] Shivaram Venkataraman commented on SPARK-11086: --- This is a great suggestion. Could you open

[jira] [Commented] (SPARK-2563) Re-open sockets to handle connect timeouts

[ https://issues.apache.org/jira/browse/SPARK-2563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14955269#comment-14955269 ] Shivaram Venkataraman commented on SPARK-2563: -- This bug was for the old NIO code. For 1.4.0

[jira] [Resolved] (SPARK-10051) Support collecting data of StructType in DataFrame

[ https://issues.apache.org/jira/browse/SPARK-10051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-10051. --- Resolution: Fixed Assignee: Sun Rui Fix Version/s: 1.6.0

[jira] [Commented] (SPARK-10683) Source code missing for SparkR test JAR

[ https://issues.apache.org/jira/browse/SPARK-10683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14952360#comment-14952360 ] Shivaram Venkataraman commented on SPARK-10683: --- Yeah - the JAR has no impact on Spark

[jira] [Updated] (SPARK-10683) Source code missing for SparkR test JAR

[ https://issues.apache.org/jira/browse/SPARK-10683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-10683: -- Component/s: SparkR > Source code missing for SparkR test JAR >

[jira] [Commented] (SPARK-11057) SparkSQL: corr and cov for many columns

[ https://issues.apache.org/jira/browse/SPARK-11057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14952432#comment-14952432 ] Shivaram Venkataraman commented on SPARK-11057: --- [~Narine] Does this feature exist in Scala

[jira] [Resolved] (SPARK-10079) Make `column` and `col` functions be S4 functions

[ https://issues.apache.org/jira/browse/SPARK-10079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-10079. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request

[jira] [Updated] (SPARK-10079) Make `column` and `col` functions be S4 functions

[ https://issues.apache.org/jira/browse/SPARK-10079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-10079: -- Assignee: Sun Rui > Make `column` and `col` functions be S4 functions >

[jira] [Resolved] (SPARK-10905) Export freqItems() for DataFrameStatFunctions in SparkR

[ https://issues.apache.org/jira/browse/SPARK-10905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-10905. --- Resolution: Fixed Assignee: rerngvit yanggratoke Fix

[jira] [Resolved] (SPARK-10836) SparkR: Add sort function to dataframe

[ https://issues.apache.org/jira/browse/SPARK-10836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-10836. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request

[jira] [Updated] (SPARK-10836) SparkR: Add sort function to dataframe

[ https://issues.apache.org/jira/browse/SPARK-10836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-10836: -- Assignee: Narine Kokhlikyan > SparkR: Add sort function to dataframe >

[jira] [Commented] (SPARK-9443) Expose sampleByKey in SparkR

[ https://issues.apache.org/jira/browse/SPARK-9443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14945816#comment-14945816 ] Shivaram Venkataraman commented on SPARK-9443: -- Yes. I think so > Expose sampleByKey in

[jira] [Commented] (SPARK-9318) Add `merge` as synonym for join

[ https://issues.apache.org/jira/browse/SPARK-9318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14945402#comment-14945402 ] Shivaram Venkataraman commented on SPARK-9318: -- [~Narine] Could you post general questions /

[jira] [Resolved] (SPARK-10904) select(df, c("col1", "col2")) fails

[ https://issues.apache.org/jira/browse/SPARK-10904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-10904. --- Resolution: Fixed Fix Version/s: 1.5.2 1.6.0 Issue

[jira] [Updated] (SPARK-10904) select(df, c("col1", "col2")) fails

[ https://issues.apache.org/jira/browse/SPARK-10904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-10904: -- Assignee: Felix Cheung > select(df, c("col1", "col2")) fails >

[jira] [Commented] (SPARK-10903) Make sqlContext global

[ https://issues.apache.org/jira/browse/SPARK-10903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14941353#comment-14941353 ] Shivaram Venkataraman commented on SPARK-10903: --- I'd say lets have one common function to

[jira] [Commented] (SPARK-10913) Add attach() function for DataFrame

[ https://issues.apache.org/jira/browse/SPARK-10913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14941427#comment-14941427 ] Shivaram Venkataraman commented on SPARK-10913: --- Can this also address SPARK-7499 or are

[jira] [Commented] (SPARK-10894) Add 'drop' support for DataFrame's subset function

[ https://issues.apache.org/jira/browse/SPARK-10894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14940037#comment-14940037 ] Shivaram Venkataraman commented on SPARK-10894: --- I'm not sure this is a very useful feature

[jira] [Commented] (SPARK-10904) select(df, c("col1", "col2")) fails

[ https://issues.apache.org/jira/browse/SPARK-10904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14940310#comment-14940310 ] Shivaram Venkataraman commented on SPARK-10904: --- I don't think we support passing in `c`

[jira] [Commented] (SPARK-10903) Make sqlContext global

[ https://issues.apache.org/jira/browse/SPARK-10903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14940432#comment-14940432 ] Shivaram Venkataraman commented on SPARK-10903: --- Yeah this sounds like a good idea as we

[jira] [Commented] (SPARK-10894) Add 'drop' support for DataFrame's subset function

[ https://issues.apache.org/jira/browse/SPARK-10894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14940442#comment-14940442 ] Shivaram Venkataraman commented on SPARK-10894: --- Yes, as [~felixcheung] said this is by

[jira] [Resolved] (SPARK-10807) Add as.data.frame() as a synonym for collect()

[ https://issues.apache.org/jira/browse/SPARK-10807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-10807. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request

[jira] [Updated] (SPARK-10807) Add as.data.frame() as a synonym for collect()

[ https://issues.apache.org/jira/browse/SPARK-10807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-10807: -- Assignee: Oscar D. Lara Yejas > Add as.data.frame() as a synonym for collect()

[jira] [Commented] (SPARK-10844) SparkR: Add correlation function to dataframe

[ https://issues.apache.org/jira/browse/SPARK-10844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14933602#comment-14933602 ] Shivaram Venkataraman commented on SPARK-10844: --- [~Narine] We already have a JIRA and PR

[jira] [Resolved] (SPARK-10844) SparkR: Add correlation function to dataframe

[ https://issues.apache.org/jira/browse/SPARK-10844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-10844. --- Resolution: Duplicate > SparkR: Add correlation function to dataframe >

[jira] [Commented] (SPARK-10851) Exception not failing R applications (in yarn cluster mode)

[ https://issues.apache.org/jira/browse/SPARK-10851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14933484#comment-14933484 ] Shivaram Venkataraman commented on SPARK-10851: --- cc [~sunrui] > Exception not failing R

[jira] [Commented] (SPARK-9466) Flaky test: org.apache.spark.sql.hive.thriftserver.CliSuite

[ https://issues.apache.org/jira/browse/SPARK-9466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14934152#comment-14934152 ] Shivaram Venkataraman commented on SPARK-9466: -- I ran into this again today with what looks

[jira] [Commented] (SPARK-10863) Method coltypes() to return the R column types of a DataFrame

[ https://issues.apache.org/jira/browse/SPARK-10863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14934302#comment-14934302 ] Shivaram Venkataraman commented on SPARK-10863: --- This seems like it is covered in

[jira] [Comment Edited] (SPARK-9318) Add `merge` as synonym for join

[ https://issues.apache.org/jira/browse/SPARK-9318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14934376#comment-14934376 ] Shivaram Venkataraman edited comment on SPARK-9318 at 9/29/15 2:04 AM:

[jira] [Commented] (SPARK-9318) Add `merge` as synonym for join

[ https://issues.apache.org/jira/browse/SPARK-9318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14934484#comment-14934484 ] Shivaram Venkataraman commented on SPARK-9318: -- Sure. Feel free to send a PR and cc [~falaki]

[jira] [Commented] (SPARK-10824) DataFrame show method - show(df) should show first N number of rows, similar to R

[ https://issues.apache.org/jira/browse/SPARK-10824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14908380#comment-14908380 ] Shivaram Venkataraman commented on SPARK-10824: --- [~Narine] We discussed this in

[jira] [Resolved] (SPARK-10760) SparkR glm: the documentation in examples - family argument is missing

[ https://issues.apache.org/jira/browse/SPARK-10760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-10760. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request

[jira] [Updated] (SPARK-10760) SparkR glm: the documentation in examples - family argument is missing

[ https://issues.apache.org/jira/browse/SPARK-10760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-10760: -- Assignee: Narine Kokhlikyan > SparkR glm: the documentation in examples -

[jira] [Commented] (SPARK-7736) Exception not failing Python applications (in yarn cluster mode)

[ https://issues.apache.org/jira/browse/SPARK-7736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14908389#comment-14908389 ] Shivaram Venkataraman commented on SPARK-7736: -- [~ztoth] Could you open a new JIRA for the

[jira] [Commented] (SPARK-10828) Can we use the accumulo data RDD created from JAVA in spark, in sparkR?Is there any other way to proceed with it to create RRDD from a source RDD other than text RDD?O

[ https://issues.apache.org/jira/browse/SPARK-10828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14908399#comment-14908399 ] Shivaram Venkataraman commented on SPARK-10828: --- I don't think we want to support new ways

[jira] [Updated] (SPARK-9710) RPackageUtilsSuite fails if R is not installed

[ https://issues.apache.org/jira/browse/SPARK-9710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-9710: - Fix Version/s: (was: 1.5.0) 1.5.1 > RPackageUtilsSuite

<    2   3   4   5   6   7   8   9   10   11   >