[jira] [Commented] (SPARK-10903) Make sqlContext global

2015-10-19 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14964672#comment-14964672 ] Sun Rui commented on SPARK-10903: - I figured out the reason. You have to export the S3 me

[jira] [Commented] (SPARK-10903) Make sqlContext global

2015-10-19 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14964642#comment-14964642 ] Felix Cheung commented on SPARK-10903: -- Working from SparkR package version in this

[jira] [Commented] (SPARK-10903) Make sqlContext global

2015-10-19 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14964574#comment-14964574 ] Sun Rui commented on SPARK-10903: - Yes, I did the experiment by typing code in the shell.

[jira] [Commented] (SPARK-10903) Make sqlContext global

2015-10-19 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14964570#comment-14964570 ] Felix Cheung commented on SPARK-10903: -- Something to do with the namespace {code} >

[jira] [Commented] (SPARK-10903) Make sqlContext global

2015-10-19 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14964552#comment-14964552 ] Sun Rui commented on SPARK-10903: - I don't know what's the difference:) > Make sqlContex

[jira] [Commented] (SPARK-10903) Make sqlContext global

2015-10-19 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14964551#comment-14964551 ] Felix Cheung commented on SPARK-10903: -- And when revert the code in SparkR package i

[jira] [Commented] (SPARK-10903) Make sqlContext global

2015-10-19 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14964543#comment-14964543 ] Felix Cheung commented on SPARK-10903: -- It says 'no methods found'. btw, I think I k

[jira] [Commented] (SPARK-10903) Make sqlContext global

2015-10-19 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14964539#comment-14964539 ] Sun Rui commented on SPARK-10903: - Could you dump the following output? methods("createDa

[jira] [Commented] (SPARK-10903) Make sqlContext global

2015-10-19 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14964531#comment-14964531 ] Felix Cheung commented on SPARK-10903: -- That's puzzling. Any tips on how to debug th

[jira] [Commented] (SPARK-10903) Make sqlContext global

2015-10-19 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14964525#comment-14964525 ] Sun Rui commented on SPARK-10903: - That's strange. It worked on my machine. > createDataF

[jira] [Commented] (SPARK-10903) Make sqlContext global

2015-10-19 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14964507#comment-14964507 ] Felix Cheung commented on SPARK-10903: -- Same with this {code} createDataFrame <- fun

[jira] [Commented] (SPARK-10903) Make sqlContext global

2015-10-19 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14964504#comment-14964504 ] Felix Cheung commented on SPARK-10903: -- I was sure I tried that but double-checking

[jira] [Commented] (SPARK-10903) Make sqlContext global

2015-10-19 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14964494#comment-14964494 ] Sun Rui commented on SPARK-10903: - [~felixcheung], I did some experiment and found that S

[jira] [Commented] (SPARK-10903) Make sqlContext global

2015-10-19 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14964333#comment-14964333 ] Felix Cheung commented on SPARK-10903: -- Created SPARK-11199 to track context initial

[jira] [Commented] (SPARK-10903) Make sqlContext global

2015-10-19 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14964326#comment-14964326 ] Felix Cheung commented on SPARK-10903: -- Looked into and tested with a few approaches

[jira] [Commented] (SPARK-10903) Make sqlContext global

2015-10-08 Thread Hossein Falaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14949657#comment-14949657 ] Hossein Falaki commented on SPARK-10903: I meant the SQL Context: https://github

[jira] [Commented] (SPARK-10903) Make sqlContext global

2015-10-08 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14949654#comment-14949654 ] Felix Cheung commented on SPARK-10903: -- +1 perhaps sparkR.init() should create sqlCo

[jira] [Commented] (SPARK-10903) Make sqlContext global

2015-10-08 Thread Hossein Falaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14949293#comment-14949293 ] Hossein Falaki commented on SPARK-10903: +1 We have seen a lot of questions from

[jira] [Commented] (SPARK-10903) Make sqlContext global

2015-10-08 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14949185#comment-14949185 ] Felix Cheung commented on SPARK-10903: -- [~sunrui] Agreed. I'd like to propose adding

[jira] [Commented] (SPARK-10903) Make sqlContext global

2015-10-08 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14948268#comment-14948268 ] Sun Rui commented on SPARK-10903: - There are a number of functions defined in SQLContext.

[jira] [Commented] (SPARK-10903) Make sqlContext global

2015-10-02 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941353#comment-14941353 ] Shivaram Venkataraman commented on SPARK-10903: --- I'd say lets have one comm

[jira] [Commented] (SPARK-10903) Make sqlContext global

2015-10-01 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14940694#comment-14940694 ] Felix Cheung commented on SPARK-10903: -- toDF is doing checks in preference order btw

[jira] [Commented] (SPARK-10903) Make sqlContext global

2015-10-01 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14940508#comment-14940508 ] Davies Liu commented on SPARK-10903: LGTM. Another question is that can we have diffe

[jira] [Commented] (SPARK-10903) Make sqlContext global

2015-10-01 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14940432#comment-14940432 ] Shivaram Venkataraman commented on SPARK-10903: --- Yeah this sounds like a go

[jira] [Commented] (SPARK-10903) Make sqlContext global

2015-10-01 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14940231#comment-14940231 ] Felix Cheung commented on SPARK-10903: -- [~shivaram]what do you think? If ok I would

[jira] [Commented] (SPARK-10903) Make sqlContext global

2015-10-01 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14940229#comment-14940229 ] Felix Cheung commented on SPARK-10903: -- +1 could/should we have a version of this th