[ https://issues.apache.org/jira/browse/SPARK-2973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14572047#comment-14572047 ]
Yin Huai commented on SPARK-2973: --------------------------------- Also, {{sqlContext.tables().select(...).collect}} triggers a job (the reason is explained above https://issues.apache.org/jira/browse/SPARK-2973?focusedCommentId=14326247&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-14326247). > Use LocalRelation for all ExecutedCommands, avoid job for take/collect() > ------------------------------------------------------------------------ > > Key: SPARK-2973 > URL: https://issues.apache.org/jira/browse/SPARK-2973 > Project: Spark > Issue Type: Improvement > Components: SQL > Reporter: Aaron Davidson > Assignee: Cheng Lian > Priority: Critical > > Right now, sql("show tables").collect() will start a Spark job which shows up > in the UI. There should be a way to get these without this step. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org