[
https://issues.apache.org/jira/browse/TOREE-411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16045657#comment-16045657
]
Ryan Blue commented on TOREE-411:
---------------------------------
The solution to this problem that we use is to set the catalog implementation
to "hive", as suggested by Xin, in our Spark defaults.
Also, TOREE-390 was just committed, which changes the Spark session so that it
is lazily created when you reference {{spark}} or picks up an existing context.
That means you can either use the default session or create your own and call
{{enableHiveSupport}}, among other configuration options. This should address
the problem without needing to set the catalog implementation outside of Toree.
> Hive tables are not visible from Toree
> --------------------------------------
>
> Key: TOREE-411
> URL: https://issues.apache.org/jira/browse/TOREE-411
> Project: TOREE
> Issue Type: Bug
> Components: Kernel
> Environment: hadoop-2.7.3 Spark 2.1.0 Hive 2.1
> Reporter: Alex Adria Cuadripani
> Labels: hadoop, hive, spark
> Fix For: 0.2.0
>
>
> I am trying to work with Hive tables but is impossible to see it with toree.
> I do:
> from pyspark.sql import SparkSession
> spark =
> SparkSession.builder.master("spark://spark-master-01:7077").enableHiveSupport().getOrCreate()
> spark.sql("show tables").show()
> It works perfectly in pyspark kernel (ipykernel), but in toree kernel it
> returns an empty list.
> I have seen issue 353, but I don't know if it is the same issue, or what I
> have to do exactly.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
