Confirming that Spark can read newly created views - I just created a test
view in HDFS and I was able to query it in Spark 1.5 immediately after
without a refresh. Possibly an issue with your Spark-Hive connection?
Jon
On Sun, Feb 5, 2017 at 9:31 PM, KhajaAsmath Mohammed <
mdkhajaasm...@gmail.com> wrote:
> Hi Khan,
>
> It didn't work in my case. used below code. View is already present in
> Hive but I cant read that in spark sql. Throwing exception that table not
> found
>
> sqlCtx.refreshTable("schema.hive_view")
>
>
> Thanks,
>
> Asmath
>
>
> On Sun, Feb 5, 2017 at 7:56 PM, vaquar khan <vaquar.k...@gmail.com> wrote:
>
>> Hi Ashmath,
>>
>> Try refresh table
>>
>> // spark is an existing SparkSession
>> spark.catalog.refreshTable("my_table")
>>
>>
>> http://spark.apache.org/docs/latest/sql-programming-guide.ht
>> ml#metadata-refreshing
>>
>>
>>
>> Regards,
>> Vaquar khan
>>
>>
>>
>> On Sun, Feb 5, 2017 at 7:19 PM, KhajaAsmath Mohammed <
>> mdkhajaasm...@gmail.com> wrote:
>>
>>> Hi,
>>>
>>> I have a hive view which is basically set of select statements on some
>>> tables. I want to read the hive view and use hive builtin functions
>>> available in spark sql.
>>>
>>> I am not able to read that hive view in spark sql but can retreive data
>>> in hive shell.
>>>
>>> can't spark access hive views?
>>>
>>> Thanks,
>>> Asmath
>>>
>>
>>
>>
>> --
>> Regards,
>> Vaquar Khan
>> +1 -224-436-0783 <(224)%20436-0783>
>>
>> IT Architect / Lead Consultant
>> Greater Chicago
>>
>
>
