Did you try MSCK REPAIR TABLE ?
Regards,
Vaquar Khan
On Feb 6, 2017 11:21 AM, "KhajaAsmath Mohammed" <mdkhajaasm...@gmail.com>
wrote:
> I dont think so, i was able to insert overwrite other created tables in
> hive using spark sql. The only problem I am facing is, spark is not able
> to recognize hive view name. Very strange but not sure where I am doing
> wrong in this.
>
> On Mon, Feb 6, 2017 at 11:03 AM, Jon Gregg <coble...@gmail.com> wrote:
>
>> Confirming that Spark can read newly created views - I just created a
>> test view in HDFS and I was able to query it in Spark 1.5 immediately after
>> without a refresh. Possibly an issue with your Spark-Hive connection?
>>
>> Jon
>>
>> On Sun, Feb 5, 2017 at 9:31 PM, KhajaAsmath Mohammed <
>> mdkhajaasm...@gmail.com> wrote:
>>
>>> Hi Khan,
>>>
>>> It didn't work in my case. used below code. View is already present in
>>> Hive but I cant read that in spark sql. Throwing exception that table not
>>> found
>>>
>>> sqlCtx.refreshTable("schema.hive_view")
>>>
>>>
>>> Thanks,
>>>
>>> Asmath
>>>
>>>
>>> On Sun, Feb 5, 2017 at 7:56 PM, vaquar khan <vaquar.k...@gmail.com>
>>> wrote:
>>>
>>>> Hi Ashmath,
>>>>
>>>> Try refresh table
>>>>
>>>> // spark is an existing SparkSession
>>>> spark.catalog.refreshTable("my_table")
>>>>
>>>>
>>>> http://spark.apache.org/docs/latest/sql-programming-guide.ht
>>>> ml#metadata-refreshing
>>>>
>>>>
>>>>
>>>> Regards,
>>>> Vaquar khan
>>>>
>>>>
>>>>
>>>> On Sun, Feb 5, 2017 at 7:19 PM, KhajaAsmath Mohammed <
>>>> mdkhajaasm...@gmail.com> wrote:
>>>>
>>>>> Hi,
>>>>>
>>>>> I have a hive view which is basically set of select statements on some
>>>>> tables. I want to read the hive view and use hive builtin functions
>>>>> available in spark sql.
>>>>>
>>>>> I am not able to read that hive view in spark sql but can retreive
>>>>> data in hive shell.
>>>>>
>>>>> can't spark access hive views?
>>>>>
>>>>> Thanks,
>>>>> Asmath
>>>>>
>>>>
>>>>
>>>>
>>>> --
>>>> Regards,
>>>> Vaquar Khan
>>>> +1 -224-436-0783 <(224)%20436-0783>
>>>>
>>>> IT Architect / Lead Consultant
>>>> Greater Chicago
>>>>
>>>
>>>
>>
>
