Hi Farhan,
Thank you for your response, I am using databricks with 11.3x-scala2.12.

Here I am overwriting all the tables in the same database in concurrent
thread,  But when I do in the iterative manner it is working fine,
For Example, i am having 200 tables in same database, i am overwriting the
tables in a concurrent manner, are this is the issue(so we have any
constraint for it)

For this kind of run time how we can usually identify the root cause of
it?????


On Thu, May 11, 2023 at 9:37 PM Farhan Misarwala <farhan.misarw...@gmail.com>
wrote:

> Hi Karthick,
>
> I think I have seen this before and this probably could be because of an
> incompatibility between your spark and delta versions.
>
> Or an incompatibility between the delta version you are using now vs the
> one you used earlier on the existing table you are merging with.
>
> Let me know if this is the case.
>
> Thanks,
> Farhan.
>
> On Thu, May 11, 2023 at 2:54 PM Jacek Laskowski <ja...@japila.pl> wrote:
>
>> Hi Karthick,
>>
>> Sorry to say it but there's not enough "data" to help you. There should
>> be something more above or below this exception snippet you posted that
>> could pinpoint the root cause.
>>
>> Pozdrawiam,
>> Jacek Laskowski
>> ----
>> "The Internals Of" Online Books <https://books.japila.pl/>
>> Follow me on https://twitter.com/jaceklaskowski
>>
>> <https://twitter.com/jaceklaskowski>
>>
>>
>> On Wed, May 10, 2023 at 8:03 PM Karthick Nk <kcekarth...@gmail.com>
>> wrote:
>>
>>> Hi,
>>>
>>> I am trying to merge daaframe with delta table in databricks, but i am
>>> getting error, i have attached the code nippet and error message for
>>> reference below,
>>>
>>> code:
>>> [image: image.png]
>>>
>>> error:
>>>
>>> [image: image.png]
>>>
>>> Thanks
>>>
>>

Reply via email to