Re: DataSourceV2 sync notes (#4)

to be updated a default value. One can choose to do a data fix, at any point though. Happy Holidays All in advance :-) Warm Regards, Srabasti Banerjee On Tuesday, 18 December, 2018, 4:15:06 PM GMT-8, Ryan Blue wrote: Hi everyone, sorry these notes are late. I didn’t have the time to

Re: DataSourceV2 sync today

Thanks for the info Ryan :-) Will join on Hangouts! Warm Regards,Srabasti Banerjee On Wednesday, 14 November, 2018, 4:13:32 PM GMT-8, Ryan Blue wrote: Srabasti, It looks like the live stream only works within the host's domain. Everyone should just join the meet/hangout. On Wed

Re: DataSourceV2 sync today

Hi All, I am trying to view using gmail and see following message as below. Anyone getting the same error? Are there any alternate options? Any number I can dial in or Webex that I can attend? Thanks for your help in advance :-) Warm Regards,Srabasti Banerjee On Wednesday, 14 November

Re: Happy Diwali everyone!!!

Thoughtful of you to remember Xiao :-) Wish everyone a Happy & Prosperous Diwali ! ThanksSrabasti Banerjee On Wednesday, 7 November, 2018, 3:12:01 PM GMT-8, Dilip Biswal wrote: Thank you Sean. Happy Diwali !! -- Dilip - Original message - From: Xiao Li To: "u...@spark.apache.o

Re: Timestamp Difference/operations

f, or alternatively, the hour difference of. Currently I'm able to get the day difference, with rounding, by ... | | | | Looks like you can get the difference in seconds as well.Hopefully this helps!  Are you looking for a specific usecase? Can you please elaborate with an example? Thank

Re: Spark Streaming : Multiple sources found for csv : Error

Franke wrote: Can’t you remove the dependency to the databricks CSV data source? Spark has them now integrated since some versions so it is not needed. On 31. Aug 2018, at 05:52, Srabasti Banerjee wrote: Hi, I am trying to run below code to read file as a dataframe onto a Stream (for Spark

Re: Spark Streaming : Multiple sources found for csv : Error

Great we are already discussing/working to fix the issue.Happy to help if I can :-) Any workarounds that we can use for now? Please note I am not invoking any additional packages while running spark submit on the thin jar. Thanks,Srabasti Banerjee On Thursday, 30 August, 2018, 9:02:11

Spark Streaming : Multiple sources found for csv : Error

Hi, I am trying to run below code to read file as a dataframe onto a Stream (for Spark Streaming) developed via Eclipse IDE, defining schemas appropriately, by running thin jar on server and am getting error below. Tried out suggestions from researching on internet based on "spark.read.option.sc

Access multiple dictionaries inside list in Scala

Hi All, Is there a way to access multiple dictionaries with different schema structures inside a list in txt file, individually in isolation/combination as needed, from Spark shell using Scala? The need is to use information from different combinations of the dictionaries to calculate for repor

Re: welcoming Burak and Holden as committers

Congratulations Holden & Burak :-) ThanksSrabasti On Tuesday, 24 January 2017 10:51 AM, shane knapp wrote: congrats to the both of you!  :) On Tue, Jan 24, 2017 at 10:13 AM, Reynold Xin wrote: > Hi all, > > Burak and Holden have recently been elected as Apache Spark committers. > > B