Manohar
subject to change or not reliable from a user point of view. ?
If not reliable , is there another way by which I can
logically/programatically
identify that a column such as R_sum(CAST(`integer_type_col` AS
BIGINT))
corresponds to the input pivot value "R" and aggregation function of
sum(`integer_type_col`)
Thanks
Manohar
d(message,StructType(StructField(event,StringType,true),
StructField(timestamp,TimestampType,true)),true))
parsed: org.apache.spark.sql.Dataset[org.apache.spark.sql.Row] = [message:
struct, ts: timestamp]
```
That said, I think the example with the JOIN helps put *why* it's important
for the windowing to happen afterwards in picture. Anyways, is there
another way to accurately express this query? Thanks in advance.
--
Best regards,
Tejas Manohar
understanding right?
Manohar
From: Steve Loughran [mailto:ste...@hortonworks.com]
Sent: Thursday, January 5, 2017 11:05 PM
To: Manohar Reddy
Cc: user@spark.apache.org
Subject: Re: Spark Read from Google store and save in AWS s3
On 5 Jan 2017, at 09:58, Manohar753
<manohar.re...@happiestminds.
Yaa got it
Thanks Akhil.
From: Akhil Das [mailto:ak...@sigmoidanalytics.com]
Sent: Tuesday, July 28, 2015 2:47 PM
To: Manohar Reddy
Cc: user@spark.apache.org
Subject: Re: java.lang.ArrayIndexOutOfBoundsException: 0 on Yarn Client
That happens when you batch duration is less than your processing
...@sigmoidanalytics.com]
Sent: Tuesday, July 28, 2015 1:52 PM
To: Manohar Reddy
Cc: user@spark.apache.org
Subject: Re: java.lang.ArrayIndexOutOfBoundsException: 0 on Yarn Client
Put a try catch inside your code and inside the catch print out the length or
the list itself which causes
)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
From: Akhil Das [mailto:ak...@sigmoidanalytics.com]
Sent: Tuesday, July 28, 2015 2:30 PM
To: Manohar Reddy
Cc: user@spark.apache.org
Subject: Re: java.lang.ArrayIndexOutOfBoundsException: 0 on Yarn Client
Hi,
what are the options in DataFrame/JdbcRdd save/saveAsTable api.
is there any options to override/update a particular column in the table
instead of whole table overriding based on some ID colum.
SaveMode append is there but it wont help us to update the record,it will
append/add new row to
