Spark 2.0 is EOL. Can you try 2.3 or 2.4?
On Thu, Mar 21, 2019 at 10:23 AM asma zgolli wrote:
> Hello ,
>
> I need to cross my data and i'm executing a cross join on two dataframes .
>
> C = A.crossJoin(B)
> A has 50 records
> B has 5 records
>
> the result im getting with spark 2.0 is a
quick update:
since kicking httpd on the jenkins master "fixes" the GUI hanging, i set up
a cron job to restart httpd 4 times per day.
this is not the final solution, but will definitely help over the weekend
as i'm heading out of town.
shane
On Fri, Mar 22, 2019 at 9:50 AM shane knapp wrote:
Try `val enconder = RowEncoder(df.schema).resolveAndBind()` ?
On Thu, Mar 21, 2019 at 5:39 PM Long, Andrew
wrote:
> Thanks a ton for the help!
>
>
>
> Is there a standardized way of converting the internal row to rows?
>
>
>
> I’ve tried this but im getting an exception
>
>
>
> *val *enconder =
Did you include the whole error message?
On Fri, Mar 22, 2019 at 12:45 AM 563280193 <563280...@qq.com> wrote:
> Hi ,
> I ran a spark sql like this:
>
> *select imei,tag, product_id,*
> * sum(case when succ1>=1 then 1 else 0 end) as succ,*
> * sum(case when fail1>=1 and succ1=0 then 1
i was right to not hold my breath... while my apache changes seem to have
helped a bit, things are still slowing down after 10-12 hours.
i have a few other things i can look at, and will get as much done as
possible before the weekend. serious troubleshooting will begin anew
monday.
apologies
Hi All,
Seems like there is a jenkins issue again. After a PR builder unit test
failure I'm not able to open the jenkins page to take a look at the issue
(it got stuck in infinite wait).
BR,
G
Hi ,
I ran a spark sql like this:
select imei,tag, product_id,
sum(case when succ1>=1 then 1 else 0 end) as succ,
sum(case when fail1>=1 and succ1=0 then 1 else 0 end) as fail,
count(*) as cnt
from t_tbl
where sum(case when succ1>=1 then 1 else 0 end)=0
Hi ,
I ran a spark sql like this:
select imei,tag, product_id,
sum(case when succ1>=1 then 1 else 0 end) as succ,
sum(case when fail1>=1 and succ1=0 then 1 else 0 end) as fail,
count(*) as cnt
from t_tbl
where sum(case when succ1>=1 then 1 else 0 end)=0 and sum(case when
Since we have couple concerns and hesitations to release rc8, how
about we give it couple days, and have another vote on March 25,
Monday? In this case, I will cut another rc9 in the Monday morning.
Darcy, as Dongjoon mentioned,
https://github.com/apache/spark/pull/24092 is conflict against
