Spark 2.0 is EOL. Can you try 2.3 or 2.4?
On Thu, Mar 21, 2019 at 10:23 AM asma zgolli wrote:
> Hello ,
>
> I need to cross my data and i'm executing a cross join on two dataframes .
>
> C = A.crossJoin(B)
> A has 50 records
> B has 5 records
>
> the result im getting with spark 2.0 is a datafra
quick update:
since kicking httpd on the jenkins master "fixes" the GUI hanging, i set up
a cron job to restart httpd 4 times per day.
this is not the final solution, but will definitely help over the weekend
as i'm heading out of town.
shane
On Fri, Mar 22, 2019 at 9:50 AM shane knapp wrote:
Try `val enconder = RowEncoder(df.schema).resolveAndBind()` ?
On Thu, Mar 21, 2019 at 5:39 PM Long, Andrew
wrote:
> Thanks a ton for the help!
>
>
>
> Is there a standardized way of converting the internal row to rows?
>
>
>
> I’ve tried this but im getting an exception
>
>
>
> *val *enconder =
Did you include the whole error message?
On Fri, Mar 22, 2019 at 12:45 AM 563280193 <563280...@qq.com> wrote:
> Hi ,
> I ran a spark sql like this:
>
> *select imei,tag, product_id,*
> * sum(case when succ1>=1 then 1 else 0 end) as succ,*
> * sum(case when fail1>=1 and succ1=0 then 1 else
i was right to not hold my breath... while my apache changes seem to have
helped a bit, things are still slowing down after 10-12 hours.
i have a few other things i can look at, and will get as much done as
possible before the weekend. serious troubleshooting will begin anew
monday.
apologies a
Hi All,
Seems like there is a jenkins issue again. After a PR builder unit test
failure I'm not able to open the jenkins page to take a look at the issue
(it got stuck in infinite wait).
BR,
G
Hi ,
I ran a spark sql like this:
select imei,tag, product_id,
sum(case when succ1>=1 then 1 else 0 end) as succ,
sum(case when fail1>=1 and succ1=0 then 1 else 0 end) as fail,
count(*) as cnt
from t_tbl
where sum(case when succ1>=1 then 1 else 0 end)=0
Hi ,
I ran a spark sql like this:
select imei,tag, product_id,
sum(case when succ1>=1 then 1 else 0 end) as succ,
sum(case when fail1>=1 and succ1=0 then 1 else 0 end) as fail,
count(*) as cnt
from t_tbl
where sum(case when succ1>=1 then 1 else 0 end)=0 and sum(case when
fail1>
Since we have couple concerns and hesitations to release rc8, how
about we give it couple days, and have another vote on March 25,
Monday? In this case, I will cut another rc9 in the Monday morning.
Darcy, as Dongjoon mentioned,
https://github.com/apache/spark/pull/24092 is conflict against
branch