Allen: Since you mentioned scheduling, I assume you were talking about node label support in YARN. If that is the case, can you give us some more information: How node labels are setup in YARN cluster How you specified node labels in application Hadoop and Spark releases you are using
Cheers > On Dec 16, 2015, at 1:00 AM, Chang Ya-Hsuan <sumti...@gmail.com> wrote: > > are you trying to do dataframe boolean expression? > please use '&' for 'and', '|' for 'or', '~' for 'not' when building DataFrame > boolean expressions. > > example: > > >>> df = sqlContext.range(10) > >>> df.where( (df.id==1) | ~(df.id==1)) > DataFrame[id: bigint] > > >> On Wed, Dec 16, 2015 at 4:32 PM, Allen Zhang <allenzhang...@126.com> wrote: >> Hi All, >> >> does spark label expression really support "&&" or "||" or even "!" for >> label based schedulering? >> I tried that but it does NOT work. >> >> Best Regards, >> Allen > > > > -- > -- 張雅軒
