Re: Time to cut an Apache 2.4.1 release?

not be >> > back-ported to 2.4.x.SPARK-26154 does look like a bug whose fix could >> > be back-ported, but that's a big change. I wouldn't hold up 2.4.1 for >> > it, but it could go in if otherwise ready. >> > >> > >> > On Mon, Feb 11, 2019 at

Re: Time to cut an Apache 2.4.1 release?

>> Let me know if you have any concern or any PR you would like to get in. >> >> Thanks! >> >> --------- >> To unsubscribe e-mail: dev-unsubscr...@spark.apache.org >> >> -- *Dongjin Lee* *A hitchhiker in the mathematical world.* *github: <http://goog_969573159/&g

Re: Ask for reviewing on Structured Streaming PRs

o be reviewed, too. > > Thanks in advance, > Jungtaek Lim (HeartSaVioR) > > 1. > https://github.com/apache/spark/pulls?utf8=%E2%9C%93=is%3Aopen+is%3Apr+author%3AHeartSaVioR+%5BSS%5D > 2. > https://github.com/apache/spark/pulls?utf8=%E2%9C%93=is%3Aopen+is%3Apr+%5BSS

Re: welcome a new batch of committers

gt; >>> >>> >>> >>> >>> -- >>> Sent from: http://apache-spark-developers-list.1001551.n3.nabble.com/ >>> >>> - >>> To unsubscribe e-mail: dev-unsubscr...@s

Re: from_csv

riginal dataset by positions is expensive and not convenient. Instead >>>> users parse CSV columns by string functions. The approach is usually error >>>> prone especially for quoted values and other special cases. >>>> >>>> The proposed in the PR methods

Re: MatrixUDT and VectorUDT in Spark ML

courrier ou de > toute pièce jointe est interdite. Si vous avez reçu cette communication par > erreur, veuillez nous en aviser par courrier et détruire immédiatement le > courrier et les pièces jointes. Merci. > -- > > -- *Dongjin Lee* *A hitchhiker in the mathematical worl

Missing config property in documentation

://github.com/apache/spark/blob/master/core/src/main/scala/org/apache/spark/scheduler/TaskResultGetter.scala -- *Dongjin Lee* *A hitchhiker in the mathematical world.facebook: www.facebook.com/dongjin.lee.kr <http://www.facebook.com/dongjin.lee.kr>linkedin: kr.linkedin.com/in/dongjinleekr

Re: Issues: Generate JSON with null values in Spark 2.0.x

, 2017 at 4:44 PM, Chetan Khatri <chetan.opensou...@gmail.com> wrote: > Exactly. > > On Sat, Mar 11, 2017 at 1:35 PM, Dongjin Lee <dong...@apache.org> wrote: > >> Hello Chetan, >> >> Could you post some code? If I understood correctly, you are trying to &

Re: Spark Local Pipelines

g on Spark at all. >> >> I've written up a doc >> <https://docs.google.com/document/d/1Ha4DRMio5A7LjPqiHUnwVzbaxbev6ys04myyz6nDgI4/edit?usp=sharing> >> detailing the approach, and I'm happy to discuss alternatives. If this >> gains traction, I can create a branch with

Re: Issues: Generate JSON with null values in Spark 2.0.x

to SparkSQL[Row] but in scala how can > we generate json will null values as a Dataframe ? > > Thanks. > -- *Dongjin Lee* *Software developer in Line+.So interested in massive-scale machine learning.facebook: www.facebook.com/dongjin.lee.kr <http://www.facebook.com/dongjin.lee.kr&

Re: GraphX-related "open" issues

to the spark > packages https://spark-packages.org/)? ISTM graphx has already necessary > and sufficient APIs for these third-party ones. > > On Thu, Jan 19, 2017 at 12:21 PM, Dongjin Lee <dong...@apache.org> wrote: > >> Hi all, >> >> I am currently workin

Re: GraphX-related "open" issues

s okay to close tickets about "Improvement" and "New >> Feature" for now. >> >> I'm just wondering about what kind of field value you want to fill in the >> `Resolution` field for those issues. >> >> Maybe, 'Later'? Or, 'Won't Fix'? >> &g