[VOTE][RESULT] Spark 2.2.3 (RC1)

2019-01-11 Thread Dongjoon Hyun
Hi, All.

The vote passes. Thanks to all who helped with this release 2.2.3 (the
final 2.2.x)!
I'll follow up later with a release announcement once everything is
published.

+1 (* = binding):

DB Tsai*
Wenchen Fan*
Dongjoon Hyun
Denny Lee
Sean Owen*
Hyukjin Kwon
John Zhuge

+0: None

-1: None

Bests,
Dongjoon.


Re: Reading as Parquet a directory created by Spark Structured Streaming - problems

2019-01-11 Thread Phillip Henry
Hi, Denis.

It should be a String. Even if it looks like a number when you do hadoop fs
-ls ..., it's a String representation of a date/time.

Phillip

On Thu, Jan 10, 2019 at 2:00 PM ddebarbieux  wrote:

> cala> spark.read.schema(StructType(Seq(StructField("_1",StringType,false),
> StructField("_2",StringType,true.parque ("hdfs://---/MY_DIRECTORY/
> *_1=201812030900*").show()
> +++
> |  _1|  _2|
> +++
> |null|ba1ca2dc033440125...|
> |null|ba1ca2dc033440125...|
> |null|ba1ca2dc033440125...|
>
>
> Is the column '_1' a String or a Number?
>
> Denis
>
>