-1 (non-binding) The problem of compatibility with Spark 2.4 in reading/writing dates/timestamps hasn't been solved completely so far. In particular, the sub-task https://issues.apache.org/jira/browse/SPARK-31328 hasn't resolved yet.
Maxim Gekk Software Engineer Databricks, Inc. On Wed, Apr 1, 2020 at 7:09 PM Ryan Blue <rb...@netflix.com.invalid> wrote: > -1 (non-binding) > > I agree with Jungtaek. The change to create datasource tables instead of > Hive tables by default (no USING or STORED AS clauses) has created > confusing behavior and should either be rolled back or fixed before 3.0. > > On Wed, Apr 1, 2020 at 5:12 AM Sean Owen <sro...@gmail.com> wrote: > >> Those are not per se release blockers. They are (perhaps important) >> improvements to functionality. I don't know who is active and able to >> review that part of the code; I'd look for authors of changes in the >> surrounding code. The question here isn't so much what one would like >> to see in this release, but evaluating whether the release is sound >> and free of show-stopper problems. There will always be potentially >> important changes and fixes to come. >> >> On Wed, Apr 1, 2020 at 5:31 AM Dr. Kent Yao <yaooq...@qq.com> wrote: >> > >> > -1 >> > Do not release this package because v3.0.0 is the 3rd major release >> since we >> > added Spark On Kubernetes. Can we make it more production-ready as it >> has >> > been experimental for more than 2 years? >> > >> > The main practical adoption of Spark on Kubernetes is to take on the >> role of >> > other cluster managers(mainly YARN). And the storage layer(mainly HDFS) >> > would be more likely kept anyway. But Spark on Kubernetes with HDFS >> seems >> > not to work properly. >> > >> > e.g. >> > This ticket and PR were submitted 7 months ago, and never get reviewed. >> > https://issues.apache.org/jira/browse/SPARK-29974 >> > https://issues.apache.org/jira/browse/SPARK-28992 >> > https://github.com/apache/spark/pull/25695 >> > >> > And this. >> > https://issues.apache.org/jira/browse/SPARK-28896 >> > https://github.com/apache/spark/pull/25609 >> > >> > In terms of how often this module is updated, it seems to be stable. >> > But in terms of how often PRs for this module are reviewed, it seems >> that it >> > will stay experimental for a long time. >> > >> > Thanks. >> > >> > >> > >> > -- >> > Sent from: http://apache-spark-developers-list.1001551.n3.nabble.com/ >> > >> > --------------------------------------------------------------------- >> > To unsubscribe e-mail: dev-unsubscr...@spark.apache.org >> > >> >> --------------------------------------------------------------------- >> To unsubscribe e-mail: dev-unsubscr...@spark.apache.org >> >> > > -- > Ryan Blue > Software Engineer > Netflix >
