[GitHub] [incubator-hudi] n3nash commented on issue #801: How to customize schema

2019-07-30 Thread GitBox
n3nash commented on issue #801: How to customize schema URL: https://github.com/apache/incubator-hudi/issues/801#issuecomment-516512834 There is an effort to upgrade Hudi to using Spark 2.4.x. here is the PR : https://github.com/apache/incubator-hudi/pull/638. You should be able to use

[GitHub] [incubator-hudi] n3nash commented on issue #801: How to customize schema

2019-07-24 Thread GitBox
n3nash commented on issue #801: How to customize schema URL: https://github.com/apache/incubator-hudi/issues/801#issuecomment-514799616 @zhangxinjian123 You can evolve your schema in a backwards compatible way. Mark the fields you don't want to produce to as optional and add new fields to