Re: [DISCUSS] Support multiple ordering fields

[Pratyaksh Sharma]

Hi

We can use transformer to have a combination of multiple ordering fields.
However custom Comparable implementation is not possible in that case. So
overall a +1 from my side as well.

On Tue, Jan 19, 2021 at 1:58 PM 刘金辉 <965147...@qq.com> wrote:

> +1，&nbsp;Currently we have encountered such scenarios and look forward to
> supporting
>
>
>
>
> ------------------&nbsp;原始邮件&nbsp;------------------
> 发件人:
>                                                   "dev"
>                                                                 <
> danny0...@apache.org&gt;;
> 发送时间:&nbsp;2021年1月19日(星期二) 下午4:25
> 收件人:&nbsp;"dev"<dev@hudi.apache.org&gt;;
>
> 主题:&nbsp;Re: [DISCUSS] Support multiple ordering fields
>
>
>
> &gt; Wondering if we should just take a bunch of payload configs and
> deprecate
> these flags
>
> I have the same feeling, there are already so many config options in
> Hoodie, the maintain work for developers or users is hard.
>
> Vinoth Chandar <vin...@apache.org&gt; 于2021年1月18日周一 下午11:40写道：
>
> &gt; +1 as well.
> &gt;
> &gt; Slightly orthogonal point.
> &gt;
> &gt; Wondering if we should just take a bunch of payload configs and
> deprecate
> &gt; these flags?
> &gt; What I mean is : --source-ordering-field ultimately is used by the
> &gt; HoodieAvroPayload class (or its family).
> &gt; Our utilities expose these as flags for convenience, but its just
> more work
> &gt; to maintain.
> &gt;
> &gt; On Mon, Jan 18, 2021 at 7:09 AM vino yang <yanghua1...@gmail.com&gt;
> wrote:
> &gt;
> &gt; &gt; +1,
> &gt; &gt;
> &gt; &gt; We have found that such flexibility is needed in some scenarios.
> &gt; &gt;
> &gt; &gt; Best,
> &gt; &gt; Vino
> &gt; &gt;
> &gt; &gt; Raymond Xu <xu.shiyan.raym...@gmail.com&gt; 于2021年1月17日周日
> 上午3:38写道：
> &gt; &gt;
> &gt; &gt; &gt; Just want to discuss a small improvement for setting
> ordering fields.
> &gt; &gt; &gt; For
> &gt; &gt; &gt; - property `hoodie.payload.ordering.field` and
> &gt; &gt; &gt; - deltastreamer --source-ordering-field
> &gt; &gt; &gt; I think it can be useful to support multiple fields
> (configured via a
> &gt; &gt; &gt; comma-separated list) to determine the order in some cases.
> This would
> &gt; &gt; need
> &gt; &gt; &gt; another config to set the Comparable implementation, say
> &gt; &gt; &gt; hoodie.payload.ordering.comparable.class to allow custom
> logic for
> &gt; doing
> &gt; &gt; &gt; comparison.
> &gt; &gt; &gt;
> &gt; &gt; &gt; Any suggestions? Thanks.
> &gt; &gt; &gt;
> &gt; &gt;
> &gt;