A better way of doing this would be to use the fieldTransformation setting
and the REMOVE method to get rid of the extraneous fields. Docs are
included at
https://metron.apache.org/current-book/metron-platform/metron-parsers/index.html#
That way you don’t need a separate preprocessing step.
Hi ,
Thanks for your reply. Issue got resolved after several restarts. I faced
issues like when it is a new index it is taking time to index the data.
After restarting to nearly five times, suddenly data appeared in the index.
Thanks and Regards,
Hema
On Wed, 13 Nov, 2019, 12:48 PM Hema malini,
Thanks ..will do preprocessing of data..
On Sat, 16 Nov, 2019, 9:25 PM Otto Fowler, wrote:
> No, there is no way to do this currently.
>
> The parser parses the line into and array of strings that must match the
> size of the columns.
>
> The underlying opencsv parser does not support this
No, there is no way to do this currently.
The parser parses the line into and array of strings that must match the
size of the columns.
The underlying opencsv parser does not support this either. You may have
to do some normalization work on your data if you need to account for this.
On
Hi all,
Is there any way to mark some columns as optional in column mapping in CSV
parser.
Thanks and Regards,
Hema
