[
https://issues.apache.org/jira/browse/FLUME-3021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15932606#comment-15932606
]
Helmut Wahrman commented on FLUME-3021:
---------------------------------------
ok, my initial problem is gone. I had a problem in my Serializer, where i
didn't issue an builder.endObject().
Seems that this was accepted with ES < 2.0.
I have now a bulkinsert working, but get a crash afterwards. So not all data is
inserted.
2017-03-20 00:37:27,550 (SinkRunner-PollingRunner-DefaultSinkProcessor) [ERROR
-
org.apache.flume.sink.elasticsearch.ElasticSearchSink.process(ElasticSearchSink.java:225)]
Failed to commit transaction. Transaction rolled back.
org.apache.flume.EventDeliveryException: failure in bulk execution:
[7]: index [sa-2017-03-20], type [data], id [AVrqAWyTSRW-h0z5T32U], message
[MapperParsingException[failed to parse [@fields.filename]]; nested:
IllegalStateException[Can't get text on a START_OBJECT at 1:629];]
at
org.apache.flume.sink.elasticsearch.client.ElasticSearchTransportClient.execute(ElasticSearchTransportClient.java:186)
at
org.apache.flume.sink.elasticsearch.ElasticSearchSink.process(ElasticSearchSink.java:205)
at
org.apache.flume.sink.DefaultSinkProcessor.process(DefaultSinkProcessor.java:67)
at org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:145)
at java.lang.Thread.run(Thread.java:745)
2017-03-20 00:37:27,553 (SinkRunner-PollingRunner-DefaultSinkProcessor) [ERROR
- org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:158)] Unable to
deliver event. Exception follows.
org.apache.flume.EventDeliveryException: Failed to commit transaction.
Transaction rolled back.
at
org.apache.flume.sink.elasticsearch.ElasticSearchSink.process(ElasticSearchSink.java:227)
at
org.apache.flume.sink.DefaultSinkProcessor.process(DefaultSinkProcessor.java:67)
at org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:145)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.flume.EventDeliveryException: failure in bulk execution:
[7]: index [sa-2017-03-20], type [data], id [AVrqAWyTSRW-h0z5T32U], message
[MapperParsingException[failed to parse [@fields.filename]]; nested:
IllegalStateException[Can't get text on a START_OBJECT at 1:629];]
at
org.apache.flume.sink.elasticsearch.client.ElasticSearchTransportClient.execute(ElasticSearchTransportClient.java:186)
at
org.apache.flume.sink.elasticsearch.ElasticSearchSink.process(ElasticSearchSink.java:205)
... 3 more
Seems there is a problem in my data, related to @fields.filename, will debug
that.
> flume Elasticsearch 5.0 not support
> -----------------------------------
>
> Key: FLUME-3021
> URL: https://issues.apache.org/jira/browse/FLUME-3021
> Project: Flume
> Issue Type: Bug
> Components: Sinks+Sources
> Affects Versions: 1.7.0
> Reporter: tycho_yang
> Assignee: Yonghao Zou
> Fix For: 1.8.0
>
> Attachments: FLUME-3021-0.patch
>
>
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
