[
https://issues.apache.org/jira/browse/SAMZA-479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14268964#comment-14268964
]
Yan Fang commented on SAMZA-479:
--------------------------------
have been thinking over this. Because currently all the samza logs are string
format, when a new format (e.g. json) log is added, the system needs to have
two serdes. Technically, we can apply different serdes according to the package
name specified in log4j properties file. Then, there is one concern, because we
may also want to publish to a different stream for a new serd, ( otherwise, two
different formats will be in one stream, which I think is a mess-up ), we will
have two or more output streams for the logs, will that still be acceptable?
And there will be one restriction, all the logs under one package name should
have the same format. Is that acceptable as well? Am I thinking in the right
direction?
> Make StreamAppender pluggable for different log formats
> -------------------------------------------------------
>
> Key: SAMZA-479
> URL: https://issues.apache.org/jira/browse/SAMZA-479
> Project: Samza
> Issue Type: Improvement
> Affects Versions: 0.9.0
> Reporter: Yan Fang
> Assignee: Yan Fang
> Fix For: 0.9.0
>
>
> Currently the StreamAppender only accepts String and sends String as the
> format for all the logs. It will be useful to have StreamAppender to accept
> and send other formats, such as Avro, JSON, etc. So the idea is to move the
> encoding of the LoggingEvent to a serde.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
