Steve Blackmon created STREAMS-207:
--------------------------------------
Summary: Customize metadata fields written/read to/from HDFS/S3
Key: STREAMS-207
URL: https://issues.apache.org/jira/browse/STREAMS-207
Project: Streams
Issue Type: Improvement
Reporter: Steve Blackmon
These persisters currently expect a 4-column format. It should be possible via
configuration to omit one or more of the four principle fields (id, timestamp,
metadata, document) and have the reader and writer operations succeed. The
default behavior should remain write and read of all four fields.
This will allow streams to be constructed from files containing only ids, only
documents, or only metadata without processor-based workarounds.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
