[ https://issues.apache.org/jira/browse/BEAM-1581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Aviem Zur updated BEAM-1581: ---------------------------- Description: JSON source and sink to read/write JSON files. Similarly to {{XmlSource}}/{{XmlSink}}, these be a {{JsonSource}}/{{JonSink}} which are a {{FileBaseSource}}/{{FileBasedSink}}. Consider using methods/code (or refactor these) found in {{AsJsons}} and {{ParseJsons}} The {{PCollection}} of objects the user passes to the transform should be embedded in a valid JSON file, this normal pattern for this is a large objects with an array member which holds all the data objects and other members for metadata. Examples of public JSON APIs: https://www.sitepoint.com/10-example-json-files/ Another pattern used in integration is a file which is simply a JSON array of objects. was: JSON source and sink to read/write JSON files. Similarly to {{XmlSource}}/{{XmlSink}}, these be a {{JsonSource}}/{{JonSink}} which are a {{FileBaseSource}}/{{FileBasedSink}}. Consider using methods/code (or refactor these) found in {{AsJsons}} and {{ParseJsons}} The {{PCollection}} of objects the user passes to the transform should be embedded in a valid JSON file, this normal pattern for this is a large objects with an array member which holds all the data objects and other members for metadata. Examples of public JSON APIs: https://www.sitepoint.com/10-example-json-files/ Another common pattern used in integration is a file which is simply a JSON array of objects. > JSON source and sink > -------------------- > > Key: BEAM-1581 > URL: https://issues.apache.org/jira/browse/BEAM-1581 > Project: Beam > Issue Type: New Feature > Components: sdk-java-extensions > Reporter: Aviem Zur > Assignee: Aviem Zur > > JSON source and sink to read/write JSON files. > Similarly to {{XmlSource}}/{{XmlSink}}, these be a {{JsonSource}}/{{JonSink}} > which are a {{FileBaseSource}}/{{FileBasedSink}}. > Consider using methods/code (or refactor these) found in {{AsJsons}} and > {{ParseJsons}} > The {{PCollection}} of objects the user passes to the transform should be > embedded in a valid JSON file, this normal pattern for this is a large > objects with an array member which holds all the data objects and other > members for metadata. > Examples of public JSON APIs: https://www.sitepoint.com/10-example-json-files/ > Another pattern used in integration is a file which is simply a JSON array of > objects. -- This message was sent by Atlassian JIRA (v6.3.15#6346)