[streams] branch STREAMS-683 created (now ec9c4b2846)
This is an automated email from the ASF dual-hosted git repository. sblackmon pushed a change to branch STREAMS-683 in repository https://gitbox.apache.org/repos/asf/streams.git at ec9c4b2846 resolves STREAMS-683: upgrade jsonschema2pojo usage to modern version This branch includes the following new commits: new ec9c4b2846 resolves STREAMS-683: upgrade jsonschema2pojo usage to modern version The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference.
[streams] 01/01: resolves STREAMS-683: upgrade jsonschema2pojo usage to modern version
This is an automated email from the ASF dual-hosted git repository.
sblackmon pushed a commit to branch STREAMS-683
in repository https://gitbox.apache.org/repos/asf/streams.git
commit ec9c4b2846ecc09f1d7dba0776e51dcf8689f6ab
Author: sblackmon
AuthorDate: Sun Aug 28 13:27:25 2022 -0500
resolves STREAMS-683: upgrade jsonschema2pojo usage to modern version
because there were syntax changes in the new version, had to tweak a lot of
json schema files and some utility classes
---
pom.xml| 2 +-
.../ActivityConverterProcessorConfiguration.json | 4 +-
...ivityObjectConverterProcessorConfiguration.json | 4 +-
.../ElasticsearchReaderConfiguration.json | 2 +-
.../streams/graph/GraphReaderConfiguration.json| 4 +-
.../serializer/util/InstagramActivityUtil.java | 39 +---
.../streams/instagram/api/CommentsResponse.json| 4 +-
.../streams/instagram/api/MediaResponse.json | 4 +-
.../streams/instagram/api/RecentMediaResponse.json | 4 +-
.../streams/instagram/api/SearchMediaResponse.json | 4 +-
.../streams/instagram/api/SearchUsersResponse.json | 4 +-
.../streams/instagram/api/UserInfoResponse.json| 4 +-
.../streams/instagram/api/UsersInfoResponse.json | 4 +-
.../org/apache/streams/instagram/pojo/Media.json | 24 ++--
.../apache/streams/instagram/pojo/MediaItem.json | 23 +++
streams-contrib/streams-provider-linkedin/pom.xml | 30 --
.../jsonschema/ElasticsearchHdfsConfiguration.json | 12 +++-
.../jsonschema/HdfsElasticsearchConfiguration.json | 12 +++-
.../ElasticsearchReindexConfiguration.json | 12 +++-
.../MongoElasticsearchSyncConfiguration.json | 12 +++-
.../TwitterFollowNeo4jConfiguration.json | 12 +++-
.../TwitterHistoryElasticsearchConfiguration.json | 12 +++-
...witterUserstreamElasticsearchConfiguration.json | 12 +++-
.../plugins/StreamsPojoGenerationConfig.java | 8 +--
.../streams/plugins/StreamsPojoRuleLogger.java | 70 ++
.../plugins/StreamsPojoSourceGenerator.java| 22 ---
.../plugins/StreamsPojoSourceGeneratorMojo.java| 3 +-
.../test/StreamsPojoSourceGeneratorTest.java | 2 +-
.../java/org/apache/streams/util/PropertyUtil.java | 2 +-
.../streams/util/schema/SchemaStoreImpl.java | 5 +-
30 files changed, 234 insertions(+), 122 deletions(-)
diff --git a/pom.xml b/pom.xml
index 4cb83da891..f70b1b942f 100644
--- a/pom.xml
+++ b/pom.xml
@@ -380,7 +380,7 @@
2.4.0
0.1.10
7.2.1
-0.4.10
+1.1.2
0.14.0
0.11.1
1.3.0
diff --git
a/streams-components/streams-converters/src/main/jsonschema/org/apache/streams/converter/ActivityConverterProcessorConfiguration.json
b/streams-components/streams-converters/src/main/jsonschema/org/apache/streams/converter/ActivityConverterProcessorConfiguration.json
index f535b5ab3e..feb1b130cd 100644
---
a/streams-components/streams-converters/src/main/jsonschema/org/apache/streams/converter/ActivityConverterProcessorConfiguration.json
+++
b/streams-components/streams-converters/src/main/jsonschema/org/apache/streams/converter/ActivityConverterProcessorConfiguration.json
@@ -11,14 +11,14 @@
"classifiers": {
"type": "array",
"items": {
-"javaType": "org.apache.streams.data.DocumentClassifier",
+"existingJavaType":
"org.apache.streams.data.DocumentClassifier",
"type": "object"
}
},
"converters": {
"type": "array",
"items": {
-"javaType": "org.apache.streams.data.ActivityConverter",
+"existingJavaType":
"org.apache.streams.data.ActivityConverter",
"type": "object"
}
}
diff --git
a/streams-components/streams-converters/src/main/jsonschema/org/apache/streams/converter/ActivityObjectConverterProcessorConfiguration.json
b/streams-components/streams-converters/src/main/jsonschema/org/apache/streams/converter/ActivityObjectConverterProcessorConfiguration.json
index 7eacacbd2d..cd4dddbbd3 100644
---
a/streams-components/streams-converters/src/main/jsonschema/org/apache/streams/converter/ActivityObjectConverterProcessorConfiguration.json
+++
b/streams-components/streams-converters/src/main/jsonschema/org/apache/streams/converter/ActivityObjectConverterProcessorConfiguration.json
@@ -12,14 +12,14 @@
"type": "array",
"items": {
"type": "object",
-"javaType": "org.apache.streams.data.DocumentClassifier"
+"existingJavaType":
"org.apache.streams.data.DocumentClassifier"
}
},
"converters": {
"type": "array",
"items": {
"type": "object",
-"javaType": "org.apache.streams.data.ActivityObjectConverter"
+"e
[jira] [Work started] (STREAMS-683) upgrade jsonschema2pojo usage to modern version
[ https://issues.apache.org/jira/browse/STREAMS-683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on STREAMS-683 started by Steve Blackmon. -- > upgrade jsonschema2pojo usage to modern version > --- > > Key: STREAMS-683 > URL: https://issues.apache.org/jira/browse/STREAMS-683 > Project: Streams > Issue Type: Task > Components: Plugins >Reporter: Steve Blackmon >Assignee: Steve Blackmon >Priority: Minor > > The version of jsonschema2pojo-maven-plugin we wrap is very dated and lacking > some useful new features -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Resolved] (STREAMS-679) add support for accessing and searching with twitter derived fields
[ https://issues.apache.org/jira/browse/STREAMS-679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Blackmon resolved STREAMS-679. Resolution: Fixed > add support for accessing and searching with twitter derived fields > --- > > Key: STREAMS-679 > URL: https://issues.apache.org/jira/browse/STREAMS-679 > Project: Streams > Issue Type: Task >Reporter: Steve Blackmon >Assignee: Steve Blackmon >Priority: Major > > add support for accessing and searching with twitter derived fields -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Resolved] (STREAMS-676) remove unnecessary keying and use GlobalWindow in streams-examples-flink/flink-twitter-collection
[ https://issues.apache.org/jira/browse/STREAMS-676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Blackmon resolved STREAMS-676. Resolution: Fixed > remove unnecessary keying and use GlobalWindow in > streams-examples-flink/flink-twitter-collection > -- > > Key: STREAMS-676 > URL: https://issues.apache.org/jira/browse/STREAMS-676 > Project: Streams > Issue Type: Task >Reporter: Steve Blackmon >Assignee: Steve Blackmon >Priority: Major > > remove unnecessary keying and use GlobalWindow in > streams-examples-flink/flink-twitter-collection -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Resolved] (STREAMS-677) add support for setting earliest timestamp in TwitterTimelineProviderTask
[ https://issues.apache.org/jira/browse/STREAMS-677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Blackmon resolved STREAMS-677. Resolution: Fixed > add support for setting earliest timestamp in TwitterTimelineProviderTask > - > > Key: STREAMS-677 > URL: https://issues.apache.org/jira/browse/STREAMS-677 > Project: Streams > Issue Type: Task >Reporter: Steve Blackmon >Assignee: Steve Blackmon >Priority: Major > > add support for setting earliest timestamp in TwitterTimelineProviderTask -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Resolved] (STREAMS-680) improve performance/efficiency of twitter search providers
[ https://issues.apache.org/jira/browse/STREAMS-680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Blackmon resolved STREAMS-680. Resolution: Fixed > improve performance/efficiency of twitter search providers > -- > > Key: STREAMS-680 > URL: https://issues.apache.org/jira/browse/STREAMS-680 > Project: Streams > Issue Type: Task >Reporter: Steve Blackmon >Assignee: Steve Blackmon >Priority: Major > > improve performance and memory efficiency of twitter search providers -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Resolved] (STREAMS-503) MediaLink class is not being generated in streams-pojo
[ https://issues.apache.org/jira/browse/STREAMS-503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Blackmon resolved STREAMS-503. Resolution: Fixed > MediaLink class is not being generated in streams-pojo > -- > > Key: STREAMS-503 > URL: https://issues.apache.org/jira/browse/STREAMS-503 > Project: Streams > Issue Type: Bug >Reporter: Steve Blackmon >Assignee: Steve Blackmon >Priority: Major > Original Estimate: 4h > Remaining Estimate: 4h > > Rather it is generated, but it is named ImageParent. This is wrong. > MediaLink should be a class that can be used and extended in other modules. > Image should be an instance of MediaLink. > There don't appear to be any other cases like this in streams-pojo, but we > should check the entire project to make sure generated beans have the right > classnames. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Resolved] (STREAMS-518) Support java.util.Date fields with StreamsJacksonMapper
[ https://issues.apache.org/jira/browse/STREAMS-518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Blackmon resolved STREAMS-518. Resolution: Fixed > Support java.util.Date fields with StreamsJacksonMapper > --- > > Key: STREAMS-518 > URL: https://issues.apache.org/jira/browse/STREAMS-518 > Project: Streams > Issue Type: Improvement >Reporter: Steve Blackmon >Assignee: Steve Blackmon >Priority: Major > > StreamsJacksonMapper support serializing and deserializing arbitrary formats > to org.joda.time.DateTime very well. > It should be able to do the same using java.util.Date, retaining the same > configuration and processing mechanisms -- This message was sent by Atlassian Jira (v8.20.10#820010)
