This is an automated email from the ASF dual-hosted git repository.
sblackmon pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/streams.git.
from 2e4e52f don’t interfere with flink environment-level parallelism
new c176d09 STREAMS-671 flink twitter examples output files do not
contain date-time fields
new 23c98f2 add better support for java.util.Date in streams-pojo
new 55ef8ff gets ride of streams datum which contains joda DateTime in
the flink pipelines
new d94d1b5 include the flink examples in the distribution
The 4 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
streams-contrib/streams-provider-twitter/pom.xml | 42 +++++-
.../org/apache/streams/twitter/api/Twitter.java | 5 +-
...itterJodaDateSwap.java => TwitterDateSwap.java} | 26 ++--
.../converter/util/TwitterActivityUtil.java | 5 +-
.../twitter/test/api/TwitterSecurityTest.java | 3 +-
.../test/utils/TwitterActivityConvertersTest.java | 143 ---------------------
.../TwitterActivityObjectsConvertersTest.java | 78 -----------
streams-dist/pom.xml | 6 +
.../flink-twitter-collection/pom.xml | 83 +++++++++---
.../TwitterFollowingPipelineConfiguration.json | 6 +-
.../TwitterPostsPipelineConfiguration.json | 6 +-
.../TwitterSpritzerPipelineConfiguration.json | 6 +-
...witterUserInformationPipelineConfiguration.json | 6 +-
.../apache/streams/examples/flink/FlinkBase.scala | 18 +--
.../collection/FlinkTwitterFollowingPipeline.scala | 7 +-
.../collection/FlinkTwitterPostsPipeline.scala | 30 +----
.../collection/FlinkTwitterSpritzerPipeline.scala | 35 +----
.../FlinkTwitterUserInformationPipeline.scala | 28 +---
.../FollowingCollectorFlatMapFunction.scala | 27 ++--
.../flink/twitter/collection/SpritzerSource.scala | 59 +++++++++
.../TimelineCollectorFlatMapFunction.scala | 28 ++--
.../UserInformationCollectorFlatMapFunction.scala | 26 ++--
...erializer.java => StreamsDateDeserializer.java} | 34 ++---
...eSerializer.java => StreamsDateSerializer.java} | 18 +--
.../streams/jackson/StreamsJacksonModule.java | 4 +
.../juneau/{JodaDateSwap.java => DateSwap.java} | 42 +++---
26 files changed, 317 insertions(+), 454 deletions(-)
copy
streams-contrib/streams-provider-twitter/src/main/java/org/apache/streams/twitter/converter/{TwitterJodaDateSwap.java
=> TwitterDateSwap.java} (57%)
delete mode 100644
streams-contrib/streams-provider-twitter/src/test/java/org/apache/streams/twitter/test/utils/TwitterActivityConvertersTest.java
delete mode 100644
streams-contrib/streams-provider-twitter/src/test/java/org/apache/streams/twitter/test/utils/TwitterActivityObjectsConvertersTest.java
create mode 100644
streams-examples/streams-examples-flink/flink-twitter-collection/src/main/scala/org/apache/streams/examples/flink/twitter/collection/SpritzerSource.scala
copy
streams-pojo/src/main/java/org/apache/streams/jackson/{StreamsDateTimeDeserializer.java
=> StreamsDateDeserializer.java} (65%)
copy
streams-pojo/src/main/java/org/apache/streams/jackson/{StreamsDateTimeSerializer.java
=> StreamsDateSerializer.java} (65%)
copy streams-pojo/src/main/java/org/apache/streams/juneau/{JodaDateSwap.java
=> DateSwap.java} (54%)