[jira] [Commented] (STREAMS-377) can't create different LineReadWriteUtils

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/STREAMS-377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15176086#comment-15176086
 ] 

ASF GitHub Bot commented on STREAMS-377:


Github user asfgit closed the pull request at:

https://github.com/apache/incubator-streams/pull/280


> can't create different LineReadWriteUtils 
> --
>
> Key: STREAMS-377
> URL: https://issues.apache.org/jira/browse/STREAMS-377
> Project: Streams
>  Issue Type: Bug
>Reporter: Steve Blackmon
>
> Singleton implementation of LineReadWriteUtil makes it tough to use two 
> configurations in the same JVM.  Refactor to allow any number of LRWU objects 
> with different configurations, while maintaining singleton access model.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (STREAMS-393) Switch any usage of System.out and System.err to slf4j

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/STREAMS-393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15176120#comment-15176120
 ] 

ASF GitHub Bot commented on STREAMS-393:


Github user asfgit closed the pull request at:

https://github.com/apache/incubator-streams/pull/279


> Switch any usage of System.out and System.err to slf4j
> --
>
> Key: STREAMS-393
> URL: https://issues.apache.org/jira/browse/STREAMS-393
> Project: Streams
>  Issue Type: Improvement
>Reporter: Steve Blackmon
>Assignee: Steve Blackmon
>
> There are ~25 places in the code using System.out or System.err.  This is not 
> best practice and should be switching over to slf4j



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (STREAMS-401) Refresh Streams Website

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/STREAMS-401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15266038#comment-15266038
 ] 

ASF GitHub Bot commented on STREAMS-401:


GitHub user steveblackmon opened a pull request:

https://github.com/apache/incubator-streams-master/pull/3

resolves STREAMS-401

incubator-streams-master updates to produce revamped streams website

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/apache/incubator-streams-master newwebpage

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-streams-master/pull/3.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #3


commit 64bf15a1a4dfe35170ba972e9bfeba96bc885fa8
Author: Steve Blackmon @steveblackmon 
Date:   2016-02-25T22:43:47Z

add new version of streams.incubator.apache.org

temporarily hosted under people.apache.org/~sblackmon

commit 3740e92550f0b3094e039b473e40c2dd4df959fb
Author: Steve Blackmon @steveblackmon 
Date:   2016-02-25T22:49:56Z

add link to javadocs

commit 538a6c938db7b7aef5b2bebf8ddb55f775303811
Author: Steve Blackmon @steveblackmon 
Date:   2016-02-29T15:27:00Z

add a contributor to generate project-team.html

commit 09f4d6596ddf73bb693a0ee064d9e5a996b1cac1
Author: Steve Blackmon @steveblackmon 
Date:   2016-02-29T15:27:14Z

add props file to support text customization

commit ecbb81a0f5e627053553144ecbbdb43198762f1b
Author: Steve Blackmon @steveblackmon 
Date:   2016-02-29T15:27:34Z

tweaks to site outline and content

commit 51428a8f0fede10593722fd3579324cb9bea92f4
Author: Steve Blackmon @steveblackmon 
Date:   2016-02-29T15:27:48Z

add css file to customize look-and-feel

commit 88b9c369f2dd06c5af25b0bcd3f9cdd384415004
Author: Steve Blackmon @steveblackmon 
Date:   2016-02-29T23:07:48Z

additional streams-master site updates

commit c5d54a9bcf7266d16180fec336964b343650feee
Author: Steve Blackmon @steveblackmon 
Date:   2016-03-01T21:45:32Z

better markdown

commit 37f6768f7c6521811046f12d2c8678a64a32bac9
Author: Steve Blackmon @steveblackmon 
Date:   2016-03-01T23:08:22Z

better markdown

commit 749300a88c5704578ceeb75d06bcb16362c0a467
Author: Steve Blackmon @steveblackmon 
Date:   2016-04-21T20:44:15Z

add architecture and example diagrams

rework architecture content

commit 283d0fc46896a64dafd31879173ac1f81f32a8df
Author: Steve Blackmon @steveblackmon 
Date:   2016-04-25T16:04:59Z

Add tutorial

commit b0c4310ab32662f20a4e7b1daa4cbae00501c481
Author: Steve Blackmon @steveblackmon 
Date:   2016-04-25T16:18:28Z

add svgs

commit a3b44b926df39f9840d1233af7774e808cf72163
Author: Steve Blackmon @steveblackmon 
Date:   2016-04-25T20:20:01Z

add tutorial, website instructions, use latest instead of absolute versions

commit 9cb990c6683cb7c293c3f2b8b2aa8de9093cad59
Author: Steve Blackmon @steveblackmon 
Date:   2016-04-25T20:23:21Z

add bit about deleting existing site

commit 51456fb00ea48a091f5e0bc6fb134e3ddd85b1f3
Author: Steve Blackmon @steveblackmon 
Date:   2016-04-25T20:41:10Z

fix blockquote inside lists

commit ff129ea871bb0dd212fa429639c84d3eb10d97c4
Author: Steve Blackmon @steveblackmon 
Date:   2016-04-26T21:09:17Z

round of improvements - getting close

commit 249138318a63454299b5c18589adc26abd76c5fa
Author: Steve Blackmon @steveblackmon 
Date:   2016-04-27T20:54:29Z

another round of site improvements

commit 9e91ffe3a3068db5d6756add06203dd3e0dc375a
Author: Steve Blackmon @steveblackmon 
Date:   2016-04-28T00:23:05Z

add source plugin

commit 3689338f3567f3b863399d327ec2b31291845ff1
Author: Steve Blackmon @steveblackmon 
Date:   2016-04-28T00:23:14Z

add google analytics

commit 02e97430dbc54e3ce7ce9675fd3e355d3d513e9c
Author: Steve Blackmon @steveblackmon 
Date:   2016-04-28T21:16:49Z

google analytics

commit 2cd53890bf01e52c632ecaa8418dbcdfc17c1b68
Author: Steve Blackmon @steveblackmon 
Date:   2016-04-30T20:06:10Z

fix typos on faq and a broken link




> Refresh Streams Website
> ---
>
> Key: STREAMS-401
> URL: https://issues.apache.org/jira/browse/STREAMS-401
> Project: Streams
>  Issue Type: Improvement
>Reporter: Steve Blackmon
>Assignee: Steve Blackmon
>
> with additional content and why and how to use streams, per mailing list 
> discussion started by ate



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (STREAMS-401) Refresh Streams Website

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/STREAMS-401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15266043#comment-15266043
 ] 

ASF GitHub Bot commented on STREAMS-401:


GitHub user steveblackmon opened a pull request:

https://github.com/apache/incubator-streams/pull/281

resolves STREAMS-401

incubator-streams updates to produce revamped streams website

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/steveblackmon/incubator-streams STREAMS-401

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-streams/pull/281.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #281


commit 25f1ca1431026a57dfb5935edc655765f3b13fe2
Author: Steve Blackmon 
Date:   2016-03-27T17:42:30Z

move all README.md into src/site/markdown, add example configurations, link 
to jsons, confs, and javadocs from module index.md

commit 89e10dd581ae06e9c88cee7667cf15a227e497fb
Author: Steve Blackmon 
Date:   2016-03-28T00:54:49Z

more READMEs

commit 6e5e5c207269e77eabdbd8f9093f1f2db7132c24
Author: Steve Blackmon 
Date:   2016-03-28T13:26:50Z

create index.md for most modules

commit 44bc089cf429b928f2988038e555064250835388
Author: Steve Blackmon @steveblackmon 
Date:   2016-04-20T18:35:31Z

new components diagrams

commit a786c8b8c65e080c3a7f2861b22374ed5a674acc
Author: Steve Blackmon @steveblackmon 
Date:   2016-04-21T20:28:06Z

add diagrams and improve index.md for provider / persist modules

commit c22fce00f388b222ba7337a0d0290fd661af7cea
Author: Steve Blackmon @steveblackmon 
Date:   2016-04-21T20:37:33Z

elasticsearch diagram and confs

commit d8fc70224375415825531be728831718bfd982f7
Author: Steve Blackmon @steveblackmon 
Date:   2016-04-21T21:15:02Z

add diagrams and improve index.html

commit 2a4a96d79adc79668b97e0b857fc363f79270081
Author: Steve Blackmon @steveblackmon 
Date:   2016-04-25T21:18:07Z

prefix schema directories with ${project.basedir}

prefix schema directories with ${project.basedir} because newer 
org.jsonschema2pojo requires this to resolve the right directories during a 
maven multi-module build

commit c907f058f913e15a2f7b73fab927ef0293ec18e5
Author: Steve Blackmon @steveblackmon 
Date:   2016-04-25T21:18:38Z

fix a few edges that were pointing the wrong way

commit 4b6121a760197a16f977b5d789fb0a261d8c293f
Author: Steve Blackmon @steveblackmon 
Date:   2016-04-27T20:52:48Z

another round of README and diagram improvements

commit 0e7fbcb6b783373e95073eb12c14b884b9f42489
Author: Steve Blackmon @steveblackmon 
Date:   2016-04-28T00:22:32Z

tweaks to readmes




> Refresh Streams Website
> ---
>
> Key: STREAMS-401
> URL: https://issues.apache.org/jira/browse/STREAMS-401
> Project: Streams
>  Issue Type: Improvement
>Reporter: Steve Blackmon
>Assignee: Steve Blackmon
>
> with additional content and why and how to use streams, per mailing list 
> discussion started by ate



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (STREAMS-401) Refresh Streams Website

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/STREAMS-401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15271239#comment-15271239
 ] 

ASF GitHub Bot commented on STREAMS-401:


Github user eponvert commented on a diff in the pull request:


https://github.com/apache/incubator-streams-master/pull/3#discussion_r62097216
  
--- Diff: pom.xml ---
@@ -68,20 +68,147 @@
 
 
 
-
+  
> Key: STREAMS-401
> URL: https://issues.apache.org/jira/browse/STREAMS-401
> Project: Streams
>  Issue Type: Improvement
>Reporter: Steve Blackmon
>Assignee: Steve Blackmon
>
> with additional content and why and how to use streams, per mailing list 
> discussion started by ate



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (STREAMS-401) Refresh Streams Website

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/STREAMS-401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15271245#comment-15271245
 ] 

ASF GitHub Bot commented on STREAMS-401:


Github user eponvert commented on a diff in the pull request:


https://github.com/apache/incubator-streams-master/pull/3#discussion_r62097479
  
--- Diff: pom.xml ---
@@ -717,11 +1097,11 @@
 
 
 
-
-com.github.ferstl
-depgraph-maven-plugin
-${depgraph.plugin.version}
-
+
--- End diff --

same thing -- is it worth keeping this in here commented? if so, perhaps 
include a comment like "Uncomment this if you need to "


> Refresh Streams Website
> ---
>
> Key: STREAMS-401
> URL: https://issues.apache.org/jira/browse/STREAMS-401
> Project: Streams
>  Issue Type: Improvement
>Reporter: Steve Blackmon
>Assignee: Steve Blackmon
>
> with additional content and why and how to use streams, per mailing list 
> discussion started by ate



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (STREAMS-401) Refresh Streams Website

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/STREAMS-401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15271438#comment-15271438
 ] 

ASF GitHub Bot commented on STREAMS-401:


Github user steveblackmon commented on a diff in the pull request:


https://github.com/apache/incubator-streams-master/pull/3#discussion_r62115341
  
--- Diff: pom.xml ---
@@ -68,20 +68,147 @@
 
 
 
-
+  
> Key: STREAMS-401
> URL: https://issues.apache.org/jira/browse/STREAMS-401
> Project: Streams
>  Issue Type: Improvement
>Reporter: Steve Blackmon
>Assignee: Steve Blackmon
>
> with additional content and why and how to use streams, per mailing list 
> discussion started by ate



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (STREAMS-401) Refresh Streams Website

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/STREAMS-401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15271477#comment-15271477
 ] 

ASF GitHub Bot commented on STREAMS-401:


Github user steveblackmon commented on a diff in the pull request:


https://github.com/apache/incubator-streams-master/pull/3#discussion_r62118978
  
--- Diff: pom.xml ---
@@ -717,11 +1097,11 @@
 
 
 
-
-com.github.ferstl
-depgraph-maven-plugin
-${depgraph.plugin.version}
-
+
--- End diff --

no reason to keep these commented out, will revert


> Refresh Streams Website
> ---
>
> Key: STREAMS-401
> URL: https://issues.apache.org/jira/browse/STREAMS-401
> Project: Streams
>  Issue Type: Improvement
>Reporter: Steve Blackmon
>Assignee: Steve Blackmon
>
> with additional content and why and how to use streams, per mailing list 
> discussion started by ate



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (STREAMS-401) Refresh Streams Website

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/STREAMS-401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15272558#comment-15272558
 ] 

ASF GitHub Bot commented on STREAMS-401:


Github user steveblackmon commented on a diff in the pull request:


https://github.com/apache/incubator-streams-master/pull/3#discussion_r62209259
  
--- Diff: pom.xml ---
@@ -68,20 +68,147 @@
 
 
 
-
+  
> Key: STREAMS-401
> URL: https://issues.apache.org/jira/browse/STREAMS-401
> Project: Streams
>  Issue Type: Improvement
>Reporter: Steve Blackmon
>Assignee: Steve Blackmon
>
> with additional content and why and how to use streams, per mailing list 
> discussion started by ate



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (STREAMS-401) Refresh Streams Website

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/STREAMS-401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15274978#comment-15274978
 ] 

ASF GitHub Bot commented on STREAMS-401:


Github user asfgit closed the pull request at:

https://github.com/apache/incubator-streams-master/pull/3


> Refresh Streams Website
> ---
>
> Key: STREAMS-401
> URL: https://issues.apache.org/jira/browse/STREAMS-401
> Project: Streams
>  Issue Type: Improvement
>Reporter: Steve Blackmon
>Assignee: Steve Blackmon
>
> with additional content and why and how to use streams, per mailing list 
> discussion started by ate



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (STREAMS-401) Refresh Streams Website

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/STREAMS-401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15274988#comment-15274988
 ] 

ASF GitHub Bot commented on STREAMS-401:


Github user asfgit closed the pull request at:

https://github.com/apache/incubator-streams/pull/281


> Refresh Streams Website
> ---
>
> Key: STREAMS-401
> URL: https://issues.apache.org/jira/browse/STREAMS-401
> Project: Streams
>  Issue Type: Improvement
>Reporter: Steve Blackmon
>Assignee: Steve Blackmon
>
> with additional content and why and how to use streams, per mailing list 
> discussion started by ate



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (STREAMS-330) make TwitterErrorHandler respect the Twitter4j RateLimitStatus reset time

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/STREAMS-330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15305076#comment-15305076
 ] 

ASF GitHub Bot commented on STREAMS-330:


GitHub user jfrazee opened a pull request:

https://github.com/apache/incubator-streams/pull/282

STREAMS-330 Make TwitterErrorHandler respect RateLimitStatus reset time



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/jfrazee/incubator-streams STREAMS-330

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-streams/pull/282.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #282


commit 77f3e8a38316312ebee74af143f5703fbab36541
Author: Joey Frazee 
Date:   2016-05-28T01:20:36Z

Changed handleTwitterError() to use RateLimitStatus for sleep/reset




> make TwitterErrorHandler respect the Twitter4j RateLimitStatus reset time
> -
>
> Key: STREAMS-330
> URL: https://issues.apache.org/jira/browse/STREAMS-330
> Project: Streams
>  Issue Type: Improvement
>Reporter: Steve Blackmon
>
> rather than auto-retry on a fixed schedule with a maximum number of failed 
> attempt, refactor TwitterErrorHandler to respect the Twitter4j 
> RateLimitStatus reset time and sleep for duration directed.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (STREAMS-330) make TwitterErrorHandler respect the Twitter4j RateLimitStatus reset time

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/STREAMS-330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15309032#comment-15309032
 ] 

ASF GitHub Bot commented on STREAMS-330:


Github user steveblackmon commented on the pull request:

https://github.com/apache/incubator-streams/pull/282
  
looks good 
👍 


> make TwitterErrorHandler respect the Twitter4j RateLimitStatus reset time
> -
>
> Key: STREAMS-330
> URL: https://issues.apache.org/jira/browse/STREAMS-330
> Project: Streams
>  Issue Type: Improvement
>Reporter: Steve Blackmon
>
> rather than auto-retry on a fixed schedule with a maximum number of failed 
> attempt, refactor TwitterErrorHandler to respect the Twitter4j 
> RateLimitStatus reset time and sleep for duration directed.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (STREAMS-314) Prevent catastrophic backtracking in RegexUtils Extraction

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/STREAMS-314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15309179#comment-15309179
 ] 

ASF GitHub Bot commented on STREAMS-314:


Github user jfrazee commented on the pull request:

https://github.com/apache/incubator-streams/pull/214
  
@robdouglas Hey, do you have this change still? Can't tell what's going on 
with the issue/branch.


> Prevent catastrophic backtracking in RegexUtils Extraction
> --
>
> Key: STREAMS-314
> URL: https://issues.apache.org/jira/browse/STREAMS-314
> Project: Streams
>  Issue Type: Bug
>Reporter: Robert Douglas
>
> Prevent catastrophic backtracking in RegexUtils Extraction



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (STREAMS-389) Support generation of scala source from jsonschemas

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/STREAMS-389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15310741#comment-15310741
 ] 

ASF GitHub Bot commented on STREAMS-389:


GitHub user steveblackmon opened a pull request:

https://github.com/apache/incubator-streams/pull/283

source and resource generation modules

supports generation of source code and resource files for several 
technologies from project and arbitrary jsonschemas
resolves STREAMS-389
resolves STREAMS-398

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/apache/incubator-streams STREAMS-389

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-streams/pull/283.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #283


commit f0a3518ef7e89f4b3ce2ebc3b0141ef240c00c72
Author: Steve Blackmon (@steveblackmon) 
Date:   2015-12-29T23:19:15Z

start of implementation for STREAMS-398

commit 1c78ecc7fe7bf72dad6cd204cffc4fae1ac4b41b
Author: Steve Blackmon @steveblackmon 
Date:   2016-03-28T13:32:00Z

create streams-plugin-pojo

commit 6501b27cdc148e5044b893197b5dc38d34aa8aeb
Author: Steve Blackmon @steveblackmon 
Date:   2016-03-28T13:32:19Z

rename Hive Generator

commit eea09756b2388acca625e2e752be127874a52599
Author: Steve Blackmon @steveblackmon 
Date:   2016-03-28T13:32:27Z

test pom for streams-plugin-pojo

commit 02b5adda7694698e732980c4b2702a2b67ff5548
Author: Steve Blackmon @steveblackmon 
Date:   2016-04-21T16:41:59Z

STREAMS-398 - streams-schemas

moves jsonschemas to a seperate module
  this averts dependency graph cycle that would occur once 
streams-plugin-pojo is a dependency of streams-pojo and streams-scala

commit bf31cbe000b950cb07298d7dbc735726d4b91e3d
Author: Steve Blackmon @steveblackmon 
Date:   2016-04-21T16:42:44Z

STREAMS-398 - pojo generation

code and plugin for generating POJOs now resides in streams-project
unit testing for generating POJOs without maven
unit testing for generating POJOs with maven

commit 9618adaf3f828f9f3682226f666e5732824e4212
Author: Steve Blackmon @steveblackmon 
Date:   2016-05-03T21:32:58Z

hive generation is looking pretty good

commit 02dc8efc6615142cce4d3ddd62d28c1972c82855
Author: Steve Blackmon @steveblackmon 
Date:   2016-05-03T21:33:47Z

re-enable hive plugin

commit 95a02d71c8b28ffda7ef37a151efd896d65b1223
Author: Steve Blackmon @steveblackmon 
Date:   2016-05-07T00:45:12Z

WIP for apachecon

commit 57f17d765a5e0f4767a998e47e8afb096a8ff792
Author: Steve Blackmon (@steveblackmon) 
Date:   2015-12-07T20:48:38Z

first take at STREAMS-389: 
streams-project/streams-plugins/streams-plugin-scala

commit 6187265fc0395a8051483ba3b905d976299217a3
Author: Steve Blackmon @steveblackmon 
Date:   2016-06-01T17:32:14Z

refactoring, testing, documentation, CLI modes

break up streams-schemas into streams-util and 
streams-schema-activitystreams
add index.md to each plugin
specify basepath of jsonschema project-wide
harmonize plugin behavior, code style, docs
ensure all tests pass
add CLI modes




> Support generation of scala source from jsonschemas
> ---
>
> Key: STREAMS-389
> URL: https://issues.apache.org/jira/browse/STREAMS-389
> Project: Streams
>  Issue Type: New Feature
>Reporter: Steve Blackmon
>Assignee: Steve Blackmon
>
> Support generation of scala source from jsonschemas, similar to what 
> jsonschema2pojo does to generate java pojos.  Implement as a maven plugin 
> that can be enable on a module-by-module basis.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (STREAMS-389) Support generation of scala source from jsonschemas

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/STREAMS-389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15310750#comment-15310750
 ] 

ASF GitHub Bot commented on STREAMS-389:


Github user steveblackmon closed the pull request at:

https://github.com/apache/incubator-streams/pull/283


> Support generation of scala source from jsonschemas
> ---
>
> Key: STREAMS-389
> URL: https://issues.apache.org/jira/browse/STREAMS-389
> Project: Streams
>  Issue Type: New Feature
>Reporter: Steve Blackmon
>Assignee: Steve Blackmon
>
> Support generation of scala source from jsonschemas, similar to what 
> jsonschema2pojo does to generate java pojos.  Implement as a maven plugin 
> that can be enable on a module-by-module basis.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (STREAMS-389) Support generation of scala source from jsonschemas

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/STREAMS-389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15310770#comment-15310770
 ] 

ASF GitHub Bot commented on STREAMS-389:


GitHub user steveblackmon opened a pull request:

https://github.com/apache/incubator-streams/pull/284

source and resource generation modules

adds maven plugins to generate source code and resource files for several 
technologies
resolves STREAMS-389
resolves STREAMS-398
this is a big PR, BUT nearly all of it is new greenfield modules and there 
should be little to no impact on other modules at this point.

once the the java source generation capability specifically is ready, two 
additional steps are appropriate:
a) refactor out usage of org.jsonschema2pojo:jsonschema2pojo-maven-plugin 
and instead rely on org.apache.streams:streams-plugin-pojo 
b) replace references to the jsonschemas in streams-pojo with references to 
the jsonschemas in streams-schema-activitystreams.  the generated / compiled 
pojo can still reside in streams-pojo just the process by which they are built 
and the schemas themselves will be factored out for re-use elsewhere.

there are many many ways we can improve the individual generators and the 
common libraries underlying schema resolution and schema-driven generation. 
this PR merges the proof-of-concept starting point for that effort.

more details at 
http://sblackmon-apache-org.herokuapp.com/apacheconna2016-schemas.html

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/apache/incubator-streams STREAMS-389

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-streams/pull/284.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #284


commit 50f67bf8d97a61bb325f8524472f5c20e86287d0
Author: Steve Blackmon (@steveblackmon) 
Date:   2015-12-29T23:19:15Z

start of implementation for STREAMS-398

commit ded4ad68d41c8b158fdca3f249a57055eab095f8
Author: Steve Blackmon @steveblackmon 
Date:   2016-03-28T13:32:00Z

create streams-plugin-pojo

commit 7d318c3fba9faf106eed8797263d52114a312d6c
Author: Steve Blackmon @steveblackmon 
Date:   2016-03-28T13:32:19Z

rename Hive Generator

commit 387da685f37a7135d556f4f645a3e77e6138f958
Author: Steve Blackmon @steveblackmon 
Date:   2016-03-28T13:32:27Z

test pom for streams-plugin-pojo

commit 0424855cf0a4fd15be298906922333ae74c8e9ae
Author: Steve Blackmon @steveblackmon 
Date:   2016-04-21T16:41:59Z

STREAMS-398 - streams-schemas

moves jsonschemas to a seperate module
  this averts dependency graph cycle that would occur once 
streams-plugin-pojo is a dependency of streams-pojo and streams-scala

commit 7b8ef0a22707af88426c18e0869ad01a261602c5
Author: Steve Blackmon @steveblackmon 
Date:   2016-04-21T16:42:44Z

STREAMS-398 - pojo generation

code and plugin for generating POJOs now resides in streams-project
unit testing for generating POJOs without maven
unit testing for generating POJOs with maven

commit e84dcd7230f02087db2b6bf7ea6d2148d585e77d
Author: Steve Blackmon @steveblackmon 
Date:   2016-05-03T21:32:58Z

hive generation is looking pretty good

commit 114c1c5ff31447a0ab85d9a2518d5ce08284d3ff
Author: Steve Blackmon @steveblackmon 
Date:   2016-05-03T21:33:47Z

re-enable hive plugin

commit 61f2736a9424516606b9f7544b894cb81f65922c
Author: Steve Blackmon (@steveblackmon) 
Date:   2015-12-07T20:48:38Z

first take at STREAMS-389: 
streams-project/streams-plugins/streams-plugin-scala

commit 1bc84dbc614cc0537e3238a6786a005f609b429c
Author: Steve Blackmon @steveblackmon 
Date:   2016-05-07T00:45:12Z

WIP for apachecon

commit d9674f7c0706d0e170f123c461d22e56e8f73807
Author: Steve Blackmon @steveblackmon 
Date:   2016-06-01T17:32:14Z

refactoring, testing, documentation, CLI modes

break up streams-schemas into streams-util and 
streams-schema-activitystreams
add index.md to each plugin
specify basepath of jsonschema project-wide
harmonize plugin behavior, code style, docs
ensure all tests pass
add CLI modes




> Support generation of scala source from jsonschemas
> ---
>
> Key: STREAMS-389
> URL: https://issues.apache.org/jira/browse/STREAMS-389
> Project: Streams
>  Issue Type: New Feature
>Reporter: Steve Blackmon
>Assignee: Steve Blackmon
>
> Support generation of scala source from jsonschemas, similar to what 
> jsonschema2pojo does to generate java pojos.  Implement as a maven plugin 
> that can be enable on a module-by-module basis.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (STREAMS-74) Use maven plugin to require headers with correct license and required javadoc plugin lines

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/STREAMS-74?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15323326#comment-15323326
 ] 

ASF GitHub Bot commented on STREAMS-74:
---

GitHub user jfrazee opened a pull request:

https://github.com/apache/incubator-streams/pull/285

STREAMS-74 Adds contrib-check profile to verify, fixes licensing violations



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/jfrazee/incubator-streams STREAMS-74

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-streams/pull/285.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #285


commit 503245b725859205b91404ae56e9e04c7578e532
Author: Joey Frazee 
Date:   2016-06-01T04:05:04Z

Adds contrib-check profile to verify, fixes licensing violations




> Use maven plugin to require headers with correct license and required javadoc 
> plugin lines
> --
>
> Key: STREAMS-74
> URL: https://issues.apache.org/jira/browse/STREAMS-74
> Project: Streams
>  Issue Type: Improvement
>Reporter: Steve Blackmon
>Assignee: Joey Frazee
>Priority: Minor
>
> Use maven plugin to require headers with correct license and required javadoc 
> plugin lines



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (STREAMS-74) Use maven plugin to require headers with correct license and required javadoc plugin lines

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/STREAMS-74?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15323934#comment-15323934
 ] 

ASF GitHub Bot commented on STREAMS-74:
---

Github user steveblackmon commented on the issue:

https://github.com/apache/incubator-streams/pull/285
  
this will allow our CI system to let us knew if files are committed without 
appropriate license headers.
i believe i was the original committer of all the files adjusted in this PR 
- and confirm that they were all intended as AL 2.0
👍 


> Use maven plugin to require headers with correct license and required javadoc 
> plugin lines
> --
>
> Key: STREAMS-74
> URL: https://issues.apache.org/jira/browse/STREAMS-74
> Project: Streams
>  Issue Type: Improvement
>Reporter: Steve Blackmon
>Assignee: Joey Frazee
>Priority: Minor
>
> Use maven plugin to require headers with correct license and required javadoc 
> plugin lines



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (STREAMS-74) Use maven plugin to require headers with correct license and required javadoc plugin lines

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/STREAMS-74?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15323937#comment-15323937
 ] 

ASF GitHub Bot commented on STREAMS-74:
---

Github user steveblackmon commented on the issue:

https://github.com/apache/incubator-streams/pull/285
  
btw i think it's only a 'violation' per se if the project performs a 
release containing code missing an acceptable license or if otherwise negligent 
in permitting unlicensed code in the repo.  that's not the case here - 
rat:check is run before every release.


> Use maven plugin to require headers with correct license and required javadoc 
> plugin lines
> --
>
> Key: STREAMS-74
> URL: https://issues.apache.org/jira/browse/STREAMS-74
> Project: Streams
>  Issue Type: Improvement
>Reporter: Steve Blackmon
>Assignee: Joey Frazee
>Priority: Minor
>
> Use maven plugin to require headers with correct license and required javadoc 
> plugin lines



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (STREAMS-330) make TwitterErrorHandler respect the Twitter4j RateLimitStatus reset time

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/STREAMS-330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15353163#comment-15353163
 ] 

ASF GitHub Bot commented on STREAMS-330:


Github user asfgit closed the pull request at:

https://github.com/apache/incubator-streams/pull/282


> make TwitterErrorHandler respect the Twitter4j RateLimitStatus reset time
> -
>
> Key: STREAMS-330
> URL: https://issues.apache.org/jira/browse/STREAMS-330
> Project: Streams
>  Issue Type: Improvement
>Reporter: Steve Blackmon
>
> rather than auto-retry on a fixed schedule with a maximum number of failed 
> attempt, refactor TwitterErrorHandler to respect the Twitter4j 
> RateLimitStatus reset time and sleep for duration directed.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (STREAMS-74) Use maven plugin to require headers with correct license and required javadoc plugin lines

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/STREAMS-74?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15353229#comment-15353229
 ] 

ASF GitHub Bot commented on STREAMS-74:
---

Github user asfgit closed the pull request at:

https://github.com/apache/incubator-streams/pull/285


> Use maven plugin to require headers with correct license and required javadoc 
> plugin lines
> --
>
> Key: STREAMS-74
> URL: https://issues.apache.org/jira/browse/STREAMS-74
> Project: Streams
>  Issue Type: Improvement
>Reporter: Steve Blackmon
>Assignee: Joey Frazee
>Priority: Minor
>
> Use maven plugin to require headers with correct license and required javadoc 
> plugin lines



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (STREAMS-316) add “apache’ to the artifact name

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/STREAMS-316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15545270#comment-15545270
 ] 

ASF GitHub Bot commented on STREAMS-316:


GitHub user smarthi opened a pull request:

https://github.com/apache/incubator-streams-master/pull/5

STREAMS-316: Add 'apache' to artifact names



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/smarthi/incubator-streams-master master

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-streams-master/pull/5.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #5


commit 518cb42a6db287efd694c9bb87aa06f2e4d03234
Author: smarthi 
Date:   2016-10-04T12:47:23Z

STREAMS-316: Add 'apache' to artifact names




> add “apache’ to the artifact name
> -
>
> Key: STREAMS-316
> URL: https://issues.apache.org/jira/browse/STREAMS-316
> Project: Streams
>  Issue Type: Task
>Reporter: Steve Blackmon
>Priority: Trivial
>
> Suggestions from 0.2-rc3 vote:
> - You may want to consider adding “apache’ to the artifact name



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (STREAMS-316) add “apache’ to the artifact name

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/STREAMS-316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15545271#comment-15545271
 ] 

ASF GitHub Bot commented on STREAMS-316:


GitHub user smarthi opened a pull request:

https://github.com/apache/incubator-streams/pull/286

STREAMS-316: Add 'apache' to artifact names



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/smarthi/incubator-streams sundry

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-streams/pull/286.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #286


commit e32c846430c8877f64f58b833cbe6429ca9f804c
Author: smarthi 
Date:   2016-10-04T12:46:33Z

STREAMS-316: Add 'apache' to artifact names




> add “apache’ to the artifact name
> -
>
> Key: STREAMS-316
> URL: https://issues.apache.org/jira/browse/STREAMS-316
> Project: Streams
>  Issue Type: Task
>Reporter: Steve Blackmon
>Priority: Trivial
>
> Suggestions from 0.2-rc3 vote:
> - You may want to consider adding “apache’ to the artifact name



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (STREAMS-403) Ensure all providers function stand-alone

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/STREAMS-403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15546522#comment-15546522
 ] 

ASF GitHub Bot commented on STREAMS-403:


GitHub user steveblackmon opened a pull request:

https://github.com/apache/incubator-streams/pull/287

related to STREAMS-403



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/steveblackmon/incubator-streams STREAMS-403

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-streams/pull/287.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #287


commit 9bf8ef9ba566351a855366875f0253059c0473ed
Author: Steve Blackmon @steveblackmon 
Date:   2016-10-04T20:06:14Z

related to STREAMS-403




> Ensure all providers function stand-alone
> -
>
> Key: STREAMS-403
> URL: https://issues.apache.org/jira/browse/STREAMS-403
> Project: Streams
>  Issue Type: Improvement
>Reporter: Steve Blackmon
>Assignee: Steve Blackmon
> Fix For: 0.4
>
>
> Any provider should be able to collect and supply data using the following 
> simple pattern:
> instantiate via constructor
> call prepare
> call startStream
> do {
>   readCurrent
> } while !isRunning
> cleanUp
> this should work regardless of what runtime (or whether any runtime) is 
> involved.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (STREAMS-316) add “apache’ to the artifact name

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/STREAMS-316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15546697#comment-15546697
 ] 

ASF GitHub Bot commented on STREAMS-316:


Github user steveblackmon commented on the issue:

https://github.com/apache/incubator-streams/pull/286
  
we'd have to do this simultaneously in all three repos and push snapshots 
for CI to pass


> add “apache’ to the artifact name
> -
>
> Key: STREAMS-316
> URL: https://issues.apache.org/jira/browse/STREAMS-316
> Project: Streams
>  Issue Type: Task
>Reporter: Steve Blackmon
>Assignee: Suneel Marthi
>Priority: Trivial
> Fix For: 0.4
>
>
> Suggestions from 0.2-rc3 vote:
> - You may want to consider adding “apache’ to the artifact name



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (STREAMS-423) reboot: cleanup source code using import .*;

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/STREAMS-423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15550243#comment-15550243
 ] 

ASF GitHub Bot commented on STREAMS-423:


Github user steveblackmon commented on a diff in the pull request:

https://github.com/apache/incubator-streams/pull/289#discussion_r82089937
  
--- Diff: 
streams-contrib/streams-provider-twitter/src/main/java/org/apache/streams/twitter/provider/TwitterTimelineProvider.java
 ---
@@ -18,22 +18,39 @@
 
 package org.apache.streams.twitter.provider;
 
+import com.fasterxml.jackson.core.JsonProcessingException;
+import com.fasterxml.jackson.databind.ObjectMapper;
 import com.google.common.base.Preconditions;
 import com.google.common.collect.Lists;
 import com.google.common.collect.Queues;
+import com.google.common.util.concurrent.Uninterruptibles;
+import com.typesafe.config.Config;
+import com.typesafe.config.ConfigFactory;
+import com.typesafe.config.ConfigParseOptions;
 import org.apache.commons.lang.NotImplementedException;
+import org.apache.streams.config.ComponentConfigurator;
+import org.apache.streams.config.StreamsConfiguration;
+import org.apache.streams.config.StreamsConfigurator;
 import org.apache.streams.core.DatumStatusCounter;
 import org.apache.streams.core.StreamsDatum;
 import org.apache.streams.core.StreamsProvider;
 import org.apache.streams.core.StreamsResultSet;
+import org.apache.streams.jackson.StreamsJacksonMapper;
 import org.apache.streams.twitter.TwitterUserInformationConfiguration;
+import org.apache.streams.twitter.converter.TwitterDateTimeFormat;
+import org.apache.streams.twitter.pojo.Tweet;
 import org.apache.streams.util.ComponentUtils;
 import org.joda.time.DateTime;
 import org.slf4j.Logger;
 import org.slf4j.LoggerFactory;
 import twitter4j.*;
--- End diff --

corrected within streams-provider-twitter for this PR
opened STREAMS-423 to correct project-wide


> reboot: cleanup source code using import .*;
> 
>
> Key: STREAMS-423
> URL: https://issues.apache.org/jira/browse/STREAMS-423
> Project: Streams
>  Issue Type: Task
>Reporter: Steve Blackmon
>Assignee: Steve Blackmon
>
> as ~smarthi mentioned, using import .*; is bad practice
> correct this in the >100 files where it occurs 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (STREAMS-423) reboot: cleanup source code using import .*;

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/STREAMS-423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15550244#comment-15550244
 ] 

ASF GitHub Bot commented on STREAMS-423:


Github user steveblackmon commented on a diff in the pull request:

https://github.com/apache/incubator-streams/pull/289#discussion_r82089943
  
--- Diff: 
streams-contrib/streams-provider-twitter/src/main/java/org/apache/streams/twitter/provider/TwitterTimelineProvider.java
 ---
@@ -18,22 +18,39 @@
 
 package org.apache.streams.twitter.provider;
 
+import com.fasterxml.jackson.core.JsonProcessingException;
+import com.fasterxml.jackson.databind.ObjectMapper;
 import com.google.common.base.Preconditions;
 import com.google.common.collect.Lists;
 import com.google.common.collect.Queues;
+import com.google.common.util.concurrent.Uninterruptibles;
+import com.typesafe.config.Config;
+import com.typesafe.config.ConfigFactory;
+import com.typesafe.config.ConfigParseOptions;
 import org.apache.commons.lang.NotImplementedException;
+import org.apache.streams.config.ComponentConfigurator;
+import org.apache.streams.config.StreamsConfiguration;
+import org.apache.streams.config.StreamsConfigurator;
 import org.apache.streams.core.DatumStatusCounter;
 import org.apache.streams.core.StreamsDatum;
 import org.apache.streams.core.StreamsProvider;
 import org.apache.streams.core.StreamsResultSet;
+import org.apache.streams.jackson.StreamsJacksonMapper;
 import org.apache.streams.twitter.TwitterUserInformationConfiguration;
+import org.apache.streams.twitter.converter.TwitterDateTimeFormat;
+import org.apache.streams.twitter.pojo.Tweet;
 import org.apache.streams.util.ComponentUtils;
 import org.joda.time.DateTime;
 import org.slf4j.Logger;
 import org.slf4j.LoggerFactory;
 import twitter4j.*;
 import twitter4j.conf.ConfigurationBuilder;
 
+import java.io.BufferedOutputStream;
+import java.io.File;
+import java.io.FileNotFoundException;
+import java.io.FileOutputStream;
+import java.io.PrintStream;
 import java.io.Serializable;
 import java.math.BigInteger;
 import java.util.*;
--- End diff --

corrected within streams-provider-twitter for this PR
opened STREAMS-423 to correct project-wide


> reboot: cleanup source code using import .*;
> 
>
> Key: STREAMS-423
> URL: https://issues.apache.org/jira/browse/STREAMS-423
> Project: Streams
>  Issue Type: Task
>Reporter: Steve Blackmon
>Assignee: Steve Blackmon
>
> as ~smarthi mentioned, using import .*; is bad practice
> correct this in the >100 files where it occurs 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (STREAMS-403) Ensure all providers function stand-alone

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/STREAMS-403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15556067#comment-15556067
 ] 

ASF GitHub Bot commented on STREAMS-403:


Github user asfgit closed the pull request at:

https://github.com/apache/incubator-streams/pull/287


> Ensure all providers function stand-alone
> -
>
> Key: STREAMS-403
> URL: https://issues.apache.org/jira/browse/STREAMS-403
> Project: Streams
>  Issue Type: Improvement
>Reporter: Steve Blackmon
>Assignee: Steve Blackmon
> Fix For: 0.4
>
>
> Any provider should be able to collect and supply data using the following 
> simple pattern:
> instantiate via constructor
> call prepare
> call startStream
> do {
>   readCurrent
> } while !isRunning
> cleanUp
> this should work regardless of what runtime (or whether any runtime) is 
> involved.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (STREAMS-409) the copyright year in the NOTICE files need to be updated for 2016.

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/STREAMS-409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15566239#comment-15566239
 ] 

ASF GitHub Bot commented on STREAMS-409:


GitHub user charlesmims opened a pull request:

https://github.com/apache/incubator-streams/pull/290

resolves STREAMS-409



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/charlesmims/incubator-streams STREAMS-409

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-streams/pull/290.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #290


commit 012d383ef690259cda96272676094c3ee8f223e7
Author: charlesmims 
Date:   2016-10-11T18:40:08Z

resolves STREAMS-409




> the copyright year in the NOTICE files need to be updated for 2016. 
> 
>
> Key: STREAMS-409
> URL: https://issues.apache.org/jira/browse/STREAMS-409
> Project: Streams
>  Issue Type: Task
>Reporter: Steve Blackmon
> Fix For: 0.4
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (STREAMS-405) Link to src/site/markdown/index.md in README.md is broken

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/STREAMS-405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15566260#comment-15566260
 ] 

ASF GitHub Bot commented on STREAMS-405:


GitHub user charlesmims opened a pull request:

https://github.com/apache/incubator-streams/pull/291

resolves STREAMS-405



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/charlesmims/incubator-streams STREAMS-405

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-streams/pull/291.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #291


commit 51961a01ded3072e2a2c1a66a46d22ed5dd64813
Author: charlesmims 
Date:   2016-10-11T18:53:53Z

resolves STREAMS-405




> Link to src/site/markdown/index.md in README.md is broken
> -
>
> Key: STREAMS-405
> URL: https://issues.apache.org/jira/browse/STREAMS-405
> Project: Streams
>  Issue Type: Bug
>Reporter: Joey Frazee
>Assignee: Joey Frazee
>Priority: Minor
> Fix For: 0.4
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (STREAMS-409) the copyright year in the NOTICE files need to be updated for 2016.

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/STREAMS-409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15566262#comment-15566262
 ] 

ASF GitHub Bot commented on STREAMS-409:


Github user mfranklin commented on the issue:

https://github.com/apache/incubator-streams/pull/290
  
👍 


> the copyright year in the NOTICE files need to be updated for 2016. 
> 
>
> Key: STREAMS-409
> URL: https://issues.apache.org/jira/browse/STREAMS-409
> Project: Streams
>  Issue Type: Task
>Reporter: Steve Blackmon
> Fix For: 0.4
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (STREAMS-405) Link to src/site/markdown/index.md in README.md is broken

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/STREAMS-405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15566279#comment-15566279
 ] 

ASF GitHub Bot commented on STREAMS-405:


Github user steveblackmon commented on the issue:

https://github.com/apache/incubator-streams/pull/291
  
👍 


> Link to src/site/markdown/index.md in README.md is broken
> -
>
> Key: STREAMS-405
> URL: https://issues.apache.org/jira/browse/STREAMS-405
> Project: Streams
>  Issue Type: Bug
>Reporter: Joey Frazee
>Assignee: Joey Frazee
>Priority: Minor
> Fix For: 0.4
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (STREAMS-407) add DateTimeSerializers for formats safely, don't crash if invalid

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/STREAMS-407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15566594#comment-15566594
 ] 

ASF GitHub Bot commented on STREAMS-407:


GitHub user steveblackmon opened a pull request:

https://github.com/apache/incubator-streams/pull/292

resolves STREAMS-407



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/steveblackmon/incubator-streams STREAMS-407

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-streams/pull/292.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #292


commit 1f5f5e7b8f38c5f39a7a2fbe3e69aaf486365558
Author: Steve Blackmon @steveblackmon 
Date:   2016-10-11T20:58:19Z

resolves STREAMS-407




> add DateTimeSerializers for formats safely, don't crash if invalid
> --
>
> Key: STREAMS-407
> URL: https://issues.apache.org/jira/browse/STREAMS-407
> Project: Streams
>  Issue Type: Bug
>Reporter: Steve Blackmon
>Assignee: Steve Blackmon
> Fix For: 0.4
>
>
> add DateTimeSerializers for formats safely, don't crash if invalid



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (STREAMS-410) Delete any modules which have been removed from reactor from master branch

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/STREAMS-410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15566763#comment-15566763
 ] 

ASF GitHub Bot commented on STREAMS-410:


GitHub user eponvert opened a pull request:

https://github.com/apache/incubator-streams/pull/293

Resolves STREAMS-410



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/eponvert/incubator-streams STREAMS-410

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-streams/pull/293.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #293


commit ce7aa24dab5a417a0470a0ce8e0f7cd2f3520271
Author: Elias Ponvert 
Date:   2016-10-11T22:02:40Z

resolves STREAMS-410




> Delete any modules which have been removed from reactor from master branch
> --
>
> Key: STREAMS-410
> URL: https://issues.apache.org/jira/browse/STREAMS-410
> Project: Streams
>  Issue Type: Task
>Reporter: Steve Blackmon
> Fix For: 0.4
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (STREAMS-410) Delete any modules which have been removed from reactor from master branch

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/STREAMS-410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15566778#comment-15566778
 ] 

ASF GitHub Bot commented on STREAMS-410:


Github user steveblackmon commented on the issue:

https://github.com/apache/incubator-streams/pull/293
  
that looks about right 👍 


> Delete any modules which have been removed from reactor from master branch
> --
>
> Key: STREAMS-410
> URL: https://issues.apache.org/jira/browse/STREAMS-410
> Project: Streams
>  Issue Type: Task
>Reporter: Steve Blackmon
> Fix For: 0.4
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (STREAMS-427) Support any jackson-compatible class as valid input to base converters and provider converters

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/STREAMS-427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15566926#comment-15566926
 ] 

ASF GitHub Bot commented on STREAMS-427:


GitHub user steveblackmon opened a pull request:

https://github.com/apache/incubator-streams/pull/294

resolves STREAMS-427

no reason to limit these classes to String and ObjectNode input documents
adds testing to ensure typed object and string json versions both work

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/steveblackmon/incubator-streams STREAMS-427

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-streams/pull/294.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #294


commit 57541e8b8bb61da98fe1f8a52ff7f85fe55f31cd
Author: Steve Blackmon @steveblackmon 
Date:   2016-10-11T23:15:30Z

resolves STREAMS-427




> Support any jackson-compatible class as valid input to base converters and 
> provider converters
> --
>
> Key: STREAMS-427
> URL: https://issues.apache.org/jira/browse/STREAMS-427
> Project: Streams
>  Issue Type: Improvement
>Reporter: Steve Blackmon
>Assignee: Steve Blackmon
> Fix For: 0.4
>
>
> some converters require input datum to be a json string or jackson object 
> node.
> any bean that can be serialized as json should be valid.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (STREAMS-405) Link to src/site/markdown/index.md in README.md is broken

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/STREAMS-405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15568936#comment-15568936
 ] 

ASF GitHub Bot commented on STREAMS-405:


Github user asfgit closed the pull request at:

https://github.com/apache/incubator-streams/pull/291


> Link to src/site/markdown/index.md in README.md is broken
> -
>
> Key: STREAMS-405
> URL: https://issues.apache.org/jira/browse/STREAMS-405
> Project: Streams
>  Issue Type: Bug
>Reporter: Joey Frazee
>Assignee: Joey Frazee
>Priority: Minor
> Fix For: 0.4
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (STREAMS-409) the copyright year in the NOTICE files need to be updated for 2016.

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/STREAMS-409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15568943#comment-15568943
 ] 

ASF GitHub Bot commented on STREAMS-409:


Github user asfgit closed the pull request at:

https://github.com/apache/incubator-streams/pull/290


> the copyright year in the NOTICE files need to be updated for 2016. 
> 
>
> Key: STREAMS-409
> URL: https://issues.apache.org/jira/browse/STREAMS-409
> Project: Streams
>  Issue Type: Task
>Reporter: Steve Blackmon
> Fix For: 0.4
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (STREAMS-410) Delete any modules which have been removed from reactor from master branch

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/STREAMS-410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15568961#comment-15568961
 ] 

ASF GitHub Bot commented on STREAMS-410:


Github user asfgit closed the pull request at:

https://github.com/apache/incubator-streams/pull/293


> Delete any modules which have been removed from reactor from master branch
> --
>
> Key: STREAMS-410
> URL: https://issues.apache.org/jira/browse/STREAMS-410
> Project: Streams
>  Issue Type: Task
>Reporter: Steve Blackmon
> Fix For: 0.4
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (STREAMS-389) Support generation of scala source from jsonschemas

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/STREAMS-389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15569375#comment-15569375
 ] 

ASF GitHub Bot commented on STREAMS-389:


Github user asfgit closed the pull request at:

https://github.com/apache/incubator-streams/pull/284


> Support generation of scala source from jsonschemas
> ---
>
> Key: STREAMS-389
> URL: https://issues.apache.org/jira/browse/STREAMS-389
> Project: Streams
>  Issue Type: New Feature
>Reporter: Steve Blackmon
>Assignee: Steve Blackmon
>
> Support generation of scala source from jsonschemas, similar to what 
> jsonschema2pojo does to generate java pojos.  Implement as a maven plugin 
> that can be enable on a module-by-module basis.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (STREAMS-407) add DateTimeSerializers for formats safely, don't crash if invalid

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/STREAMS-407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15572171#comment-15572171
 ] 

ASF GitHub Bot commented on STREAMS-407:


Github user steveblackmon commented on the issue:

https://github.com/apache/incubator-streams/pull/292
  
I will lazy consensus merge this in 24 hours.


> add DateTimeSerializers for formats safely, don't crash if invalid
> --
>
> Key: STREAMS-407
> URL: https://issues.apache.org/jira/browse/STREAMS-407
> Project: Streams
>  Issue Type: Bug
>Reporter: Steve Blackmon
>Assignee: Steve Blackmon
> Fix For: 0.4
>
>
> add DateTimeSerializers for formats safely, don't crash if invalid



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (STREAMS-427) Support any jackson-compatible class as valid input to base converters and provider converters

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/STREAMS-427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15572168#comment-15572168
 ] 

ASF GitHub Bot commented on STREAMS-427:


Github user steveblackmon commented on the issue:

https://github.com/apache/incubator-streams/pull/294
  
I will lazy consensus merge this in 24 hours.


> Support any jackson-compatible class as valid input to base converters and 
> provider converters
> --
>
> Key: STREAMS-427
> URL: https://issues.apache.org/jira/browse/STREAMS-427
> Project: Streams
>  Issue Type: Improvement
>Reporter: Steve Blackmon
>Assignee: Steve Blackmon
> Fix For: 0.4
>
>
> some converters require input datum to be a json string or jackson object 
> node.
> any bean that can be serialized as json should be valid.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (STREAMS-413) Update dependency and plugin versions - Q4 2016

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/STREAMS-413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15573160#comment-15573160
 ] 

ASF GitHub Bot commented on STREAMS-413:


GitHub user steveblackmon opened a pull request:

https://github.com/apache/incubator-streams/pull/298

level up facebook provider

update jFacebook client version (STREAMS-413)
use provider without a runtime (STREAMS-403)
add main methods to each Provider (STREAMS-411)
add real integration tests (STREAMS-415)
isolate isRunning and readCurrent (STREAMS-425)
FacebookPostSerDeIT was failing, now it’s passing

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/steveblackmon/incubator-streams 0.4-facebook

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-streams/pull/298.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #298


commit 112fba0896d0588ea236a42ed5cc7ff95987260f
Author: Steve Blackmon @steveblackmon 
Date:   2016-10-13T20:57:58Z

level up facebook provider

update jFacebook client version (STREAMS-413)
use provider without a runtime (STREAMS-403)
add main methods to each Provider (STREAMS-411)
add real integration tests (STREAMS-415)
isolate isRunning and readCurrent (STREAMS-425)
FacebookPostSerDeIT was failing, now it’s passing




> Update dependency and plugin versions - Q4 2016
> ---
>
> Key: STREAMS-413
> URL: https://issues.apache.org/jira/browse/STREAMS-413
> Project: Streams
>  Issue Type: Improvement
>Reporter: Steve Blackmon
> Fix For: 0.4
>
>
> Update dependency and plugin versions in poms through-out 
> incubator-streams-master and streams-project.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (STREAMS-427) Support any jackson-compatible class as valid input to base converters and provider converters

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/STREAMS-427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15575531#comment-15575531
 ] 

ASF GitHub Bot commented on STREAMS-427:


Github user asfgit closed the pull request at:

https://github.com/apache/incubator-streams/pull/294


> Support any jackson-compatible class as valid input to base converters and 
> provider converters
> --
>
> Key: STREAMS-427
> URL: https://issues.apache.org/jira/browse/STREAMS-427
> Project: Streams
>  Issue Type: Improvement
>Reporter: Steve Blackmon
>Assignee: Steve Blackmon
> Fix For: 0.4
>
>
> some converters require input datum to be a json string or jackson object 
> node.
> any bean that can be serialized as json should be valid.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (STREAMS-407) add DateTimeSerializers for formats safely, don't crash if invalid

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/STREAMS-407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15575576#comment-15575576
 ] 

ASF GitHub Bot commented on STREAMS-407:


Github user asfgit closed the pull request at:

https://github.com/apache/incubator-streams/pull/292


> add DateTimeSerializers for formats safely, don't crash if invalid
> --
>
> Key: STREAMS-407
> URL: https://issues.apache.org/jira/browse/STREAMS-407
> Project: Streams
>  Issue Type: Bug
>Reporter: Steve Blackmon
>Assignee: Steve Blackmon
> Fix For: 0.4
>
>
> add DateTimeSerializers for formats safely, don't crash if invalid



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (STREAMS-413) Update dependency and plugin versions - Q4 2016

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/STREAMS-413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15576889#comment-15576889
 ] 

ASF GitHub Bot commented on STREAMS-413:


GitHub user steveblackmon opened a pull request:

https://github.com/apache/incubator-streams/pull/299

0.4 gplus

level up gplus provider

update google client version (STREAMS-413)
use provider without a runtime (STREAMS-403)
add main methods to each Provider (STREAMS-411)
add real integration tests (STREAMS-415)
isolate isRunning and readCurrent (STREAMS-425)
and fix failing integration test

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/steveblackmon/incubator-streams 0.4-gplus

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-streams/pull/299.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #299


commit b7ee7d4d9845d15685ae6b9e5b8a332bbc18f891
Author: Steve Blackmon @steveblackmon 
Date:   2016-10-14T14:33:44Z

start level-up gplus providers

commit 3f80b0c1948046d295910bc3c1368e839e097b7d
Author: Steve Blackmon @steveblackmon 
Date:   2016-10-14T20:32:24Z

integration tests work

commit a0fb1937df887b789db7a57bfab1fc99f8db45b8
Author: Steve Blackmon @steveblackmon 
Date:   2016-10-14T20:49:54Z

isolate isRunning and readCurrent (STREAMS-425)

commit 770a8cb16db77372d1d50895045472211db4cd40
Author: Steve Blackmon @steveblackmon 
Date:   2016-10-14T20:50:25Z

add main methods and instructions on how to run to each Provider 
(STREAMS-411)

commit ee1d3c0956285f05aa7f69393267595da071b02f
Author: Steve Blackmon @steveblackmon 
Date:   2016-10-14T23:38:47Z

fix failing ITs




> Update dependency and plugin versions - Q4 2016
> ---
>
> Key: STREAMS-413
> URL: https://issues.apache.org/jira/browse/STREAMS-413
> Project: Streams
>  Issue Type: Improvement
>Reporter: Steve Blackmon
>Assignee: Steve Blackmon
> Fix For: 0.4
>
>
> Update dependency and plugin versions in poms through-out 
> incubator-streams-master and streams-project.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (STREAMS-416) Delete defunct or not-implemented provider modules

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/STREAMS-416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15582650#comment-15582650
 ] 

ASF GitHub Bot commented on STREAMS-416:


GitHub user eponvert opened a pull request:

https://github.com/apache/incubator-streams/pull/300

Resolves STREAMS-416



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/eponvert/incubator-streams STREAMS-416

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-streams/pull/300.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #300


commit 0b512d8b6c0d2b36a635d20b9be9a481eb67d6b9
Author: Elias Ponvert 
Date:   2016-10-17T15:37:51Z

Resolves STREAMS-416




> Delete defunct or not-implemented provider modules
> --
>
> Key: STREAMS-416
> URL: https://issues.apache.org/jira/browse/STREAMS-416
> Project: Streams
>  Issue Type: Task
>Reporter: Steve Blackmon
>Assignee: Elias Ponvert
> Fix For: 0.4
>
>
> Delete any provider modules for which the integrated service is no longer 
> running.
> streams-provider-datasift/ : Datasift no longer supplies twitter data so 
> there's no reason to keep any of the twitter support around. 
> streams-provider-gnip/gnip-edc-* : None of these providers actually collect 
> data.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (STREAMS-412) ability (and instructions on how) to run processors directly from console

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/STREAMS-412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15582713#comment-15582713
 ] 

ASF GitHub Bot commented on STREAMS-412:


GitHub user steveblackmon opened a pull request:

https://github.com/apache/incubator-streams/pull/301

level up rss provider

add main methods to each Provider (STREAMS-412)
add real integration tests (STREAMS-415)
fix a failing test

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/steveblackmon/incubator-streams 0.4-rss

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-streams/pull/301.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #301


commit 427faf5378b3de99df81604dd4ec856c89766224
Author: Steve Blackmon @steveblackmon 
Date:   2016-10-17T16:44:20Z

level up rss provider

add main methods to each Provider (STREAMS-412)
add real integration tests (STREAMS-415)
fix a failing test




> ability (and instructions on how) to run processors directly from console
> -
>
> Key: STREAMS-412
> URL: https://issues.apache.org/jira/browse/STREAMS-412
> Project: Streams
>  Issue Type: Improvement
>Reporter: Steve Blackmon
>
> All of the processors currently require attachment to a run-time to use.
> If processors could be configured and executed directly from the console, 
> they would become more valuable for casual use cases where users just want to 
> easily transform documents without writing or deploying custom code.
> This would probably take the form of adding a main method and perhaps a 
> Runnable trait to each processor, that when launched resolves the appropriate 
> typesafe config, starts up the process, and transforms documents from STDIN 
> writing them to STDOUT until the input stops.
> Instructions how to do this should also be added to the javadocs of the 
> processors and/or the markdowns of each module.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (STREAMS-416) Delete defunct or not-implemented provider modules

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/STREAMS-416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15582728#comment-15582728
 ] 

ASF GitHub Bot commented on STREAMS-416:


Github user steveblackmon commented on the issue:

https://github.com/apache/incubator-streams/pull/300
  
looks good to me.  it would be great to restore some of these features at a 
higher level of code quality and test coverage someday but for now i'd just as 
soon remove everything that isn't known to work as advertised. 👍 


> Delete defunct or not-implemented provider modules
> --
>
> Key: STREAMS-416
> URL: https://issues.apache.org/jira/browse/STREAMS-416
> Project: Streams
>  Issue Type: Task
>Reporter: Steve Blackmon
>Assignee: Elias Ponvert
> Fix For: 0.4
>
>
> Delete any provider modules for which the integrated service is no longer 
> running.
> streams-provider-datasift/ : Datasift no longer supplies twitter data so 
> there's no reason to keep any of the twitter support around. 
> streams-provider-gnip/gnip-edc-* : None of these providers actually collect 
> data.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (STREAMS-429) fix failing tests in streams-plugins

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/STREAMS-429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15584079#comment-15584079
 ] 

ASF GitHub Bot commented on STREAMS-429:


GitHub user steveblackmon opened a pull request:

https://github.com/apache/incubator-streams/pull/302

STREAMS-429 - fix failing tests in streams-plugins

progress on STREAMS-430 - update jenkins to run advanced integration testing

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/apache/incubator-streams STREAMS-429

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-streams/pull/302.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #302


commit 055ed882af713ff17ad5498aab66be973d5e9b75
Author: Steve Blackmon @steveblackmon 
Date:   2016-10-17T17:40:29Z

switch mojo tests to ITs, so they don’t fail jenkins Streams Trunk build

commit 2b57853a80b1ae8a37572df5a30a1c47438ab6b0
Author: Steve Blackmon @steveblackmon 
Date:   2016-10-17T21:38:57Z

these plugin versions should be inherited from streams-master

commit 0dec8adab664e1c1054c05c942b4cd39ddb6fded
Author: Steve Blackmon @steveblackmon 
Date:   2016-10-17T21:39:23Z

hotfix test failure due to addition of AL 2.0 header

commit b5303f8b58733c0242d2dddaa775051a73472d9e
Author: Steve Blackmon @steveblackmon 
Date:   2016-10-17T22:08:17Z

maybe this’ll fix it?

commit e7bb15a51c5d9ecf570685b3af7149e3252bd16e
Author: Steve Blackmon @steveblackmon 
Date:   2016-10-17T23:17:15Z

same change to mongo and es

commit 77d780c84f92c917576281ef2e5e987cabe56d6a
Author: Steve Blackmon @steveblackmon 
Date:   2016-10-18T01:28:58Z

mvn clean install passes

moves as 1.0 test jsons into streams-schemas-activitystreams




> fix failing tests in streams-plugins
> 
>
> Key: STREAMS-429
> URL: https://issues.apache.org/jira/browse/STREAMS-429
> Project: Streams
>  Issue Type: Improvement
>Reporter: Steve Blackmon
>Assignee: Steve Blackmon
> Fix For: 0.4
>
>
> 6 tests in streams-plugins are failing verify in jenkins
> https://builds.apache.org/job/Streams%20Trunk/236/



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (STREAMS-429) fix failing tests in streams-plugins

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/STREAMS-429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15584081#comment-15584081
 ] 

ASF GitHub Bot commented on STREAMS-429:


Github user steveblackmon commented on the issue:

https://github.com/apache/incubator-streams/pull/302
  
merging now, in the interest of promptly restoring 
https://builds.apache.org/job/streams-project/ to stable


> fix failing tests in streams-plugins
> 
>
> Key: STREAMS-429
> URL: https://issues.apache.org/jira/browse/STREAMS-429
> Project: Streams
>  Issue Type: Improvement
>Reporter: Steve Blackmon
>Assignee: Steve Blackmon
> Fix For: 0.4
>
>
> 6 tests in streams-plugins are failing verify in jenkins
> https://builds.apache.org/job/Streams%20Trunk/236/



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (STREAMS-429) fix failing tests in streams-plugins

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/STREAMS-429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15584083#comment-15584083
 ] 

ASF GitHub Bot commented on STREAMS-429:


Github user asfgit closed the pull request at:

https://github.com/apache/incubator-streams/pull/302


> fix failing tests in streams-plugins
> 
>
> Key: STREAMS-429
> URL: https://issues.apache.org/jira/browse/STREAMS-429
> Project: Streams
>  Issue Type: Improvement
>Reporter: Steve Blackmon
>Assignee: Steve Blackmon
> Fix For: 0.4
>
>
> 6 tests in streams-plugins are failing verify in jenkins
> https://builds.apache.org/job/Streams%20Trunk/236/



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (STREAMS-316) add “apache’ to the artifact name

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/STREAMS-316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15586469#comment-15586469
 ] 

ASF GitHub Bot commented on STREAMS-316:


Github user steveblackmon commented on the issue:

https://github.com/apache/incubator-streams/pull/286
  
@smarthi can you close this PR since we resolved the issue won't fix?


> add “apache’ to the artifact name
> -
>
> Key: STREAMS-316
> URL: https://issues.apache.org/jira/browse/STREAMS-316
> Project: Streams
>  Issue Type: Task
>Reporter: Steve Blackmon
>Assignee: Suneel Marthi
>Priority: Trivial
> Fix For: 0.4
>
>
> Suggestions from 0.2-rc3 vote:
> - You may want to consider adding “apache’ to the artifact name



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (STREAMS-316) add “apache’ to the artifact name

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/STREAMS-316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15586536#comment-15586536
 ] 

ASF GitHub Bot commented on STREAMS-316:


Github user smarthi closed the pull request at:

https://github.com/apache/incubator-streams/pull/286


> add “apache’ to the artifact name
> -
>
> Key: STREAMS-316
> URL: https://issues.apache.org/jira/browse/STREAMS-316
> Project: Streams
>  Issue Type: Task
>Reporter: Steve Blackmon
>Assignee: Suneel Marthi
>Priority: Trivial
> Fix For: 0.4
>
>
> Suggestions from 0.2-rc3 vote:
> - You may want to consider adding “apache’ to the artifact name



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (STREAMS-416) Delete defunct or not-implemented provider modules

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/STREAMS-416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15587253#comment-15587253
 ] 

ASF GitHub Bot commented on STREAMS-416:


Github user asfgit closed the pull request at:

https://github.com/apache/incubator-streams/pull/300


> Delete defunct or not-implemented provider modules
> --
>
> Key: STREAMS-416
> URL: https://issues.apache.org/jira/browse/STREAMS-416
> Project: Streams
>  Issue Type: Task
>Reporter: Steve Blackmon
>Assignee: Elias Ponvert
> Fix For: 0.4
>
>
> Delete any provider modules for which the integrated service is no longer 
> running.
> streams-provider-datasift/ : Datasift no longer supplies twitter data so 
> there's no reason to keep any of the twitter support around. 
> streams-provider-gnip/gnip-edc-* : None of these providers actually collect 
> data.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (STREAMS-413) Update dependency and plugin versions - Q4 2016

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/STREAMS-413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15589786#comment-15589786
 ] 

ASF GitHub Bot commented on STREAMS-413:


Github user asfgit closed the pull request at:

https://github.com/apache/incubator-streams/pull/299


> Update dependency and plugin versions - Q4 2016
> ---
>
> Key: STREAMS-413
> URL: https://issues.apache.org/jira/browse/STREAMS-413
> Project: Streams
>  Issue Type: Improvement
>Reporter: Steve Blackmon
>Assignee: Steve Blackmon
> Fix For: 0.4
>
>
> Update dependency and plugin versions in poms through-out 
> incubator-streams-master and streams-project.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (STREAMS-412) ability (and instructions on how) to run processors directly from console

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/STREAMS-412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15589800#comment-15589800
 ] 

ASF GitHub Bot commented on STREAMS-412:


Github user asfgit closed the pull request at:

https://github.com/apache/incubator-streams/pull/301


> ability (and instructions on how) to run processors directly from console
> -
>
> Key: STREAMS-412
> URL: https://issues.apache.org/jira/browse/STREAMS-412
> Project: Streams
>  Issue Type: Improvement
>Reporter: Steve Blackmon
>
> All of the processors currently require attachment to a run-time to use.
> If processors could be configured and executed directly from the console, 
> they would become more valuable for casual use cases where users just want to 
> easily transform documents without writing or deploying custom code.
> This would probably take the form of adding a main method and perhaps a 
> Runnable trait to each processor, that when launched resolves the appropriate 
> typesafe config, starts up the process, and transforms documents from STDIN 
> writing them to STDOUT until the input stops.
> Instructions how to do this should also be added to the javadocs of the 
> processors and/or the markdowns of each module.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (STREAMS-413) Update dependency and plugin versions - Q4 2016

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/STREAMS-413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15589820#comment-15589820
 ] 

ASF GitHub Bot commented on STREAMS-413:


Github user asfgit closed the pull request at:

https://github.com/apache/incubator-streams/pull/298


> Update dependency and plugin versions - Q4 2016
> ---
>
> Key: STREAMS-413
> URL: https://issues.apache.org/jira/browse/STREAMS-413
> Project: Streams
>  Issue Type: Improvement
>Reporter: Steve Blackmon
>Assignee: Steve Blackmon
> Fix For: 0.4
>
>
> Update dependency and plugin versions in poms through-out 
> incubator-streams-master and streams-project.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (STREAMS-421) Delete defunct or not-implemented runtime modules

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/STREAMS-421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15592571#comment-15592571
 ] 

ASF GitHub Bot commented on STREAMS-421:


GitHub user smarthi opened a pull request:

https://github.com/apache/incubator-streams/pull/303

STREAMS-421: Delete defunct or not-implemented runtime modules



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/smarthi/incubator-streams STREAMS-421

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-streams/pull/303.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #303


commit 11e3a0f1b78e548c7678a91f6793c8568cfca0c9
Author: smarthi 
Date:   2016-10-20T18:19:30Z

STREAMS-421: Delete defunct or not-implemented runtime modules




> Delete defunct or not-implemented runtime modules
> -
>
> Key: STREAMS-421
> URL: https://issues.apache.org/jira/browse/STREAMS-421
> Project: Streams
>  Issue Type: Task
>Reporter: Steve Blackmon
>Assignee: Suneel Marthi
> Fix For: 0.4
>
>
> Delete defunct or not-implemented runtime modules



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (STREAMS-421) Delete defunct or not-implemented runtime modules

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/STREAMS-421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15592602#comment-15592602
 ] 

ASF GitHub Bot commented on STREAMS-421:


Github user steveblackmon commented on the issue:

https://github.com/apache/incubator-streams/pull/303
  
looks good 👍 


> Delete defunct or not-implemented runtime modules
> -
>
> Key: STREAMS-421
> URL: https://issues.apache.org/jira/browse/STREAMS-421
> Project: Streams
>  Issue Type: Task
>Reporter: Steve Blackmon
>Assignee: Suneel Marthi
> Fix For: 0.4
>
>
> Delete defunct or not-implemented runtime modules



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (STREAMS-421) Delete defunct or not-implemented runtime modules

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/STREAMS-421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15592778#comment-15592778
 ] 

ASF GitHub Bot commented on STREAMS-421:


Github user asfgit closed the pull request at:

https://github.com/apache/incubator-streams/pull/303


> Delete defunct or not-implemented runtime modules
> -
>
> Key: STREAMS-421
> URL: https://issues.apache.org/jira/browse/STREAMS-421
> Project: Streams
>  Issue Type: Task
>Reporter: Steve Blackmon
>Assignee: Suneel Marthi
> Fix For: 0.4
>
>
> Delete defunct or not-implemented runtime modules



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (STREAMS-217) Delete unneeded Configurator classes

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/STREAMS-217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15593397#comment-15593397
 ] 

ASF GitHub Bot commented on STREAMS-217:


GitHub user smarthi opened a pull request:

https://github.com/apache/incubator-streams/pull/304

STREAMS-217: [WIP - Don't Merge] Delete unneeded Configurator classes



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/smarthi/incubator-streams STREAMS-186

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-streams/pull/304.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #304


commit 7524f4918b3f8389ce402b31dfc3526eace224b7
Author: smarthi 
Date:   2016-10-20T23:49:09Z

STREAMS-217: [WIP - Don't Merge] Delete unneeded Configurator classes




> Delete unneeded Configurator classes
> 
>
> Key: STREAMS-217
> URL: https://issues.apache.org/jira/browse/STREAMS-217
> Project: Streams
>  Issue Type: Sub-task
>Reporter: Steve Blackmon
>Assignee: Suneel Marthi
> Fix For: 0.4
>
>
> Quick hit list: Delete or at least @Deprecate each of these classes
> GMailConfigurator.java
> GPlusConfigurator.java
> HttpConfigurator.java
> ElasticsearchConfigurator.java
> HbaseConfigurator.java
> HdfsConfigurator.java
> KafkaConfigurator.java
> MongoConfigurator.java
> S3Configurator.java
> DatasiftStreamConfigurator.java
> FacebookStreamConfigurator.java
> InstagramConfigurator.java
> MoreoverConfigurator.java
> RssStreamConfigurator.java
> SysomosConfigurator.java
> TwitterConfigurator.java



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (STREAMS-412) ability (and instructions on how) to run processors directly from console

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/STREAMS-412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15595514#comment-15595514
 ] 

ASF GitHub Bot commented on STREAMS-412:


GitHub user steveblackmon opened a pull request:

https://github.com/apache/incubator-streams/pull/305

level up sysomos provider

add main methods to each Provider (STREAMS-412)
add real integration tests (STREAMS-415)
tune up POM

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/steveblackmon/incubator-streams 0.4-sysomos

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-streams/pull/305.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #305


commit ac523f62bb3ee157dcc8043f2a7b00d14e66a537
Author: Steve Blackmon @steveblackmon 
Date:   2016-10-21T16:03:13Z

level up sysomos provider

add main methods to each Provider (STREAMS-412)
add real integration tests (STREAMS-415)
tune up POM




> ability (and instructions on how) to run processors directly from console
> -
>
> Key: STREAMS-412
> URL: https://issues.apache.org/jira/browse/STREAMS-412
> Project: Streams
>  Issue Type: Improvement
>Reporter: Steve Blackmon
>
> All of the processors currently require attachment to a run-time to use.
> If processors could be configured and executed directly from the console, 
> they would become more valuable for casual use cases where users just want to 
> easily transform documents without writing or deploying custom code.
> This would probably take the form of adding a main method and perhaps a 
> Runnable trait to each processor, that when launched resolves the appropriate 
> typesafe config, starts up the process, and transforms documents from STDIN 
> writing them to STDOUT until the input stops.
> Instructions how to do this should also be added to the javadocs of the 
> processors and/or the markdowns of each module.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (STREAMS-412) ability (and instructions on how) to run processors directly from console

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/STREAMS-412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15595520#comment-15595520
 ] 

ASF GitHub Bot commented on STREAMS-412:


GitHub user steveblackmon opened a pull request:

https://github.com/apache/incubator-streams/pull/306

level up moreover provider

add main methods to each Provider (STREAMS-412)
add real integration tests (STREAMS-415)
reorganize packages

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/steveblackmon/incubator-streams 0.4-moreover

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-streams/pull/306.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #306


commit 015f0ae1eb8b662889e0fa544607c28e25b0dc38
Author: Steve Blackmon @steveblackmon 
Date:   2016-10-21T16:04:47Z

level up moreover provider

add main methods to each Provider (STREAMS-412)
add real integration tests (STREAMS-415)
reorganize packages




> ability (and instructions on how) to run processors directly from console
> -
>
> Key: STREAMS-412
> URL: https://issues.apache.org/jira/browse/STREAMS-412
> Project: Streams
>  Issue Type: Improvement
>Reporter: Steve Blackmon
>
> All of the processors currently require attachment to a run-time to use.
> If processors could be configured and executed directly from the console, 
> they would become more valuable for casual use cases where users just want to 
> easily transform documents without writing or deploying custom code.
> This would probably take the form of adding a main method and perhaps a 
> Runnable trait to each processor, that when launched resolves the appropriate 
> typesafe config, starts up the process, and transforms documents from STDIN 
> writing them to STDOUT until the input stops.
> Instructions how to do this should also be added to the javadocs of the 
> processors and/or the markdowns of each module.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (STREAMS-431) Remove streams.util.RegexUtils

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/STREAMS-431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15595746#comment-15595746
 ] 

ASF GitHub Bot commented on STREAMS-431:


GitHub user jfrazee opened a pull request:

https://github.com/apache/incubator-streams/pull/307

STREAMS-431 Remove streams.util.RegexUtils



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/jfrazee/incubator-streams STREAMS-431

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-streams/pull/307.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #307






> Remove streams.util.RegexUtils
> --
>
> Key: STREAMS-431
> URL: https://issues.apache.org/jira/browse/STREAMS-431
> Project: Streams
>  Issue Type: Improvement
>Reporter: Joey Frazee
>Assignee: Joey Frazee
>Priority: Minor
>
> org.apache.streams.util.RegexUtils isn't used in streams or streams-examples 
> and there's another RegexUtils available in 
> streams-contrib/streams-processor-regex. This unused class should be removed.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (STREAMS-431) Remove streams.util.RegexUtils

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/STREAMS-431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15595905#comment-15595905
 ] 

ASF GitHub Bot commented on STREAMS-431:


Github user steveblackmon commented on the issue:

https://github.com/apache/incubator-streams/pull/307
  
👍 


> Remove streams.util.RegexUtils
> --
>
> Key: STREAMS-431
> URL: https://issues.apache.org/jira/browse/STREAMS-431
> Project: Streams
>  Issue Type: Improvement
>Reporter: Joey Frazee
>Assignee: Joey Frazee
>Priority: Minor
>
> org.apache.streams.util.RegexUtils isn't used in streams or streams-examples 
> and there's another RegexUtils available in 
> streams-contrib/streams-processor-regex. This unused class should be removed.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (STREAMS-432) Update to Java 8

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/STREAMS-432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15595920#comment-15595920
 ] 

ASF GitHub Bot commented on STREAMS-432:


GitHub user jfrazee opened a pull request:

https://github.com/apache/incubator-streams/pull/308

STREAMS-432 Update to Java 8



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/jfrazee/incubator-streams STREAMS-432

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-streams/pull/308.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #308






> Update to Java 8
> 
>
> Key: STREAMS-432
> URL: https://issues.apache.org/jira/browse/STREAMS-432
> Project: Streams
>  Issue Type: Improvement
>Reporter: Joey Frazee
>Assignee: Joey Frazee
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (STREAMS-432) Update to Java 8

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/STREAMS-432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15595919#comment-15595919
 ] 

ASF GitHub Bot commented on STREAMS-432:


GitHub user jfrazee opened a pull request:

https://github.com/apache/incubator-streams-master/pull/7

STREAMS-432 Update to Java 8



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/jfrazee/incubator-streams-master STREAMS-432

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-streams-master/pull/7.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #7






> Update to Java 8
> 
>
> Key: STREAMS-432
> URL: https://issues.apache.org/jira/browse/STREAMS-432
> Project: Streams
>  Issue Type: Improvement
>Reporter: Joey Frazee
>Assignee: Joey Frazee
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (STREAMS-432) Update to Java 8

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/STREAMS-432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15595955#comment-15595955
 ] 

ASF GitHub Bot commented on STREAMS-432:


Github user smarthi commented on the issue:

https://github.com/apache/incubator-streams/pull/308
  
How about enforcing Java 8 and mmaven 3.3.9 like this?
`  
org.apache.maven.plugins
maven-enforcer-plugin
1.4

  
enforce-versions

  enforce


  

  [1.7,)

  
[3.3.3,)
  
  

  

  `


> Update to Java 8
> 
>
> Key: STREAMS-432
> URL: https://issues.apache.org/jira/browse/STREAMS-432
> Project: Streams
>  Issue Type: Improvement
>Reporter: Joey Frazee
>Assignee: Joey Frazee
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (STREAMS-432) Update to Java 8

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/STREAMS-432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15595963#comment-15595963
 ] 

ASF GitHub Bot commented on STREAMS-432:


Github user jfrazee commented on the issue:

https://github.com/apache/incubator-streams/pull/308
  
@smarthi That is what it's doing, but without the enforcement for Maven, so 
I'll add the Maven check and push back to the branch.


> Update to Java 8
> 
>
> Key: STREAMS-432
> URL: https://issues.apache.org/jira/browse/STREAMS-432
> Project: Streams
>  Issue Type: Improvement
>Reporter: Joey Frazee
>Assignee: Joey Frazee
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (STREAMS-217) Delete unneeded Configurator classes

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/STREAMS-217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15596012#comment-15596012
 ] 

ASF GitHub Bot commented on STREAMS-217:


Github user asfgit closed the pull request at:

https://github.com/apache/incubator-streams/pull/304


> Delete unneeded Configurator classes
> 
>
> Key: STREAMS-217
> URL: https://issues.apache.org/jira/browse/STREAMS-217
> Project: Streams
>  Issue Type: Sub-task
>Reporter: Steve Blackmon
>Assignee: Suneel Marthi
> Fix For: 0.4
>
>
> Quick hit list: Delete or at least @Deprecate each of these classes
> GMailConfigurator.java
> GPlusConfigurator.java
> HttpConfigurator.java
> ElasticsearchConfigurator.java
> HbaseConfigurator.java
> HdfsConfigurator.java
> KafkaConfigurator.java
> MongoConfigurator.java
> S3Configurator.java
> DatasiftStreamConfigurator.java
> FacebookStreamConfigurator.java
> InstagramConfigurator.java
> MoreoverConfigurator.java
> RssStreamConfigurator.java
> SysomosConfigurator.java
> TwitterConfigurator.java



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (STREAMS-432) Update to Java 8

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/STREAMS-432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15596014#comment-15596014
 ] 

ASF GitHub Bot commented on STREAMS-432:


Github user smarthi commented on a diff in the pull request:

https://github.com/apache/incubator-streams/pull/308#discussion_r84527128
  
--- Diff: incubator-streams-master-pom.xml ---
@@ -322,9 +323,13 @@
 
 
 
-Java 6 or higher is 
required to compile this module
-${java.version}
+Java 8 or higher is 
required to compile this module
+
[${java.version},)
 
+
+Maven 3.0 or higher is 
required to compile this module
--- End diff --

Enforce Maven 3.3.9 or higher


> Update to Java 8
> 
>
> Key: STREAMS-432
> URL: https://issues.apache.org/jira/browse/STREAMS-432
> Project: Streams
>  Issue Type: Improvement
>Reporter: Joey Frazee
>Assignee: Joey Frazee
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (STREAMS-432) Update to Java 8

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/STREAMS-432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15596016#comment-15596016
 ] 

ASF GitHub Bot commented on STREAMS-432:


Github user smarthi commented on a diff in the pull request:

https://github.com/apache/incubator-streams/pull/308#discussion_r84527171
  
--- Diff: incubator-streams-master-pom.xml ---
@@ -117,11 +117,12 @@
 
 
 
-1.7
+1.8
+3.0.5
--- End diff --

Change to 3.3.9


> Update to Java 8
> 
>
> Key: STREAMS-432
> URL: https://issues.apache.org/jira/browse/STREAMS-432
> Project: Streams
>  Issue Type: Improvement
>Reporter: Joey Frazee
>Assignee: Joey Frazee
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (STREAMS-431) Remove streams.util.RegexUtils

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/STREAMS-431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15596044#comment-15596044
 ] 

ASF GitHub Bot commented on STREAMS-431:


Github user asfgit closed the pull request at:

https://github.com/apache/incubator-streams/pull/307


> Remove streams.util.RegexUtils
> --
>
> Key: STREAMS-431
> URL: https://issues.apache.org/jira/browse/STREAMS-431
> Project: Streams
>  Issue Type: Improvement
>Reporter: Joey Frazee
>Assignee: Joey Frazee
>Priority: Minor
>
> org.apache.streams.util.RegexUtils isn't used in streams or streams-examples 
> and there's another RegexUtils available in 
> streams-contrib/streams-processor-regex. This unused class should be removed.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (STREAMS-432) Update to Java 8

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/STREAMS-432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15596053#comment-15596053
 ] 

ASF GitHub Bot commented on STREAMS-432:


Github user jfrazee commented on a diff in the pull request:

https://github.com/apache/incubator-streams/pull/308#discussion_r84528708
  
--- Diff: incubator-streams-master-pom.xml ---
@@ -117,11 +117,12 @@
 
 
 
-1.7
+1.8
+3.0.5
--- End diff --

Done.


> Update to Java 8
> 
>
> Key: STREAMS-432
> URL: https://issues.apache.org/jira/browse/STREAMS-432
> Project: Streams
>  Issue Type: Improvement
>Reporter: Joey Frazee
>Assignee: Joey Frazee
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (STREAMS-410) Delete any modules which have been removed from reactor from master branch

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/STREAMS-410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15596079#comment-15596079
 ] 

ASF GitHub Bot commented on STREAMS-410:


GitHub user smarthi opened a pull request:

https://github.com/apache/incubator-streams/pull/309

STREAMS-410: Delete Provision and Poms modules



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/smarthi/incubator-streams Streams-410

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-streams/pull/309.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #309


commit fbaa4664a9d3e51b983c0b0fdf73789cf52cf553
Author: smarthi 
Date:   2016-10-21T19:21:55Z

STREAMS-410: Delete Provision and Poms modules




> Delete any modules which have been removed from reactor from master branch
> --
>
> Key: STREAMS-410
> URL: https://issues.apache.org/jira/browse/STREAMS-410
> Project: Streams
>  Issue Type: Task
>Reporter: Steve Blackmon
>Assignee: Elias Ponvert
> Fix For: 0.4
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (STREAMS-410) Delete any modules which have been removed from reactor from master branch

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/STREAMS-410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15596096#comment-15596096
 ] 

ASF GitHub Bot commented on STREAMS-410:


Github user asfgit closed the pull request at:

https://github.com/apache/incubator-streams/pull/309


> Delete any modules which have been removed from reactor from master branch
> --
>
> Key: STREAMS-410
> URL: https://issues.apache.org/jira/browse/STREAMS-410
> Project: Streams
>  Issue Type: Task
>Reporter: Steve Blackmon
>Assignee: Elias Ponvert
> Fix For: 0.4
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (STREAMS-432) Update to Java 8

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/STREAMS-432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15596172#comment-15596172
 ] 

ASF GitHub Bot commented on STREAMS-432:


Github user smarthi commented on the issue:

https://github.com/apache/incubator-streams/pull/308
  
+1 LGTM, we could remove the declarations for both java and maven once we 
include the maven-enforcer-plugin and enforce the respective versions within 
there.


> Update to Java 8
> 
>
> Key: STREAMS-432
> URL: https://issues.apache.org/jira/browse/STREAMS-432
> Project: Streams
>  Issue Type: Improvement
>Reporter: Joey Frazee
>Assignee: Joey Frazee
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (STREAMS-316) add “apache’ to the artifact name

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/STREAMS-316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15596315#comment-15596315
 ] 

ASF GitHub Bot commented on STREAMS-316:


Github user smarthi closed the pull request at:

https://github.com/apache/incubator-streams-master/pull/5


> add “apache’ to the artifact name
> -
>
> Key: STREAMS-316
> URL: https://issues.apache.org/jira/browse/STREAMS-316
> Project: Streams
>  Issue Type: Task
>Reporter: Steve Blackmon
>Assignee: Suneel Marthi
>Priority: Trivial
> Fix For: 0.4
>
>
> Suggestions from 0.2-rc3 vote:
> - You may want to consider adding “apache’ to the artifact name



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (STREAMS-432) Update to Java 8

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/STREAMS-432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15598365#comment-15598365
 ] 

ASF GitHub Bot commented on STREAMS-432:


Github user asfgit closed the pull request at:

https://github.com/apache/incubator-streams/pull/308


> Update to Java 8
> 
>
> Key: STREAMS-432
> URL: https://issues.apache.org/jira/browse/STREAMS-432
> Project: Streams
>  Issue Type: Improvement
>Reporter: Joey Frazee
>Assignee: Joey Frazee
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (STREAMS-412) ability (and instructions on how) to run processors directly from console

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/STREAMS-412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15598373#comment-15598373
 ] 

ASF GitHub Bot commented on STREAMS-412:


Github user asfgit closed the pull request at:

https://github.com/apache/incubator-streams/pull/305


> ability (and instructions on how) to run processors directly from console
> -
>
> Key: STREAMS-412
> URL: https://issues.apache.org/jira/browse/STREAMS-412
> Project: Streams
>  Issue Type: Improvement
>Reporter: Steve Blackmon
> Fix For: 0.5
>
>
> All of the processors currently require attachment to a run-time to use.
> If processors could be configured and executed directly from the console, 
> they would become more valuable for casual use cases where users just want to 
> easily transform documents without writing or deploying custom code.
> This would probably take the form of adding a main method and perhaps a 
> Runnable trait to each processor, that when launched resolves the appropriate 
> typesafe config, starts up the process, and transforms documents from STDIN 
> writing them to STDOUT until the input stops.
> Instructions how to do this should also be added to the javadocs of the 
> processors and/or the markdowns of each module.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (STREAMS-412) ability (and instructions on how) to run processors directly from console

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/STREAMS-412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15598372#comment-15598372
 ] 

ASF GitHub Bot commented on STREAMS-412:


Github user asfgit closed the pull request at:

https://github.com/apache/incubator-streams/pull/306


> ability (and instructions on how) to run processors directly from console
> -
>
> Key: STREAMS-412
> URL: https://issues.apache.org/jira/browse/STREAMS-412
> Project: Streams
>  Issue Type: Improvement
>Reporter: Steve Blackmon
> Fix For: 0.5
>
>
> All of the processors currently require attachment to a run-time to use.
> If processors could be configured and executed directly from the console, 
> they would become more valuable for casual use cases where users just want to 
> easily transform documents without writing or deploying custom code.
> This would probably take the form of adding a main method and perhaps a 
> Runnable trait to each processor, that when launched resolves the appropriate 
> typesafe config, starts up the process, and transforms documents from STDIN 
> writing them to STDOUT until the input stops.
> Instructions how to do this should also be added to the javadocs of the 
> processors and/or the markdowns of each module.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (STREAMS-399) Add any missing fields to tweet.json

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/STREAMS-399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15598376#comment-15598376
 ] 

ASF GitHub Bot commented on STREAMS-399:


GitHub user steveblackmon opened a pull request:

https://github.com/apache/incubator-streams/pull/313

resolves STREAMS-399



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/steveblackmon/incubator-streams STREAMS-399

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-streams/pull/313.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #313


commit 57b715420b8b1b0eba544221a35d439e8fadb7b6
Author: Steve Blackmon @steveblackmon 
Date:   2016-10-21T17:01:32Z

resolves STREAMS-399




> Add any missing fields to tweet.json
> 
>
> Key: STREAMS-399
> URL: https://issues.apache.org/jira/browse/STREAMS-399
> Project: Streams
>  Issue Type: Improvement
>Reporter: Steve Blackmon
>Assignee: Steve Blackmon
>
> Noticed some new fields in tweets:
> is_quote_status
> quoted_status_id
> quoted_status
> Add these and any other missing fields to tweet.json



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (STREAMS-399) Add any missing fields to tweet.json

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/STREAMS-399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15598419#comment-15598419
 ] 

ASF GitHub Bot commented on STREAMS-399:


Github user smarthi commented on a diff in the pull request:

https://github.com/apache/incubator-streams/pull/313#discussion_r84584515
  
--- Diff: 
streams-contrib/streams-provider-twitter/src/main/java/org/apache/streams/twitter/converter/util/TwitterActivityUtil.java
 ---
@@ -350,4 +351,26 @@ public static void addTwitterExtensions(Activity 
activity, Tweet tweet) {
 
 extensions.put("keywords", tweet.getText());
 }
+
+/**
+ * Compute central coordinates from bounding box
+ * @param place the bounding box to use as the source
+ */
+public static List boundingBoxCenter(Place place) {
+if( place == null ) return new ArrayList<>();
+if( place.getBoundingBox() == null ) return new ArrayList<>();
+if( place.getBoundingBox().getCoordinates().size() != 1 ) return 
new ArrayList<>();
+if( place.getBoundingBox().getCoordinates().get(0).size() != 4 ) 
return new ArrayList<>();
+List lats = Lists.newArrayList();
+List lons = Lists.newArrayList();
+for( List point : 
place.getBoundingBox().getCoordinates().get(0)) {
+lats.add(point.get(0));
+lons.add(point.get(1));
+}
+List result = new ArrayList();
--- End diff --

the RHS can just be 'new ArrayList<>();' -> Java 7


> Add any missing fields to tweet.json
> 
>
> Key: STREAMS-399
> URL: https://issues.apache.org/jira/browse/STREAMS-399
> Project: Streams
>  Issue Type: Improvement
>Reporter: Steve Blackmon
>Assignee: Steve Blackmon
>
> Noticed some new fields in tweets:
> is_quote_status
> quoted_status_id
> quoted_status
> Add these and any other missing fields to tweet.json



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (STREAMS-399) Add any missing fields to tweet.json

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/STREAMS-399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15598433#comment-15598433
 ] 

ASF GitHub Bot commented on STREAMS-399:


Github user smarthi commented on a diff in the pull request:

https://github.com/apache/incubator-streams/pull/313#discussion_r84584725
  
--- Diff: 
streams-contrib/streams-provider-twitter/src/main/java/org/apache/streams/twitter/converter/util/TwitterActivityUtil.java
 ---
@@ -273,8 +275,7 @@ public static void addLocationExtension(Activity 
activity, Tweet tweet) {
 .or(Optional.of(tweet.getId().toString()))
 .orNull()
 ));
-location.put("coordinates", tweet.getCoordinates());
-extensions.put("location", location);
+location.put("coordinates", boundingBoxCenter(tweet.getPlace()));  
 extensions.put("location", location);
--- End diff --

put them on 2 separate lines


> Add any missing fields to tweet.json
> 
>
> Key: STREAMS-399
> URL: https://issues.apache.org/jira/browse/STREAMS-399
> Project: Streams
>  Issue Type: Improvement
>Reporter: Steve Blackmon
>Assignee: Steve Blackmon
>
> Noticed some new fields in tweets:
> is_quote_status
> quoted_status_id
> quoted_status
> Add these and any other missing fields to tweet.json



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (STREAMS-399) Add any missing fields to tweet.json

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/STREAMS-399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15598452#comment-15598452
 ] 

ASF GitHub Bot commented on STREAMS-399:


Github user steveblackmon commented on a diff in the pull request:

https://github.com/apache/incubator-streams/pull/313#discussion_r84584956
  
--- Diff: 
streams-contrib/streams-provider-twitter/src/main/java/org/apache/streams/twitter/converter/util/TwitterActivityUtil.java
 ---
@@ -49,6 +50,7 @@
 import java.util.List;
 import java.util.Map;
 
+import static com.google.common.math.DoubleMath.mean;
--- End diff --

sounds good this change alone doesn't remove the dependency


> Add any missing fields to tweet.json
> 
>
> Key: STREAMS-399
> URL: https://issues.apache.org/jira/browse/STREAMS-399
> Project: Streams
>  Issue Type: Improvement
>Reporter: Steve Blackmon
>Assignee: Steve Blackmon
>
> Noticed some new fields in tweets:
> is_quote_status
> quoted_status_id
> quoted_status
> Add these and any other missing fields to tweet.json



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (STREAMS-399) Add any missing fields to tweet.json

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/STREAMS-399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15598456#comment-15598456
 ] 

ASF GitHub Bot commented on STREAMS-399:


Github user steveblackmon closed the pull request at:

https://github.com/apache/incubator-streams/pull/313


> Add any missing fields to tweet.json
> 
>
> Key: STREAMS-399
> URL: https://issues.apache.org/jira/browse/STREAMS-399
> Project: Streams
>  Issue Type: Improvement
>Reporter: Steve Blackmon
>Assignee: Steve Blackmon
>
> Noticed some new fields in tweets:
> is_quote_status
> quoted_status_id
> quoted_status
> Add these and any other missing fields to tweet.json



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (STREAMS-399) Add any missing fields to tweet.json

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/STREAMS-399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15598455#comment-15598455
 ] 

ASF GitHub Bot commented on STREAMS-399:


Github user steveblackmon commented on the issue:

https://github.com/apache/incubator-streams/pull/313
  
had to rebase - closing this will reopen 


> Add any missing fields to tweet.json
> 
>
> Key: STREAMS-399
> URL: https://issues.apache.org/jira/browse/STREAMS-399
> Project: Streams
>  Issue Type: Improvement
>Reporter: Steve Blackmon
>Assignee: Steve Blackmon
>
> Noticed some new fields in tweets:
> is_quote_status
> quoted_status_id
> quoted_status
> Add these and any other missing fields to tweet.json



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (STREAMS-436) Put a timeout on all Provider Integration Tests

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/STREAMS-436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15600577#comment-15600577
 ] 

ASF GitHub Bot commented on STREAMS-436:


Github user steveblackmon commented on the issue:

https://github.com/apache/incubator-streams/pull/318
  
merged


> Put a timeout on all Provider Integration Tests 
> 
>
> Key: STREAMS-436
> URL: https://issues.apache.org/jira/browse/STREAMS-436
> Project: Streams
>  Issue Type: Bug
>Reporter: Steve Blackmon
>Assignee: Steve Blackmon
> Fix For: 0.4
>
>
> They should not be able to halt the build indefinitely if they have problems. 
>  This has happened several time on Jenkins



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (STREAMS-436) Put a timeout on all Provider Integration Tests

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/STREAMS-436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15600578#comment-15600578
 ] 

ASF GitHub Bot commented on STREAMS-436:


Github user steveblackmon closed the pull request at:

https://github.com/apache/incubator-streams/pull/318


> Put a timeout on all Provider Integration Tests 
> 
>
> Key: STREAMS-436
> URL: https://issues.apache.org/jira/browse/STREAMS-436
> Project: Streams
>  Issue Type: Bug
>Reporter: Steve Blackmon
>Assignee: Steve Blackmon
> Fix For: 0.4
>
>
> They should not be able to halt the build indefinitely if they have problems. 
>  This has happened several time on Jenkins



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (STREAMS-437) DatumFromMetadataProcessorIT failing during 0.4 release

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/STREAMS-437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15600584#comment-15600584
 ] 

ASF GitHub Bot commented on STREAMS-437:


GitHub user steveblackmon opened a pull request:

https://github.com/apache/incubator-streams/pull/319

STREAMS-437: Resolved



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/steveblackmon/incubator-streams STREAMS-437

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-streams/pull/319.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #319


commit 3856581a8bfd2b601d50765afd21c289537a1119
Author: Steve Blackmon @steveblackmon 
Date:   2016-10-24T00:50:35Z

STREAMS-437: Resolved




> DatumFromMetadataProcessorIT failing during 0.4 release
> ---
>
> Key: STREAMS-437
> URL: https://issues.apache.org/jira/browse/STREAMS-437
> Project: Streams
>  Issue Type: Bug
>Reporter: Steve Blackmon
>Assignee: Suneel Marthi
> Fix For: 0.4
>
>
> DatumFromMetadataProcessorIT is failing during 0.4 release.
> Figure out why and fix



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (STREAMS-437) DatumFromMetadataProcessorIT failing during 0.4 release

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/STREAMS-437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15600594#comment-15600594
 ] 

ASF GitHub Bot commented on STREAMS-437:


Github user asfgit closed the pull request at:

https://github.com/apache/incubator-streams/pull/319


> DatumFromMetadataProcessorIT failing during 0.4 release
> ---
>
> Key: STREAMS-437
> URL: https://issues.apache.org/jira/browse/STREAMS-437
> Project: Streams
>  Issue Type: Bug
>Reporter: Steve Blackmon
>Assignee: Suneel Marthi
> Fix For: 0.4
>
>
> DatumFromMetadataProcessorIT is failing during 0.4 release.
> Figure out why and fix



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (STREAMS-441) Remove compile dependency on guava for core packages

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/STREAMS-441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15605170#comment-15605170
 ] 

ASF GitHub Bot commented on STREAMS-441:


GitHub user smarthi opened a pull request:

https://github.com/apache/incubator-streams/pull/320

STREAMS-441: Remove compile dependency on guava for core packages

Initial set of changes, more to follow.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/smarthi/incubator-streams STREAMS-441

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-streams/pull/320.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #320


commit 52a98890c340c5527f885075e77f6eff5dec6bd7
Author: smarthi 
Date:   2016-10-25T04:50:41Z

STREAMS-441: Remove compile dependency on guava for core packages




> Remove compile dependency on guava for core packages
> 
>
> Key: STREAMS-441
> URL: https://issues.apache.org/jira/browse/STREAMS-441
> Project: Streams
>  Issue Type: Improvement
>Reporter: Steve Blackmon
>Assignee: Suneel Marthi
> Fix For: 0.5
>
>
> To simplify the transitive dependency tree and reduce odds of users hitting 
> shading issues.
> streams-util
> streams-config
> streams-core
> streams-pojo
> streams-pojo-extensions
> streams-schemas/*
> streams-verbs



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (STREAMS-446) RAT check fails in prep for 0.4-incubating release

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/STREAMS-446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15609152#comment-15609152
 ] 

ASF GitHub Bot commented on STREAMS-446:


GitHub user jfrazee opened a pull request:

https://github.com/apache/incubator-streams-master/pull/10

STREAMS-446 RAT check fails in prep for 0.4-incubating release



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/jfrazee/incubator-streams-master STREAMS-446

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-streams-master/pull/10.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #10






> RAT check fails in prep for 0.4-incubating release
> --
>
> Key: STREAMS-446
> URL: https://issues.apache.org/jira/browse/STREAMS-446
> Project: Streams
>  Issue Type: Bug
>Affects Versions: 0.3
>Reporter: Suneel Marthi
>Assignee: Joey Frazee
> Fix For: 0.4
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (STREAMS-446) RAT check fails in prep for 0.4-incubating release

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/STREAMS-446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15609151#comment-15609151
 ] 

ASF GitHub Bot commented on STREAMS-446:


GitHub user jfrazee opened a pull request:

https://github.com/apache/incubator-streams/pull/321

STREAMS-446 RAT check fails in prep for 0.4-incubating release



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/jfrazee/incubator-streams STREAMS-446

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-streams/pull/321.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #321






> RAT check fails in prep for 0.4-incubating release
> --
>
> Key: STREAMS-446
> URL: https://issues.apache.org/jira/browse/STREAMS-446
> Project: Streams
>  Issue Type: Bug
>Affects Versions: 0.3
>Reporter: Suneel Marthi
>Assignee: Joey Frazee
> Fix For: 0.4
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (STREAMS-446) RAT check fails in prep for 0.4-incubating release

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/STREAMS-446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15609201#comment-15609201
 ] 

ASF GitHub Bot commented on STREAMS-446:


Github user steveblackmon commented on a diff in the pull request:

https://github.com/apache/incubator-streams/pull/321#discussion_r85184214
  
--- Diff: pom.xml ---
@@ -235,6 +235,7 @@
   .gitignore
   .git/**
   .idea/**
+  .java-version
--- End diff --

it's fine to mark this to exclude manually, but the real problem is that 
by-products of build / test fall under apache-rat:check at all.

what if instead we bind apache-rat:check to validate phase globally in the 
master pom?


> RAT check fails in prep for 0.4-incubating release
> --
>
> Key: STREAMS-446
> URL: https://issues.apache.org/jira/browse/STREAMS-446
> Project: Streams
>  Issue Type: Bug
>Affects Versions: 0.3
>Reporter: Suneel Marthi
>Assignee: Joey Frazee
> Fix For: 0.4
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (STREAMS-446) RAT check fails in prep for 0.4-incubating release

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/STREAMS-446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15609211#comment-15609211
 ] 

ASF GitHub Bot commented on STREAMS-446:


Github user steveblackmon commented on a diff in the pull request:

https://github.com/apache/incubator-streams/pull/321#discussion_r85184664
  
--- Diff: pom.xml ---
@@ -250,6 +251,7 @@
   
**/src/site/resources/**/*.txt
   
**/src/site/resources/**/*.json
   **/.gitignore
+  **/*.md
--- End diff --

all (or nearly all) of the md files in the project have an apache license 
as a footer.  did you come across any that didn't?

also, we should probably consolidate these rules in the master pom, so they 
get applied in project and examples.


> RAT check fails in prep for 0.4-incubating release
> --
>
> Key: STREAMS-446
> URL: https://issues.apache.org/jira/browse/STREAMS-446
> Project: Streams
>  Issue Type: Bug
>Affects Versions: 0.3
>Reporter: Suneel Marthi
>Assignee: Joey Frazee
> Fix For: 0.4
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (STREAMS-446) RAT check fails in prep for 0.4-incubating release

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/STREAMS-446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15609819#comment-15609819
 ] 

ASF GitHub Bot commented on STREAMS-446:


Github user jfrazee commented on a diff in the pull request:

https://github.com/apache/incubator-streams/pull/321#discussion_r85229514
  
--- Diff: pom.xml ---
@@ -250,6 +251,7 @@
   
**/src/site/resources/**/*.txt
   
**/src/site/resources/**/*.json
   **/.gitignore
+  **/*.md
--- End diff --

@steveblackmon Yes. I can go back and add the license to the markdown. 
Wasn't thinking about rat being able to pull that out of markdown.


> RAT check fails in prep for 0.4-incubating release
> --
>
> Key: STREAMS-446
> URL: https://issues.apache.org/jira/browse/STREAMS-446
> Project: Streams
>  Issue Type: Bug
>Affects Versions: 0.3
>Reporter: Suneel Marthi
>Assignee: Joey Frazee
> Fix For: 0.4
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (STREAMS-447) Scala-plugin failures in prep for 0.4-incubating release

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/STREAMS-447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15610531#comment-15610531
 ] 

ASF GitHub Bot commented on STREAMS-447:


GitHub user steveblackmon opened a pull request:

https://github.com/apache/incubator-streams/pull/322

STREAMS-447: build a test jar in streams-pojo (needed by 
streams-plugin-scala)



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/steveblackmon/incubator-streams STREAMS-447

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-streams/pull/322.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #322


commit ba2289b9755c5a42dab257114d8caa1e723be235
Author: Steve Blackmon @steveblackmon 
Date:   2016-10-27T03:31:55Z

STREAMS-447: build a test jar in streams-pojo (needed by 
streams-plugin-scala)




> Scala-plugin failures in prep for 0.4-incubating release
> 
>
> Key: STREAMS-447
> URL: https://issues.apache.org/jira/browse/STREAMS-447
> Project: Streams
>  Issue Type: Bug
>Affects Versions: 0.3
>Reporter: Suneel Marthi
>Assignee: Suneel Marthi
> Fix For: 0.4
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)