[jira] [Created] (FLUME-3000) Update morphline solr sink to use solr-6

2016-09-28 Thread wolfgang hoschek (JIRA)
wolfgang hoschek created FLUME-3000: --- Summary: Update morphline solr sink to use solr-6 Key: FLUME-3000 URL: https://issues.apache.org/jira/browse/FLUME-3000 Project: Flume Issue Type: Bug

[jira] [Commented] (FLUME-2633) Update Kite dependency to 1.0.0

2015-02-26 Thread wolfgang hoschek (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14339408#comment-14339408 ] wolfgang hoschek commented on FLUME-2633: - Can you please also update the

[jira] [Commented] (FLUME-2571) Update Kite dependency to 0.17.0 (or 0.17.1)

2014-12-09 Thread wolfgang hoschek (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14239467#comment-14239467 ] wolfgang hoschek commented on FLUME-2571: - Good idea! > Update Kite dep

Re: [ANNOUNCE] New Flume PMC Member - Roshan Naik

2014-11-05 Thread Wolfgang Hoschek
Congrats Roshan! On Nov 5, 2014, at 11:54 AM, Saravanan Nagarajan wrote: > Congratulations Roshan! > > On Wed, Nov 5, 2014 at 7:32 AM, Ahmed Radwan wrote: > >> Congrats Roshan! >> >> On Tue, Nov 4, 2014 at 2:12 PM, Arvind Prabhakar >> wrote: >> >>> On behalf of Apache Flume PMC, it is my

[jira] [Commented] (FLUME-2530) Resource leaks found by Coverity tool

2014-10-29 Thread wolfgang hoschek (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14189067#comment-14189067 ] wolfgang hoschek commented on FLUME-2530: - +1 to the chang

[jira] [Commented] (FLUME-2501) Updating HttpClient lib version to ensure compat with Solr

2014-10-27 Thread wolfgang hoschek (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14185186#comment-14185186 ] wolfgang hoschek commented on FLUME-2501: - +1 Looks good. Thanks! > U

[jira] [Commented] (FLUME-2501) Updating HttpClient lib version to ensure compat with Solr

2014-10-16 Thread wolfgang hoschek (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14174143#comment-14174143 ] wolfgang hoschek commented on FLUME-2501: - Similar reason here - Flume in C

[jira] [Comment Edited] (FLUME-2501) Updating HttpClient lib version to ensure compat with Solr

2014-10-16 Thread wolfgang hoschek (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14173554#comment-14173554 ] wolfgang hoschek edited comment on FLUME-2501 at 10/16/14 9:1

[jira] [Commented] (FLUME-2501) Updating HttpClient lib version to ensure compat with Solr

2014-10-16 Thread wolfgang hoschek (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14173554#comment-14173554 ] wolfgang hoschek commented on FLUME-2501: - How about updating to httpclien

[jira] [Commented] (FLUME-2503) hadoop-1 profile is broken in Morphline Sink

2014-10-16 Thread wolfgang hoschek (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14173505#comment-14173505 ] wolfgang hoschek commented on FLUME-2503: - +1 Patch looks good to me and

[jira] [Commented] (FLUME-2491) Include Kite morphline dependencies for Morphline Solr sink

2014-10-02 Thread wolfgang hoschek (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14157437#comment-14157437 ] wolfgang hoschek commented on FLUME-2491: - The advantage of marking

[jira] [Commented] (FLUME-2491) Include Kite morphline dependencies for Morphline Solr sink

2014-10-02 Thread wolfgang hoschek (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14157425#comment-14157425 ] wolfgang hoschek commented on FLUME-2491: - The solr and lucene libs are requ

Re: Kite Morphline Sink dependencies

2014-10-02 Thread Wolfgang Hoschek
Here is a way to get hold of the dependencies: https://groups.google.com/a/cloudera.org/forum/#!msg/cdk-dev/7T4pTebdWN4/sBHGkoS70LkJ Maybe we should add this info to the pom.xml to make it easier for folks? Thoughts? Wolfgang. On Oct 2, 2014, at 2:40 AM, Hari Shreedharan wrote: > Ryan/Wolfga

[jira] [Commented] (FLUME-2449) Kite-0.15 brings in hadoop-2.x dependencies in hadoop-1 profile

2014-08-25 Thread wolfgang hoschek (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14109493#comment-14109493 ] wolfgang hoschek commented on FLUME-2449: - org.apache.solr:solr-core ind

Re: Getting java.lang.OutOfMemoryError: GC overhead limit exceeded with Morphline Interceptor

2014-06-18 Thread Wolfgang Hoschek
The default memory settings for flume are extremely low. Try giving it more Java memory. On Jun 18, 2014, at 12:57 PM, David Gates wrote: > When running a test to see if I can get Morphline Interceptor working to > convert some timestamps in logfiles, I am getting a java GC overhead limit > exc

[jira] [Commented] (FLUME-2392) Flume MorphlineSink can not work because of java.lang.NoClassDefFoundError: org/kitesdk/morphline/api/MorphlineCompilationException

2014-05-29 Thread wolfgang hoschek (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14012197#comment-14012197 ] wolfgang hoschek commented on FLUME-2392: - The dependencies have been

[jira] [Resolved] (FLUME-2392) Flume MorphlineSink can not work because of java.lang.NoClassDefFoundError: org/kitesdk/morphline/api/MorphlineCompilationException

2014-05-29 Thread wolfgang hoschek (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wolfgang hoschek resolved FLUME-2392. - Resolution: Won't Fix > Flume MorphlineSink can not work be

Re: [VOTE] Apache Flume 1.5.0 RC1

2014-05-18 Thread Wolfgang Hoschek
+1 Looks good to me! Wolfgang Hoschek On May 17, 2014, at 8:47 PM, Hari Shreedharan wrote: > Flume PMC - Please vote! > > > On Wed, May 14, 2014 at 12:31 AM, Arvind Prabhakar wrote: > >> +1 >> >> * Verified signatures and checksums for both binary and sou

Re: Flume Jambalaya - A Flume Plugin with Multiple Components

2014-05-02 Thread Wolfgang Hoschek
My sense is that a) is interesting if it evolves into a capable true native tailer, whereas b) is already available in flume and c) and d) are already available in flume via the MorphlineInterceptor Wolfgang. On May 3, 2014, at 12:18 AM, Israel Ekpo wrote: > Flume Community, > > I created a

[jira] [Resolved] (FLUME-2317) Upgrade Dataset sink to kite-0.12.0

2014-03-13 Thread wolfgang hoschek (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wolfgang hoschek resolved FLUME-2317. - Resolution: Duplicate Dupe of https://issues.apache.org/jira/browse/FLUME-2345

[jira] [Resolved] (FLUME-2316) Upgrade MorphlineSolrSink to kite-0.12.0

2014-03-13 Thread wolfgang hoschek (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wolfgang hoschek resolved FLUME-2316. - Resolution: Fixed Already fixed by https://issues.apache.org/jira/browse/FLUME-2345

Re: Flume 1.5

2014-03-13 Thread Wolfgang Hoschek
These patches are also ready to go: https://issues.apache.org/jira/browse/FLUME-2316 https://issues.apache.org/jira/browse/FLUME-2330 Wolfgang. On Mar 13, 2014, at 1:35 PM, Hari Shreedharan wrote: > There are a couple patches - the bidirectional HTTP source handler and the > elastic search HTT

[jira] [Commented] (FLUME-2330) Remove the MorphlineHandlerImpl configuration option from MorphlineSink

2014-03-12 Thread wolfgang hoschek (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13932736#comment-13932736 ] wolfgang hoschek commented on FLUME-2330: - After thinking about this some mor

[jira] [Updated] (FLUME-2330) Remove the MorphlineHandlerImpl configuration option from MorphlineSink

2014-03-12 Thread wolfgang hoschek (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wolfgang hoschek updated FLUME-2330: Affects Version/s: v1.4.0 Fix Version/s: v1.5.0 > Remove the MorphlineHandlerI

[jira] [Updated] (FLUME-2330) Remove the MorphlineHandlerImpl configuration option from MorphlineSink

2014-03-12 Thread wolfgang hoschek (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wolfgang hoschek updated FLUME-2330: Attachment: FLUME-2330-v1.patch > Remove the MorphlineHandlerImpl configuration opt

[jira] [Updated] (FLUME-2317) Upgrade Dataset sink to kite-0.12.0

2014-03-11 Thread wolfgang hoschek (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wolfgang hoschek updated FLUME-2317: Attachment: FLUME-2317-v2.patch > Upgrade Dataset sink to kite-0.1

[jira] [Updated] (FLUME-2317) Upgrade Dataset sink to kite-0.12.0

2014-03-11 Thread wolfgang hoschek (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wolfgang hoschek updated FLUME-2317: Attachment: (was: FLUME-2317-v1.patch) > Upgrade Dataset sink to kite-0.1

[jira] [Updated] (FLUME-2317) Upgrade Dataset sink to kite-0.12.0

2014-03-11 Thread wolfgang hoschek (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wolfgang hoschek updated FLUME-2317: Summary: Upgrade Dataset sink to kite-0.12.0 (was: Upgrade Dataset sink to kite-0.11.0

[jira] [Updated] (FLUME-2316) Upgrade MorphlineSolrSink to kite-0.12.0

2014-03-11 Thread wolfgang hoschek (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wolfgang hoschek updated FLUME-2316: Attachment: (was: FLUME-2316-v2.patch) > Upgrade MorphlineSolrSink to kite-0.1

[jira] [Updated] (FLUME-2316) Upgrade MorphlineSolrSink to kite-0.12.0

2014-03-11 Thread wolfgang hoschek (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wolfgang hoschek updated FLUME-2316: Attachment: FLUME-2316-v3.patch > Upgrade MorphlineSolrSink to kite-0.1

[jira] [Updated] (FLUME-2316) Upgrade MorphlineSolrSink to kite-0.12.0

2014-03-11 Thread wolfgang hoschek (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wolfgang hoschek updated FLUME-2316: Summary: Upgrade MorphlineSolrSink to kite-0.12.0 (was: Upgrade MorphlineSolrSink to kite

[jira] [Commented] (FLUME-2340) Refactor to make room for Morphlines Elasticsearch Sink

2014-03-05 Thread wolfgang hoschek (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13921192#comment-13921192 ] wolfgang hoschek commented on FLUME-2340: - [~otis] Once someone put together

[jira] [Commented] (FLUME-2340) Refactor to make room for Morphlines Elasticsearch Sink

2014-03-03 Thread wolfgang hoschek (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13918531#comment-13918531 ] wolfgang hoschek commented on FLUME-2340: - Here is what enabling ES would inv

[jira] [Commented] (FLUME-2329) Add an alias for the Morphline Solr Sink

2014-02-20 Thread wolfgang hoschek (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13907692#comment-13907692 ] wolfgang hoschek commented on FLUME-2329: - Looks like a patch for a diffe

[jira] [Commented] (FLUME-2323) Morphline sink must increment eventDrainAttemptCount when it takes event from channel

2014-02-15 Thread wolfgang hoschek (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13902565#comment-13902565 ] wolfgang hoschek commented on FLUME-2323: - +1 Looks good to me. > Morphli

Re: Event header validation using interceptors

2014-02-13 Thread Wolfgang Hoschek
actually match event headers or > just the event body? > > -Jeff > > On Thu, Feb 13, 2014 at 10:05 AM, Wolfgang Hoschek > wrote: >> You could probably do this with a MorphlineInterceptor, e.g. via using the >> grok command in combination with the tryCatch

Re: Event header validation using interceptors

2014-02-13 Thread Wolfgang Hoschek
You could probably do this with a MorphlineInterceptor, e.g. via using the grok command in combination with the tryCatch command. http://flume.apache.org/FlumeUserGuide.html#morphline-interceptor http://kitesdk.org/docs/current/kite-morphlines/index.html http://kitesdk.org/docs/current/kite-morp

[jira] [Updated] (FLUME-2317) Upgrade Dataset sink to kite-0.11.0

2014-02-08 Thread wolfgang hoschek (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wolfgang hoschek updated FLUME-2317: Attachment: FLUME-2317-v1.patch > Upgrade Dataset sink to kite-0.1

[jira] [Created] (FLUME-2317) Upgrade Dataset sink to kite-0.11.0

2014-02-08 Thread wolfgang hoschek (JIRA)
wolfgang hoschek created FLUME-2317: --- Summary: Upgrade Dataset sink to kite-0.11.0 Key: FLUME-2317 URL: https://issues.apache.org/jira/browse/FLUME-2317 Project: Flume Issue Type

[jira] [Updated] (FLUME-2316) Upgrade MorphlineSolrSink to kite-0.11.0

2014-02-08 Thread wolfgang hoschek (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wolfgang hoschek updated FLUME-2316: Attachment: FLUME-2316-v2.patch > Upgrade MorphlineSolrSink to kite-0.1

[jira] [Updated] (FLUME-2316) Upgrade MorphlineSolrSink to kite-0.11.0

2014-02-08 Thread wolfgang hoschek (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wolfgang hoschek updated FLUME-2316: Attachment: (was: FLUME-2316-v1.patch) > Upgrade MorphlineSolrSink to kite-0.1

[jira] [Updated] (FLUME-2316) Upgrade MorphlineSolrSink to kite-0.11.0

2014-02-08 Thread wolfgang hoschek (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wolfgang hoschek updated FLUME-2316: Attachment: FLUME-2316-v1.patch > Upgrade MorphlineSolrSink to kite-0.1

[jira] [Created] (FLUME-2316) Upgrade MorphlineSolrSink to kite-0.11.0

2014-02-08 Thread wolfgang hoschek (JIRA)
wolfgang hoschek created FLUME-2316: --- Summary: Upgrade MorphlineSolrSink to kite-0.11.0 Key: FLUME-2316 URL: https://issues.apache.org/jira/browse/FLUME-2316 Project: Flume Issue Type

[jira] [Commented] (FLUME-2315) org.apache.flume.sink.solr.morphline.BlobDeserializer is unable to handle empty streams

2014-02-08 Thread wolfgang hoschek (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13895507#comment-13895507 ] wolfgang hoschek commented on FLUME-2315: - What's the exception you are

Re: [DISCUSS] Release Flume 1.5.0

2014-01-30 Thread Wolfgang Hoschek
+1 There a many important new features and fixes ready to go. Wolfgang. On Jan 30, 2014, at 7:43 PM, Chiwan Park wrote: > +1 on new release! > > -- > Regards, > Chiwan Park > > On Jan 31, 2014, at 2:17 AM, Hari Shreedharan > wrote: > >> Hi folks, >> >> It has been about 6 months since we d

[jira] [Updated] (FLUME-2275) Improve scalability of MorphlineInterceptor under contention

2014-01-02 Thread wolfgang hoschek (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wolfgang hoschek updated FLUME-2275: Attachment: FLUME-2275-v4.patch revised patch according to Hari's suggestions >

[jira] [Commented] (FLUME-2275) Improve scalability of MorphlineInterceptor under contention

2014-01-02 Thread wolfgang hoschek (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13860913#comment-13860913 ] wolfgang hoschek commented on FLUME-2275: - Sure, +1 for adding those suggest

[jira] [Updated] (FLUME-2275) Improve scalability of MorphlineInterceptor under contention

2013-12-17 Thread wolfgang hoschek (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wolfgang hoschek updated FLUME-2275: Attachment: (was: FLUME-2275-v1.patch) > Improve scalability of MorphlineIntercep

[jira] [Updated] (FLUME-2275) Improve scalability of MorphlineInterceptor under contention

2013-12-17 Thread wolfgang hoschek (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wolfgang hoschek updated FLUME-2275: Attachment: (was: FLUME-2275-v2.patch) > Improve scalability of MorphlineIntercep

[jira] [Updated] (FLUME-2275) Improve scalability of MorphlineInterceptor under contention

2013-12-17 Thread wolfgang hoschek (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wolfgang hoschek updated FLUME-2275: Attachment: FLUME-2275-v3.patch > Improve scalability of MorphlineInterceptor un

[jira] [Updated] (FLUME-2275) Improve scalability of MorphlineInterceptor under contention

2013-12-17 Thread wolfgang hoschek (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wolfgang hoschek updated FLUME-2275: Attachment: FLUME-2275-v2.patch > Improve scalability of MorphlineInterceptor un

[jira] [Updated] (FLUME-2275) Improve scalability of MorphlineInterceptor under contention

2013-12-17 Thread wolfgang hoschek (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wolfgang hoschek updated FLUME-2275: Attachment: FLUME-2275-v1.patch Patch is attached. > Improve scalability

[jira] [Created] (FLUME-2275) Improve scalability of MorphlineInterceptor under contention

2013-12-17 Thread wolfgang hoschek (JIRA)
wolfgang hoschek created FLUME-2275: --- Summary: Improve scalability of MorphlineInterceptor under contention Key: FLUME-2275 URL: https://issues.apache.org/jira/browse/FLUME-2275 Project: Flume

[jira] [Updated] (FLUME-2266) Update Morphline Sink to kite-0.10.0

2013-12-10 Thread wolfgang hoschek (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wolfgang hoschek updated FLUME-2266: Attachment: FLUME-2266-v1.patch Patch is attached > Update Morphline Sink to kite-0.1

[jira] [Created] (FLUME-2266) Update Morphline Sink to kite-0.10.0

2013-12-10 Thread wolfgang hoschek (JIRA)
wolfgang hoschek created FLUME-2266: --- Summary: Update Morphline Sink to kite-0.10.0 Key: FLUME-2266 URL: https://issues.apache.org/jira/browse/FLUME-2266 Project: Flume Issue Type: Bug

Re: New Features Proposed for Apache Flume

2013-11-16 Thread Wolfgang Hoschek
/lucene.apache.org/core/4_4_0/core/org/apache/lucene/search/NumericRangeQuery.html > > *Author and Instructor for the Upcoming Book and Lecture Series* > *Massive Log Data Aggregation, Processing, Searching and Visualization with > Open Source Software* > *http://massivelog

Re: MorphlineInterceptor questions

2013-11-11 Thread Wolfgang Hoschek
On Nov 11, 2013, at 9:09 PM, Otis Gospodnetic wrote: > Hi, > > While poking around MorphlineSolrSink I got intrigued by > MorphlineIntercepor in ...solr.morphline package. A few Qs: > > 1) This is also not Solr-specific, right? yep > > 2) I couldn't find any code in ...solr.morphline packag

Re: Questions about Morphline Solr Sink structure

2013-11-11 Thread Wolfgang Hoschek
sticsearch Support * http://sematext.com/ > > > On Mon, Nov 11, 2013 at 8:25 PM, Roshan Naik wrote: >> imho...would be nice if the code changes were done... but renaming it in >> the user guide (without changing FQCNs) can be done regardless. and perhaps >> more impt from

Re: Questions about Morphline Solr Sink structure

2013-11-11 Thread Wolfgang Hoschek
s. and perhaps > more impt from a user perspective.. > > > On Mon, Nov 11, 2013 at 4:04 PM, Wolfgang Hoschek > wrote: > >> Yep, the names are a bit misleading now that so much has been generalized, >> but whatever we do, breaking backwards compat isn't an

Re: Questions about Morphline Solr Sink structure

2013-11-11 Thread Wolfgang Hoschek
Yep, the names are a bit misleading now that so much has been generalized, but whatever we do, breaking backwards compat isn't an option. Shipping a sink without tests doesn't seem compelling to me either. Taste in names aside, as far as I can see you could use this sink for ES today without a

Re: Questions about Morphline Solr Sink structure

2013-11-11 Thread Wolfgang Hoschek
Hi Otis, You bring up a lot of very good points here, indeed. I'll try to answer as best as I can... In the early days this Flume Sink started out as being very Solr specific. Over time I have made it more generic and reduced the dependency on Solr more and more, and at this point, there is in

Re: Morphline Solr sink dependencies on solr

2013-11-07 Thread Wolfgang Hoschek
Sounds like a misunderstanding - the Solr deps of the Morphline solr sink are already marked as "optional" or "test" as far as I can see. What issue are you running into? Wolfgang. On Nov 7, 2013, at 6:29 PM, Roshan Naik wrote: > Elastic search sink marks its dependencies on elastic search li

[jira] [Commented] (FLUME-1988) Add Support for Additional Deserializers for SpoolingDirectorySource

2013-11-06 Thread wolfgang hoschek (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-1988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13815353#comment-13815353 ] wolfgang hoschek commented on FLUME-1988: - Tip: Looks like in this case (read

[jira] [Commented] (FLUME-1988) Add Support for Additional Deserializers for SpoolingDirectorySource

2013-11-06 Thread wolfgang hoschek (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-1988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13815355#comment-13815355 ] wolfgang hoschek commented on FLUME-1988: - Also, let me know your thought

Re: Review Request 15107: Moving BlobHandler out of morphline sink and into HTTP source

2013-11-04 Thread Wolfgang Hoschek
lr/morphline/BlobHandler.java <https://reviews.apache.org/r/15107/#comment54790> realBlobHandler seems obsolete now - Wolfgang Hoschek On Nov. 5, 2013, 1:42 a.m., Roshan Naik wrote: > > --- > This is an automatically genera

Re: Review Request 15107: Moving BlobHandler out of morphline sink and into HTTP source

2013-11-04 Thread Wolfgang Hoschek
> On Nov. 4, 2013, 8:42 p.m., Wolfgang Hoschek wrote: > > flume-ng-sinks/flume-ng-morphline-solr-sink/src/main/java/org/apache/flume/sink/solr/morphline/BlobHandler.java, > > line 52 > > <https://reviews.apache.org/r/15107/diff/1/?file=374518#file374518line52> >

Re: Review Request 15107: Moving BlobHandler out of morphline sink and into HTTP source

2013-11-04 Thread Wolfgang Hoschek
/apache/flume/sink/solr/morphline/BlobHandler.java <https://reviews.apache.org/r/15107/#comment54748> How about using the same implementation approach as for BlobDeserializer wrt. subclassing, etc? - Wolfgang Hoschek On Oct. 31, 2013, 12:48 a.m., Roshan Naik

Re: Review Request 15110: Moving the BlobDeserializer from Morphline Sink to flume-ng-core/.../serialization

2013-11-04 Thread Wolfgang Hoschek
org/r/15110/#comment54738> ES changes should be moved into a separate JIRA as they are unrelated. flume-ng-doc/sphinx/FlumeUserGuide.rst <https://reviews.apache.org/r/15110/#comment54739> ES changes should be moved into a separate JIRA as they are unrelated. - Wolfgang Hosc

[jira] [Commented] (FLUME-2227) Move the BlobDeserializer from Morphline Sink to flume-ng-core/.../serialization

2013-10-30 Thread wolfgang hoschek (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13808808#comment-13808808 ] wolfgang hoschek commented on FLUME-2227: - Good idea as long as existing con

Re: Morphline Solr Sink Unit Test Error

2013-10-23 Thread Wolfgang Hoschek
Looks like Guava's ClassPath helper wasn't tested on Windows, after all (it works on Unix, of course). This ClassPath class is manually shaded from guava-14.0.1 in order to not require (yet to allow) users to run guava > 11.0.2 because guava-11.0.2 is what a lot of Hadoop components bundle. Yo

[jira] [Updated] (FLUME-2213) MorphlineInterceptor should share metric registry across threads for better (aggregate) reporting

2013-10-13 Thread wolfgang hoschek (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wolfgang hoschek updated FLUME-2213: Attachment: FLUME-2213-v3.patch add some more metrics > MorphlineInterceptor should sh

[jira] [Updated] (FLUME-2213) MorphlineInterceptor should share metric registry across threads for better (aggregate) reporting

2013-10-13 Thread wolfgang hoschek (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wolfgang hoschek updated FLUME-2213: Attachment: (was: FLUME-2213-v2.patch) > MorphlineInterceptor should share met

[jira] [Updated] (FLUME-2213) MorphlineInterceptor should share metric registry across threads for better (aggregate) reporting

2013-10-12 Thread wolfgang hoschek (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wolfgang hoschek updated FLUME-2213: Attachment: (was: FLUME-2213-v1.patch) > MorphlineInterceptor should share met

[jira] [Updated] (FLUME-2213) MorphlineInterceptor should share metric registry across threads for better (aggregate) reporting

2013-10-12 Thread wolfgang hoschek (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wolfgang hoschek updated FLUME-2213: Attachment: FLUME-2213-v2.patch better patch, now also shared registry among sinks that

[jira] [Updated] (FLUME-2213) MorphlineInterceptor should share metric registry across threads for better (aggregate) reporting

2013-10-12 Thread wolfgang hoschek (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wolfgang hoschek updated FLUME-2213: Affects Version/s: v1.4.0 Fix Version/s: (was: v1.4.0

[jira] [Updated] (FLUME-2213) MorphlineInterceptor should share metric registry across threads for better (aggregate) reporting

2013-10-12 Thread wolfgang hoschek (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wolfgang hoschek updated FLUME-2213: Attachment: FLUME-2213-v1.patch > MorphlineInterceptor should share metric registry acr

[jira] [Created] (FLUME-2213) MorphlineInterceptor should share metric registry across threads for better (aggregate) reporting

2013-10-12 Thread wolfgang hoschek (JIRA)
wolfgang hoschek created FLUME-2213: --- Summary: MorphlineInterceptor should share metric registry across threads for better (aggregate) reporting Key: FLUME-2213 URL: https://issues.apache.org/jira/browse/FLUME

[jira] [Updated] (FLUME-2213) MorphlineInterceptor should share metric registry across threads for better (aggregate) reporting

2013-10-12 Thread wolfgang hoschek (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wolfgang hoschek updated FLUME-2213: Description: Otherwise the each thread will have it's own registry which isn't

[jira] [Updated] (FLUME-2212) upgrade to Morphlines-0.8.0

2013-10-11 Thread wolfgang hoschek (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wolfgang hoschek updated FLUME-2212: Attachment: FLUME-2212-v1.patch > upgrade to Morphlines-0.

[jira] [Created] (FLUME-2212) upgrade to Morphlines-0.8.0

2013-10-11 Thread wolfgang hoschek (JIRA)
wolfgang hoschek created FLUME-2212: --- Summary: upgrade to Morphlines-0.8.0 Key: FLUME-2212 URL: https://issues.apache.org/jira/browse/FLUME-2212 Project: Flume Issue Type: Improvement

[jira] [Commented] (FLUME-1988) Add Support for Additional Deserializers for SpoolingDirectorySource

2013-09-27 Thread wolfgang hoschek (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-1988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13780509#comment-13780509 ] wolfgang hoschek commented on FLUME-1988: - Splitting an input stream into ev

Re: [ANNOUNCE] New Flume Committer - Wolfgang Hoschek

2013-09-25 Thread Wolfgang Hoschek
Thanks everybody! Looking forward to a good ride. Wolfgang. On Sep 24, 2013, at 3:39 PM, Hari Shreedharan wrote: > On behalf of the Apache Flume PMC, I am excited to welcome Wolfgang Hoschek > as a committer on the Apache Flume project. Wolfgang contributed a new sink > with the abil

[jira] [Updated] (FLUME-2185) Upgrade morphlines to 0.7.0

2013-09-11 Thread wolfgang hoschek (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wolfgang hoschek updated FLUME-2185: Fix Version/s: v1.4.1 > Upgrade morphlines to 0.

[jira] [Updated] (FLUME-2185) Upgrade morphlines to 0.7.0

2013-09-08 Thread wolfgang hoschek (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wolfgang hoschek updated FLUME-2185: Attachment: FLUME-2185-v2.patch > Upgrade morphlines to 0.

[jira] [Commented] (FLUME-2185) Upgrade morphlines to 0.7.0

2013-09-08 Thread wolfgang hoschek (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13761535#comment-13761535 ] wolfgang hoschek commented on FLUME-2185: - FYI, the patch assumes that FLUME-

[jira] [Updated] (FLUME-2185) Upgrade morphlines to 0.7.0

2013-09-08 Thread wolfgang hoschek (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wolfgang hoschek updated FLUME-2185: Attachment: FLUME-2185-v1.patch > Upgrade morphlines to 0.

[jira] [Created] (FLUME-2185) Upgrade morphlines to 0.7.0

2013-09-08 Thread wolfgang hoschek (JIRA)
wolfgang hoschek created FLUME-2185: --- Summary: Upgrade morphlines to 0.7.0 Key: FLUME-2185 URL: https://issues.apache.org/jira/browse/FLUME-2185 Project: Flume Issue Type: New Feature

[jira] [Commented] (FLUME-2184) flume-ng-morphline-solr-sink Build failing due to incorrect hadoop-common dependency declaration

2013-09-08 Thread wolfgang hoschek (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13761527#comment-13761527 ] wolfgang hoschek commented on FLUME-2184: - Ok, thanks! +1 to the p

[jira] [Commented] (FLUME-2184) flume-ng-morphline-solr-sink Build failing due to incorrect hadoop-common dependency declaration

2013-09-07 Thread wolfgang hoschek (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13761204#comment-13761204 ] wolfgang hoschek commented on FLUME-2184: - Looks like the underlying proble

Re: New Features Proposed for Apache Flume

2013-08-28 Thread Wolfgang Hoschek
Re: GrokInterceptor This functionality is already available in the form of the Apache Flume MorphlineInterceptor [1] with the grok command [2]. While grok is very useful, consider that grok alone often isn't enough - you typically need some other log event processing commands as well, for examp

[jira] [Comment Edited] (FLUME-2174) Integration of morphline solr sink puts Lucene/Solr dependencies on the default classpath

2013-08-21 Thread wolfgang hoschek (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13747113#comment-13747113 ] wolfgang hoschek edited comment on FLUME-2174 at 8/22/13 1:1

[jira] [Commented] (FLUME-2174) Integration of morphline solr sink puts Lucene/Solr dependencies on the default classpath

2013-08-21 Thread wolfgang hoschek (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13747113#comment-13747113 ] wolfgang hoschek commented on FLUME-2174: - The exclusions should not get pu

[jira] [Commented] (FLUME-2174) Integration of morphline solr sink puts Lucene/Solr dependencies on the default classpath

2013-08-21 Thread wolfgang hoschek (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13747105#comment-13747105 ] wolfgang hoschek commented on FLUME-2174: - I think the patch shouldn't r

[jira] [Commented] (FLUME-1687) ApacheSolrSink

2013-07-16 Thread wolfgang hoschek (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-1687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13710118#comment-13710118 ] wolfgang hoschek commented on FLUME-1687: - My understanding of FLUME-1687 is

[jira] [Updated] (FLUME-2124) Upgrade Morphline Solr Sink to CDK 0.4.1

2013-07-10 Thread wolfgang hoschek (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wolfgang hoschek updated FLUME-2124: Description: Now that CDK 0.4.1 has been released it would be good to upgrade the

[jira] [Commented] (FLUME-2124) Upgrade Morphline Solr Sink to CDK 0.4.1

2013-07-10 Thread wolfgang hoschek (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13705267#comment-13705267 ] wolfgang hoschek commented on FLUME-2124: - yes, 0.4.1, s

[jira] [Updated] (FLUME-2124) Upgrade Morphline Solr Sink to CDK 1.4.1

2013-07-10 Thread wolfgang hoschek (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wolfgang hoschek updated FLUME-2124: Attachment: FLUME-2124-v1.patch > Upgrade Morphline Solr Sink to CDK 1.

[jira] [Created] (FLUME-2124) Upgrade Morphline Solr Sink to CDK 1.4.1

2013-07-10 Thread wolfgang hoschek (JIRA)
wolfgang hoschek created FLUME-2124: --- Summary: Upgrade Morphline Solr Sink to CDK 1.4.1 Key: FLUME-2124 URL: https://issues.apache.org/jira/browse/FLUME-2124 Project: Flume Issue Type: Bug

[jira] [Commented] (FLUME-2123) Morphline Solr sink missing short type name

2013-07-09 Thread wolfgang hoschek (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13704166#comment-13704166 ] wolfgang hoschek commented on FLUME-2123: - Looks good to me. Th

[jira] [Updated] (FLUME-2105) Add docs for MorphlineSolrSink

2013-06-24 Thread wolfgang hoschek (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wolfgang hoschek updated FLUME-2105: Attachment: FLUME-2105-v2.patch > Add docs for MorphlineSolrS

  1   2   >