[jira] [Commented] (FLUME-3036) Create a RegexSerializer for Hive Sink

2017-04-03 Thread Roshan Naik (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-3036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15954335#comment-15954335 ] Roshan Naik commented on FLUME-3036: [~kalyanhadoop] thanks for your efforts to

[jira] [Commented] (FLUME-2620) File channel throws NullPointerException if a header value is null

2017-03-13 Thread Roshan Naik (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15923388#comment-15923388 ] Roshan Naik commented on FLUME-2620: [~marcellhegedus] It is easier to review

[jira] [Commented] (FLUME-2620) File channel throws NullPointerException if a header value is null

2017-03-13 Thread Roshan Naik (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15923387#comment-15923387 ] Roshan Naik commented on FLUME-2620: [~marcellhegedus] i have added yo

[jira] [Updated] (FLUME-3036) Create a RegexSerializer for Hive Sink

2017-01-20 Thread Roshan Naik (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-3036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Roshan Naik updated FLUME-3036: --- Summary: Create a RegexSerializer for Hive Sink (was: Create a Hive Sink based on the Streaming

[jira] [Commented] (FLUME-3036) Create a Hive Sink based on the Streaming support with RegexSerializer

2017-01-18 Thread Roshan Naik (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-3036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15829101#comment-15829101 ] Roshan Naik commented on FLUME-3036: Put my comments in github. > Create a Hi

[jira] [Commented] (FLUME-3036) Create a Hive Sink based on the Streaming support with RegexSerializer

2017-01-18 Thread Roshan Naik (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-3036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15829050#comment-15829050 ] Roshan Naik commented on FLUME-3036: [~kalyanhadoop] Can you please comment on

[jira] [Commented] (FLUME-3036) Create a Hive Sink based on the Streaming support with RegexSerializer

2016-12-29 Thread Roshan Naik (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-3036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15786173#comment-15786173 ] Roshan Naik commented on FLUME-3036: Reviewed the doc and put my comments ther

[jira] [Updated] (FLUME-3036) Create a Hive Sink based on the Streaming support with RegexSerializer

2016-12-27 Thread Roshan Naik (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-3036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Roshan Naik updated FLUME-3036: --- Assignee: Kalyan > Create a Hive Sink based on the Streaming support with RegexSeriali

[jira] [Commented] (FLUME-3036) Create a Hive Sink based on the Streaming support with RegexSerializer

2016-12-27 Thread Roshan Naik (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-3036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15781609#comment-15781609 ] Roshan Naik commented on FLUME-3036: can u update the user guide with info on

Re: [ANNOUNCE] Apache Flume 1.7.0 released

2016-10-20 Thread Roshan Naik
Thanks Donat & Mike for this release. -roshan On 10/20/16, 1:47 AM, "Attila Simon" wrote: >Hi, > >Congratulations for all of those who made this >possible! > >Cheers, >Attila > >On Wednesday, 19 October 2016, Hari Shreedharan >wrote: > >> Thanks Donat and Mike! Great work! >> >> On Wed, Oct 19,

Re: Flume bechmarks

2016-10-13 Thread Roshan Naik
You may want to take a look at - https://cwiki.apache.org/confluence/display/FLUME/Performance+Measurements+ -+round+2 and the older.. - https://cwiki.apache.org/confluence/display/FLUME/Flume+NG+Performance+Meas urements when coming up with a list of configurations to benchmark. -roshan O

[jira] [Commented] (FLUME-2892) Unable to compile & install flume with Maven

2016-09-14 Thread Roshan Naik (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15490818#comment-15490818 ] Roshan Naik commented on FLUME-2892: the Console output seems like an inconsis

[jira] [Commented] (FLUME-2965) race condition in SpillableMemoryChannel log print

2016-08-03 Thread Roshan Naik (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15406832#comment-15406832 ] Roshan Naik commented on FLUME-2965: Thanks [~lqp276] Took a quick look... an

[jira] [Created] (FLUME-2947) Upgrade Hive and thrift libraries

2016-07-05 Thread Roshan Naik (JIRA)
Roshan Naik created FLUME-2947: -- Summary: Upgrade Hive and thrift libraries Key: FLUME-2947 URL: https://issues.apache.org/jira/browse/FLUME-2947 Project: Flume Issue Type: Bug

[jira] [Resolved] (FLUME-2762) Improve HDFS Sink performance

2016-06-21 Thread Roshan Naik (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Roshan Naik resolved FLUME-2762. Resolution: Invalid Release Note: my thoughts didn't pan out on prototyping > Impr

[jira] [Updated] (FLUME-2762) Improve HDFS Sink performance

2016-06-21 Thread Roshan Naik (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Roshan Naik updated FLUME-2762: --- Fix Version/s: (was: v1.7.0) > Improve HDFS Sink performa

[jira] [Updated] (FLUME-2914) Upgrade httpclient version 4.3.6

2016-06-08 Thread Roshan Naik (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Roshan Naik updated FLUME-2914: --- Attachment: FLUME-2914.v2.patch > Upgrade httpclient version 4.

[jira] [Commented] (FLUME-2799) Kafka Source - Message Offset and Partition add to headers

2016-06-07 Thread Roshan Naik (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15319493#comment-15319493 ] Roshan Naik commented on FLUME-2799: [~michael.andre.pearce] any update ? >

[jira] [Updated] (FLUME-2914) Upgrade httpclient version 4.3.6

2016-05-26 Thread Roshan Naik (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Roshan Naik updated FLUME-2914: --- Attachment: FLUME-2914.patch > Upgrade httpclient version 4.

[jira] [Created] (FLUME-2914) Upgrade httpclient version 4.3.6

2016-05-26 Thread Roshan Naik (JIRA)
Roshan Naik created FLUME-2914: -- Summary: Upgrade httpclient version 4.3.6 Key: FLUME-2914 URL: https://issues.apache.org/jira/browse/FLUME-2914 Project: Flume Issue Type: Bug

[jira] [Commented] (FLUME-2792) Flume Kafka Kerberos Support

2016-05-17 Thread Roshan Naik (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15287547#comment-15287547 ] Roshan Naik commented on FLUME-2792: Yes .. in the next release. > Flum

Re: JIRA Assignment - FLUME-2905

2016-05-02 Thread Roshan Naik
Added you to contributors list. Can you try assigning to self now ? On 5/2/16, 4:32 PM, "Siddharth Ahuja" wrote: >Hi there, > >I created a Flume JIRA yesterday: >https://issues.apache.org/jira/browse/FLUME-2905. > >Would it be possible for someone to assign this to me? > >Thanks in advance! > >

[jira] [Commented] (FLUME-2889) Fixes to DateTime computations

2016-04-25 Thread Roshan Naik (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15256883#comment-15256883 ] Roshan Naik commented on FLUME-2889: +1 .. am running the tests. Shall commit

[jira] [Updated] (FLUME-2889) Fixes to DateTime computations

2016-04-25 Thread Roshan Naik (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Roshan Naik updated FLUME-2889: --- Assignee: Tristan Stevens (was: Roshan Naik) > Fixes to DateTime computati

[jira] [Updated] (FLUME-2901) Document Kerberos setup for Kafka channel

2016-04-20 Thread Roshan Naik (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Roshan Naik updated FLUME-2901: --- Attachment: FLUME-2901.v3.patch uploading revised patch v3 with fix for issue pointed out by

[jira] [Commented] (FLUME-2901) Document Kerberos setup for Kafka channel

2016-04-20 Thread Roshan Naik (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15250758#comment-15250758 ] Roshan Naik commented on FLUME-2901: [~jholoman] thanks for spotting that pro

[jira] [Commented] (FLUME-2901) Document Kerberos setup for Kafka channel

2016-04-19 Thread Roshan Naik (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15248741#comment-15248741 ] Roshan Naik commented on FLUME-2901: [~hshreedharan] can u take a look ? > D

[jira] [Updated] (FLUME-2901) Document Kerberos setup for Kafka channel

2016-04-19 Thread Roshan Naik (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Roshan Naik updated FLUME-2901: --- Attachment: FLUME-2901.v2.patch revising patch with minor addition to documentation > Docum

[jira] [Updated] (FLUME-2901) Document Kerberos setup for Kafka channel

2016-04-18 Thread Roshan Naik (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Roshan Naik updated FLUME-2901: --- Attachment: FLUME-2901.patch Uploading patch. includes Kafka channel kerberos documentation and

[jira] [Created] (FLUME-2901) Document Kerberos setup for Kafka channel

2016-04-18 Thread Roshan Naik (JIRA)
Roshan Naik created FLUME-2901: -- Summary: Document Kerberos setup for Kafka channel Key: FLUME-2901 URL: https://issues.apache.org/jira/browse/FLUME-2901 Project: Flume Issue Type: Bug

[jira] [Comment Edited] (FLUME-2433) Add kerberos support for Hive sink

2016-04-12 Thread Roshan Naik (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15238492#comment-15238492 ] Roshan Naik edited comment on FLUME-2433 at 4/13/16 2:5

[jira] [Commented] (FLUME-2433) Add kerberos support for Hive sink

2016-04-12 Thread Roshan Naik (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15238492#comment-15238492 ] Roshan Naik commented on FLUME-2433: [~wpwang] can you please try the same with

kafka source - resource leak ?

2016-04-12 Thread Roshan Naik
I suspect there is a resource leak in the below code ... just wanted to confirm before filing a jira.. https://github.com/apache/flume/blob/e8c4a7bffc74f6ea10ae6cc45adbaf4919f45186/flume-ng-sources/flume-kafka-source/src/test/java/org/apache/flume/source/kafka/KafkaSourceEmbeddedKafka.java#L128-L

[jira] [Commented] (FLUME-2781) A Kafka Channel defined as parseAsFlumeEvent=false cannot be correctly used by a Flume source

2016-03-31 Thread Roshan Naik (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15220676#comment-15220676 ] Roshan Naik commented on FLUME-2781: Thanks for confirming [~gherreros] I g

[jira] [Commented] (FLUME-2781) A Kafka Channel defined as parseAsFlumeEvent=false cannot be correctly used by a Flume source

2016-03-30 Thread Roshan Naik (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15219177#comment-15219177 ] Roshan Naik commented on FLUME-2781: [~gherreros] this is a very useful fea

[jira] [Commented] (FLUME-2863) How to install Flume on Windows server (best practices)

2016-03-29 Thread Roshan Naik (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15216363#comment-15216363 ] Roshan Naik commented on FLUME-2863: I know that HDP bundles Flume on Windows

[jira] [Commented] (FLUME-2889) Fixes to DateTime computations

2016-03-24 Thread Roshan Naik (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15210557#comment-15210557 ] Roshan Naik commented on FLUME-2889: Sorry [~tmgstev] i have not. Wont be abl

[jira] [Commented] (FLUME-2889) Fixes to DateTime computations

2016-03-08 Thread Roshan Naik (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15186250#comment-15186250 ] Roshan Naik commented on FLUME-2889: oh i thought i had committed it... perhap

[jira] [Commented] (FLUME-2889) Fixes to DateTime computations

2016-02-29 Thread Roshan Naik (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15172541#comment-15172541 ] Roshan Naik commented on FLUME-2889: Shall wait for [~tmgstev] till end of da

[jira] [Commented] (FLUME-2889) Fixes to DateTime computations

2016-02-26 Thread Roshan Naik (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15170096#comment-15170096 ] Roshan Naik commented on FLUME-2889: Yes will wait for Tristan. Trying to as

[jira] [Commented] (FLUME-2889) Fixes to DateTime computations

2016-02-26 Thread Roshan Naik (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15170010#comment-15170010 ] Roshan Naik commented on FLUME-2889: [~hshreedharan] i am thinking we revert/over

[jira] [Comment Edited] (FLUME-2889) Fixes to DateTime computations

2016-02-26 Thread Roshan Naik (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15169995#comment-15169995 ] Roshan Naik edited comment on FLUME-2889 at 2/26/16 10:4

[jira] [Updated] (FLUME-2889) Fixes to DateTime computations

2016-02-26 Thread Roshan Naik (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Roshan Naik updated FLUME-2889: --- Attachment: FLUME-2889.3.patch Thanks [~tmgstev] for catching that. I am revising the patch with

[jira] [Updated] (FLUME-2889) Fixes to DateTime computations

2016-02-25 Thread Roshan Naik (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Roshan Naik updated FLUME-2889: --- Fix Version/s: v1.7.0 > Fixes to DateTime computati

Leap year : Date parsing in SyslogParser used by MultiportSyslogTCP source

2016-02-25 Thread Roshan Naik
Recently found a DateTime computation in issue FLUME-2889 which might affect dates when leap year is involved. Given that 2016 is a leap year, I am trying to assess the impact of this bug. Method SyslogParser.parseRfc3164Time() appears to be actually adjusting the year in the date that it is p

[jira] [Updated] (FLUME-2889) Fixes to DateTime computations

2016-02-24 Thread Roshan Naik (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Roshan Naik updated FLUME-2889: --- Affects Version/s: v1.6.0 > Fixes to DateTime computati

[jira] [Updated] (FLUME-2889) Fixes to DateTime computations

2016-02-24 Thread Roshan Naik (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Roshan Naik updated FLUME-2889: --- Attachment: FLUME-2889.patch Uploading patch... minor 1 liner fixes in a few places > Fixes

[jira] [Created] (FLUME-2889) Fixes to DateTime computations

2016-02-24 Thread Roshan Naik (JIRA)
Roshan Naik created FLUME-2889: -- Summary: Fixes to DateTime computations Key: FLUME-2889 URL: https://issues.apache.org/jira/browse/FLUME-2889 Project: Flume Issue Type: Bug

Re: Support for Hive Mutation Streaming

2016-02-22 Thread Roshan Naik
e Mutation APIs over Streaming APIs ? -roshan On 2/20/16, 5:20 AM, "Amit Jain" wrote: >Hi Roshan, > >Could you please help me learn why Hive Mutation Streaming APIs would not >be good value addition to Flume? > > >-- >Thanks, >Amit > >On Sat, Feb 20, 2

Re: Support for Hive Mutation Streaming

2016-02-19 Thread Roshan Naik
For the Flume kind of streaming ingest, the Hive Streaming APIs should be more appropriate Š which is already supported. -roshan On 2/19/16, 5:30 AM, "Amit Jain" wrote: >Hi All, > >We have use case where we want to make use of hive mutation streaming >feature. Do we have support for this in upc

[jira] [Updated] (FLUME-2881) Windows Launch Script fails in plugins dir code

2016-02-17 Thread Roshan Naik (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Roshan Naik updated FLUME-2881: --- Assignee: Jonathan Smith > Windows Launch Script fails in plugins dir c

[jira] [Updated] (FLUME-2881) Windows Launch Script fails in plugins dir code

2016-02-17 Thread Roshan Naik (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Roshan Naik updated FLUME-2881: --- Fix Version/s: v1.7.0 > Windows Launch Script fails in plugins dir c

[jira] [Commented] (FLUME-2881) Windows Launch Script fails in plugins dir code

2016-02-17 Thread Roshan Naik (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15151297#comment-15151297 ] Roshan Naik commented on FLUME-2881: Added some jars in plugins.d/1/lib/x

[jira] [Updated] (FLUME-2881) Windows Launch Script fails in plugins dir code

2016-02-17 Thread Roshan Naik (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Roshan Naik updated FLUME-2881: --- Summary: Windows Launch Script fails in plugins dir code (was: Windows Launch Script fails

[jira] [Commented] (FLUME-2881) Windows Launch Script fails

2016-02-17 Thread Roshan Naik (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15151168#comment-15151168 ] Roshan Naik commented on FLUME-2881: oh i see. i did add some plugin dirs bu

[jira] [Commented] (FLUME-2881) Windows Launch Script fails

2016-02-16 Thread Roshan Naik (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15149627#comment-15149627 ] Roshan Naik commented on FLUME-2881: [~jonathansmith] i am able to run the sc

[jira] [Commented] (FLUME-2881) Windows Launch Script fails

2016-02-16 Thread Roshan Naik (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15149367#comment-15149367 ] Roshan Naik commented on FLUME-2881: sure.. will take a look by tomorrow. >

Re: Reviews

2016-02-08 Thread Roshan Naik
I would support Ralph's suggestion for the policy change. Overall it should benefit Flume. Perhaps extend the time frame to 5 days (120 hrs) instead of 72 hours. -roshan On 2/8/16, 8:00 AM, "Ralph Goers" wrote: >I submitted a review for Flume 2875 a week ago. I have updated it a few >times s

Re: Flume HTTP source and CSRF vulnerability

2016-01-16 Thread Roshan Naik
de "Identifier" to the client which can be used by anyone >else. > >You must have encountered something interesting, would be good to know >(on ML or off ML both works fine) > > > >On Fri, Jan 8, 2016 at 1:08 PM, Roshan Naik >wrote: >> My understandin

[jira] [Commented] (FLUME-2799) Kafka Source - Message Offset and Partition add to headers

2016-01-15 Thread Roshan Naik (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15102905#comment-15102905 ] Roshan Naik commented on FLUME-2799: In flume-ng-doc/sphinx/FlumeUserGuide.rst

[jira] [Commented] (FLUME-2704) Configurable poll delay for spooling directory source

2016-01-15 Thread Roshan Naik (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15102901#comment-15102901 ] Roshan Naik commented on FLUME-2704: [~jrufus] can u commit this if it looks

[jira] [Created] (FLUME-2865) Upgrade thrift version to 0.9.3

2016-01-15 Thread Roshan Naik (JIRA)
Roshan Naik created FLUME-2865: -- Summary: Upgrade thrift version to 0.9.3 Key: FLUME-2865 URL: https://issues.apache.org/jira/browse/FLUME-2865 Project: Flume Issue Type: Bug

[jira] [Commented] (FLUME-2799) Kafka Source - Message Offset and Partition add to headers

2016-01-14 Thread Roshan Naik (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15098913#comment-15098913 ] Roshan Naik commented on FLUME-2799: - I don't think it is wise to b

[jira] [Commented] (FLUME-2799) Kafka Source - Message Offset and Partition add to headers

2016-01-13 Thread Roshan Naik (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15097032#comment-15097032 ] Roshan Naik commented on FLUME-2799: My comments: - Needs update to documentation

[jira] [Commented] (FLUME-2799) Kafka Source - Message Offset and Partition add to headers

2016-01-13 Thread Roshan Naik (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15096971#comment-15096971 ] Roshan Naik commented on FLUME-2799: [~gwenshap]would you be able to review

Flume HTTP source and CSRF vulnerability

2016-01-08 Thread Roshan Naik
My understanding is that Flume HTTP source does not have any protection against Cross-Site Request Forgery (CSRF) attacks. Wanted to double check with others if that is correct ? -roshan

[jira] [Commented] (FLUME-2806) flume-ng.ps1 Error running script to start an agent on Windows

2015-12-29 Thread Roshan Naik (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15074295#comment-15074295 ] Roshan Naik commented on FLUME-2806: thanks [~lmousseau] for the contribu

[jira] [Resolved] (FLUME-2806) flume-ng.ps1 Error running script to start an agent on Windows

2015-12-29 Thread Roshan Naik (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Roshan Naik resolved FLUME-2806. Resolution: Fixed Fix Version/s: v1.7.0 > flume-ng.ps1 Error running script to start

[jira] [Commented] (FLUME-2806) flume-ng.ps1 Error running script to start an agent on Windows

2015-12-29 Thread Roshan Naik (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15074287#comment-15074287 ] Roshan Naik commented on FLUME-2806: +1 > flume-ng.ps1 Error running script t

[jira] [Updated] (FLUME-2806) flume-ng.ps1 Error running script to start an agent on Windows

2015-12-29 Thread Roshan Naik (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Roshan Naik updated FLUME-2806: --- Assignee: Liam Mousseau > flume-ng.ps1 Error running script to start an agent on Wind

Re: Transfer files from windows server to HDFS

2015-12-29 Thread Roshan Naik
anks for your information Roshan. > >Do we have windows flume distro? > >Other suggestions required, Is there any reliable solution to transfer >files from windows server to HDFS periodically? > >Thanks. >On 29-Dec-2015 3:15 pm, "Roshan Naik" wrote: > >> Use

Re: Transfer files from windows server to HDFS

2015-12-29 Thread Roshan Naik
Use any Windows certified Flume distro ... use the SpoolDir source, file channel and HDFS sink. On 12/28/15, 11:56 PM, "Shiva Ram" wrote: >Hi All, > >Is there any reliable solution to transfer files from windows server to >HDFS using Flume periodically? > >Thanks. >Shivaram.

[jira] [Issue Comment Deleted] (FLUME-2854) Parameterize jetty version in pom

2015-12-17 Thread Roshan Naik (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Roshan Naik updated FLUME-2854: --- Comment: was deleted (was: +1) > Parameterize jetty version in

[jira] [Commented] (FLUME-2854) Parameterize jetty version in pom

2015-12-17 Thread Roshan Naik (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15062566#comment-15062566 ] Roshan Naik commented on FLUME-2854: +1 > Parameterize jetty version

[jira] [Comment Edited] (FLUME-2801) Performance improvement on TailDir source

2015-12-17 Thread Roshan Naik (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15062513#comment-15062513 ] Roshan Naik edited comment on FLUME-2801 at 12/17/15 6:4

[jira] [Commented] (FLUME-2801) Performance improvement on TailDir source

2015-12-17 Thread Roshan Naik (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15062513#comment-15062513 ] Roshan Naik commented on FLUME-2801: Thanks [~iijima_satoshi] for the review.

[jira] [Commented] (FLUME-2801) Performance improvement on TailDir source

2015-12-16 Thread Roshan Naik (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15060897#comment-15060897 ] Roshan Naik commented on FLUME-2801: [~iijima_satoshi] could you help review

[jira] [Updated] (FLUME-2801) Performance improvement on TailDir source

2015-12-16 Thread Roshan Naik (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Roshan Naik updated FLUME-2801: --- Assignee: Jun Seok Hong > Performance improvement on TailDir sou

[jira] [Commented] (FLUME-2451) HDFS Sink Cannot Reconnect After NameNode Restart

2015-12-09 Thread Roshan Naik (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15049341#comment-15049341 ] Roshan Naik commented on FLUME-2451: patch v2 from here went into the Flume incl

[jira] [Commented] (FLUME-2716) File Channel cannot handle capacity Integer.MAX_VALUE

2015-12-07 Thread Roshan Naik (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15045807#comment-15045807 ] Roshan Naik commented on FLUME-2716: I assume the new limit after this patch for

Re: Potential Gerrit support in review/commit flow

2015-11-06 Thread Roshan Naik
Have not used it .. But the listed features sound good. On 11/6/15 10:56 AM, "Jarek Jarcec Cecho" wrote: >I like the gerrit flow a lot. I can¹t speak for the flume community, but >I would be in favor of that :) > >You might consider sending similar email to Sqoop community where I would >suppor

[jira] [Commented] (FLUME-2792) Flume Kafka Kerberos Support

2015-11-04 Thread Roshan Naik (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14990763#comment-14990763 ] Roshan Naik commented on FLUME-2792: Updates - - PLAINTESTSAL is being rename

[jira] [Comment Edited] (FLUME-2792) Flume Kafka Kerberos Support

2015-11-04 Thread Roshan Naik (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14990763#comment-14990763 ] Roshan Naik edited comment on FLUME-2792 at 11/5/15 12:0

[jira] [Commented] (FLUME-2835) Hive Sink tests need to create table with transactional property set

2015-11-03 Thread Roshan Naik (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14988108#comment-14988108 ] Roshan Naik commented on FLUME-2835: +1 > Hive Sink tests need to create tab

[jira] [Comment Edited] (FLUME-2819) Kafka libs are being bundled into Flume distro

2015-10-23 Thread Roshan Naik (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14972217#comment-14972217 ] Roshan Naik edited comment on FLUME-2819 at 10/24/15 12:5

[jira] [Comment Edited] (FLUME-2819) Kafka libs are being bundled into Flume distro

2015-10-23 Thread Roshan Naik (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14972217#comment-14972217 ] Roshan Naik edited comment on FLUME-2819 at 10/24/15 12:5

[jira] [Commented] (FLUME-2819) Kafka libs are being bundled into Flume distro

2015-10-23 Thread Roshan Naik (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14972217#comment-14972217 ] Roshan Naik commented on FLUME-2819: No doubt a common issue. For e.g Hive does

[jira] [Comment Edited] (FLUME-2819) Kafka libs are being bundled into Flume distro

2015-10-23 Thread Roshan Naik (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14972022#comment-14972022 ] Roshan Naik edited comment on FLUME-2819 at 10/23/15 10:4

[jira] [Commented] (FLUME-2819) Kafka libs are being bundled into Flume distro

2015-10-23 Thread Roshan Naik (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14972022#comment-14972022 ] Roshan Naik commented on FLUME-2819: - Flume depends on several external serv

[jira] [Comment Edited] (FLUME-2792) Flume Kafka Kerberos Support

2015-10-21 Thread Roshan Naik (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14967495#comment-14967495 ] Roshan Naik edited comment on FLUME-2792 at 10/21/15 5:2

[jira] [Commented] (FLUME-2792) Flume Kafka Kerberos Support

2015-10-21 Thread Roshan Naik (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14967495#comment-14967495 ] Roshan Naik commented on FLUME-2792: opened FLUME-2819 > Flume Kafka K

[jira] [Created] (FLUME-2819) Kafka libs are being bundled into Flume distro

2015-10-21 Thread Roshan Naik (JIRA)
Roshan Naik created FLUME-2819: -- Summary: Kafka libs are being bundled into Flume distro Key: FLUME-2819 URL: https://issues.apache.org/jira/browse/FLUME-2819 Project: Flume Issue Type: Bug

Re: New Flafka component - "kafka consumer" channel

2015-10-02 Thread Roshan Naik
without wrapping it in a FlumeEvent object. -roshan On 8/28/15 2:56 PM, "Roshan Naik" wrote: >OK that's really good to know. We won't need an additional component if it >can function that way. Also in that case I would expect it to be quite >fast. > >Will t

[jira] [Resolved] (FLUME-2798) Malformed Syslog messages can lead to OutOfMemoryException

2015-10-02 Thread Roshan Naik (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Roshan Naik resolved FLUME-2798. Resolution: Fixed Fix Version/s: v1.7.0 > Malformed Syslog messages can lead

[jira] [Commented] (FLUME-2798) Malformed Syslog messages can lead to OutOfMemoryException

2015-10-02 Thread Roshan Naik (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941944#comment-14941944 ] Roshan Naik commented on FLUME-2798: Its committed. Thanks very much for the p

[jira] [Updated] (FLUME-2798) Malformed Syslog messages can lead to OutOfMemoryException

2015-10-02 Thread Roshan Naik (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Roshan Naik updated FLUME-2798: --- Assignee: Phil D'Amore > Malformed Syslog messages can lead to OutOfMemoryE

[jira] [Commented] (FLUME-2798) Malformed Syslog messages can lead to OutOfMemoryException

2015-10-02 Thread Roshan Naik (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941911#comment-14941911 ] Roshan Naik commented on FLUME-2798: This patch looks good to me. +1 > Ma

[jira] [Updated] (FLUME-2804) Hive sink - abort remaining transactions on shutdown

2015-10-02 Thread Roshan Naik (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Roshan Naik updated FLUME-2804: --- Assignee: Sriharsha Chintalapani > Hive sink - abort remaining transactions on shutd

[jira] [Commented] (FLUME-2792) Flume Kafka Kerberos Support

2015-10-01 Thread Roshan Naik (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14940582#comment-14940582 ] Roshan Naik commented on FLUME-2792: Here are some notes that i gathered from tal

[jira] [Updated] (FLUME-2804) Hive sink - abort remaining transactions on shutdown

2015-09-29 Thread Roshan Naik (JIRA)
[ https://issues.apache.org/jira/browse/FLUME-2804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Roshan Naik updated FLUME-2804: --- Component/s: Sinks+Sources > Hive sink - abort remaining transactions on shutd

  1   2   3   4   5   6   7   8   9   10   >