GitHub user wtx626 opened a pull request:
https://github.com/apache/flume/pull/191
dataset sink support non-avro
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/wtx626/flume trunk
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/flume/pull/191.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #191
----
commit 0bbd0ad7aaad2f592c596608d4e1981aa86eb53d
Author: Hari Shreedharan <hshreedharan@...>
Date: 2014-09-17T04:24:37Z
FLUME-2250. Kafka Source.
(Frank Yao, Ashish Paliwal, Gwen Shapira via Hari)
commit 186a3b808b371cbf2c4b5a47325caa324c7c7a6e
Author: Hari Shreedharan <hshreedharan@...>
Date: 2014-09-24T05:33:55Z
FLUME-2455. Kafka Sink Documentation.
(Thilina Buddika, Gwen Shapira via Hari)
commit bde2c28211a2d05a9930f1599cb15864ad3cdba0
Author: Hari Shreedharan <hshreedharan@...>
Date: 2014-09-24T06:10:25Z
FLUME-2470. Kafka Sink and Source must use camel case for all configs.
(Gwen Shapira via Hari)
commit 26444fd7a8c804b6f2507ee3bf54e1c811ee5168
Author: Hari Shreedharan <hshreedharan@...>
Date: 2014-09-24T06:17:40Z
FLUME-2470. Kafka Sink and Source config updates. Missed a couple files in
the last commit, adding them.
(Gwen Shapira via Hari)
commit ef2b089ab70e04e67b70c23416ef7051e992122b
Author: Hari Shreedharan <hshreedharan@...>
Date: 2014-09-25T06:58:50Z
FLUME-2469. DatasetSink should load dataset when needed, not at startup.
(Ryan Blue via Hari)
commit 6d0243112fa1ff1cb796ebe158630ae681a2afc8
Author: Hari Shreedharan <hshreedharan@...>
Date: 2014-09-26T18:45:54Z
FLUME-2463. Add Hive and HBase dataset support in DatasetSink.
(Ryan Blue via Hari)
commit d2cb4ba7524b3dacbce9f19a524a56c786eb3e48
Author: Hari Shreedharan <hshreedharan@...>
Date: 2014-09-30T19:21:55Z
FLUME-1501. Flume Scribe Source needs unit tests.
(Ashish Paliwal via Hari)
commit e1e5acea2fbb04699eba76ea930def38e34f328d
Author: Hari Shreedharan <hshreedharan@...>
Date: 2014-10-02T05:23:15Z
FLUME-2481. TestFileChannelEncryption fails with System locale other than
en_US
(Santiago M. Mola via Hari)
commit 9f75c40a69fa4404ea2c344fa29285a00eb082fa
Author: Hari Shreedharan <hshreedharan@...>
Date: 2014-10-03T18:24:24Z
FLUME-2492. Flume's Kafka Source doesn't account time correctly
(Gwen Shapira via Hari)
commit e1cb6913f358e4de54d69d1f6f21edecf06a9da2
Author: Hari Shreedharan <hshreedharan@...>
Date: 2014-10-03T18:52:13Z
FLUME-2479. Kafka property auto.commit.enable is incorrect for KafkaSource.
(Gwen Shapira via Hari)
commit 9b2c28d805b89b8b3eac8f082e580e313f44c384
Author: Hari Shreedharan <hshreedharan@...>
Date: 2014-10-03T18:56:15Z
FLUME-2479. Adding new test files.
(Gwen Shapira via Hari)
commit 9f0abea027c408669977aa34cd32f5e525bb508b
Author: Hari Shreedharan <hshreedharan@...>
Date: 2014-10-07T21:12:02Z
FLUME-2495. Kafka Source may miss events when channel is not available
(Gwen Shapira via Hari)
commit 9968f0fb00f8d25245067242a48040229952e46f
Author: Hari Shreedharan <hshreedharan@...>
Date: 2014-10-09T03:21:25Z
FLUME-2466. Embedded agent name cannot contain spaces
(Johny Rufus via Hari)
commit 35cf900017a797e5ff3aedb01f05c88bb3f86ca0
Author: Hari Shreedharan <hshreedharan@...>
Date: 2014-10-09T23:10:10Z
FLUME-2346. idLogFileMap in Log can lose track of file ids.
(Johny Rufus via Hari)
commit 72b54c9909290fa5b98123b4b0c1332a425c5c64
Author: Hari Shreedharan <hshreedharan@...>
Date: 2014-10-10T06:17:30Z
FLUME-2472. SyslogUtils fails when system locale is not English
(Santiago M. Mola via Hari)
commit 7ffbd86bc01013ef0a0cbf855243aec5d772a386
Author: Hari Shreedharan <hshreedharan@...>
Date: 2014-10-10T07:11:21Z
FLUME-2489. Upgrade Apache Curator to 2.6.0
(Santiago M. Mola via Hari)
commit f17c7d5022d3e9d112a3843909ad523535fe7e4f
Author: Hari Shreedharan <hshreedharan@...>
Date: 2014-10-10T17:43:58Z
FLUME-2475. toLowerCase/toUpperCase must specify Locale.
(Santiago M. Mola via Hari)
commit 84c526fedbf30f14bf80ac7bc40aa043f400ec98
Author: Jarek Jarcec Cecho <jarcec@...>
Date: 2014-10-11T20:05:13Z
FLUME-2237. Example config in User Guide to use same notation for Agent name
(Ashish Paliwal via Jarek Jarcec Cecho)
commit 8328bccd41077d457cab064541127fc993e97619
Author: Hari Shreedharan <hshreedharan@...>
Date: 2014-10-15T00:28:25Z
FLUME-2126. Problem in elasticsearch sink when the event body is a complex
field
(Ashish Paliwal via Hari)
commit aa6fb7fbd9273c905a242c045f99a5b114fb3dc0
Author: Hari Shreedharan <hshreedharan@...>
Date: 2014-10-15T01:08:52Z
FLUME-1710. JSONEvent.getBody should not return null
(Ashish Paliwal via Hari)
commit a582c100f5f0b368a6dcc77c2b29138ef4b28840
Author: Hari Shreedharan <hshreedharan@...>
Date: 2014-10-15T01:17:34Z
FLUME-2482. File Channel tests must disable scheduled checkpoint to avoid a
race condition with forced checkpoint.
(Johny Rufus via Hari)
commit f979b2683fc48d85806ae7593ee0e393bd812260
Author: Hari Shreedharan <hshreedharan@...>
Date: 2014-10-16T04:29:46Z
FLUME-2502. Improve Spool Directory Source's performance by not listing
files each time.
(Prateek Rungta via Hari)
commit 622faa6f8812cd751dfad22deaa21bf0aa613111
Author: Hari Shreedharan <hshreedharan@...>
Date: 2014-10-16T05:20:34Z
FLUME-2499. Include Kafka Message Key in Event Headers.
(Ricky Saltzer via Hari)
commit f99adaabcf9d6c6b8f4c8fe5895fe478c8307694
Author: Hari Shreedharan <hshreedharan@...>
Date: 2014-10-16T06:16:15Z
FLUME-2486. TestExecSource fails on some environments
(Santiago M. Mola via Hari)
commit 375143493c79d8c1a05723ea16ccd25374fe7294
Author: Hari Shreedharan <hshreedharan@...>
Date: 2014-10-23T01:27:36Z
FLUME-2511. Allow configuration of enabled protocols in Avro source and
RpcClient.
(Tom White via Hari)
commit 77d56e95ead7a04499aa83d1a78fcfbd957b20c7
Author: Hari Shreedharan <hshreedharan@...>
Date: 2014-10-27T20:41:25Z
FLUME-2517. Cache SimpleDataFormat objects in bucketwriter for better
performance.
(Pal Konyves via Hari)
commit ea2fcdaa5132bd4fe01bc00a7da2dddb29756b02
Author: Jarek Jarcec Cecho <jarcec@...>
Date: 2014-10-27T23:27:00Z
FLUME-2520: HTTP Source should be able to block a prefixed set of protocols.
(Hari Shreedharan via Jarek Jarcec Cecho)
commit aef02df10a26a6b6911b771a506994f2069857cf
Author: Jarek Jarcec Cecho <jarcec@...>
Date: 2014-10-28T21:59:23Z
FLUME-2500: Add a channel that uses Kafka
(Hari Shreedharan via Jarek Jarcec Cecho)
commit fdd61e840b004ca1b5c23b28e8d9eeda300f56f7
Author: Hari Shreedharan <hshreedharan@...>
Date: 2014-10-31T21:27:21Z
FLUME-2523. Document Kafka channel
(Gwen Shapira via Hari)
commit 7e21ad36c05e07c4c6b92aa489f08c3cb562cb28
Author: Jarek Jarcec Cecho <jarcec@...>
Date: 2014-11-06T00:53:13Z
FLUME-2533: HTTPS tests fail on Java 6
(Hari Shreedharan via Jarek Jarcec Cecho)
----
---
