Updated Branches: refs/heads/flume-1.4 3664472f8 -> 756924e96
FLUME-2108. Corrections to CHANGELOG for 1.4.0 release. (Mike Percy) Project: http://git-wip-us.apache.org/repos/asf/flume/repo Commit: http://git-wip-us.apache.org/repos/asf/flume/commit/756924e9 Tree: http://git-wip-us.apache.org/repos/asf/flume/tree/756924e9 Diff: http://git-wip-us.apache.org/repos/asf/flume/diff/756924e9 Branch: refs/heads/flume-1.4 Commit: 756924e96ace470289472a3bdb4d87e273ca74ef Parents: 3664472 Author: Mike Percy <[email protected]> Authored: Mon Jun 24 17:18:55 2013 -0700 Committer: Mike Percy <[email protected]> Committed: Mon Jun 24 17:19:41 2013 -0700 ---------------------------------------------------------------------- CHANGELOG | 100 +++------------------------------------------------------ 1 file changed, 4 insertions(+), 96 deletions(-) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/flume/blob/756924e9/CHANGELOG ---------------------------------------------------------------------- diff --git a/CHANGELOG b/CHANGELOG index 00b95b4..edbc482 100644 --- a/CHANGELOG +++ b/CHANGELOG @@ -1,47 +1,23 @@ Release Notes - Flume - Version v1.4.0 ** New Feature - * [FLUME-917] - Thrift Support * [FLUME-924] - Implement a JMS source for Flume NG * [FLUME-997] - Support secure transport mechanism * [FLUME-1170] - Create a framework for transaction listeners - * [FLUME-1249] - Add start/stop script - * [FLUME-1485] - FileChannel should support checksum * [FLUME-1502] - Support for running simple configurations embedded in host process * [FLUME-1516] - FileChannel Write Dual Checkpoints to avoid replays * [FLUME-1632] - Persist progress on each file in file spooling client/source - * [FLUME-1669] - Add support for columnar event serializer in HDFS - * [FLUME-1715] - OpenTSDB Sink + * [FLUME-1735] - Add support for a plugins.d directory * [FLUME-1894] - Implement Thrift RPC * [FLUME-1917] - FileChannel group commit (coalesce fsync) - * [FLUME-1941] - Support defaults or inheritance in configs - * [FLUME-1988] - Add Support for Additional Deserializers for SpoolingDirectorySource - * [FLUME-1998] - FlumeRESTClient - A HTTP Client for Interacting with REST Servers - * [FLUME-1999] - GooglePlusSource - An EventDrivenSource for for Streaming In Data from Google+ - * [FLUME-2000] - EmailSource - An EventDrivenSource for Streaming In Events from POP/IMAP Mailboxes - * [FLUME-2001] - TwitterSource - An EventDrivenSource for Streaming In Data from Twitter * [FLUME-2004] - Need to capture metrics on the Flume exec source such as events received, rejected, etc. * [FLUME-2010] - Support Avro records in Log4jAppender and the HDFS Sink * [FLUME-2048] - Avro container file deserializer + * [FLUME-2070] - Add a Flume Morphline Solr Sink ** Improvement - * [FLUME-841] - Generate javadoc from NG build - * [FLUME-890] - Add unit tests for flume ng channels - * [FLUME-1033] - Create system tests for flume - * [FLUME-1071] - Evaluate performance of AVRO source with multiple clients - * [FLUME-1076] - SInk batch sizes vary wildy - * [FLUME-1081] - Load testing tool for Avro source + * [FLUME-1076] - Sink batch sizes vary wildy * [FLUME-1100] - HDFSWriterFactory and HDFSFormatterFactory should allow extension - * [FLUME-1141] - Avro compression unit test should fail if compression does not work - * [FLUME-1159] - Add reconfigurability support to components - * [FLUME-1178] - Improve performance of SyslogTcpSource - * [FLUME-1209] - Support file name extension for HDFS sink - * [FLUME-1237] - Refactor configuration and add more tests. - * [FLUME-1274] - Clarify semantics of uncaught runtime exceptions thrown from configure() method - * [FLUME-1278] - Flume hot-reconfiguration specification - * [FLUME-1413] - Document of Channel (especially FileChannel) and Transaction - * [FLUME-1497] - Make the TestFileChannel.testInOut() more deterministic - * [FLUME-1521] - Document the StressSource * [FLUME-1571] - Channels should check for positive capacity and transaction capacity values * [FLUME-1586] - File Channel should support verifying integrity of individual events. * [FLUME-1652] - Logutils.getLogs could NPE @@ -49,16 +25,11 @@ Release Notes - Flume - Version v1.4.0 * [FLUME-1677] - Add File-channel dependency to flume-ng-node's pom.xml * [FLUME-1699] - Make the rename of the meta file platform neutral * [FLUME-1702] - HDFSEventSink should write to a hidden file as opposed to a .tmp file - * [FLUME-1722] - License file corrections - * [FLUME-1735] - Add support for a plugins.d directory * [FLUME-1740] - Remove contrib/ directory from Flume NG * [FLUME-1745] - FlumeConfiguration Eats Exceptions * [FLUME-1756] - Avro client should be able to use load balancing RPC * [FLUME-1757] - Improve configuration of hbase serializers - * [FLUME-1759] - make file and dirname of flume log tweakable in log4j - * [FLUME-1760] - an extra hdfs. prefix feels redundant in HDFS sink configuration * [FLUME-1762] - File Channel should recover automatically if the checkpoint is incomplete or bad by deleting the contents of the checkpoint directory - * [FLUME-1764] - File_roll type Sink how to achieve according to multiple files dynamically generated directory, and the file on the corresponding directory * [FLUME-1768] - Multiplexing channel selector should allow optional-only channels * [FLUME-1769] - Replicating channel selector should support optional channels * [FLUME-1770] - Flume should have serializer which supports serializer the headers to a simple string @@ -66,7 +37,6 @@ Release Notes - Flume - Version v1.4.0 * [FLUME-1790] - Commands in EncryptionTestUtils comments require high encryption pack to be installed * [FLUME-1794] - FileChannel check for full disks in the background * [FLUME-1800] - Docs for spooling source durability changes - * [FLUME-1801] - Configurable batch size for spooling client * [FLUME-1808] - ElasticSearchSink is missing log4.properties * [FLUME-1821] - Support configuration of hbase instances to be used in AsyncHBaseSink from flume config * [FLUME-1847] - NPE in SourceConfiguration @@ -83,7 +53,6 @@ Release Notes - Flume - Version v1.4.0 * [FLUME-1926] - Optionally timeout Avro Sink Rpc Clients to avoid stickiness * [FLUME-1940] - Log a snapshot of Flume metrics on shutdown * [FLUME-1945] - HBase Serializer allow key from regular expression group - * [FLUME-1961] - Enhancements to the Channel interface * [FLUME-1976] - JMS Source document should provide instruction on JMS implementation jars * [FLUME-1977] - JMS Source connectionFactory property is not documented * [FLUME-1992] - ElasticSearch dependency is marked optional @@ -97,47 +66,24 @@ Release Notes - Flume - Version v1.4.0 * [FLUME-2049] - Compile ElasticSearchSink with elasticsearch 0.90 * [FLUME-2062] - make it possible for HBase sink to deposit event headers into corresponding column qualifiers * [FLUME-2063] - Add Configurable charset to RegexHbaseEventSerializer - * [FLUME-2070] - Add a Flume Morphline Solr Sink + * [FLUME-2076] - JMX metrics support for HTTP Source * [FLUME-2093] - binary tarball that is created by flume's assembly shouldn't contain sources * [FLUME-2100] - Increase default batchSize of Morphline Solr Sink * [FLUME-2105] - Add docs for MorphlineSolrSink ** Bug - * [FLUME-981] - Unify sink failure behavior, throwing EventDeliveryException - * [FLUME-1000] - Properties validator misses an invalid config - * [FLUME-1086] - duplicate lib in Flume's lib dir - * [FLUME-1093] - HDFSEventSink gives no indication of failure when Hadoop jars aren't in the classpath * [FLUME-1110] - HDFS Sink throws IllegalStateException when flume-daemon shuts down - * [FLUME-1115] - project "flume-ng-node" should depends on "flume-recoverable-memory-channel" - * [FLUME-1152] - flume-ng script has issue with hadoop 0.23 script * [FLUME-1153] - flume-ng script is missing some agent options in help output - * [FLUME-1161] - Logging output says name:null after initiating agent shutdown - * [FLUME-1165] - Separate the component factories into pools which hold state and factories which simply create the new components * [FLUME-1175] - RollingFileSink complains of Bad File Descriptor upon a reconfig event - * [FLUME-1203] - Hbase Sink needs to check for partial failures. - * [FLUME-1206] - Hbase sink should pull in dependencies based on profiles - * [FLUME-1233] - HDFS Sink has problem with %c escape sequence in bucket path * [FLUME-1262] - Move doc generation to a different profile - * [FLUME-1283] - Flume HDFS Sink can't generate file name containing space and : which mentioned by %c * [FLUME-1285] - FileChannel has a dependency on Hadoop IO classes - * [FLUME-1291] - FileChannel log close calls interrupt on current thread and does not kill worker thread immediately * [FLUME-1296] - Lifecycle supervisor should check if the monitor service is still running before supervising - * [FLUME-1308] - HDFS Sink throws DFSOutputStream when exception when maxOpenFiles=1 - * [FLUME-1321] - BasicTransactionSemantics should never throw from close() - * [FLUME-1378] - Sink falls into infinite lifecycle with EventDeliveryException - * [FLUME-1403] - File channel throws logFile is null exception in channel.take - * [FLUME-1411] - Add average events per second params to MBeans - * [FLUME-1481] - Custom component may not support dynamic configuration * [FLUME-1511] - Scribe-source doesn't handle zero message request correctly. - * [FLUME-1551] - Create a home for custom Flume components - * [FLUME-1623] - Add more info about failover sink processor * [FLUME-1676] - ExecSource should provide a configurable charset * [FLUME-1688] - Bump AsyncHBase version to 1.4.1 * [FLUME-1709] - HDFS CompressedDataStream doesn't support serializer parameter * [FLUME-1720] - LICENSE file contain entry for protobuf-<version>.jar, however proper artifact name is protobuf-java-<version>.jar - * [FLUME-1721] - SpoolDirectorySource stop should shutdown executor * [FLUME-1731] - SpoolableDirectorySource should have configurable support for deleting files it has already completed instead of renaming - * [FLUME-1732] - Build is failing due to netty problems * [FLUME-1741] - ElasticSearch tests leave directory data/elasticsearch/nodes/ lying around * [FLUME-1748] - HDFS Sink should check if the thread is interrupted before performing any HDFS operations * [FLUME-1755] - Load balancing RPC client has issues with downed hosts @@ -158,7 +104,6 @@ Release Notes - Flume - Version v1.4.0 * [FLUME-1803] - Generated dist tarball is missing flume-ng-embedded-agent * [FLUME-1804] - JMS source not included in binary dist * [FLUME-1805] - Embedded agent deps should be specified in dependencyManagement section of pom - * [FLUME-1815] - File Channel auto-recovery when checkpoint is bad should be optional * [FLUME-1818] - Support various layouts in log4jappender * [FLUME-1819] - ExecSource don't flush the cache if there is no input entries * [FLUME-1820] - Should not be possible for RPC client to block indefinitely on close() @@ -190,7 +135,6 @@ Release Notes - Flume - Version v1.4.0 * [FLUME-1911] - Add deprecation back to the legacy thrift code * [FLUME-1916] - HDFS sink should poll for # of active replicas. If less than required, roll the file. * [FLUME-1918] - File Channel cannot handle capacity of more than 500 Million events - * [FLUME-1919] - Consider adding areYouOK() RPC calls to Avro & Thrift RPC mechanisms * [FLUME-1922] - HDFS Sink should optionally insert the timestamp at the sink * [FLUME-1924] - Bug in serializer context parsing in RollingFileSink * [FLUME-1925] - HDFS timeouts should not starve other threads @@ -198,11 +142,9 @@ Release Notes - Flume - Version v1.4.0 * [FLUME-1930] - Inflights should clean up executors on close. * [FLUME-1931] - HDFS Sink has a commons-lang dependency which is missing in pom * [FLUME-1932] - no-reload-conf command line param does not work - * [FLUME-1936] - Configure max rolls for under-replicated blocks * [FLUME-1937] - Issue with maxUnderReplication in HDFS sink * [FLUME-1939] - FlumeEventQueue must check if file is open before setting the length of the file * [FLUME-1943] - ExecSource tests failing on Jenkins - * [FLUME-1944] - parameterising the dependency variables in pom file. * [FLUME-1948] - plugins.d directory(ies) should be separately overridable, independent of FLUME_HOME * [FLUME-1949] - Documentation for sink processor lists incorrect default * [FLUME-1955] - fileSuffix does not work with compressed streams @@ -233,7 +175,6 @@ Release Notes - Flume - Version v1.4.0 * [FLUME-2054] - Support Version Info on Windows and fix failure of TestVersionInfo * [FLUME-2057] - Failures in FileChannel's TestEventQueueBackingStoreFactory on Windows * [FLUME-2060] - Failure in TestLog.testReplaySucceedsWithUnusedEmptyLogMetaDataFastReplay test on Windows - * [FLUME-2068] - File Channel issue - recovering from BadCheckpoint exception on Windows * [FLUME-2072] - JMX metrics support for HBase Sink * [FLUME-2081] - JMX metrics support for SpoolDir * [FLUME-2082] - JMX support for Seq Generator Source @@ -241,14 +182,7 @@ Release Notes - Flume - Version v1.4.0 * [FLUME-2098] - Make Solr sink depend on the CDK version of morphlines ** Documentation - * [FLUME-1014] - Agent Config docs are out of date - * [FLUME-1022] - Update Flume NG Getting Started Guide to mention pulling from trunk instead of flume-728 - * [FLUME-1144] - Update Flume User Guide with a section on Flume properties such as flume.called.from.service - * [FLUME-1592] - Remove appendTimeout from HDFS sink docs - * [FLUME-1594] - Document JMX options * [FLUME-1621] - Document new MemoryChannel parameters in Flume User Guide - * [FLUME-1624] - Docs could be more consistent when giving examples of types - * [FLUME-1833] - Embedded Agent docs are missing from website * [FLUME-1910] - Add thrift RPC documentation * [FLUME-1953] - Fix dev guide error that says sink can read from multiple channels * [FLUME-1962] - Document proper specification of lzo codec as lzop in Flume User Guide @@ -256,42 +190,16 @@ Release Notes - Flume - Version v1.4.0 * [FLUME-2030] - Documentation of Configuration Changes JMSSource, HBaseSink, AsyncHBaseSink and ElasticSearchSink ** Task - * [FLUME-813] - Build Flume site from Maven - * [FLUME-1051] - Configuration System - * [FLUME-1618] - Make Flume NG build and tests work with Hadoop 2.0 * [FLUME-1686] - Exclude target directories & Eclipse files from rat checks - * [FLUME-2076] - JMX metrics support for HTTP Source * [FLUME-2094] - Remove the deprecated - Recoverable Memory Channel ** Sub-task - * [FLUME-731] - Create NG internal diagrams - * [FLUME-732] - Create NG developer code tour docs - * [FLUME-733] - Define NG master interfaces and classes - * [FLUME-738] - Create NG system configuration component - * [FLUME-749] - Add support for monitoring APIs - * [FLUME-1056] - AvroSource configuration - * [FLUME-1057] - AvroSink configuration - * [FLUME-1058] - Exec source configuration - * [FLUME-1059] - failover sink configuration - * [FLUME-1060] - Hdfs sink configuration - * [FLUME-1061] - jdbc channel configuration - * [FLUME-1062] - Memory Channel configuration - * [FLUME-1063] - Miscellanous changes related to imports and minor changes related to config changes - * [FLUME-1064] - Channel selector configuration - * [FLUME-1065] - netcat source configuration - * [FLUME-1066] - PseudoTxnMemoryChannel configuration - * [FLUME-1067] - RollingFileSink configuration - * [FLUME-1068] - syslog source configuration - * [FLUME-1069] - FileChannel configuration * [FLUME-1626] - Support Hbase security in Hbase sink * [FLUME-1630] - Flume configuration code could be improved * [FLUME-1674] - Documentation / Wiki * [FLUME-1896] - Implement Thrift RpcClient * [FLUME-1897] - Implement Thrift Sink * [FLUME-1898] - Implement Thrift Source - * [FLUME-1989] - Source Code and Unit Tests for org.apache.flume.serialization.RegexDelimiterDeSerializer - * [FLUME-1990] - Source Code and Unit Tests for org.apache.flume.serialization.CharSequenceDelimiterDeSerializer - * [FLUME-1991] - Documentation for New Deserializers for SpoolingDirectorySource * [FLUME-2102] - Update LICENSE file for Flume 1.4.0 ----
