GitHub user PramodSSImmaneni reopened a pull request: https://github.com/apache/apex-malhar/pull/475
APEXMALHAR-2324 Megh flume Flume support from megh project. Preserved attribution for individual commits, filtered flume related commits only from the megh project. Applied formatting and licensing changes compatible with the Apex project as author Apex Dev <dev@apex.apache.org>. @tweise @amolhkekre @gauravgopi123 @243826 @chandnisingh please see megh: https://github.com/datatorrent/megh You can merge this pull request into a Git repository by running: $ git pull https://github.com/PramodSSImmaneni/apex-malhar megh-flume Alternatively you can review and apply these changes as the patch at: https://github.com/apache/apex-malhar/pull/475.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #475 ---- commit 29fc62a42d350908b0b75ac54fca64aad95063f6 Author: gaurav <gau...@datatorrent.com> Date: 2014-01-15T04:28:45Z hdfs storage imlemented component interface commit c600cc150b10efb5722448ec0ff3afa7bdea44ac Author: Chetan Narsude <che...@datatorrent.com> Date: 2014-01-15T04:41:31Z handle the byte to command conversion reliably. commit 9c70a2d47ee33ac0fa2a07cf1b007c7f503cc7c6 Author: Chetan Narsude <che...@datatorrent.com> Date: 2014-01-15T04:47:30Z call setup and teardown from the tests. commit 0c4e0a86d8bb30db06a8e5b4424cf5d707e33ab0 Author: Chetan Narsude <che...@datatorrent.com> Date: 2014-01-15T08:33:13Z ensure that the last offset is appropriately written to the offset file. commit 488f0e9a78d161b947edbd9b9705de53cb66d0ad Author: Chetan Narsude <che...@datatorrent.com> Date: 2014-01-15T18:20:43Z Reset the stats after connection reset commit 2911438a3cdaf558b817c5f713a432ff52e9700e Author: Chetan Narsude <che...@datatorrent.com> Date: 2014-01-16T00:40:29Z Added better logging to assist with debugging. commit a26ff817ee05015e9e3e887e3c12ebed90b2c55d Author: Chetan Narsude <che...@datatorrent.com> Date: 2014-01-16T01:15:43Z Move the parsing out of IO thread. commit 12f376e2326188d06c9e6838efc4a91f6a9e8d2a Author: Chetan Narsude <che...@datatorrent.com> Date: 2014-01-16T01:31:47Z reset the outstanding event count everytime we close the connection. commit 339c4d25e2e3390b91b314160e1cce726d2702d9 Author: gaurav <gau...@datatorrent.com> Date: 2014-01-16T03:21:28Z added the support for local file system commit 31dc58042848db16068072a978b68985b667c8c8 Author: gaurav <gau...@datatorrent.com> Date: 2014-01-16T16:05:27Z made more checks while closing unflushed files commit cfc5ee2cb9ed3e8716accd2a1b3bc5d38f45e786 Author: gaurav <gau...@datatorrent.com> Date: 2014-01-16T16:14:59Z made more checks while closing unflushed files commit f81ac88c7c06cfee23ce87c2a62bd4f01ea53aa3 Author: gaurav <gau...@datatorrent.com> Date: 2014-01-16T18:04:38Z added more checks in tests commit f4eef5c731a589b72b9d80540017f13d98f826ca Author: gaurav <gau...@datatorrent.com> Date: 2014-01-16T18:20:36Z moved the closing of unflushed files in the begining of the retrieval commit 93c1372108d5b8e84bfeb71ee166d15a76b62c48 Author: gaurav <gau...@datatorrent.com> Date: 2014-01-16T18:31:15Z removed unused code commit 83e3ebbfd7f1fdc6be3e951534a7c2ae691e5152 Author: gaurav <gau...@datatorrent.com> Date: 2014-01-16T19:06:19Z merged the changes from fluse-discovery to master commit 12cad9dc0b643740b7c82a89cbb212f8fececb13 Author: gaurav <gau...@datatorrent.com> Date: 2014-01-16T19:06:19Z Attempt to fix the problem of transmission of corrupt data from HDFSStorage. commit 201852c04e0875527b8ca48671bd19d99f90bcc6 Author: Chetan Narsude <che...@datatorrent.com> Date: 2014-01-16T19:56:01Z Even in case of exception during discovery, ensure that the next attempt is made only after discovery timeout. commit 35ab93044339367c62e7fdba51c1555896ef2309 Author: Chetan Narsude <che...@datatorrent.com> Date: 2014-01-16T20:17:27Z Print the connectionSpecs's first element in toString. commit 16e0a5090501f597c83526d294cc944b4042ac2f Author: Chetan Narsude <che...@datatorrent.com> Date: 2014-01-16T20:33:16Z Temporary Change for Debugging! More debugging. commit a9a78d7add7941b8ca42ec9621fee380cdd66e65 Author: Chetan Narsude <che...@datatorrent.com> Date: 2014-01-16T21:08:21Z bla commit 97f4f25e9bc648971b616f357b6849a33df40c5d Author: Chetan Narsude <che...@datatorrent.com> Date: 2014-01-16T21:16:51Z More debugging. commit e169192360fe7929731ecc21594b8d987446dfb2 Author: Chetan Narsude <che...@datatorrent.com> Date: 2014-01-16T21:28:02Z more ebug commit 83810487ed4cfe867afc73265b706698363655fd Author: Chetan Narsude <che...@datatorrent.com> Date: 2014-01-16T21:49:55Z remove cloning of the event bodies commit de9f1facada1dae42f7b38265b527b300ac4c9c8 Author: Chetan Narsude <che...@datatorrent.com> Date: 2014-01-18T00:01:34Z revert the changes made for debugging. commit 5f250731f7d38e527baeb4f5aa8e53fd511334d6 Author: Chetan Narsude <che...@datatorrent.com> Date: 2014-01-18T01:02:29Z debug UserStats/ commit 65c7a7076b021371560b678f0ed011181b7fa225 Author: Chetan Narsude <che...@datatorrent.com> Date: 2014-01-18T01:11:34Z debug UserStats/ commit da3e8fb16ab4594b5801f321c1716921f8e132a5 Author: Chetan Narsude <che...@datatorrent.com> Date: 2014-01-18T07:32:23Z defined RecoveryAddress.toString commit 6b074880e70df48e3bdb214c3a0dbaef9bcdb79b Author: Chetan Narsude <che...@datatorrent.com> Date: 2014-01-21T19:56:11Z Mark ZKAssistedDiscovery serializable so that it gets serialized properly. commit 2990c83eadaa5aaad6612ea3602ed97ba12bf799 Author: Chetan Narsude <che...@datatorrent.com> Date: 2014-01-22T01:22:57Z changed the error log to be more discoverable commit c232400bf6292e88be0110431bfe574e43ea3047 Author: Chetan Narsude <che...@datatorrent.com> Date: 2014-01-22T02:18:33Z always query the map from the ThreadLocal variable and do not depend on serialized value ---- --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---