Re: GenericFileOutputOpeator doesn't work for all hadoop file systems

I would suggest, we override "openStream" in GenericFileOutputOpeator, as suggested in option 2 and then handle "append" in different way for FS which doesn't support append. Or else create concrete classes for all file systems which don't support append and override the required functions. -1 for

[jira] [Assigned] (APEXMALHAR-2183) Add user document for CsvFormatter operator

[ https://issues.apache.org/jira/browse/APEXMALHAR-2183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Venkatesh Kottapalli reassigned APEXMALHAR-2183: Assignee: Venkatesh Kottapalli > Add user document for CsvForm

[jira] [Commented] (APEXCORE-515) Refresh tokens failing in some scenarios with a login failure message

[ https://issues.apache.org/jira/browse/APEXCORE-515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15436009#comment-15436009 ] ASF GitHub Bot commented on APEXCORE-515: - GitHub user PramodSSImmaneni opened a

[GitHub] apex-core pull request #374: APEXCORE-515 Providing principal for token refr...

GitHub user PramodSSImmaneni opened a pull request: https://github.com/apache/apex-core/pull/374 APEXCORE-515 Providing principal for token refresh @gauravgopi123 please see You can merge this pull request into a Git repository by running: $ git pull https://github.com/PramodSS

[GitHub] apex-malhar pull request #378: Apexmalhar 2183

GitHub user venkateshkottapalli opened a pull request: https://github.com/apache/apex-malhar/pull/378 Apexmalhar 2183 You can merge this pull request into a Git repository by running: $ git pull https://github.com/venkateshkottapalli/apex-malhar APEXMALHAR-2183 Alternatively

[jira] [Updated] (APEXMALHAR-2190) Use reusable buffer to serial spillable data structure

[ https://issues.apache.org/jira/browse/APEXMALHAR-2190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bright chen updated APEXMALHAR-2190: Summary: Use reusable buffer to serial spillable data structure (was: Use shared memor

[jira] [Commented] (APEXMALHAR-2199) 0.8 kafka input operator doesn't support chroot zookeeper path (multitenant kafka support)

[ https://issues.apache.org/jira/browse/APEXMALHAR-2199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15435402#comment-15435402 ] Siyuan Hua commented on APEXMALHAR-2199: 0.9 operator should not have this pr

[jira] [Commented] (APEXMALHAR-2199) 0.8 kafka input operator doesn't support chroot zookeeper path (multitenant kafka support)

[ https://issues.apache.org/jira/browse/APEXMALHAR-2199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15435399#comment-15435399 ] Siyuan Hua commented on APEXMALHAR-2199: [~chaithu] Can you please take a loo

[jira] [Updated] (APEXMALHAR-2199) 0.8 kafka input operator doesn't support chroot zookeeper path (multitenant kafka support)

[ https://issues.apache.org/jira/browse/APEXMALHAR-2199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyuan Hua updated APEXMALHAR-2199: --- Affects Version/s: 3.5.0 3.4.0 > 0.8 kafka input operator doesn't

[jira] [Created] (APEXMALHAR-2199) 0.8 kafka input operator doesn't support chroot zookeeper path (multitenant kafka support)

Siyuan Hua created APEXMALHAR-2199: -- Summary: 0.8 kafka input operator doesn't support chroot zookeeper path (multitenant kafka support) Key: APEXMALHAR-2199 URL: https://issues.apache.org/jira/browse/APEXMALHAR-

[jira] [Commented] (APEXCORE-475) change the YARN_APPLICATION_TYPE from DataTorrent to ApacheApex

[ https://issues.apache.org/jira/browse/APEXCORE-475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15435001#comment-15435001 ] ASF GitHub Bot commented on APEXCORE-475: - GitHub user sandeshh opened a pull re

[GitHub] apex-core pull request #373: APEXCORE-475 1st part, as discussed in the jira...

GitHub user sandeshh opened a pull request: https://github.com/apache/apex-core/pull/373 APEXCORE-475 1st part, as discussed in the jira. This will make the c… …lient the forward compatible, then in the next release we can change the type to of the applicationt to ApacheApex Yo

GenericFileOutputOpeator doesn't work for all hadoop file systems

Hi All, GenericFileOutputOpeator which is in Malhar repository works only for few file systems. GenericFileOutputOpeator is extended from AbstractFileOutputOperator. Reason: openStream() method which is in AbstractFileOutputOperator calls append operation. But, all the file systems doesn't su

[jira] [Resolved] (APEXMALHAR-2185) Add a Deduper implementation for Bounded data

[ https://issues.apache.org/jira/browse/APEXMALHAR-2185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chinmay Kolhatkar resolved APEXMALHAR-2185. --- Resolution: Resolved Fix Version/s: 3.5.0 > Add a Deduper implemen

[jira] [Commented] (APEXMALHAR-2185) Add a Deduper implementation for Bounded data

[ https://issues.apache.org/jira/browse/APEXMALHAR-2185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15434593#comment-15434593 ] ASF GitHub Bot commented on APEXMALHAR-2185: Github user asfgit closed th

[GitHub] apex-malhar pull request #369: APEXMALHAR-2185: Added Bounded Deduper

Github user asfgit closed the pull request at: https://github.com/apache/apex-malhar/pull/369 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Resolved] (APEXMALHAR-2100) Development of Inner Join Operator using Spillable Datastructures

[ https://issues.apache.org/jira/browse/APEXMALHAR-2100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chinmay Kolhatkar resolved APEXMALHAR-2100. --- Resolution: Fixed Fix Version/s: 3.5.0 > Development of Inner Join

[GitHub] apex-malhar pull request #330: APEXMALHAR-2100 Implementation of Inner Join ...

Github user asfgit closed the pull request at: https://github.com/apache/apex-malhar/pull/330 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (APEXMALHAR-2100) Development of Inner Join Operator using Spillable Datastructures

[ https://issues.apache.org/jira/browse/APEXMALHAR-2100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15434434#comment-15434434 ] ASF GitHub Bot commented on APEXMALHAR-2100: Github user asfgit closed th