Re: [ANNOUNCE] New Apache Apex PMC Member: Chinmay Kolhatkar

2018-05-25 Thread Deepak Narkhede
mod Immaneni < > > > pra...@apache.org> > > > > >> >>> wrote: > > > > >> >>>>> Congratulations Chinmay. > > > > >> >>>>> > > > > >> >>>>>> On Thu, May 24, 2018 at 9:39 AM Thomas Weise < > t...@apache.org > > > > > > > >> wrote: > > > > >> >>>>>> > > > > >> >>>>>> The Apache Apex PMC is pleased to announce that Chinmay > > > > Kolhatkar is > > > > >> >>>> now > > > > >> >>>>> a > > > > >> >>>>>> PMC member. > > > > >> >>>>>> > > > > >> >>>>>> Chinmay has contributed to Apex in many ways, including: > > > > >> >>>>>> > > > > >> >>>>>> - Various transform operators in Malhar > > > > >> >>>>>> - SQL translation based on Calcite > > > > >> >>>>>> - Apache Bigtop integration > > > > >> >>>>>> - Docker sandbox > > > > >> >>>>>> - Blogs and conference presentations > > > > >> >>>>>> > > > > >> >>>>>> We appreciate all his contributions to the project so far, > > and > > > > are > > > > >> >>>>> looking > > > > >> >>>>>> forward to more. > > > > >> >>>>>> > > > > >> >>>>>> Congrats! > > > > >> >>>>>> Thomas, for the Apache Apex PMC. > > > > >> >>>>>> > > > > >> > > > > >> > > > > > > > > > > -- > > > > > > > > > > Regards, > > > > > Ashwin. > > > > > > > > > > > > > -- > Thanks and Regards, > Shubhrajyoti Mohapatra > Mobile: +91-9769292295 > -- Thanks & Regards Deepak Narkhede

Re: [Feature Proposal] Add metrics dropwizards like gauges, meters, histogram etc to Apex Platform

2018-05-10 Thread Deepak Narkhede
; - it is probably good to retain a level of abstraction, to avoid > direct > > > > dependency on dropwizard > > > > - support programmatic metric creation (not just annotations) > > > > - remove deprecated counter and auto-metric code and migrate > ope

[Feature Proposal] Add metrics dropwizards like gauges, meters, histogram etc to Apex Platform

2018-05-08 Thread Deepak Narkhede
Hi Community, I want to propose addition of metrics like gauges, meters, counters and historgram for the following components. 1) Addition of metrics for Container Stats. 2) Addition of metrics for Operator Stats. 3) Addition of metrics for Stram Application Master stats. 4) Addition of metrics

[jira] [Commented] (APEXCORE-724) Support for Kubernetes

2017-05-18 Thread Deepak Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16016862#comment-16016862 ] Deepak Narkhede commented on APEXCORE-724: -- Hi Thomas, I would lik

[GitHub] apex-malhar pull request #594: APEXMALHAR-2460 Redshift output module unable...

2017-04-11 Thread deepak-narkhede
Github user deepak-narkhede closed the pull request at: https://github.com/apache/apex-malhar/pull/594 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] apex-malhar pull request #594: APEXMALHAR-2460 Redshift output module unable...

2017-04-11 Thread deepak-narkhede
GitHub user deepak-narkhede reopened a pull request: https://github.com/apache/apex-malhar/pull/594 APEXMALHAR-2460 Redshift output module unable to emit tuples. Tested with newly created application kinesis-to-redshift app-template (under separate PR). You can merge this pull

[GitHub] apex-malhar pull request #601: APEXMALHAR-2431 Create Kinesis Input operator...

2017-04-10 Thread deepak-narkhede
GitHub user deepak-narkhede reopened a pull request: https://github.com/apache/apex-malhar/pull/601 APEXMALHAR-2431 Create Kinesis Input operator which emits byte array You can merge this pull request into a Git repository by running: $ git pull https://github.com/deepak

[GitHub] apex-malhar pull request #601: APEXMALHAR-2431 Create Kinesis Input operator...

2017-04-10 Thread deepak-narkhede
Github user deepak-narkhede closed the pull request at: https://github.com/apache/apex-malhar/pull/601 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] apex-malhar pull request #601: APEXMALHAR-2431 Create Kinesis Input operator...

2017-04-05 Thread deepak-narkhede
GitHub user deepak-narkhede opened a pull request: https://github.com/apache/apex-malhar/pull/601 APEXMALHAR-2431 Create Kinesis Input operator which emits byte array You can merge this pull request into a Git repository by running: $ git pull https://github.com/deepak

[GitHub] apex-malhar pull request #594: APEXMALHAR-2460 Redshift output module unable...

2017-03-29 Thread deepak-narkhede
GitHub user deepak-narkhede opened a pull request: https://github.com/apache/apex-malhar/pull/594 APEXMALHAR-2460 Redshift output module unable to emit tuples. Tested with newly created application kinesis-to-redshift app-template (under separate PR). You can merge this pull

[jira] [Updated] (APEXMALHAR-2460) Redshift output module tuples unable to emit tuples

2017-03-29 Thread Deepak Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Deepak Narkhede updated APEXMALHAR-2460: Summary: Redshift output module tuples unable to emit tuples (was: Redshift

[jira] [Created] (APEXMALHAR-2460) Redshift output module tuples were unable to emit

2017-03-29 Thread Deepak Narkhede (JIRA)
Deepak Narkhede created APEXMALHAR-2460: --- Summary: Redshift output module tuples were unable to emit Key: APEXMALHAR-2460 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2460 Project

[jira] [Created] (APEXMALHAR-2431) Create Kinesis Input operator which emits byte array as tuple

2017-03-03 Thread Deepak Narkhede (JIRA)
Deepak Narkhede created APEXMALHAR-2431: --- Summary: Create Kinesis Input operator which emits byte array as tuple Key: APEXMALHAR-2431 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2431

[GitHub] apex-malhar pull request #564: APEXMALHAR-2427 Kinesis Input Operator docume...

2017-02-27 Thread deepak-narkhede
GitHub user deepak-narkhede opened a pull request: https://github.com/apache/apex-malhar/pull/564 APEXMALHAR-2427 Kinesis Input Operator documentation. You can merge this pull request into a Git repository by running: $ git pull https://github.com/deepak-narkhede/apex-malhar

[jira] [Created] (APEXMALHAR-2427) Kinesis Input Operator documentation

2017-02-27 Thread Deepak Narkhede (JIRA)
Deepak Narkhede created APEXMALHAR-2427: --- Summary: Kinesis Input Operator documentation Key: APEXMALHAR-2427 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2427 Project: Apache Apex

[GitHub] apex-core pull request #478: APEXCORE-634 Changes to unifier attribute test ...

2017-02-23 Thread deepak-narkhede
GitHub user deepak-narkhede opened a pull request: https://github.com/apache/apex-core/pull/478 APEXCORE-634 Changes to unifier attribute test case for module. Incorporated comments from Vlad on (https://github.com/apache/apex-core/pull/466) [APEXCORE-634] Apex Platform unable

[GitHub] apex-malhar pull request #550: APEXMALHAR-2381 Change WindowManager for perf...

2017-02-20 Thread deepak-narkhede
Github user deepak-narkhede closed the pull request at: https://github.com/apache/apex-malhar/pull/550 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] apex-malhar pull request #550: APEXMALHAR-2381 Change WindowManager for perf...

2017-02-20 Thread deepak-narkhede
GitHub user deepak-narkhede reopened a pull request: https://github.com/apache/apex-malhar/pull/550 APEXMALHAR-2381 Change WindowManager for performance issues in Kinesi… For performance benefits change existing windowDataManager. If FSWindowManager is required we can very well

[GitHub] apex-malhar pull request #550: APEXMALHAR-2381 Change WindowManager for perf...

2017-02-20 Thread deepak-narkhede
GitHub user deepak-narkhede reopened a pull request: https://github.com/apache/apex-malhar/pull/550 APEXMALHAR-2381 Change WindowManager for performance issues in Kinesi… For performance benefits change existing windowDataManager. If FSWindowManager is required we can very well

[GitHub] apex-malhar pull request #550: APEXMALHAR-2381 Change WindowManager for perf...

2017-02-20 Thread deepak-narkhede
Github user deepak-narkhede closed the pull request at: https://github.com/apache/apex-malhar/pull/550 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] apex-malhar pull request #550: APEXMALHAR-2381 Change WindowManager for perf...

2017-02-20 Thread deepak-narkhede
Github user deepak-narkhede closed the pull request at: https://github.com/apache/apex-malhar/pull/550 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] apex-malhar pull request #550: APEXMALHAR-2381 Change WindowManager for perf...

2017-02-20 Thread deepak-narkhede
GitHub user deepak-narkhede reopened a pull request: https://github.com/apache/apex-malhar/pull/550 APEXMALHAR-2381 Change WindowManager for performance issues in Kinesi… For performance benefits change existing windowDataManager. If FSWindowManager is required we can very well

[GitHub] apex-malhar pull request #556: APEXMALHAR-2412 Provide emitTuple overriding ...

2017-02-17 Thread deepak-narkhede
GitHub user deepak-narkhede opened a pull request: https://github.com/apache/apex-malhar/pull/556 APEXMALHAR-2412 Provide emitTuple overriding functionality for user in kinesis Input operator Provide emitTuple overriding functionality for user in kinesis Input operator

[GitHub] apex-malhar pull request #555: APEXMALHAR-2411 Avoid isreplaystate variable,...

2017-02-16 Thread deepak-narkhede
GitHub user deepak-narkhede opened a pull request: https://github.com/apache/apex-malhar/pull/555 APEXMALHAR-2411 Avoid isreplaystate variable, incorporate logic in activate() and replay() for Kinesis Input Operator Avoid isreplaystate variable, incorporate logic in activate() and

[jira] [Updated] (APEXMALHAR-2411) Avoid isreplaystate variable, incorporate logic in activate() and replay() for Kinesis Input Operator

2017-02-16 Thread Deepak Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Deepak Narkhede updated APEXMALHAR-2411: Summary: Avoid isreplaystate variable, incorporate logic in activate() and

[jira] [Created] (APEXMALHAR-2412) Provide emitTuple overriding functionality for user in kinesis Input operator

2017-02-16 Thread Deepak Narkhede (JIRA)
Deepak Narkhede created APEXMALHAR-2412: --- Summary: Provide emitTuple overriding functionality for user in kinesis Input operator Key: APEXMALHAR-2412 URL: https://issues.apache.org/jira/browse/APEXMALHAR

[jira] [Created] (APEXMALHAR-2411) Avoid consumer start while replay state in KinesisInputOperator

2017-02-16 Thread Deepak Narkhede (JIRA)
Deepak Narkhede created APEXMALHAR-2411: --- Summary: Avoid consumer start while replay state in KinesisInputOperator Key: APEXMALHAR-2411 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2411

[GitHub] apex-core pull request #466: APEXCORE-634 Apex Platform unable to set unifie...

2017-02-15 Thread deepak-narkhede
GitHub user deepak-narkhede reopened a pull request: https://github.com/apache/apex-core/pull/466 APEXCORE-634 Apex Platform unable to set unifier attributes for modules Problem: Unable to set Unifier attributes of output port within modules Description: When modules are

[GitHub] apex-core pull request #466: APEXCORE-634 Apex Platform unable to set unifie...

2017-02-15 Thread deepak-narkhede
Github user deepak-narkhede closed the pull request at: https://github.com/apache/apex-core/pull/466 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] apex-malhar pull request #550: APEXMALHAR-2381 Change WindowManager for perf...

2017-02-13 Thread deepak-narkhede
GitHub user deepak-narkhede opened a pull request: https://github.com/apache/apex-malhar/pull/550 APEXMALHAR-2381 Change WindowManager for performance issues in Kinesi… For performance benefits change existing windowDataManager. If FSWindowManager is required we can very well set

[GitHub] apex-malhar pull request #549: APEXMALHAR-2380 Add MutablePair for Kinensis ...

2017-02-13 Thread deepak-narkhede
GitHub user deepak-narkhede opened a pull request: https://github.com/apache/apex-malhar/pull/549 APEXMALHAR-2380 Add MutablePair for Kinensis Operator for Recovery State Add MutablePair for Kinensis Operator for Recovery State which will avoid default serialization caused by

[jira] [Commented] (APEXCORE-634) Apex Platform unable to set unifier attributes for modules in DAG

2017-02-07 Thread Deepak Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15855811#comment-15855811 ] Deepak Narkhede commented on APEXCORE-634: -- Hi Ram, After fur

[jira] [Updated] (APEXCORE-634) Apex Platform unable to set unifier attributes for modules in DAG

2017-02-07 Thread Deepak Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Deepak Narkhede updated APEXCORE-634: - Summary: Apex Platform unable to set unifier attributes for modules in DAG (was: Apex

[GitHub] apex-core pull request #466: APEXCORE-634 Apex Platform unable to set unifie...

2017-02-07 Thread deepak-narkhede
GitHub user deepak-narkhede opened a pull request: https://github.com/apache/apex-core/pull/466 APEXCORE-634 Apex Platform unable to set unifier attributes for modules Problem: Unable to set Unifier attributes of output port within modules Description: When modules are

[jira] [Created] (APEXCORE-634) Apex Platform unable to set Unifier attribute window time out

2017-02-01 Thread Deepak Narkhede (JIRA)
Deepak Narkhede created APEXCORE-634: Summary: Apex Platform unable to set Unifier attribute window time out Key: APEXCORE-634 URL: https://issues.apache.org/jira/browse/APEXCORE-634 Project

[jira] [Assigned] (APEXCORE-621) populate TIMEOUT_WINDOW_COUNT for thread local operators from downstreams.

2017-01-24 Thread Deepak Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Deepak Narkhede reassigned APEXCORE-621: Assignee: Deepak Narkhede > populate TIMEOUT_WINDOW_COUNT for thread lo

[jira] [Created] (APEXMALHAR-2381) Change FSWindowManager for performance issues in Kinesis Input Operator

2017-01-05 Thread Deepak Narkhede (JIRA)
Deepak Narkhede created APEXMALHAR-2381: --- Summary: Change FSWindowManager for performance issues in Kinesis Input Operator Key: APEXMALHAR-2381 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2381

[jira] [Created] (APEXMALHAR-2380) Add MutablePair for Kinensis Operator for Recovery State

2017-01-02 Thread Deepak Narkhede (JIRA)
Deepak Narkhede created APEXMALHAR-2380: --- Summary: Add MutablePair for Kinensis Operator for Recovery State Key: APEXMALHAR-2380 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2380

[jira] [Commented] (APEXMALHAR-2375) Latest Apex Malhar build failure with Apex core version 3.5.0

2016-12-21 Thread Deepak Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15769155#comment-15769155 ] Deepak Narkhede commented on APEXMALHAR-2375: - Hi Thomas, I had

Is there any plan to upgrade Apex core version for Apex Malhar ?

2016-12-21 Thread Deepak Narkhede
fails. Mostly they are used in test scenario. Let me know If there are plan to upgrade Apex core version, would like to take it up. Also opened the jira for the same: APEXMALHAR-2375 -- Thanks & Regards Deepak Narkhede

[jira] [Created] (APEXMALHAR-2375) Latest Apex Malhar build failure with Apex core version 3.5.0

2016-12-21 Thread Deepak Narkhede (JIRA)
Deepak Narkhede created APEXMALHAR-2375: --- Summary: Latest Apex Malhar build failure with Apex core version 3.5.0 Key: APEXMALHAR-2375 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2375

StramEvents for AppDataTracker for debugging and monitoring.

2016-11-28 Thread Deepak Narkhede
JSON similar to stats. 4) Also we can add aggregators for these events. Extending further if we add other transport to existing transport interface we can achieve Use case #3. Please let me know your feedback. -- Thanks & Regards Deepak Narkhede

[jira] [Created] (APEXMALHAR-2348) Mock tests for PostgreSQL for JdbcPollInputOperator

2016-11-20 Thread Deepak Narkhede (JIRA)
Deepak Narkhede created APEXMALHAR-2348: --- Summary: Mock tests for PostgreSQL for JdbcPollInputOperator Key: APEXMALHAR-2348 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2348 Project

[jira] [Created] (APEXMALHAR-2349) Mock tests for PostgreSQL for JdbcPollInputOperator

2016-11-20 Thread Deepak Narkhede (JIRA)
Deepak Narkhede created APEXMALHAR-2349: --- Summary: Mock tests for PostgreSQL for JdbcPollInputOperator Key: APEXMALHAR-2349 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2349 Project

[GitHub] apex-malhar pull request #489: APEXMALHAR-2330 JdbcPOJOPollInputOperator fai...

2016-11-09 Thread deepak-narkhede
Github user deepak-narkhede closed the pull request at: https://github.com/apache/apex-malhar/pull/489 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] apex-malhar pull request #489: APEXMALHAR-2330 JdbcPOJOPollInputOperator fai...

2016-11-09 Thread deepak-narkhede
GitHub user deepak-narkhede reopened a pull request: https://github.com/apache/apex-malhar/pull/489 APEXMALHAR-2330 JdbcPOJOPollInputOperator fails with NullPointerExcep… **Problem:** JdbcPOJOPollInputOperator fails with NullPointerException using PostgreSQL driver

[GitHub] apex-malhar pull request #489: APEXMALHAR-2330 JdbcPOJOPollInputOperator fai...

2016-11-09 Thread deepak-narkhede
GitHub user deepak-narkhede opened a pull request: https://github.com/apache/apex-malhar/pull/489 APEXMALHAR-2330 JdbcPOJOPollInputOperator fails with NullPointerExcep… **Problem:** JdbcPOJOPollInputOperator fails with NullPointerException when PostgreSQL driver

[jira] [Created] (APEXMALHAR-2330) JdbcPOJOPollInputOperator fails with NullPointerException when PostgreSQL driver

2016-11-08 Thread Deepak Narkhede (JIRA)
Deepak Narkhede created APEXMALHAR-2330: --- Summary: JdbcPOJOPollInputOperator fails with NullPointerException when PostgreSQL driver Key: APEXMALHAR-2330 URL: https://issues.apache.org/jira/browse/APEXMALHAR

[GitHub] apex-malhar pull request #468: APEXMALHAR-2314 Improper functioning in parti...

2016-11-07 Thread deepak-narkhede
GitHub user deepak-narkhede reopened a pull request: https://github.com/apache/apex-malhar/pull/468 APEXMALHAR-2314 Improper functioning in partitioning for sequentialFileRead for FSRecord Fix the StreamCodec for FSRecordReader, initially it was hashcode of blockId's mostly a

[GitHub] apex-malhar pull request #468: APEXMALHAR-2314 Improper functioning in parti...

2016-11-07 Thread deepak-narkhede
Github user deepak-narkhede closed the pull request at: https://github.com/apache/apex-malhar/pull/468 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[jira] [Created] (APEXMALHAR-2319) Documentation for FSRecordReader Module for line by line reader.

2016-10-27 Thread Deepak Narkhede (JIRA)
Deepak Narkhede created APEXMALHAR-2319: --- Summary: Documentation for FSRecordReader Module for line by line reader. Key: APEXMALHAR-2319 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2319

[jira] [Closed] (APEXCORE-567) Documentation for FSRecordReader Module for line by line reader.

2016-10-27 Thread Deepak Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Deepak Narkhede closed APEXCORE-567. Resolution: Not A Bug > Documentation for FSRecordReader Module for line by line rea

[jira] [Created] (APEXCORE-567) Documentation for FSRecordReader Module for line by line reader.

2016-10-27 Thread Deepak Narkhede (JIRA)
Deepak Narkhede created APEXCORE-567: Summary: Documentation for FSRecordReader Module for line by line reader. Key: APEXCORE-567 URL: https://issues.apache.org/jira/browse/APEXCORE-567 Project

[jira] [Commented] (APEXMALHAR-2312) NullPointerException in FileSplitterInput only if the file path is specified for attribute instead of directory path

2016-10-27 Thread Deepak Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15611295#comment-15611295 ] Deepak Narkhede commented on APEXMALHAR-2312: - Changed to Crit

[jira] [Updated] (APEXMALHAR-2312) NullPointerException in FileSplitterInput only if the file path is specified for attribute instead of directory path

2016-10-27 Thread Deepak Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Deepak Narkhede updated APEXMALHAR-2312: Priority: Critical (was: Minor) > NullPointerException in FileSplitterIn

[jira] [Created] (APEXMALHAR-2318) Directory scanner threads unable to throw exceptions to parent in FileSplitter

2016-10-27 Thread Deepak Narkhede (JIRA)
Deepak Narkhede created APEXMALHAR-2318: --- Summary: Directory scanner threads unable to throw exceptions to parent in FileSplitter Key: APEXMALHAR-2318 URL: https://issues.apache.org/jira/browse/APEXMALHAR

[GitHub] apex-malhar pull request #468: APEXMALHAR-2314 Improper functioning in parti...

2016-10-26 Thread deepak-narkhede
GitHub user deepak-narkhede reopened a pull request: https://github.com/apache/apex-malhar/pull/468 APEXMALHAR-2314 Improper functioning in partitioning for sequentialFileRead for FSRecord Fix the StreamCodec for FSRecordReader, initially it was hashcode of blockId's mostly a

[GitHub] apex-malhar pull request #468: APEXMALHAR-2314 Improper functioning in parti...

2016-10-26 Thread deepak-narkhede
Github user deepak-narkhede closed the pull request at: https://github.com/apache/apex-malhar/pull/468 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] apex-malhar pull request #457: APEXMALHAR-2302 Exposing few properties of FS...

2016-10-26 Thread deepak-narkhede
Github user deepak-narkhede closed the pull request at: https://github.com/apache/apex-malhar/pull/457 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] apex-malhar pull request #457: APEXMALHAR-2302 Exposing few properties of FS...

2016-10-26 Thread deepak-narkhede
GitHub user deepak-narkhede reopened a pull request: https://github.com/apache/apex-malhar/pull/457 APEXMALHAR-2302 Exposing few properties of FSSplitter and BlockReader operators to FSRecordReaderModule This change includes: 1) Expose blockSize property of FileSplitter

[GitHub] apex-malhar pull request #468: APEXMALHAR-2314 Improper functioning in parti...

2016-10-26 Thread deepak-narkhede
GitHub user deepak-narkhede reopened a pull request: https://github.com/apache/apex-malhar/pull/468 APEXMALHAR-2314 Improper functioning in partitioning for sequentialFileRead for FSRecord Fix the StreamCodec for FSRecordReader, initially it was hashcode of blockId's mostly a

[GitHub] apex-malhar pull request #468: APEXMALHAR-2314 Improper functioning in parti...

2016-10-26 Thread deepak-narkhede
Github user deepak-narkhede closed the pull request at: https://github.com/apache/apex-malhar/pull/468 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[jira] [Updated] (APEXMALHAR-2314) Improper functioning in partitioning of sequentialFileRead property of FSRecordReader

2016-10-25 Thread Deepak Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Deepak Narkhede updated APEXMALHAR-2314: Description: Fix the StreamCodec for FSRecordReader, initially it was hashcode

[jira] [Updated] (APEXMALHAR-2314) Improper functioning in partitioning of sequentialFileRead property of FSRecordReader

2016-10-24 Thread Deepak Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Deepak Narkhede updated APEXMALHAR-2314: Summary: Improper functioning in partitioning of sequentialFileRead property

[jira] [Updated] (APEXMALHAR-2314) Improper functioning in partitioning of sequencialFileRead property of FSRecordReader

2016-10-24 Thread Deepak Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Deepak Narkhede updated APEXMALHAR-2314: Description: Fix the StreamCodec for FSRecordReader, initially it was hashcode

[GitHub] apex-malhar pull request #468: APEXMALHAR-2314 Improper functioning in parti...

2016-10-24 Thread deepak-narkhede
GitHub user deepak-narkhede opened a pull request: https://github.com/apache/apex-malhar/pull/468 APEXMALHAR-2314 Improper functioning in partitioning for sequencialFileRead for FSRecord Fix the StreamCodec for FSRecordReader, initially it was hashcode of blockId's mostly a

[jira] [Created] (APEXMALHAR-2314) Improper functioning in partitioning of sequencialFileRead property of FSRecordReader

2016-10-24 Thread Deepak Narkhede (JIRA)
Deepak Narkhede created APEXMALHAR-2314: --- Summary: Improper functioning in partitioning of sequencialFileRead property of FSRecordReader Key: APEXMALHAR-2314 URL: https://issues.apache.org/jira/browse

[GitHub] apex-malhar pull request #457: APEXMALHAR-2302 Exposing few properties of FS...

2016-10-23 Thread deepak-narkhede
GitHub user deepak-narkhede reopened a pull request: https://github.com/apache/apex-malhar/pull/457 APEXMALHAR-2302 Exposing few properties of FSSplitter and BlockReader operators to FSRecordReaderModule This change adds blockSize property from FileSplitter to FSRecordReaderModule

[GitHub] apex-malhar pull request #463: APEXMALHAR-2312 Fix NullPointerException for ...

2016-10-23 Thread deepak-narkhede
GitHub user deepak-narkhede reopened a pull request: https://github.com/apache/apex-malhar/pull/463 APEXMALHAR-2312 Fix NullPointerException for FileSplitterInput Operat… Problem Statement: - NullPointerException seen in FileSplitterInput only if

[GitHub] apex-malhar pull request #463: APEXMALHAR-2312 Fix NullPointerException for ...

2016-10-23 Thread deepak-narkhede
Github user deepak-narkhede closed the pull request at: https://github.com/apache/apex-malhar/pull/463 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[jira] [Updated] (APEXMALHAR-2302) Exposing few properties of FSSplitter and BlockReader operators to FSRecordReaderModule to tune Application

2016-10-21 Thread Deepak Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Deepak Narkhede updated APEXMALHAR-2302: Summary: Exposing few properties of FSSplitter and BlockReader operators to

[GitHub] apex-malhar pull request #457: APEXMALHAR-2302 Add blockSize property to FSR...

2016-10-21 Thread deepak-narkhede
Github user deepak-narkhede closed the pull request at: https://github.com/apache/apex-malhar/pull/457 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] apex-malhar pull request #457: APEXMALHAR-2302 Add blockSize property to FSR...

2016-10-21 Thread deepak-narkhede
GitHub user deepak-narkhede reopened a pull request: https://github.com/apache/apex-malhar/pull/457 APEXMALHAR-2302 Add blockSize property to FSRecordReaderModule This change adds blockSize property from FileSplitter to FSRecordReaderModule. Tested with RecordReader Application

[GitHub] apex-malhar pull request #457: APEXMALHAR-2302 Add blockSize property to FSR...

2016-10-21 Thread deepak-narkhede
Github user deepak-narkhede closed the pull request at: https://github.com/apache/apex-malhar/pull/457 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] apex-malhar pull request #463: APEXMALHAR-2312 Fix NullPointerException for ...

2016-10-20 Thread deepak-narkhede
GitHub user deepak-narkhede opened a pull request: https://github.com/apache/apex-malhar/pull/463 APEXMALHAR-2312 Fix NullPointerException for FileSplitterInput Operat… Problem Statement: - NullPointerException seen in FileSplitterInput only if the

[jira] [Commented] (APEXMALHAR-2312) NullPointerException in FileSplitterInput only if the file path is specified for attribute instead of directory path

2016-10-20 Thread Deepak Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15594249#comment-15594249 ] Deepak Narkhede commented on APEXMALHAR-2312: - Issue reproduction

[jira] [Created] (APEXMALHAR-2312) NullPointerException in FileSplitterInput only if the file path is specified for attribute instead of directory path

2016-10-20 Thread Deepak Narkhede (JIRA)
Deepak Narkhede created APEXMALHAR-2312: --- Summary: NullPointerException in FileSplitterInput only if the file path is specified for attribute instead of directory path Key: APEXMALHAR-2312 URL: https

[jira] [Created] (APEXMALHAR-2308) BlockReader must consider fixed width length in emitted block alignment.

2016-10-18 Thread Deepak Narkhede (JIRA)
Deepak Narkhede created APEXMALHAR-2308: --- Summary: BlockReader must consider fixed width length in emitted block alignment. Key: APEXMALHAR-2308 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2308

[GitHub] apex-malhar pull request #457: APEXMALHAR 2302 Add blockSize property to FSR...

2016-10-18 Thread deepak-narkhede
GitHub user deepak-narkhede reopened a pull request: https://github.com/apache/apex-malhar/pull/457 APEXMALHAR 2302 Add blockSize property to FSRecordReaderModule This change adds blockSize property from FileSplitter to FSRecordReaderModule. Tested with RecordReader Application

[GitHub] apex-malhar pull request #457: APEXMALHAR 2302 Add blockSize property to FSR...

2016-10-18 Thread deepak-narkhede
Github user deepak-narkhede closed the pull request at: https://github.com/apache/apex-malhar/pull/457 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] apex-malhar pull request #457: APEXMALHAR 2302 Add blockSize property to FSR...

2016-10-17 Thread deepak-narkhede
Github user deepak-narkhede closed the pull request at: https://github.com/apache/apex-malhar/pull/457 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] apex-malhar pull request #457: APEXMALHAR 2302 Add blockSize property to FSR...

2016-10-17 Thread deepak-narkhede
GitHub user deepak-narkhede reopened a pull request: https://github.com/apache/apex-malhar/pull/457 APEXMALHAR 2302 Add blockSize property to FSRecordReaderModule This change adds blockSize property from FileSplitter to FSRecordReaderModule. Tested with RecordReader Application

[GitHub] apex-malhar pull request #457: APEXMALHAR 2302 Add blockSize property to FSR...

2016-10-17 Thread deepak-narkhede
GitHub user deepak-narkhede opened a pull request: https://github.com/apache/apex-malhar/pull/457 APEXMALHAR 2302 Add blockSize property to FSRecordReaderModule This change adds blockSize property from FileSplitter to FSRecordReaderModule. Tested with RecordReader Application

[jira] [Created] (APEXMALHAR-2302) Add blockSize property to FSRecordReaderModule

2016-10-16 Thread Deepak Narkhede (JIRA)
Deepak Narkhede created APEXMALHAR-2302: --- Summary: Add blockSize property to FSRecordReaderModule Key: APEXMALHAR-2302 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2302 Project: Apache

Re: Generic Malhar operator to get formatted data.

2016-10-04 Thread Deepak Narkhede
than HTML? > > -Priyanla > > On Tue, Oct 4, 2016 at 12:54 PM, Deepak Narkhede > wrote: > > > Hi Folks, > > > > Planning to write an malhar operator which will take Map or POJO as input > > and provide output as formatted data string as per specified templa

Generic Malhar operator to get formatted data.

2016-10-04 Thread Deepak Narkhede
lmost zero dependencies, light weight (faster processing) Please let me know your thoughts/suggestions on this. Thanks, Deepak -- Thanks & Regards Deepak Narkhede

[GitHub] apex-core pull request #403: APEXCORE-542 - Fix debug level verbose option f...

2016-10-03 Thread deepak-narkhede
GitHub user deepak-narkhede opened a pull request: https://github.com/apache/apex-core/pull/403 APEXCORE-542 - Fix debug level verbose option for Apex cli. This changes fixes the debug level console logging for Apex cli. The default logger level is INFO level for Apex cli

[jira] [Updated] (APEXCORE-542) Fix debug level verbose option for apex cli

2016-09-28 Thread Deepak Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Deepak Narkhede updated APEXCORE-542: - Description: Fix debug level verbose option for apex cli. Currently "&quo

[jira] [Updated] (APEXCORE-542) Fix debug level verbose option for apex cli

2016-09-28 Thread Deepak Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Deepak Narkhede updated APEXCORE-542: - Summary: Fix debug level verbose option for apex cli (was: Add DEBUG level verbose

[jira] [Created] (APEXCORE-542) Add DEBUG level verbose option to apex cli

2016-09-28 Thread Deepak Narkhede (JIRA)
Deepak Narkhede created APEXCORE-542: Summary: Add DEBUG level verbose option to apex cli Key: APEXCORE-542 URL: https://issues.apache.org/jira/browse/APEXCORE-542 Project: Apache Apex Core

[GitHub] apex-core pull request #399: APEXCORE-310 - Apex cli support to kill the app...

2016-09-28 Thread deepak-narkhede
GitHub user deepak-narkhede opened a pull request: https://github.com/apache/apex-core/pull/399 APEXCORE-310 - Apex cli support to kill the app by appname This changes adds support to kill the application by application name for apex cli. Unit Testing Completed: Please

[jira] [Assigned] (APEXCORE-541) Add an Apex CLI command to set & get the logging levels.

2016-09-27 Thread Deepak Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Deepak Narkhede reassigned APEXCORE-541: Assignee: Deepak Narkhede > Add an Apex CLI command to set & get the

[jira] [Comment Edited] (APEXCORE-310) apex cli - support to kill the app by appname

2016-09-23 Thread Deepak Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15515968#comment-15515968 ] Deepak Narkhede edited comment on APEXCORE-310 at 9/23/16 9:4

[jira] [Commented] (APEXCORE-310) apex cli - support to kill the app by appname

2016-09-23 Thread Deepak Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15515968#comment-15515968 ] Deepak Narkhede commented on APEXCORE-310: -- Current Status: Fix has compl

[jira] [Commented] (APEXCORE-528) Output Ports Not Optional by Default During Validation

2016-09-22 Thread Deepak Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15512979#comment-15512979 ] Deepak Narkhede commented on APEXCORE-528: -- Hi Alex, Are you currently wor

[jira] [Assigned] (APEXCORE-310) apex cli - support to kill the app by appname

2016-09-22 Thread Deepak Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Deepak Narkhede reassigned APEXCORE-310: Assignee: Deepak Narkhede > apex cli - support to kill the app by appn