FWIW I am doing a talk on streaming planner with Apache Calcite and Apache
Apex. Anybody with any inputs on that may kindly suggest.
On Tue, Jul 12, 2016 at 11:55 PM, Rich Bowen wrote:
> As you are no doubt already aware, we will be holding ApacheCon in
> Seville, Spain, the week of November 14t
Github user tushargosavi commented on a diff in the pull request:
https://github.com/apache/apex-malhar/pull/282#discussion_r70569998
--- Diff:
library/src/main/java/com/datatorrent/lib/db/jdbc/AbstractJdbcPollInputOperator.java
---
@@ -0,0 +1,656 @@
+/**
+ * Licensed to t
[
https://issues.apache.org/jira/browse/APEXMALHAR-2066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15374441#comment-15374441
]
ASF GitHub Bot commented on APEXMALHAR-2066:
Github user tushargosavi com
Thanks Dev!
I think we should also add the following points to the design / assumptions
/ JIRA. Please suggest corrections if my understanding is incorrect.
1. This operator will create a configured number of non-polling static
partitions for fetching the existing data in the table. And an
+1. This is a really good starting point to cleanup malhar.
On Wed, Jul 13, 2016 at 3:06 AM, David Yan wrote:
> Hi Lakshmi,
>
> Thanks for volunteering.
>
> I think Pramod's suggestion of putting the operators into 3 buckets and
> Siyuan's suggestion of starting a shared Google Sheet that tracks
Strongly +1 for this.
For 1, can the mail be sent to someone who is mentioned in the PR? So for
e.g., if I mention @PramodSSImmaneni , then Pramod will be part of PR email
notification all further back and forth communication for that PR.
@Pramod, just using your name as an example.. :)
- Chinma
Sandesh created APEXCORE-491:
Summary: AppMaster memory based on the DAG
Key: APEXCORE-491
URL: https://issues.apache.org/jira/browse/APEXCORE-491
Project: Apache Apex Core
Issue Type: Improvemen
GitHub user sashadt opened a pull request:
https://github.com/apache/apex-site/pull/43
Adding Powered by Apex page
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/sashadt/incubator-apex-site APEXMALHAR-2137
Alternatively you can
[
https://issues.apache.org/jira/browse/APEXCORE-488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15374152#comment-15374152
]
ASF GitHub Bot commented on APEXCORE-488:
-
Github user PramodSSImmaneni commente
Github user PramodSSImmaneni commented on a diff in the pull request:
https://github.com/apache/apex-core/pull/357#discussion_r70553112
--- Diff:
engine/src/main/java/com/datatorrent/stram/StreamingAppMasterService.java ---
@@ -607,14 +608,15 @@ protected void serviceStart() throws
[
https://issues.apache.org/jira/browse/APEXMALHAR-2130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15374095#comment-15374095
]
bright chen commented on APEXMALHAR-2130:
-
Here are some thoughts to implemen
Vlad Rozov created APEXMALHAR-2146:
--
Summary: Benchmark operators that support Beam window concepts
Key: APEXMALHAR-2146
URL: https://issues.apache.org/jira/browse/APEXMALHAR-2146
Project: Apache Apex
Vlad Rozov created APEXMALHAR-2145:
--
Summary: Revisit Accumulation interface
Key: APEXMALHAR-2145
URL: https://issues.apache.org/jira/browse/APEXMALHAR-2145
Project: Apache Apex Malhar
Issue
Siyuan Hua created APEXMALHAR-2144:
--
Summary: Create proper toString method for Tuple sub classes
Key: APEXMALHAR-2144
URL: https://issues.apache.org/jira/browse/APEXMALHAR-2144
Project: Apache Apex M
[
https://issues.apache.org/jira/browse/APEXMALHAR-2085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David Yan resolved APEXMALHAR-2085.
---
Resolution: Fixed
Fix Version/s: 3.5.0
> Implement Windowed Operators
> --
Github user asfgit closed the pull request at:
https://github.com/apache/apex-malhar/pull/319
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is
[
https://issues.apache.org/jira/browse/APEXMALHAR-2085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15373859#comment-15373859
]
ASF GitHub Bot commented on APEXMALHAR-2085:
Github user asfgit closed th
[
https://issues.apache.org/jira/browse/APEXMALHAR-2140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Munagala V. Ramanath resolved APEXMALHAR-2140.
--
Resolution: Fixed
Fix Version/s: 3.5.0
Merged
> Move Active
Github user asfgit closed the pull request at:
https://github.com/apache/apex-malhar/pull/340
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is
[
https://issues.apache.org/jira/browse/APEXMALHAR-2140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15373818#comment-15373818
]
ASF GitHub Bot commented on APEXMALHAR-2140:
Github user asfgit closed th
[
https://issues.apache.org/jira/browse/APEXMALHAR-2143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David Yan updated APEXMALHAR-2143:
--
Assignee: Velineni Lakshmi Prasanna
> Evaluate and retire lib/math, lib/algo, and lib/strea
[
https://issues.apache.org/jira/browse/APEXMALHAR-2143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David Yan updated APEXMALHAR-2143:
--
Assignee: (was: David Yan)
> Evaluate and retire lib/math, lib/algo, and lib/streamquer
[
https://issues.apache.org/jira/browse/APEXMALHAR-2142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15373783#comment-15373783
]
Siyuan Hua commented on APEXMALHAR-2142:
https://github.com/apache/apex-malha
David Yan created APEXMALHAR-2143:
-
Summary: Evaluate and retire lib/math, lib/algo, and
lib/streamquery operators
Key: APEXMALHAR-2143
URL: https://issues.apache.org/jira/browse/APEXMALHAR-2143
Proje
+1
Ram
On Tue, Jul 12, 2016 at 2:35 PM, Pramod Immaneni
wrote:
> Hi,
>
> I was wondering how everyone felt about the volume of auto-generated emails
> on this list. Looks like multiple emails are generated and sent to everyone
> on the list even for relatively smaller actions such as commenting
[
https://issues.apache.org/jira/browse/APEXMALHAR-2142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15373760#comment-15373760
]
Siyuan Hua commented on APEXMALHAR-2142:
Basically use windowed operator to d
Siyuan Hua created APEXMALHAR-2142:
--
Summary: High-level API window support
Key: APEXMALHAR-2142
URL: https://issues.apache.org/jira/browse/APEXMALHAR-2142
Project: Apache Apex Malhar
Issue
Strong +1 from me as well (both points 1&2).
On Tue, Jul 12, 2016 at 2:38 PM, David Yan wrote:
> I'm strong +1 for Pramod's suggestion.
>
> David
>
> On Tue, Jul 12, 2016 at 2:35 PM, Pramod Immaneni
> wrote:
>
> > Hi,
> >
> > I was wondering how everyone felt about the volume of auto-generated
I'm strong +1 for Pramod's suggestion.
David
On Tue, Jul 12, 2016 at 2:35 PM, Pramod Immaneni
wrote:
> Hi,
>
> I was wondering how everyone felt about the volume of auto-generated emails
> on this list. Looks like multiple emails are generated and sent to everyone
> on the list even for relativ
Hi Lakshmi,
Thanks for volunteering.
I think Pramod's suggestion of putting the operators into 3 buckets and
Siyuan's suggestion of starting a shared Google Sheet that tracks
individual operators are both good, with the exception that lib/streamquery
is one unit and we probably do not need to loo
Hi,
I was wondering how everyone felt about the volume of auto-generated emails
on this list. Looks like multiple emails are generated and sent to everyone
on the list even for relatively smaller actions such as commenting on a
pull request, one from git, another from JIRA etc.
Understanding that
Github user vrozov commented on a diff in the pull request:
https://github.com/apache/apex-core/pull/357#discussion_r70526864
--- Diff:
engine/src/main/java/com/datatorrent/stram/StreamingAppMasterService.java ---
@@ -608,13 +609,16 @@ protected void serviceStart() throws Exception
[
https://issues.apache.org/jira/browse/APEXCORE-488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15373743#comment-15373743
]
ASF GitHub Bot commented on APEXCORE-488:
-
Github user vrozov commented on a dif
I am interested to work on this.
Regards,
Lakshmi prasanna
On Tue, Jul 12, 2016 at 1:55 PM, hsy...@gmail.com wrote:
> Why not have a shared google sheet with a list of operators and options
> that we want to do with it.
> I think it's case by case.
> But retire unused or obsolete operators is i
Github user sashadt commented on a diff in the pull request:
https://github.com/apache/apex-site/pull/42#discussion_r70523899
--- Diff: src/md/release.md ---
@@ -201,6 +242,23 @@ git push apache
```
Merge `@since` tag and change log changes to `master`.
+### Docu
[
https://issues.apache.org/jira/browse/APEXMALHAR-2141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15373694#comment-15373694
]
Siyuan Hua commented on APEXMALHAR-2141:
A stateless accumulation vs stateful
Github user sashadt commented on a diff in the pull request:
https://github.com/apache/apex-site/pull/42#discussion_r70522203
--- Diff: src/md/release.md ---
@@ -150,6 +150,47 @@ mkdir svn-dist && cp *-source-* svn-dist/
svn import svn-dist
https://dist.apache.org/repos/dist/d
Siyuan Hua created APEXMALHAR-2141:
--
Summary: An efficient Accumulation interface for primitive type
Key: APEXMALHAR-2141
URL: https://issues.apache.org/jira/browse/APEXMALHAR-2141
Project: Apache Ape
[
https://issues.apache.org/jira/browse/APEXMALHAR-2140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15373671#comment-15373671
]
devendra tagare commented on APEXMALHAR-2140:
-
PR created : https://githu
GitHub user devtagare opened a pull request:
https://github.com/apache/apex-malhar/pull/340
APEXMALHAR-2140 ActiveFieldInfo moved to AbstractJdbcPOJOOutputOperator
@amberarrow could you please review the changes.
You can merge this pull request into a Git repository by running:
[
https://issues.apache.org/jira/browse/APEXMALHAR-2140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15373669#comment-15373669
]
ASF GitHub Bot commented on APEXMALHAR-2140:
GitHub user devtagare opened
Why not have a shared google sheet with a list of operators and options
that we want to do with it.
I think it's case by case.
But retire unused or obsolete operators is important and we should do it
sooner rather than later.
Regards,
Siyuan
On Tue, Jul 12, 2016 at 1:09 PM, Amol Kekre wrote:
>
I would suggest we go through the operators in those packages on an
individual basis and grade them into 3 buckets, those that meet the level
we expect from the operators (could be few of them), those that are
potentially useful but need additional work and those that we don't think
would be useful
[
https://issues.apache.org/jira/browse/APEXCORE-488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15373640#comment-15373640
]
ASF GitHub Bot commented on APEXCORE-488:
-
Github user pradeepdalvi commented on
Github user pradeepdalvi commented on a diff in the pull request:
https://github.com/apache/apex-core/pull/357#discussion_r70516680
--- Diff:
engine/src/main/java/com/datatorrent/stram/StreamingAppMasterService.java ---
@@ -608,13 +609,16 @@ protected void serviceStart() throws Exc
Nice work Dev +1 for merging
On Tue, Jul 12, 2016 at 1:21 PM, Ashwin Chandra Putta <
ashwinchand...@gmail.com> wrote:
> Finally we have a robust jdbc polling input operator. Since it is
> @evolving, we can make improvements over time as folks start using this
> operator.
>
> +1 for merging the PR
Finally we have a robust jdbc polling input operator. Since it is
@evolving, we can make improvements over time as folks start using this
operator.
+1 for merging the PR.
Regards,
Ashwin.
On Tue, Jul 12, 2016 at 11:17 AM, Devendra Tagare wrote:
> All,
>
> We have created a JDBCPollInputOperato
Github user sandeshh closed the pull request at:
https://github.com/apache/apex-malhar/pull/298
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature
My vote is to do 2&3
Thks
Amol
On Tue, Jul 12, 2016 at 12:14 PM, Kottapalli, Venkatesh <
vkottapa...@directv.com> wrote:
> +1 for deprecating the packages listed below.
>
> -Original Message-
> From: hsy...@gmail.com [mailto:hsy...@gmail.com]
> Sent: Tuesday, July 12, 2016 12:01 PM
>
>
+1 for options 2 and 3
On Tue, Jul 12, 2016 at 12:14 PM, Kottapalli, Venkatesh <
vkottapa...@directv.com> wrote:
> +1 for deprecating the packages listed below.
>
> -Original Message-
> From: hsy...@gmail.com [mailto:hsy...@gmail.com]
> Sent: Tuesday, July 12, 2016 12:01 PM
>
> +1
>
> On
[
https://issues.apache.org/jira/browse/APEXMALHAR-2086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15373603#comment-15373603
]
ASF GitHub Bot commented on APEXMALHAR-2086:
GitHub user sandeshh reopene
[
https://issues.apache.org/jira/browse/APEXMALHAR-2086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15373602#comment-15373602
]
ASF GitHub Bot commented on APEXMALHAR-2086:
Github user sandeshh closed
GitHub user sandeshh reopened a pull request:
https://github.com/apache/apex-malhar/pull/298
[APEXMALHAR-2086] Kafka output operator: 0.9.0
Kafka output exactly once operator and the regular output operator.
You can merge this pull request into a Git repository by running:
Github user PramodSSImmaneni commented on a diff in the pull request:
https://github.com/apache/apex-site/pull/42#discussion_r70510981
--- Diff: src/md/release.md ---
@@ -150,6 +150,47 @@ mkdir svn-dist && cp *-source-* svn-dist/
svn import svn-dist
https://dist.apache.org/rep
Github user PramodSSImmaneni commented on a diff in the pull request:
https://github.com/apache/apex-site/pull/42#discussion_r70510870
--- Diff: src/md/release.md ---
@@ -150,6 +150,47 @@ mkdir svn-dist && cp *-source-* svn-dist/
svn import svn-dist
https://dist.apache.org/rep
Github user PramodSSImmaneni commented on a diff in the pull request:
https://github.com/apache/apex-site/pull/42#discussion_r70510813
--- Diff: src/md/release.md ---
@@ -150,6 +150,47 @@ mkdir svn-dist && cp *-source-* svn-dist/
svn import svn-dist
https://dist.apache.org/rep
Github user tweise commented on a diff in the pull request:
https://github.com/apache/apex-site/pull/42#discussion_r70504749
--- Diff: src/md/release.md ---
@@ -150,6 +150,47 @@ mkdir svn-dist && cp *-source-* svn-dist/
svn import svn-dist
https://dist.apache.org/repos/dist/de
Github user tweise commented on a diff in the pull request:
https://github.com/apache/apex-site/pull/42#discussion_r70504409
--- Diff: src/md/release.md ---
@@ -150,6 +150,47 @@ mkdir svn-dist && cp *-source-* svn-dist/
svn import svn-dist
https://dist.apache.org/repos/dist/de
Github user tweise commented on a diff in the pull request:
https://github.com/apache/apex-site/pull/42#discussion_r70504287
--- Diff: src/md/release.md ---
@@ -150,6 +150,47 @@ mkdir svn-dist && cp *-source-* svn-dist/
svn import svn-dist
https://dist.apache.org/repos/dist/de
+1 for deprecating the packages listed below.
-Original Message-
From: hsy...@gmail.com [mailto:hsy...@gmail.com]
Sent: Tuesday, July 12, 2016 12:01 PM
+1
On Tue, Jul 12, 2016 at 11:53 AM, David Yan wrote:
> Hi all,
>
> I would like to renew the discussion of retiring operators in Mal
+1
On Tue, Jul 12, 2016 at 11:53 AM, David Yan wrote:
> Hi all,
>
> I would like to renew the discussion of retiring operators in Malhar.
>
> As stated before, the reason why we would like to retire operators in
> Malhar is because some of them were written a long time ago before Apache
> incuba
Github user siyuanh closed the pull request at:
https://github.com/apache/apex-malhar/pull/327
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature i
GitHub user siyuanh opened a pull request:
https://github.com/apache/apex-malhar/pull/339
Windowed Strea
This is for review only, please ignore all checkstyle violations, format
issue etc.
For windowed operator changes, refer to #319
Please only review the cod
[
https://issues.apache.org/jira/browse/APEXMALHAR-2137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sasha Parfenov reassigned APEXMALHAR-2137:
--
Assignee: Sasha Parfenov
> Create an Integrated With page
> --
Hi all,
I would like to renew the discussion of retiring operators in Malhar.
As stated before, the reason why we would like to retire operators in
Malhar is because some of them were written a long time ago before Apache
incubation, and they do not pertain to real use cases, are not up to par in
As you are no doubt already aware, we will be holding ApacheCon in
Seville, Spain, the week of November 14th, 2016. The call for papers
(CFP) for this event is now open, and will remain open until
September 9th.
The event is divided into two parts, each with its own CFP. The first
part of the eve
All,
We have created a JDBCPollInputOperator with the below features,
1. poll from external jdbc store asynchronously in the input operator.
2. polling frequency and batch size are configurable.
3.User can specify the polling query
4.User can specify the columns to fetch as a part of the result s
[
https://issues.apache.org/jira/browse/APEXMALHAR-2066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15373332#comment-15373332
]
ASF GitHub Bot commented on APEXMALHAR-2066:
Github user devtagare commen
Github user devtagare commented on a diff in the pull request:
https://github.com/apache/apex-malhar/pull/282#discussion_r70488149
--- Diff:
library/src/main/java/com/datatorrent/lib/db/jdbc/AbstractJdbcPollInputOperator.java
---
@@ -0,0 +1,652 @@
+/**
+ * Licensed to the
[
https://issues.apache.org/jira/browse/APEXMALHAR-2066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15373301#comment-15373301
]
ASF GitHub Bot commented on APEXMALHAR-2066:
Github user devtagare commen
[
https://issues.apache.org/jira/browse/APEXMALHAR-2066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15373299#comment-15373299
]
ASF GitHub Bot commented on APEXMALHAR-2066:
Github user devtagare commen
Github user devtagare commented on a diff in the pull request:
https://github.com/apache/apex-malhar/pull/282#discussion_r70483612
--- Diff:
library/src/main/java/com/datatorrent/lib/db/jdbc/AbstractJdbcPollInputOperator.java
---
@@ -0,0 +1,652 @@
+/**
+ * Licensed to the
Github user devtagare commented on a diff in the pull request:
https://github.com/apache/apex-malhar/pull/282#discussion_r70483447
--- Diff:
library/src/main/java/com/datatorrent/lib/db/jdbc/JdbcMetaDataUtility.java ---
@@ -0,0 +1,344 @@
+/**
+ * Licensed to the Apache Soft
[
https://issues.apache.org/jira/browse/APEXMALHAR-2066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15373298#comment-15373298
]
ASF GitHub Bot commented on APEXMALHAR-2066:
Github user devtagare commen
[
https://issues.apache.org/jira/browse/APEXMALHAR-2066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15373297#comment-15373297
]
ASF GitHub Bot commented on APEXMALHAR-2066:
Github user devtagare commen
Github user devtagare commented on a diff in the pull request:
https://github.com/apache/apex-malhar/pull/282#discussion_r70483210
--- Diff:
library/src/main/java/com/datatorrent/lib/db/jdbc/JdbcMetaDataUtility.java ---
@@ -0,0 +1,344 @@
+/**
+ * Licensed to the Apache Soft
Github user devtagare commented on a diff in the pull request:
https://github.com/apache/apex-malhar/pull/282#discussion_r70483252
--- Diff:
library/src/main/java/com/datatorrent/lib/db/jdbc/JdbcMetaDataUtility.java ---
@@ -0,0 +1,344 @@
+/**
+ * Licensed to the Apache Soft
[
https://issues.apache.org/jira/browse/APEXMALHAR-2140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yunhan Wang updated APEXMALHAR-2140:
Assignee: devendra tagare
> Move ActiveFieldInfo class to com.datatorrent.lib.util
> --
Sandesh created APEXCORE-490:
Summary: Apex CLI tab completion based on the context
Key: APEXCORE-490
URL: https://issues.apache.org/jira/browse/APEXCORE-490
Project: Apache Apex Core
Issue Type:
[
https://issues.apache.org/jira/browse/APEXCORE-482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sandesh updated APEXCORE-482:
-
Description:
Default Unifiers are currently deployed ( except in Mx1 ) as CONTAINER_LOCAL
with the down
[
https://issues.apache.org/jira/browse/APEXCORE-482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sandesh updated APEXCORE-482:
-
Description:
Default Unifiers are currently deployed ( except in Mx1 ) as CONTAINER_LOCAL
with the down
[
https://issues.apache.org/jira/browse/APEXCORE-482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sandesh updated APEXCORE-482:
-
Description:
Default Unifiers are currently deployed ( except in Mx1 ) as CONTAINER_LOCAL
with the down
[
https://issues.apache.org/jira/browse/APEXCORE-482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sandesh updated APEXCORE-482:
-
Description:
Default Unifiers are currently deployed ( except in Mx1 ) as CONTAINER_LOCAL
with the down
[
https://issues.apache.org/jira/browse/APEXCORE-482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sandesh reassigned APEXCORE-482:
Assignee: Sandesh
> Default Unifiers should be ThreadLocal with downstream operators
> --
-0
I read the thread twice, it is not clear to me what benefit Apex users
derive from this exercise. A branch normally contains development work that
is eventually brought back to the main line and into a release. Here, the
suggestion seems to be an open ended effort to play with latest tech, isn'
85 matches
Mail list logo
