GitHub user yogidevendra opened a pull request:
https://github.com/apache/incubator-apex-malhar/pull/273
APEXMALHAR-2077 AbstractSingleFileOutputOperator appending partitionID
1. Renamed HDFSOutputOperator to BytesFileOutputOperator
2. Moved partitionID related logic into Abstrac
GitHub user shubham-pathak22 opened a pull request:
https://github.com/apache/incubator-apex-malhar/pull/272
APEXMALHAR-2088: Fixed JsonMappingException for operators using JDBCSâ¦
â¦tore
You can merge this pull request into a Git repository by running:
$ git pull https://git
Created https://issues.apache.org/jira/browse/APEXMALHAR-2090 to track
this. Will be opening the PR soon.
Regards,
Sandeep
On Tue, May 10, 2016 at 10:07 PM, Sandeep Deshmukh
wrote:
> The current implementation does query every window. I would be fixing
> existing operator for polling only. Work
I would suggest to consider usability over operator developer convenience.
With String[] as parameter, BeanUtils will automatically convert a comma
separated string into an array. That does not work with List.
Someone could also explore the use of additional BeanUtils converters for
common types t
Thomas Weise created APEXMALHAR-2091:
Summary: Integration with Apache Ignite
Key: APEXMALHAR-2091
URL: https://issues.apache.org/jira/browse/APEXMALHAR-2091
Project: Apache Apex Malhar
I
Sandeep Deshmukh created APEXMALHAR-2090:
Summary: Fix JdbcPOJOInputOperator to correctly calculate OFFSET
in the query & remove unused fetchDirection vairable
Key: APEXMALHAR-2090
URL: https://issues.apac
[
https://issues.apache.org/jira/browse/APEXMALHAR-2073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sandeep Deshmukh updated APEXMALHAR-2073:
-
Attachment: APEXMALHAR-2073.log
Complete log of the test when it failed.
> I
[
https://issues.apache.org/jira/browse/APEXMALHAR-2073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15282384#comment-15282384
]
Sandeep Deshmukh commented on APEXMALHAR-2073:
--
Attached complete log. H
If this List is large enough, the user might have to create a large number
of properties, one for each element.
In this case however, it should be small enough and I think we can go ahead
with a List.
~Bhupesh
On Thu, May 12, 2016 at 8:36 PM, Yogi Devendra
wrote:
> IMO from engineering perspect
The Apache Apex community is pleased to announce release 3.4.0 (Apex Core).
This is the first release after graduation. It adds the support for
(anti-)affinity of operators,
several documentation and other improvements and important bug fixes. The
release has 63 resolved JIRAs.
There is a backwar
IMO from engineering perspective, List is more elegant than comma
separated strings and parsing it later.
>From user experience perspective, it is important to have consistent way
across all operators. Some operators having comma separated string others
having List is confusing.
Since, this discu
Philosophical musing: In software, functionality trumps (pun *not*
intended) elegance.
Ram
On Thu, May 12, 2016 at 6:02 PM, Bhupesh Chawda
wrote:
> I thought that this might not be considered clean w.r.t. the user
> experience while configuring the operator.
> However, if it is acceptable then
I thought that this might not be considered clean w.r.t. the user
experience while configuring the operator.
However, if it is acceptable then I'll go ahead with this.
Thanks for pointing it out!
~Bhupesh
On Thu, May 12, 2016 at 5:52 PM, Thomas Weise
wrote:
> Thanks! Looks a bit cumbersome tho
Thanks! Looks a bit cumbersome though...
On Thu, May 12, 2016 at 5:47 PM, Munagala Ramanath
wrote:
> An example of doing *exactly* that is shown here:
> http://docs.datatorrent.com/application_packages/
> in the section entitled "Operator properties"
>
> Ram
>
> On Thu, May 12, 2016 at 5:44 PM,
An example of doing *exactly* that is shown here:
http://docs.datatorrent.com/application_packages/
in the section entitled "Operator properties"
Ram
On Thu, May 12, 2016 at 5:44 PM, Bhupesh Chawda
wrote:
> AFAIK, there is no clean way to set a List property from an XML file.
>
> ~Bhupesh
>
> O
AFAIK, there is no clean way to set a List property from an XML file.
~Bhupesh
On Thu, May 12, 2016 at 5:41 PM, Munagala Ramanath
wrote:
> What was the concern about "configuring the List elements from the XML
> property file"
> and what issue might it create ?
>
> Ram
>
> On Thu, May 12, 2016
What was the concern about "configuring the List elements from the XML
property file"
and what issue might it create ?
Ram
On Thu, May 12, 2016 at 5:38 PM, Bhupesh Chawda
wrote:
> Hi All,
>
> I'll reopen the pull request again after addressing review comments.
>
>- There was a concern from
Hi All,
I'll reopen the pull request again after addressing review comments.
- There was a concern from Thomas regarding configuring the List
elements from the XML property file. I think this might create an issue. I
propose that in that case we create String getters and setters instead
Github user siyuanh commented on a diff in the pull request:
https://github.com/apache/incubator-apex-malhar/pull/261#discussion_r63117429
--- Diff:
stream/src/main/java/org/apache/apex/malhar/stream/api/impl/ApexStreamImpl.java
---
@@ -0,0 +1,457 @@
+/**
+ * Licensed to
APEXMALHAR-2078
APEXMALHAR-2009
Thanks,
Chandni
On Thu, May 12, 2016 at 4:17 PM, Thomas Weise
wrote:
> As discussed, due to the backward incompatible web socket change in 3.4.0
> we are going to put out a release candidate soon.
>
> Issues:
>
>
> https://issues.apache.org/jira/issues/?jql=fixVe
[
https://issues.apache.org/jira/browse/APEXMALHAR-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15282245#comment-15282245
]
Chandni Singh commented on APEXMALHAR-2009:
---
Please rename this operator be
[
https://issues.apache.org/jira/browse/APEXMALHAR-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chandni Singh updated APEXMALHAR-2009:
--
Fix Version/s: 3.4.0
> concrete operator for writing to HDFS file
> ---
[
https://issues.apache.org/jira/browse/APEXMALHAR-2078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chandni Singh updated APEXMALHAR-2078:
--
Fix Version/s: 3.4.0
> Potential thread issue in FileSplitterInput class
>
[
https://issues.apache.org/jira/browse/APEXMALHAR-2078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chandni Singh updated APEXMALHAR-2078:
--
Priority: Major (was: Minor)
> Potential thread issue in FileSplitterInput class
>
As discussed, due to the backward incompatible web socket change in 3.4.0
we are going to put out a release candidate soon.
Issues:
https://issues.apache.org/jira/issues/?jql=fixVersion%20%3D%203.4.0%20AND%20project%20%3D%20APEXMALHAR%20ORDER%20BY%20status%20ASC
There is only one open issue: APE
Github user PramodSSImmaneni commented on the pull request:
https://github.com/apache/incubator-apex-core/pull/332#issuecomment-218912074
Done
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have
Github user PramodSSImmaneni commented on a diff in the pull request:
https://github.com/apache/incubator-apex-core/pull/332#discussion_r63111734
--- Diff: docs/security.md ---
@@ -76,6 +51,72 @@ The property `dt.authentication.principal` specifies the
Kerberos user principal
Github user davidyan74 commented on a diff in the pull request:
https://github.com/apache/incubator-apex-malhar/pull/261#discussion_r63109851
--- Diff:
stream/src/main/java/org/apache/apex/malhar/stream/api/impl/ApexStreamImpl.java
---
@@ -0,0 +1,457 @@
+/**
+ * Licensed
Github user davidyan74 commented on a diff in the pull request:
https://github.com/apache/incubator-apex-malhar/pull/261#discussion_r63109747
--- Diff:
stream/src/main/java/org/apache/apex/malhar/stream/api/impl/StreamFactory.java
---
@@ -0,0 +1,81 @@
+/**
+ * Licensed to
Github user PramodSSImmaneni commented on a diff in the pull request:
https://github.com/apache/incubator-apex-core/pull/332#discussion_r63109347
--- Diff: docs/security.md ---
@@ -76,6 +51,72 @@ The property `dt.authentication.principal` specifies the
Kerberos user principal
Github user gauravgopi123 commented on a diff in the pull request:
https://github.com/apache/incubator-apex-core/pull/332#discussion_r63108811
--- Diff: docs/security.md ---
@@ -76,6 +51,72 @@ The property `dt.authentication.principal` specifies the
Kerberos user principal
Github user PramodSSImmaneni commented on a diff in the pull request:
https://github.com/apache/incubator-apex-core/pull/332#discussion_r63108537
--- Diff: docs/security.md ---
@@ -76,6 +51,72 @@ The property `dt.authentication.principal` specifies the
Kerberos user principal
Github user gauravgopi123 commented on a diff in the pull request:
https://github.com/apache/incubator-apex-malhar/pull/261#discussion_r63107066
--- Diff:
stream/src/main/java/org/apache/apex/malhar/stream/api/impl/ApexStreamImpl.java
---
@@ -0,0 +1,457 @@
+/**
+ * Licens
Github user siyuanh commented on a diff in the pull request:
https://github.com/apache/incubator-apex-malhar/pull/261#discussion_r63105959
--- Diff:
demos/wordcount/src/test/java/com/datatorrent/demos/wordcount/LocalTestWithoutStreamApplication.java
---
@@ -0,0 +1,48 @@
+/**
Github user siyuanh commented on a diff in the pull request:
https://github.com/apache/incubator-apex-malhar/pull/261#discussion_r63105863
--- Diff:
stream/src/main/java/org/apache/apex/malhar/stream/api/impl/ApexStreamImpl.java
---
@@ -0,0 +1,457 @@
+/**
+ * Licensed to
[
https://issues.apache.org/jira/browse/APEXMALHAR-2086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sandesh updated APEXMALHAR-2086:
Description:
Goal : 2 Operartors for Kafka Output
1. Simple Kafka Output Operator
[
https://issues.apache.org/jira/browse/APEXMALHAR-2086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sandesh updated APEXMALHAR-2086:
Description:
Goal : 2 Operartors for Kafak Output
1. Simple Kafka Output Operator
[
https://issues.apache.org/jira/browse/APEXMALHAR-2067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Weise resolved APEXMALHAR-2067.
--
Resolution: Fixed
Fix Version/s: 3.4.0
> Make necessary changes in Malhar fo
Github user asfgit closed the pull request at:
https://github.com/apache/incubator-apex-malhar/pull/266
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the
Github user asfgit closed the pull request at:
https://github.com/apache/incubator-apex-malhar/pull/258
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the
This looks like network issue. Is there a way to check if cluster had
network glitch when the app was running?
On Thu, May 12, 2016 at 2:19 PM, Vlad Rozov wrote:
> Hi Alex,
>
> After starting the application, set "com.datatorrent.netlet.*" to DEBUG
> and see if this will provide more info on the
[
https://issues.apache.org/jira/browse/APEXMALHAR-2073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15282088#comment-15282088
]
Chandni Singh commented on APEXMALHAR-2073:
---
[~sandeepdeshmukh] Can you ple
Github user davidyan74 commented on a diff in the pull request:
https://github.com/apache/incubator-apex-malhar/pull/261#discussion_r63100920
--- Diff: pom.xml ---
@@ -197,6 +197,7 @@
library
contrib
+stream
--- End diff --
should move
Github user davidyan74 commented on a diff in the pull request:
https://github.com/apache/incubator-apex-malhar/pull/261#discussion_r63100793
--- Diff:
demos/wordcount/src/test/java/com/datatorrent/demos/wordcount/LocalTestWithoutStreamApplication.java
---
@@ -0,0 +1,48 @@
+/
Github user davidyan74 commented on a diff in the pull request:
https://github.com/apache/incubator-apex-malhar/pull/261#discussion_r63100731
--- Diff:
demos/wordcount/src/test/java/com/datatorrent/demos/wordcount/ApplicationWithStreamAPITest.java
---
@@ -0,0 +1,49 @@
+/**
Github user gauravgopi123 commented on a diff in the pull request:
https://github.com/apache/incubator-apex-malhar/pull/261#discussion_r63100367
--- Diff:
contrib/src/main/java/com/datatorrent/contrib/kafka/SimpleKafkaConsumer.java ---
@@ -277,7 +277,7 @@ public SimpleKafkaConsume
Github user gauravgopi123 commented on a diff in the pull request:
https://github.com/apache/incubator-apex-malhar/pull/261#discussion_r63100278
--- Diff:
stream/src/main/java/org/apache/apex/malhar/stream/api/impl/ApexStreamImpl.java
---
@@ -0,0 +1,457 @@
+/**
+ * Licens
Github user davidyan74 commented on a diff in the pull request:
https://github.com/apache/incubator-apex-malhar/pull/261#discussion_r63100120
--- Diff:
contrib/src/main/java/com/datatorrent/contrib/kafka/SimpleKafkaConsumer.java ---
@@ -277,7 +277,7 @@ public SimpleKafkaConsumer(S
Hi Alex,
After starting the application, set "com.datatorrent.netlet.*" to DEBUG
and see if this will provide more info on the actual cause of the failure.
Thank you,
Vlad
On 5/11/16 09:47, McCullough, Alex wrote:
Hi Ram,
Here are the details:
rtsBuildRevisionrev: 2d66c73 branch: refs/tags
Github user siyuanh commented on a diff in the pull request:
https://github.com/apache/incubator-apex-malhar/pull/261#discussion_r63096995
--- Diff:
stream/src/main/java/org/apache/apex/malhar/stream/api/impl/ApexStreamImpl.java
---
@@ -0,0 +1,457 @@
+/**
+ * Licensed to
Github user gauravgopi123 commented on a diff in the pull request:
https://github.com/apache/incubator-apex-malhar/pull/243#discussion_r63084018
--- Diff:
contrib/src/test/java/com/datatorrent/contrib/parser/CsvPOJOParserTest.java ---
@@ -319,6 +331,19 @@ public void TestParserMor
[
https://issues.apache.org/jira/browse/APEXMALHAR-2085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Siyuan Hua updated APEXMALHAR-2085:
---
Description:
As per our recent several discussions in the community. A group of Windowed
[
https://issues.apache.org/jira/browse/APEXMALHAR-2085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Siyuan Hua updated APEXMALHAR-2085:
---
Description:
As per our recent several discussions in the community. A group of Windowed
[
https://issues.apache.org/jira/browse/APEXMALHAR-2085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Siyuan Hua updated APEXMALHAR-2085:
---
Description:
As per our recent several discussions in the community. A group of Windowed
Github user gauravgopi123 commented on a diff in the pull request:
https://github.com/apache/incubator-apex-malhar/pull/261#discussion_r63074921
--- Diff:
stream/src/main/java/org/apache/apex/malhar/stream/api/impl/ApexStreamImpl.java
---
@@ -0,0 +1,457 @@
+/**
+ * Licens
Github user gauravgopi123 commented on a diff in the pull request:
https://github.com/apache/incubator-apex-malhar/pull/261#discussion_r63074486
--- Diff:
stream/src/main/java/org/apache/apex/malhar/stream/api/AggregationStream.java
---
@@ -0,0 +1,35 @@
+/**
+ * Licensed
Github user siyuanh commented on a diff in the pull request:
https://github.com/apache/incubator-apex-malhar/pull/261#discussion_r63073665
--- Diff:
stream/src/main/java/org/apache/apex/malhar/stream/api/impl/ApexStreamImpl.java
---
@@ -0,0 +1,457 @@
+/**
+ * Licensed to
Github user siyuanh commented on a diff in the pull request:
https://github.com/apache/incubator-apex-malhar/pull/261#discussion_r63073461
--- Diff:
stream/src/main/java/org/apache/apex/malhar/stream/api/AggregationStream.java
---
@@ -0,0 +1,35 @@
+/**
+ * Licensed to the
Github user gauravgopi123 commented on the pull request:
https://github.com/apache/incubator-apex-core/pull/332#issuecomment-218845321
Looks good overall ð
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your proj
Github user gauravgopi123 commented on a diff in the pull request:
https://github.com/apache/incubator-apex-core/pull/332#discussion_r63071671
--- Diff: docs/security.md ---
@@ -76,6 +51,72 @@ The property `dt.authentication.principal` specifies the
Kerberos user principal
GitHub user PramodSSImmaneni opened a pull request:
https://github.com/apache/incubator-apex-core/pull/332
Added token auto-refresh
@gauravgopi123 @vrozov please review
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/PramodSSImman
Pramod Immaneni created APEXCORE-455:
Summary: Create documentation for delegation token refresh for
applications in secure mode
Key: APEXCORE-455
URL: https://issues.apache.org/jira/browse/APEXCORE-455
Github user asfgit closed the pull request at:
https://github.com/apache/incubator-apex-malhar/pull/271
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the
[
https://issues.apache.org/jira/browse/APEXMALHAR-2085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Siyuan Hua updated APEXMALHAR-2085:
---
Description:
As per our recent several discussions in the community. A group of Windowed
Created proxy JIRA:
https://issues.apache.org/jira/browse/APEXMALHAR-2089
On Wed, May 11, 2016 at 1:31 PM, Thomas Weise
wrote:
> SQL -> Beam is a longer term prospect that Julian Hyde is looking at. At
> this time, I see separate translations for SQL and Beam to the Apex DAG
> representation.
[
https://issues.apache.org/jira/browse/APEXMALHAR-2089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Weise updated APEXMALHAR-2089:
-
Labels: roadmap (was: )
> Apache Beam support
> ---
>
>
Thomas Weise created APEXMALHAR-2089:
Summary: Apache Beam support
Key: APEXMALHAR-2089
URL: https://issues.apache.org/jira/browse/APEXMALHAR-2089
Project: Apache Apex Malhar
Issue Type:
Thomas Weise created APEXCORE-454:
-
Summary: Create a Powered By page
Key: APEXCORE-454
URL: https://issues.apache.org/jira/browse/APEXCORE-454
Project: Apache Apex Core
Issue Type: New Featu
Github user asfgit closed the pull request at:
https://github.com/apache/incubator-apex-site/pull/37
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the fea
shubham pathak created APEXMALHAR-2088:
--
Summary: Exception while fetching properties for Operators using
JdbcStore
Key: APEXMALHAR-2088
URL: https://issues.apache.org/jira/browse/APEXMALHAR-2088
+1.
This is one of the common use cases in batch scenarios and it will be great
to have this in a stream as well using managed state, spillableMultiMap
structure.
Regards,
Mohit
On Thu, May 12, 2016 at 2:38 PM, Yogi Devendra wrote:
> +1 for the Proposal.
>
> This will be useful for joins invol
+1 for the Proposal.
This will be useful for joins involving large amount of data to be held
intermediately.
~ Yogi
On 9 May 2016 at 14:05, Chaitanya Chebolu wrote:
> Hi ,
>
>Malhar library has in-memory join operator and this can't process large
> amount of data because of checkpoint and
[
https://issues.apache.org/jira/browse/APEXMALHAR-1939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15281288#comment-15281288
]
Thomas Weise commented on APEXMALHAR-1939:
--
https://docs.google.com/document
73 matches
Mail list logo
