Which version of Malhar is this?
On Thu, Mar 10, 2016 at 10:56 PM, Ganelin, Ilya wrote:
> Hello – I have a long-running job which simultaneously writes to multiple
> files on HDFS. I am seeing the following error come up:
>
> I would appreciate any insight into what’s going on here.
>
>
> Stopp
Hello – I have a long-running job which simultaneously writes to multiple files
on HDFS. I am seeing the following error come up:
I would appreciate any insight into what’s going on here.
Stopped running due to an exception.
com.google.common.util.concurrent.UncheckedExecutionException:
java.
[
https://issues.apache.org/jira/browse/APEXCORE-201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vlad Rozov resolved APEXCORE-201.
-
Resolution: Fixed
Fix Version/s: 3.4.0
> Reported latency is wrong when a downstream oper
[
https://issues.apache.org/jira/browse/APEXCORE-201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15190463#comment-15190463
]
ASF GitHub Bot commented on APEXCORE-201:
-
Github user asfgit closed the pull re
Github user asfgit closed the pull request at:
https://github.com/apache/incubator-apex-core/pull/230
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the fe
[
https://issues.apache.org/jira/browse/APEXCORE-201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15190360#comment-15190360
]
ASF GitHub Bot commented on APEXCORE-201:
-
Github user davidyan74 commented on t
[
https://issues.apache.org/jira/browse/APEXCORE-379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David Yan updated APEXCORE-379:
---
Description:
When the operator suddenly gets stuck, the latency value will also gets stuck,
until i
Github user davidyan74 commented on the pull request:
https://github.com/apache/incubator-apex-core/pull/230#issuecomment-195144886
@PramodSSImmaneni I opened a separate JIRA to track this issue:
https://issues.apache.org/jira/browse/APEXCORE-379
---
If your project is set up for it
[
https://issues.apache.org/jira/browse/APEXMALHAR-2008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15190355#comment-15190355
]
ASF GitHub Bot commented on APEXMALHAR-2008:
Github user ishark commented
Github user ishark commented on a diff in the pull request:
https://github.com/apache/incubator-apex-malhar/pull/207#discussion_r55781098
--- Diff:
library/src/main/java/com/datatorrent/lib/io/block/BlockReader.java ---
@@ -0,0 +1,81 @@
+/**
+ * Licensed to the Apache Soft
David Yan created APEXCORE-379:
--
Summary: Latency is stuck when an operator is stuck (before the
1000 window threshold)
Key: APEXCORE-379
URL: https://issues.apache.org/jira/browse/APEXCORE-379
Project:
[
https://issues.apache.org/jira/browse/APEXMALHAR-2008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15190352#comment-15190352
]
ASF GitHub Bot commented on APEXMALHAR-2008:
Github user ishark commented
Github user ishark commented on a diff in the pull request:
https://github.com/apache/incubator-apex-malhar/pull/207#discussion_r55781008
--- Diff:
library/src/main/java/com/datatorrent/lib/io/block/BlockReader.java ---
@@ -0,0 +1,81 @@
+/**
+ * Licensed to the Apache Soft
[
https://issues.apache.org/jira/browse/APEXCORE-201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15190351#comment-15190351
]
ASF GitHub Bot commented on APEXCORE-201:
-
Github user davidyan74 commented on t
Github user davidyan74 commented on the pull request:
https://github.com/apache/incubator-apex-core/pull/230#issuecomment-195143173
@vrozov squashed. thanks.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your projec
[
https://issues.apache.org/jira/browse/APEXCORE-201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15190341#comment-15190341
]
ASF GitHub Bot commented on APEXCORE-201:
-
Github user davidyan74 commented on t
Github user davidyan74 commented on the pull request:
https://github.com/apache/incubator-apex-core/pull/230#issuecomment-195142304
@PramodSSImmaneni, the stuck operator scenario would require changes to a
different part of the code. The change in this PR is only along the processing
[
https://issues.apache.org/jira/browse/APEXMALHAR-2008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15190284#comment-15190284
]
ASF GitHub Bot commented on APEXMALHAR-2008:
Github user ishark commented
Github user ishark commented on a diff in the pull request:
https://github.com/apache/incubator-apex-malhar/pull/207#discussion_r55778161
--- Diff:
library/src/main/java/com/datatorrent/lib/io/fs/HDFSFileSplitter.java ---
@@ -0,0 +1,184 @@
+/**
+ * Licensed to the Apache S
Github user ishark commented on a diff in the pull request:
https://github.com/apache/incubator-apex-malhar/pull/207#discussion_r55777663
--- Diff:
library/src/main/java/com/datatorrent/lib/io/fs/HDFSFileSplitter.java ---
@@ -0,0 +1,180 @@
+/**
+ * Licensed to the Apache S
[
https://issues.apache.org/jira/browse/APEXMALHAR-2008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15190283#comment-15190283
]
ASF GitHub Bot commented on APEXMALHAR-2008:
Github user ishark commented
[
https://issues.apache.org/jira/browse/APEXMALHAR-2008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15190277#comment-15190277
]
ASF GitHub Bot commented on APEXMALHAR-2008:
Github user ishark commented
Github user ishark commented on a diff in the pull request:
https://github.com/apache/incubator-apex-malhar/pull/207#discussion_r55777007
--- Diff:
library/src/main/java/com/datatorrent/lib/io/fs/HDFSFileSplitter.java ---
@@ -0,0 +1,184 @@
+/**
+ * Licensed to the Apache S
[
https://issues.apache.org/jira/browse/APEXMALHAR-2008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15190267#comment-15190267
]
ASF GitHub Bot commented on APEXMALHAR-2008:
Github user ishark commented
[
https://issues.apache.org/jira/browse/APEXMALHAR-2008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15190268#comment-15190268
]
ASF GitHub Bot commented on APEXMALHAR-2008:
Github user ishark commented
Github user ishark commented on a diff in the pull request:
https://github.com/apache/incubator-apex-malhar/pull/207#discussion_r55776429
--- Diff:
library/src/main/java/com/datatorrent/lib/io/fs/HDFSInputModule.java ---
@@ -0,0 +1,253 @@
+/**
+ * Licensed to the Apache So
Github user ishark commented on a diff in the pull request:
https://github.com/apache/incubator-apex-malhar/pull/207#discussion_r55776427
--- Diff:
library/src/main/java/com/datatorrent/lib/io/fs/HDFSInputModule.java ---
@@ -0,0 +1,253 @@
+/**
+ * Licensed to the Apache So
[
https://issues.apache.org/jira/browse/APEXCORE-201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15190205#comment-15190205
]
ASF GitHub Bot commented on APEXCORE-201:
-
Github user vrozov commented on the p
Github user vrozov commented on the pull request:
https://github.com/apache/incubator-apex-core/pull/230#issuecomment-195109499
The rest looks good to me. Please squash commits.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as
I would NOT have to depend on the next committed callback to do some
transfer of data or cleanup.
Since I have to wait till the next committed callback, I need to hold this
data separately and handle it when I get the next committed callback.
If the committed window is provided in setup this can b
Can you provide an example of where this would make your operator purge
logic more straightforward?
Thanks
On Thu, Mar 10, 2016 at 1:30 PM, Chandni Singh
wrote:
> Hi,
>
> I was working on managed state and felt that some cleanup can be easier if
> the last committed window id is accessible to a
Hi,
I was working on managed state and felt that some cleanup can be easier if
the last committed window id is accessible to all operator during setup -
maybe a DAG level Attribute.
I don't think this requires a lot of code change. Also just an additional
attribute so just an attribute addition t
Try setting the attribute on the dag.
On Thu, Mar 10, 2016 at 9:35 AM, Chaitanya Chebolu <
chaita...@datatorrent.com> wrote:
> Hi All,
>
> I want to set the custom stream codec for all the ports in a DAG.
> Is there a way to set the custom stream codec at DAG level, instead of
> setting to al
Hi All,
I want to set the custom stream codec for all the ports in a DAG.
Is there a way to set the custom stream codec at DAG level, instead of
setting to all the ports?
Regards,
Chaitanya
Hi All,
Apart from extending the JDBC Output operator (for update, merge and
delete), I am planning the following change to the "*insert*" functionality:
- It was pointed out that - if the incoming POJO has fields which are to
be inserted into a database table, the user should not have to
Github user chinmaykolhatkar commented on a diff in the pull request:
https://github.com/apache/incubator-apex-malhar/pull/207#discussion_r55667219
--- Diff:
library/src/test/java/com/datatorrent/lib/io/fs/FileSplitterInputTest.java ---
@@ -110,8 +110,7 @@ protected void starting(
[
https://issues.apache.org/jira/browse/APEXMALHAR-2008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15189175#comment-15189175
]
ASF GitHub Bot commented on APEXMALHAR-2008:
Github user chinmaykolhatkar
[
https://issues.apache.org/jira/browse/APEXMALHAR-2008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15189167#comment-15189167
]
ASF GitHub Bot commented on APEXMALHAR-2008:
Github user chinmaykolhatkar
Github user chinmaykolhatkar commented on a diff in the pull request:
https://github.com/apache/incubator-apex-malhar/pull/207#discussion_r55666817
--- Diff:
library/src/main/java/com/datatorrent/lib/io/fs/HDFSFileSplitter.java ---
@@ -0,0 +1,180 @@
+/**
+ * Licensed to th
Github user bhupeshchawda closed the pull request at:
https://github.com/apache/incubator-apex-malhar/pull/162
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or
Github user DT-Priyanka commented on a diff in the pull request:
https://github.com/apache/incubator-apex-malhar/pull/207#discussion_r55651968
--- Diff:
library/src/main/java/com/datatorrent/lib/io/block/HDFSBlockReader.java ---
@@ -0,0 +1,78 @@
+/**
+ * Licensed to the Ap
[
https://issues.apache.org/jira/browse/APEXMALHAR-2008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15188948#comment-15188948
]
ASF GitHub Bot commented on APEXMALHAR-2008:
Github user DT-Priyanka comm
[
https://issues.apache.org/jira/browse/APEXMALHAR-2008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15188942#comment-15188942
]
ASF GitHub Bot commented on APEXMALHAR-2008:
Github user DT-Priyanka comm
[
https://issues.apache.org/jira/browse/APEXMALHAR-2008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15188941#comment-15188941
]
ASF GitHub Bot commented on APEXMALHAR-2008:
Github user DT-Priyanka comm
Github user DT-Priyanka commented on a diff in the pull request:
https://github.com/apache/incubator-apex-malhar/pull/207#discussion_r55651056
--- Diff:
library/src/main/java/com/datatorrent/lib/io/block/HDFSBlockMetadata.java ---
@@ -0,0 +1,63 @@
+/**
+ * Licensed to the
Github user DT-Priyanka commented on a diff in the pull request:
https://github.com/apache/incubator-apex-malhar/pull/207#discussion_r55651031
--- Diff:
library/src/test/java/com/datatorrent/lib/io/fs/FileSplitterInputTest.java ---
@@ -110,8 +110,7 @@ protected void starting(org.j
[
https://issues.apache.org/jira/browse/APEXMALHAR-2008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15188939#comment-15188939
]
ASF GitHub Bot commented on APEXMALHAR-2008:
Github user DT-Priyanka comm
Github user DT-Priyanka commented on a diff in the pull request:
https://github.com/apache/incubator-apex-malhar/pull/207#discussion_r55650890
--- Diff:
library/src/main/java/com/datatorrent/lib/io/fs/HDFSInputModule.java ---
@@ -0,0 +1,236 @@
+/**
+ * Licensed to the Apac
Github user DT-Priyanka commented on a diff in the pull request:
https://github.com/apache/incubator-apex-malhar/pull/207#discussion_r55650677
--- Diff:
library/src/main/java/com/datatorrent/lib/io/fs/HDFSInputModule.java ---
@@ -0,0 +1,236 @@
+/**
+ * Licensed to the Apac
[
https://issues.apache.org/jira/browse/APEXMALHAR-2008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15188938#comment-15188938
]
ASF GitHub Bot commented on APEXMALHAR-2008:
Github user DT-Priyanka comm
[
https://issues.apache.org/jira/browse/APEXMALHAR-2008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15188936#comment-15188936
]
ASF GitHub Bot commented on APEXMALHAR-2008:
Github user DT-Priyanka comm
Github user DT-Priyanka commented on a diff in the pull request:
https://github.com/apache/incubator-apex-malhar/pull/207#discussion_r55650568
--- Diff:
library/src/main/java/com/datatorrent/lib/io/fs/HDFSFileSplitter.java ---
@@ -0,0 +1,180 @@
+/**
+ * Licensed to the Apa
[
https://issues.apache.org/jira/browse/APEXMALHAR-2008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15188933#comment-15188933
]
ASF GitHub Bot commented on APEXMALHAR-2008:
Github user DT-Priyanka comm
Github user DT-Priyanka commented on a diff in the pull request:
https://github.com/apache/incubator-apex-malhar/pull/207#discussion_r55650442
--- Diff:
library/src/main/java/com/datatorrent/lib/io/fs/HDFSFileSplitter.java ---
@@ -0,0 +1,180 @@
+/**
+ * Licensed to the Apa
Thanks everyone for the feedback.
@Yogi, the reason for "transform" name is that the tuple will be
transformed here.
If there are no further comments on this, I'll start working on this and
will create a PR soon.
First PR I'll create is for enhancements to PojoUtils as mentioned above
and second
Github user DT-Priyanka commented on a diff in the pull request:
https://github.com/apache/incubator-apex-malhar/pull/207#discussion_r55646438
--- Diff:
library/src/main/java/com/datatorrent/lib/io/block/HDFSBlockReader.java ---
@@ -0,0 +1,78 @@
+/**
+ * Licensed to the Ap
[
https://issues.apache.org/jira/browse/APEXMALHAR-2008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15188904#comment-15188904
]
ASF GitHub Bot commented on APEXMALHAR-2008:
Github user DT-Priyanka comm
GitHub user sashadt opened a pull request:
https://github.com/apache/incubator-apex-malhar/pull/208
Apexcore 293.migrate docs.v3
Adding Malhar docs, including all the file history from original repository.
You can merge this pull request into a Git repository by running:
$ git
Github user sashadt closed the pull request at:
https://github.com/apache/incubator-apex-malhar/pull/202
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the
[
https://issues.apache.org/jira/browse/APEXCORE-293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1517#comment-1517
]
ASF GitHub Bot commented on APEXCORE-293:
-
Github user sashadt closed the pull r
60 matches
Mail list logo
