[jira] [Updated] (SAMZA-1100) Exception when using a stream as both bootstrap and broadcast

[Xinyu Liu (JIRA)]

 [ 
https://issues.apache.org/jira/browse/SAMZA-1100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Xinyu Liu updated SAMZA-1100:
-
Description: 
The following exception is thrown after setting test-system.test-topic to be 
both broadcast and bootstrap stream:

017-02-22 20:20:45 SamzaContainer [ERROR] Caught exception in process loop.
java.util.NoSuchElementException: key not found: SystemStream 
[system=test-system, stream=test-topic]
at scala.collection.MapLike$class.default(MapLike.scala:228)
at scala.collection.AbstractMap.default(Map.scala:58)
at scala.collection.MapLike$class.apply(MapLike.scala:141)
at scala.collection.AbstractMap.apply(Map.scala:58)
at 
org.apache.samza.system.chooser.BootstrappingChooser.checkOffset(BootstrappingChooser.scala:249)
at 
org.apache.samza.system.chooser.BootstrappingChooser.register(BootstrappingChooser.scala:127)
at 
org.apache.samza.system.chooser.DefaultChooser.register(DefaultChooser.scala:289)
at 
org.apache.samza.system.SystemConsumers.register(SystemConsumers.scala:209)
at 
org.apache.samza.container.TaskInstance$$anonfun$registerConsumers$2.apply(TaskInstance.scala:134)
at 
org.apache.samza.container.TaskInstance$$anonfun$registerConsumers$2.apply(TaskInstance.scala:131)
at 
scala.collection.immutable.HashSet$HashSet1.foreach(HashSet.scala:153)
at 
scala.collection.immutable.HashSet$HashTrieSet.foreach(HashSet.scala:306)
at 
scala.collection.immutable.HashSet$HashTrieSet.foreach(HashSet.scala:306)
at 
org.apache.samza.container.TaskInstance.registerConsumers(TaskInstance.scala:131)
at 
org.apache.samza.container.SamzaContainer$$anonfun$startConsumers$2.apply(SamzaContainer.scala:823)
at 
org.apache.samza.container.SamzaContainer$$anonfun$startConsumers$2.apply(SamzaContainer.scala:823)
at scala.collection.Iterator$class.foreach(Iterator.scala:727)
at scala.collection.AbstractIterator.foreach(Iterator.scala:1157)
at 
scala.collection.MapLike$DefaultValuesIterable.foreach(MapLike.scala:206)
at 
org.apache.samza.container.SamzaContainer.startConsumers(SamzaContainer.scala:823)
at 
org.apache.samza.container.SamzaContainer.run(SamzaContainer.scala:687)
at 
org.apache.samza.container.SamzaContainer$.safeMain(SamzaContainer.scala:109)
at 
org.apache.samza.container.SamzaContainer$.main(SamzaContainer.scala:83)
at org.apache.samza.container.SamzaContainer.main(SamzaContainer.scala)
2017-02-22 20:20:45 SamzaContainer [INFO] Shutting down.

  was:
The following exception is thrown after setting 
kafka-hadoop.FortuneOrgBlockMessage to be both broadcast and bootstrap stream:

017-02-22 20:20:45 SamzaContainer [ERROR] Caught exception in process loop.
java.util.NoSuchElementException: key not found: SystemStream 
[system=kafka-hadoop, stream=FortuneOrgBlockMessage]
at scala.collection.MapLike$class.default(MapLike.scala:228)
at scala.collection.AbstractMap.default(Map.scala:58)
at scala.collection.MapLike$class.apply(MapLike.scala:141)
at scala.collection.AbstractMap.apply(Map.scala:58)
at 
org.apache.samza.system.chooser.BootstrappingChooser.checkOffset(BootstrappingChooser.scala:249)
at 
org.apache.samza.system.chooser.BootstrappingChooser.register(BootstrappingChooser.scala:127)
at 
org.apache.samza.system.chooser.DefaultChooser.register(DefaultChooser.scala:289)
at 
org.apache.samza.system.SystemConsumers.register(SystemConsumers.scala:209)
at 
org.apache.samza.container.TaskInstance$$anonfun$registerConsumers$2.apply(TaskInstance.scala:134)
at 
org.apache.samza.container.TaskInstance$$anonfun$registerConsumers$2.apply(TaskInstance.scala:131)
at 
scala.collection.immutable.HashSet$HashSet1.foreach(HashSet.scala:153)
at 
scala.collection.immutable.HashSet$HashTrieSet.foreach(HashSet.scala:306)
at 
scala.collection.immutable.HashSet$HashTrieSet.foreach(HashSet.scala:306)
at 
org.apache.samza.container.TaskInstance.registerConsumers(TaskInstance.scala:131)
at 
org.apache.samza.container.SamzaContainer$$anonfun$startConsumers$2.apply(SamzaContainer.scala:823)
at 
org.apache.samza.container.SamzaContainer$$anonfun$startConsumers$2.apply(SamzaContainer.scala:823)
at scala.collection.Iterator$class.foreach(Iterator.scala:727)
at scala.collection.AbstractIterator.foreach(Iterator.scala:1157)
at 
scala.collection.MapLike$DefaultValuesIterable.foreach(MapLike.scala:206)
at 
org.apache.samza.container.SamzaContainer.startConsumers(SamzaContainer.scala:823)
at 
org.apache.samza.container.SamzaContainer.run(SamzaContainer.scala:687)
at 
org.apache.samza.container.SamzaContainer$.safeMain(SamzaContainer.scala:109)
at 

[jira] [Commented] (SAMZA-1091) Implement key-based inner join operator with no time constraints

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/SAMZA-1091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15879518#comment-15879518
 ] 

ASF GitHub Bot commented on SAMZA-1091:
---

GitHub user prateekm opened a pull request:

https://github.com/apache/samza/pull/60

SAMZA-1091: Implement key-based inner join operator with no time constraints

... and no retention

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/prateekm/samza master

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/samza/pull/60.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #60


commit f6ced9e7ea001c53db796a9660e2d4c191bf
Author: Prateek Maheshwari 
Date:   2017-02-22T23:54:19Z

SAMZA-1091: Implement key-based inner join operator with no time 
constraints and no retention




> Implement key-based inner join operator with no time constraints
> 
>
> Key: SAMZA-1091
> URL: https://issues.apache.org/jira/browse/SAMZA-1091
> Project: Samza
>  Issue Type: Task
>Affects Versions: 0.13.0
>Reporter: Prateek Maheshwari
>Assignee: Prateek Maheshwari
>
> Implement the operator for a message key based inner join with no time 
> constraints and no expiry (i.e., since the beginning of processing).



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Created] (SAMZA-1100) Exception when using a stream as both bootstrap and broadcast

[Xinyu Liu (JIRA)]

Xinyu Liu created SAMZA-1100:


 Summary: Exception when using a stream as both bootstrap and 
broadcast
 Key: SAMZA-1100
 URL: https://issues.apache.org/jira/browse/SAMZA-1100
 Project: Samza
  Issue Type: Bug
Reporter: Xinyu Liu
Assignee: Shanthoosh Venkataraman


The following exception is thrown after setting 
kafka-hadoop.FortuneOrgBlockMessage to be both broadcast and bootstrap stream:

017-02-22 20:20:45 SamzaContainer [ERROR] Caught exception in process loop.
java.util.NoSuchElementException: key not found: SystemStream 
[system=kafka-hadoop, stream=FortuneOrgBlockMessage]
at scala.collection.MapLike$class.default(MapLike.scala:228)
at scala.collection.AbstractMap.default(Map.scala:58)
at scala.collection.MapLike$class.apply(MapLike.scala:141)
at scala.collection.AbstractMap.apply(Map.scala:58)
at 
org.apache.samza.system.chooser.BootstrappingChooser.checkOffset(BootstrappingChooser.scala:249)
at 
org.apache.samza.system.chooser.BootstrappingChooser.register(BootstrappingChooser.scala:127)
at 
org.apache.samza.system.chooser.DefaultChooser.register(DefaultChooser.scala:289)
at 
org.apache.samza.system.SystemConsumers.register(SystemConsumers.scala:209)
at 
org.apache.samza.container.TaskInstance$$anonfun$registerConsumers$2.apply(TaskInstance.scala:134)
at 
org.apache.samza.container.TaskInstance$$anonfun$registerConsumers$2.apply(TaskInstance.scala:131)
at 
scala.collection.immutable.HashSet$HashSet1.foreach(HashSet.scala:153)
at 
scala.collection.immutable.HashSet$HashTrieSet.foreach(HashSet.scala:306)
at 
scala.collection.immutable.HashSet$HashTrieSet.foreach(HashSet.scala:306)
at 
org.apache.samza.container.TaskInstance.registerConsumers(TaskInstance.scala:131)
at 
org.apache.samza.container.SamzaContainer$$anonfun$startConsumers$2.apply(SamzaContainer.scala:823)
at 
org.apache.samza.container.SamzaContainer$$anonfun$startConsumers$2.apply(SamzaContainer.scala:823)
at scala.collection.Iterator$class.foreach(Iterator.scala:727)
at scala.collection.AbstractIterator.foreach(Iterator.scala:1157)
at 
scala.collection.MapLike$DefaultValuesIterable.foreach(MapLike.scala:206)
at 
org.apache.samza.container.SamzaContainer.startConsumers(SamzaContainer.scala:823)
at 
org.apache.samza.container.SamzaContainer.run(SamzaContainer.scala:687)
at 
org.apache.samza.container.SamzaContainer$.safeMain(SamzaContainer.scala:109)
at 
org.apache.samza.container.SamzaContainer$.main(SamzaContainer.scala:83)
at org.apache.samza.container.SamzaContainer.main(SamzaContainer.scala)
2017-02-22 20:20:45 SamzaContainer [INFO] Shutting down.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

svn commit: r1784062 [12/17] - in /samza/site: ./ archive/ community/ contribute/ learn/documentation/latest/ learn/documentation/latest/api/ learn/documentation/latest/api/javadocs/ learn/documentati

[jagadish]

Added: 
samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/operators/windows/internal/package-tree.html
URL: 
http://svn.apache.org/viewvc/samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/operators/windows/internal/package-tree.html?rev=1784062=auto
==
--- 
samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/operators/windows/internal/package-tree.html
 (added)
+++ 
samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/operators/windows/internal/package-tree.html
 Wed Feb 22 21:01:21 2017
@@ -0,0 +1,135 @@
+http://www.w3.org/TR/html4/loose.dtd;>
+
+
+
+
+org.apache.samza.operators.windows.internal Class Hierarchy (samza-api 
0.13.0-SNAPSHOT API)
+
+
+
+
+
+
+
+
+JavaScript is disabled on your browser.
+
+
+
+
+
+Skip navigation links
+
+
+
+
+Overview
+Package
+Class
+Tree
+Deprecated
+Index
+Help
+
+
+
+
+Prev
+Next
+
+
+Frames
+NoFrames
+
+
+AllClasses
+
+
+
+
+
+
+
+
+
+
+Hierarchy For Package 
org.apache.samza.operators.windows.internal
+Package Hierarchies:
+
+All Packages
+
+
+
+Class Hierarchy
+
+java.lang.Object
+
+org.apache.samza.operators.windows.internal.WindowInternalM,K,WV (implements 
org.apache.samza.operators.windows.WindowM,K,WV)
+
+
+
+
+
+
+
+
+Skip navigation links
+
+
+
+
+Overview
+Package
+Class
+Tree
+Deprecated
+Index
+Help
+
+
+
+
+Prev
+Next
+
+
+Frames
+NoFrames
+
+
+AllClasses
+
+
+
+
+
+
+
+
+
+
+

Added: 
samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/operators/windows/package-frame.html
URL: 
http://svn.apache.org/viewvc/samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/operators/windows/package-frame.html?rev=1784062=auto
==
--- 
samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/operators/windows/package-frame.html
 (added)
+++ 
samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/operators/windows/package-frame.html
 Wed Feb 22 21:01:21 2017
@@ -0,0 +1,30 @@
+http://www.w3.org/TR/html4/loose.dtd;>
+
+
+
+
+org.apache.samza.operators.windows (samza-api 0.13.0-SNAPSHOT 
API)
+
+
+
+
+
+org.apache.samza.operators.windows
+
+Interfaces
+
+Window
+
+Classes
+
+WindowKey
+WindowPane
+Windows
+
+Enums
+
+AccumulationMode
+
+
+
+

Added: 
samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/operators/windows/package-summary.html
URL: 
http://svn.apache.org/viewvc/samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/operators/windows/package-summary.html?rev=1784062=auto
==
--- 
samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/operators/windows/package-summary.html
 (added)
+++ 
samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/operators/windows/package-summary.html
 Wed Feb 22 21:01:21 2017
@@ -0,0 +1,189 @@
+http://www.w3.org/TR/html4/loose.dtd;>
+
+
+
+
+org.apache.samza.operators.windows (samza-api 0.13.0-SNAPSHOT 
API)
+
+
+
+
+
+
+
+
+JavaScript is disabled on your browser.
+
+
+
+
+
+Skip navigation links
+
+
+
+
+Overview
+Package
+Class
+Tree
+Deprecated
+Index
+Help
+
+
+
+
+PrevPackage
+NextPackage
+
+
+Frames
+NoFrames
+
+
+AllClasses
+
+
+
+
+
+
+
+
+
+
+Packageorg.apache.samza.operators.windows
+
+
+
+
+
+Interface Summary
+
+Interface
+Description
+
+
+
+WindowM,K,WV
+
+Groups incoming messages in the MessageStream 
into finite
+ windows for processing.
+
+
+
+
+
+
+
+Class Summary
+
+Class
+Description
+
+
+
+WindowKeyK
+
+Key for a WindowPane 
emitted from a Window.
+
+
+
+WindowPaneK,V
+
+Specifies the result emitted from a Window.
+
+
+
+Windows
+
+APIs for creating different types of Windows.
+
+
+
+
+
+
+
+Enum Summary

svn commit: r1784062 [17/17] - in /samza/site: ./ archive/ community/ contribute/ learn/documentation/latest/ learn/documentation/latest/api/ learn/documentation/latest/api/javadocs/ learn/documentati

[jagadish]

Modified: 
samza/site/learn/documentation/latest/rest/javadocs/org/apache/samza/rest/proxy/installation/package-tree.html
URL: 
http://svn.apache.org/viewvc/samza/site/learn/documentation/latest/rest/javadocs/org/apache/samza/rest/proxy/installation/package-tree.html?rev=1784062=1784061=1784062=diff
==
--- 
samza/site/learn/documentation/latest/rest/javadocs/org/apache/samza/rest/proxy/installation/package-tree.html
 (original)
+++ 
samza/site/learn/documentation/latest/rest/javadocs/org/apache/samza/rest/proxy/installation/package-tree.html
 Wed Feb 22 21:01:21 2017
@@ -2,9 +2,9 @@
 
 
 
-
-org.apache.samza.rest.proxy.installation Class Hierarchy (samza-rest 
0.11.1-SNAPSHOT API)
-
+
+org.apache.samza.rest.proxy.installation Class Hierarchy (samza-rest 
0.13.0-SNAPSHOT API)
+
 
 
 
@@ -12,7 +12,7 @@
 
 
 
-
-
-
+
+
+