[jira] [Commented] (TINKERPOP-1731) Docker build does not appear to work for gremlin-dotnet

2017-09-17 Thread Florian Hockmann (JIRA)

[ 
https://issues.apache.org/jira/browse/TINKERPOP-1731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16169320#comment-16169320
 ] 

Florian Hockmann commented on TINKERPOP-1731:
-

I finally found the cause for this: The {{Gremlin.Net.csproj.template}} was 
encoded in UTF-8 and contained a [byte order mark 
(BOM)|https://en.wikipedia.org/wiki/Byte_order_mark]. Apparently the Groovy 
template engine has a problem with some special characters like this and 
replaces them with {{\?\?\?}} during the docker build. That resulted in a 
csproj file that had {{\?\?\?}} as the first characters right before the 
license header comment which is of course not a valid XML file anymore.
I just pushed 
[3bf128ae9f9d6f73675705a958b7b4102572eaaa|https://github.com/apache/tinkerpop/commit/3bf128ae9f9d6f73675705a958b7b4102572eaaa]
 which simply removes the BOM bytes from the template file. This fixes the 
build of Gremlin.Net with Docker.

Unfortunately the csproj file still contains some {{\?\?\?}}, e.g., 
{{TinkerPop™}} becomes {{TinkerPop\?\?\?}} and {{application’s}} becomes 
{{application\?\?\?s}}. So we should probably find a way to tell the template 
engine to always use UTF-8 as the encoding which should fix this problem 
completely.

> Docker build does not appear to work for gremlin-dotnet
> ---
>
> Key: TINKERPOP-1731
> URL: https://issues.apache.org/jira/browse/TINKERPOP-1731
> Project: TinkerPop
>  Issue Type: Improvement
>  Components: build-release, dotnet
>Affects Versions: 3.3.0
>Reporter: stephen mallette
>Priority: Critical
>
> Docker won't build the gremlin-dotnet stuff. I pulled out the {{.glv}} files 
> from that module so that docker would run properly until this can be fixed:
> https://github.com/apache/tinkerpop/blob/2d30a76aabdd009b9b926f83df2308b7578571c0/docker/scripts/build.sh#L71-L72



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[GitHub] tinkerpop issue #715: change behaviour of repeat step to be depth first sear...

2017-09-17 Thread mpollmeier
Github user mpollmeier commented on the issue:

https://github.com/apache/tinkerpop/pull/715
  
`emit` modifies the behaviour of the repeat traversal, and I am unsure why 
that is. Let me explain what I know and hopefully you or someone else can fill 
the blanks. 

Let's take my toy graph `v5 <- v3 <- v1 <- v0 -> v2 -> v4 -> v6` since it's 
easier to see where you are with a simple println of the vertex. Without emit, 
this PR does what it's supposed to do: DFS. First the even numbers, then the 
odds. 

```
graph = TinkerGraph.open()
v0 = graph.addVertex("l0")
v1 = graph.addVertex("l1")
v2 = graph.addVertex("l1")
v3 = graph.addVertex("l2")
v4 = graph.addVertex("l2")
v5 = graph.addVertex("l3")
v6 = graph.addVertex("l3")
v0.addEdge("e", v2)
v2.addEdge("e", v4)
v4.addEdge("e", v6)
v0.addEdge("e", v1)
v1.addEdge("e", v3)
v3.addEdge("e", v5)
graph.traversal().V(v0).repeat(sideEffect{println("inside repeat at " + 
it)}.out()).times(3)
inside repeat at v[0]
inside repeat at v[2]
inside repeat at v[4]
==>v[6]
inside repeat at v[1]
inside repeat at v[3]
==>v[5]
```

However if I add an `emit()` it becomes BFS again:

```
graph.traversal().V(v0).emit().repeat(sideEffect{println("inside repeat at 
" + it)}.out()).times(3)
==>v[0]
inside repeat at v[0]
==>v[2]
inside repeat at v[2]
==>v[1]
inside repeat at v[1]
==>v[4]
inside repeat at v[4]
==>v[6]
==>v[3]
inside repeat at v[3]
==>v[5]
```

I tried to understand it in the debugger, and the core difference seems to 
be the behaviour of `this.starts.hasNext()` in 
`RepeatEndStep.standardAlgorithm`, which is an `ExpandableStepIterator`. 
* without emit, `hasNext` finds that 
`this.hostStep.getPreviousStep().hasNext()` is true, because it asks it's 
`previousStep` (which is a `VertexStep(OUT)`), which in turns has some results 
for `processNextStart`. 
* with emit, the above chain returns false, which in turn leads to a 
NoSuchElementException, which short-circuits and `while (true)` loop, which 
results in losing DFS semantics.

I don't know where these different semantics derive from. 



---


[GitHub] tinkerpop issue #705: make TinkerGraph cloneable

2017-09-17 Thread mpollmeier
Github user mpollmeier commented on the issue:

https://github.com/apache/tinkerpop/pull/705
  
@spmallette addressed your comments. 
VOTE +1


---


[jira] [Created] (TINKERPOP-1786) Recipe and missing manifest items for Spark on Yarn

2017-09-17 Thread Marc de Lignie (JIRA)
Marc de Lignie created TINKERPOP-1786:
-

 Summary: Recipe and missing manifest items for Spark on Yarn
 Key: TINKERPOP-1786
 URL: https://issues.apache.org/jira/browse/TINKERPOP-1786
 Project: TinkerPop
  Issue Type: Improvement
  Components: hadoop
Affects Versions: 3.2.6, 3.3.0
 Environment: gremlin-console
Reporter: Marc de Lignie
Priority: Minor
 Fix For: 3.2.7, 3.3.1


Thorough documentation for running OLAP queries on Spark on Yarn has been 
missing, keeping some users from getting the benefits of this nice feature of 
the Tinkerpop stack and resulting in a significant number of questions on the 
gremlin users list.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Updated] (TINKERPOP-1786) Recipe and missing manifest items for Spark on Yarn

2017-09-17 Thread Marc de Lignie (JIRA)

 [ 
https://issues.apache.org/jira/browse/TINKERPOP-1786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Marc de Lignie updated TINKERPOP-1786:
--
Affects Version/s: 3.1.8

> Recipe and missing manifest items for Spark on Yarn
> ---
>
> Key: TINKERPOP-1786
> URL: https://issues.apache.org/jira/browse/TINKERPOP-1786
> Project: TinkerPop
>  Issue Type: Improvement
>  Components: hadoop
>Affects Versions: 3.3.0, 3.1.8, 3.2.6
> Environment: gremlin-console
>Reporter: Marc de Lignie
>Priority: Minor
> Fix For: 3.2.7, 3.3.1
>
>
> Thorough documentation for running OLAP queries on Spark on Yarn has been 
> missing, keeping some users from getting the benefits of this nice feature of 
> the Tinkerpop stack and resulting in a significant number of questions on the 
> gremlin users list.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (TINKERPOP-1786) Recipe and missing manifest items for Spark on Yarn

2017-09-17 Thread Marc de Lignie (JIRA)

[ 
https://issues.apache.org/jira/browse/TINKERPOP-1786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16169628#comment-16169628
 ] 

Marc de Lignie commented on TINKERPOP-1786:
---

This issue was discussed on the [dev 
list|http://mail-archives.apache.org/mod_mbox/incubator-tinkerpop-dev/201707.mbox/browser]
 (July 6) and the approach suggested by Stephen Malette turns out to be 
perfectly possible. A future PR is in pretty good shape and can be previewed  
[here|https://github.com/vtslab/incubator-tinkerpop/commit/d2a7d9e85b76b2ccfda1c15d0c18def331fb75ea].
 What I plan to do next:
* merge this commit into a branch based on master (this will break things 
because of the differences between Spark 1.6 and Spark 2.0)
* final test of the TP32 and TP33 versions on a real cluster
* issue a PR with TP32 and TP33 feature branches and receive review comments
Of course, any suggestions on the approach are also welcome at this stage.

> Recipe and missing manifest items for Spark on Yarn
> ---
>
> Key: TINKERPOP-1786
> URL: https://issues.apache.org/jira/browse/TINKERPOP-1786
> Project: TinkerPop
>  Issue Type: Improvement
>  Components: hadoop
>Affects Versions: 3.3.0, 3.1.8, 3.2.6
> Environment: gremlin-console
>Reporter: Marc de Lignie
>Priority: Minor
> Fix For: 3.2.7, 3.3.1
>
>
> Thorough documentation for running OLAP queries on Spark on Yarn has been 
> missing, keeping some users from getting the benefits of this nice feature of 
> the Tinkerpop stack and resulting in a significant number of questions on the 
> gremlin users list.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Comment Edited] (TINKERPOP-1786) Recipe and missing manifest items for Spark on Yarn

2017-09-17 Thread Marc de Lignie (JIRA)

[ 
https://issues.apache.org/jira/browse/TINKERPOP-1786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16169628#comment-16169628
 ] 

Marc de Lignie edited comment on TINKERPOP-1786 at 9/18/17 5:49 AM:


This issue was discussed on the [dev 
list|http://mail-archives.apache.org/mod_mbox/incubator-tinkerpop-dev/201707.mbox/browser]
 (July 6) and the approach suggested by Stephen Mallette turns out to be 
perfectly possible. A future PR is in pretty good shape and can be previewed  
[here|https://github.com/vtslab/incubator-tinkerpop/commit/d2a7d9e85b76b2ccfda1c15d0c18def331fb75ea].
 What I plan to do next:
* merge this commit into a branch based on master (this will break things 
because of the differences between Spark 1.6 and Spark 2.0)
* final test of the TP32 and TP33 versions on a real cluster
* issue a PR with TP32 and TP33 feature branches and receive review comments
Of course, any suggestions on the approach are also welcome at this stage.


was (Author: hadoopmarc):
This issue was discussed on the [dev 
list|http://mail-archives.apache.org/mod_mbox/incubator-tinkerpop-dev/201707.mbox/browser]
 (July 6) and the approach suggested by Stephen Malette turns out to be 
perfectly possible. A future PR is in pretty good shape and can be previewed  
[here|https://github.com/vtslab/incubator-tinkerpop/commit/d2a7d9e85b76b2ccfda1c15d0c18def331fb75ea].
 What I plan to do next:
* merge this commit into a branch based on master (this will break things 
because of the differences between Spark 1.6 and Spark 2.0)
* final test of the TP32 and TP33 versions on a real cluster
* issue a PR with TP32 and TP33 feature branches and receive review comments
Of course, any suggestions on the approach are also welcome at this stage.

> Recipe and missing manifest items for Spark on Yarn
> ---
>
> Key: TINKERPOP-1786
> URL: https://issues.apache.org/jira/browse/TINKERPOP-1786
> Project: TinkerPop
>  Issue Type: Improvement
>  Components: hadoop
>Affects Versions: 3.3.0, 3.1.8, 3.2.6
> Environment: gremlin-console
>Reporter: Marc de Lignie
>Priority: Minor
> Fix For: 3.2.7, 3.3.1
>
>
> Thorough documentation for running OLAP queries on Spark on Yarn has been 
> missing, keeping some users from getting the benefits of this nice feature of 
> the Tinkerpop stack and resulting in a significant number of questions on the 
> gremlin users list.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)