[jira] [Resolved] (TOREE-407) Improve Branding on Site

2018-01-13 Thread Luciano Resende (JIRA)

 [ 
https://issues.apache.org/jira/browse/TOREE-407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Luciano Resende resolved TOREE-407.
---
   Resolution: Fixed
Fix Version/s: Not Applicable

> Improve Branding on Site
> 
>
> Key: TOREE-407
> URL: https://issues.apache.org/jira/browse/TOREE-407
> Project: TOREE
>  Issue Type: Improvement
>Reporter: Kyle Kelley
>Assignee: Luciano Resende
> Fix For: Not Applicable
>
>
> I want to recommend Toree to others as a Scala kernel. The messaging on 
> https://toree.incubator.apache.org/ is all about "remote spark" which muddies 
> what it actually does, which is provide kernels that are connected to Spark. 
> Toree, standalone, doesn't do anything without Jupyter.
> Here's what I wish it read:
> ```
> Apache Toree
> Spark connected kernels for Jupyter projects - Scala, Python, and R
> ```



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Assigned] (TOREE-407) Improve Branding on Site

2018-01-13 Thread Luciano Resende (JIRA)

 [ 
https://issues.apache.org/jira/browse/TOREE-407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Luciano Resende reassigned TOREE-407:
-

Assignee: Luciano Resende

> Improve Branding on Site
> 
>
> Key: TOREE-407
> URL: https://issues.apache.org/jira/browse/TOREE-407
> Project: TOREE
>  Issue Type: Improvement
>Reporter: Kyle Kelley
>Assignee: Luciano Resende
>
> I want to recommend Toree to others as a Scala kernel. The messaging on 
> https://toree.incubator.apache.org/ is all about "remote spark" which muddies 
> what it actually does, which is provide kernels that are connected to Spark. 
> Toree, standalone, doesn't do anything without Jupyter.
> Here's what I wish it read:
> ```
> Apache Toree
> Spark connected kernels for Jupyter projects - Scala, Python, and R
> ```



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


CI builds only enable for Master branch ?

2018-01-13 Thread Luciano Resende
Are there any specific reasons to enable CI builds only for master? I find
it useful to be able to get a PR and try it myself or even make
modifications to validate/investigate issues and then push to a forked
branch and see how the test suite is performing but they won't run unless I
do a local branch change to remove the branch filter.

If there are no specific reasons for that, I am planning to remove that
configuration from Toree Travis CI configuration.

-- 
Luciano Resende
http://twitter.com/lresende1975
http://lresende.blogspot.com/


[jira] [Assigned] (TOREE-462) %%dataframe magic fails with df containing nulls and arrays

2018-01-13 Thread Luciano Resende (JIRA)

 [ 
https://issues.apache.org/jira/browse/TOREE-462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Luciano Resende reassigned TOREE-462:
-

Assignee: Alexander Dmitriev

> %%dataframe magic fails with df containing nulls and arrays
> ---
>
> Key: TOREE-462
> URL: https://issues.apache.org/jira/browse/TOREE-462
> Project: TOREE
>  Issue Type: Bug
>  Components: Kernel
>Affects Versions: 0.1.0, 0.2.0
>Reporter: Luciano Resende
>Assignee: Alexander Dmitriev
> Fix For: 0.2.0
>
>
> When a DF contains null, it breaks with server error:
> [Stage 2:===> (17 + 2) / 
> 19]18/01/01 17:09:46 WARN TaskSetManager: Lost task 6.0 in stage 2.0 (TID 11, 
> 192.168.1.126, executor 1): java.lang.NullPointerException
>   at 
> org.apache.toree.utils.DataFrameConverter$$anonfun$3$$anonfun$4.apply(DataFrameConverter.scala:55)
>   at 
> org.apache.toree.utils.DataFrameConverter$$anonfun$3$$anonfun$4.apply(DataFrameConverter.scala:54)
>   at 
> scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234)
>   at 
> scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234)
>   at 
> scala.collection.IndexedSeqOptimized$class.foreach(IndexedSeqOptimized.scala:33)
>   at scala.collection.mutable.WrappedArray.foreach(WrappedArray.scala:35)
>   at scala.collection.TraversableLike$class.map(TraversableLike.scala:234)
>   at scala.collection.AbstractTraversable.map(Traversable.scala:104)
>   at 
> org.apache.toree.utils.DataFrameConverter$$anonfun$3.apply(DataFrameConverter.scala:54)
>   at 
> org.apache.toree.utils.DataFrameConverter$$anonfun$3.apply(DataFrameConverter.scala:53)
>   at scala.collection.Iterator$$anon$11.next(Iterator.scala:409)
>   at scala.collection.Iterator$$anon$10.next(Iterator.scala:393)
>   at scala.collection.Iterator$class.foreach(Iterator.scala:893)
>   at scala.collection.AbstractIterator.foreach(Iterator.scala:1336)
>   at 
> scala.collection.generic.Growable$class.$plus$plus$eq(Growable.scala:59)
>   at 
> scala.collection.mutable.ArrayBuffer.$plus$plus$eq(ArrayBuffer.scala:104)
>   at 
> scala.collection.mutable.ArrayBuffer.$plus$plus$eq(ArrayBuffer.scala:48)
>   at scala.collection.TraversableOnce$class.to(TraversableOnce.scala:310)
>   at scala.collection.AbstractIterator.to(Iterator.scala:1336)
>   at 
> scala.collection.TraversableOnce$class.toBuffer(TraversableOnce.scala:302)
>   at scala.collection.AbstractIterator.toBuffer(Iterator.scala:1336)
>   at 
> scala.collection.TraversableOnce$class.toArray(TraversableOnce.scala:289)
>   at scala.collection.AbstractIterator.toArray(Iterator.scala:1336)
>   at 
> org.apache.spark.rdd.RDD$$anonfun$take$1$$anonfun$29.apply(RDD.scala:1354)
>   at 
> org.apache.spark.rdd.RDD$$anonfun$take$1$$anonfun$29.apply(RDD.scala:1354)
>   at 
> org.apache.spark.SparkContext$$anonfun$runJob$5.apply(SparkContext.scala:2062)
>   at 
> org.apache.spark.SparkContext$$anonfun$runJob$5.apply(SparkContext.scala:2062)
>   at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:87)
>   at org.apache.spark.scheduler.Task.run(Task.scala:108)
>   at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:335)
>   at 
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
>   at 
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
>   at java.lang.Thread.run(Thread.java:748)



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (TOREE-462) %%dataframe magic fails with df containing nulls and arrays

2018-01-13 Thread Alexander Dmitriev (JIRA)

[ 
https://issues.apache.org/jira/browse/TOREE-462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16325097#comment-16325097
 ] 

Alexander Dmitriev commented on TOREE-462:
--

[~luciano resende] I've created jira account as you requested in 
[pr|https://github.com/apache/incubator-toree/pull/148]

> %%dataframe magic fails with df containing nulls and arrays
> ---
>
> Key: TOREE-462
> URL: https://issues.apache.org/jira/browse/TOREE-462
> Project: TOREE
>  Issue Type: Bug
>  Components: Kernel
>Affects Versions: 0.1.0, 0.2.0
>Reporter: Luciano Resende
> Fix For: 0.2.0
>
>
> When a DF contains null, it breaks with server error:
> [Stage 2:===> (17 + 2) / 
> 19]18/01/01 17:09:46 WARN TaskSetManager: Lost task 6.0 in stage 2.0 (TID 11, 
> 192.168.1.126, executor 1): java.lang.NullPointerException
>   at 
> org.apache.toree.utils.DataFrameConverter$$anonfun$3$$anonfun$4.apply(DataFrameConverter.scala:55)
>   at 
> org.apache.toree.utils.DataFrameConverter$$anonfun$3$$anonfun$4.apply(DataFrameConverter.scala:54)
>   at 
> scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234)
>   at 
> scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234)
>   at 
> scala.collection.IndexedSeqOptimized$class.foreach(IndexedSeqOptimized.scala:33)
>   at scala.collection.mutable.WrappedArray.foreach(WrappedArray.scala:35)
>   at scala.collection.TraversableLike$class.map(TraversableLike.scala:234)
>   at scala.collection.AbstractTraversable.map(Traversable.scala:104)
>   at 
> org.apache.toree.utils.DataFrameConverter$$anonfun$3.apply(DataFrameConverter.scala:54)
>   at 
> org.apache.toree.utils.DataFrameConverter$$anonfun$3.apply(DataFrameConverter.scala:53)
>   at scala.collection.Iterator$$anon$11.next(Iterator.scala:409)
>   at scala.collection.Iterator$$anon$10.next(Iterator.scala:393)
>   at scala.collection.Iterator$class.foreach(Iterator.scala:893)
>   at scala.collection.AbstractIterator.foreach(Iterator.scala:1336)
>   at 
> scala.collection.generic.Growable$class.$plus$plus$eq(Growable.scala:59)
>   at 
> scala.collection.mutable.ArrayBuffer.$plus$plus$eq(ArrayBuffer.scala:104)
>   at 
> scala.collection.mutable.ArrayBuffer.$plus$plus$eq(ArrayBuffer.scala:48)
>   at scala.collection.TraversableOnce$class.to(TraversableOnce.scala:310)
>   at scala.collection.AbstractIterator.to(Iterator.scala:1336)
>   at 
> scala.collection.TraversableOnce$class.toBuffer(TraversableOnce.scala:302)
>   at scala.collection.AbstractIterator.toBuffer(Iterator.scala:1336)
>   at 
> scala.collection.TraversableOnce$class.toArray(TraversableOnce.scala:289)
>   at scala.collection.AbstractIterator.toArray(Iterator.scala:1336)
>   at 
> org.apache.spark.rdd.RDD$$anonfun$take$1$$anonfun$29.apply(RDD.scala:1354)
>   at 
> org.apache.spark.rdd.RDD$$anonfun$take$1$$anonfun$29.apply(RDD.scala:1354)
>   at 
> org.apache.spark.SparkContext$$anonfun$runJob$5.apply(SparkContext.scala:2062)
>   at 
> org.apache.spark.SparkContext$$anonfun$runJob$5.apply(SparkContext.scala:2062)
>   at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:87)
>   at org.apache.spark.scheduler.Task.run(Task.scala:108)
>   at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:335)
>   at 
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
>   at 
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
>   at java.lang.Thread.run(Thread.java:748)



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)