Re: PRs and ICLA

2016-01-08 Thread Chip Senkbeil
Also, wanted to point out that it appears that Apache Spark does not require the ICLA: http://apache-spark-developers-list.1001551.n3.nabble.com/Spark-Contribution-tp7935p7972.html https://cwiki.apache.org/confluence/display/SPARK/Contributing+to+Spark#ContributingtoSpark-ContributingCodeChanges

Re: Versioning

2016-01-08 Thread Chip Senkbeil
I agree with starting the version from scratch. Needing to keep Toree in line with the Spark version is difficult and limits us to the revision versions. Furthermore, now that we work as a Spark Submit application and use SPARK HOME to identify the Apache Spark version to use, I don't see the need

Continuous Integration Tooling

2016-01-08 Thread Chip Senkbeil
I know that Apache Spark uses Jenkins with a plugin in Github to allow them to manually invoke Jenkins testing against PRs. Do we want something similar (or do we have it already) for Toree? Currently, we use Travis CI, which is free for open source projects. I don't know off the top of my head if

Publishing jar binaries to Maven Central

2016-01-08 Thread Chip Senkbeil
Currently, we do not publish any binaries to Maven Central. It would be nice to take a look at doing this. There was an issue on Github to deal with this. We can move the discussion here now. We need to refactor the project's org to org.apache and the artifacts to toree- instead of just . E.g. the

Broken image on site

2016-01-08 Thread Chip Senkbeil
Anyone else notice that the Toree icon is broken on non-homepage links? http://toree.apache.org/community/ http://toree.apache.org/community-members/ It's using a relative url of "assets/themes/apache/img/logo.png", which breaks when going into subdirectories like community and community-members.

Re: Continuous Integration Tooling

2016-01-08 Thread Chip Senkbeil
at as an option. > > > > https://builds.apache.org/ > > > > On Fri, Jan 8, 2016 at 9:54 AM, Chip Senkbeil > > wrote: > > > > > I know that Apache Spark uses Jenkins with a plugin in Github to allow > > them > > > to manually invoke Jenkins te

Re: Toree source code available?

2016-01-08 Thread Chip Senkbeil
The project and its associated issues are in the process of being moved to Apache, but you can find the current source on Github: https://github.com/ibm-et/spark-kernel On Fri, Jan 8, 2016 at 9:54 PM Kasper Sørensen < i.am.kasper.soren...@gmail.com> wrote: > Hi Toree team, > > I'm trying to get a

Re: Git repository migration

2016-01-11 Thread Chip Senkbeil
@lresende, just wanted to check in about the state of merging the PR that Gino mentioned. Submitter claims to have signed the ICLA; so, we need to know whether or not we should wait until after the move to roll it in. This also brings up if there is a way for submitters to not need to sign the ICLA

Write access to repository and handling PRs

2016-01-12 Thread Chip Senkbeil
So, this may be documented somewhere, but I'm not sure where to look. How do we gain write access to the git repository? I (and several others) are still waiting to hear back from the secretary about the ICLA. I'm assuming access has something to do with the Apache id, but I don't know what you nee

Issue Tracker not available

2016-01-13 Thread Chip Senkbeil
Is there a timeline for when the issue tracker will be available for Toree? Is there something we haven't done yet? Currently, https://issues.apache.org/jira/browse/TOREE gives me a "Project does not exist" message.

Re: Issue Tracker not available

2016-01-13 Thread Chip Senkbeil
nted of a tool Apache has to port Issues into JIRA. I mentioned > to him that if it was easy, than then porting the issues would be good and > we would then go through them and clean them up. > > Thoughts? > > > On Wed, Jan 13, 2016 at 8:30 AM, Chip Senkbeil > wrote: > &

Re: Issue Tracker not available

2016-01-13 Thread Chip Senkbeil
er ( > https://issues.apache.org/jira/browse/INFRA-10144 ) but that was from > their own atlassian instance. > > — Hitesh > > On Jan 13, 2016, at 6:58 AM, Chip Senkbeil > wrote: > > > +1 to that. Any automation would be a great help. Going back and closing > > ones we don't

Re: Issue Tracker not available

2016-01-18 Thread Chip Senkbeil
; > > > > > > > > The Apex folks went through a complex import earlier ( > > > > > https://issues.apache.org/jira/browse/INFRA-10144 ) but that was > > from > > > > > their own atlassian instance. > > > > > >

Re: Issue Tracker not available

2016-01-19 Thread Chip Senkbeil
Oh, I assumed you had all of the usernames for pmc members since they were supposed to email you their IDs, right? Would it make sense to list them here? Or for each of us to comment on the JIRA itself? I've been getting emails when others got their accounts set up and the only one I haven't seen

Re: Issue Tracker not available

2016-01-19 Thread Chip Senkbeil
My jira id is senkwich. Please add me (Chip Senkbeil) as well. On Tue, Jan 19, 2016 at 9:01 AM Luciano Resende wrote: > On Tuesday, January 19, 2016, Chip Senkbeil > wrote: > > > Oh, I assumed you had all of the usernames for pmc members since they > were > > suppose

Re: Continuous Integration Tooling

2016-01-25 Thread Chip Senkbeil
the apache github is read only replicated from the apache git repo.) > > > > > On Jan 8, 2016, at 2:45 PM, Chip Senkbeil > > wrote: > > > > > > From there, I see there is better integration with Github that can be > > used > > > if you opt-

Re: Issue Tracker not available

2016-01-27 Thread Chip Senkbeil
> > >> On Jan 21, 2016, at 1:29 PM, Gino Bustelo wrote: > > >> > > >>> @lresende It does not seem that I have the ability to assign issues. > > >>> > > >>> On Tue, Jan 19, 2016 at 11:42 AM, Gino Bustelo > > >> wrote: > >

Re: Continuous Integration Tooling

2016-01-27 Thread Chip Senkbeil
he.org/infra/entry/apache_gains_additional_travis_ci, it > seems that it is a shared apache account. > > On Mon, Jan 25, 2016 at 11:24 AM, Luciano Resende > wrote: > > > On Mon, Jan 25, 2016 at 9:18 AM, Chip Senkbeil > > wrote: > > > > > So, I'm trying

Re: ZeroMQ MPL Licensing plans?

2016-01-28 Thread Chip Senkbeil
Trying to read through phone, but I noticed that it is implemented in C. We're using JeroMQ to avoid depending on a binary and JNI. If they don't have a Java API, I'd say no. Don't know if it is compatible with ZeroMQ, which we need to maintain support for Jupyter. Would need to take a deeper look

Re: ZeroMQ MPL Licensing plans?

2016-01-28 Thread Chip Senkbeil
Looked at the ZeroMQ link. They state it is not fully compatible with ZeroMQ, but is fully POSIX compliant. We'd have to dig into all ZeroMQ apis used by Jupyter to make sure we supported everything. On Thu, Jan 28, 2016, 12:38 PM Chip Senkbeil wrote: > Trying to read through phon

Potential library for improving our %%AddDeps magic

2016-01-29 Thread Chip Senkbeil
I discovered a few projects planning to move away from sbt to use this library, which can fetch dependencies from Maven/Ivy repos: https://github.com/alexarchambault/coursier Apache 2.0 license and it seems dead simple compared to our existing logic, which is a bit of a hack involving writing an

Getting admin access to Github mirror

2016-02-03 Thread Chip Senkbeil
To all mentors, are we supposed to have (or be able to get) administrative access to the Github mirror? Without it, we cannot refresh failed Travis builds or perform other tooling operations, although I've managed to get the repo enabled for Travis CI. On a JIRA I opened awhile ago asking for admi

Re: Publishing jar binaries to Maven Central

2016-02-11 Thread Chip Senkbeil
eamlined once I figure out if we can do everything through sbt. Seems like a lot of steps, though. On Mon, Jan 11, 2016 at 12:17 PM Luciano Resende wrote: > On Fri, Jan 8, 2016 at 9:58 AM, Chip Senkbeil > wrote: > > > Currently, we do not publish any binaries to Maven Central. It wo

New Spark JIRA for needed SparkR changes

2016-02-29 Thread Chip Senkbeil
Just a heads up. I opened an issue against Spark about exposing some of the SparkR APIs. They are too restrictive on what the SparkR libraries allows (no custom Java methods) and the R backend is package protected. https://issues.apache.org/jira/browse/SPARK-13573 Our SparkR implementation is a f

Re: New Spark JIRA for needed SparkR changes

2016-03-08 Thread Chip Senkbeil
2:14 PM Chip Senkbeil wrote: > Just a heads up. I opened an issue against Spark about exposing some of > the SparkR APIs. They are too restrictive on what the SparkR libraries > allows (no custom Java methods) and the R backend is package protected. > > https://issues.apache.org/jir

Re: Help needed in streaming large data from spark-kernel to spark-client

2016-03-19 Thread Chip Senkbeil
Instead of calling println(...), you can invoke kernel.stream.sendAll(...) to send your data without breaking it up into chunks. Give that a shot and see if you get all of your data via onStream. On Thu, Mar 17, 2016 at 10:33 AM Harmeet Singh wrote: > Hi All, > > I am using spark-kernel to write

Re: April Update

2016-04-06 Thread Chip Senkbeil
Are you talking about the SF Data Science meetup where Asim Jalis gave a talk? http://www.meetup.com/SF-Data-Science/events/228958752/ On Wed, Apr 6, 2016 at 9:34 AM Gino Bustelo wrote: > @Corey What was the name of that event that was using Toree? > > On Wed, Apr 6, 2016 at 9:33 AM, Gino Buste

Re: April Update

2016-04-06 Thread Chip Senkbeil
Specifically, the talk was called, "Apache Toree: How To Develop Spark/Scala Apps as Interactive Notebooks" On Wed, Apr 6, 2016 at 9:38 AM Chip Senkbeil wrote: > Are you talking about the SF Data Science meetup where Asim Jalis gave a > talk? > > http://www.meetup.com/

Re: Contributing to Toree

2016-07-22 Thread Chip Senkbeil
To get involved with the project, all you need to do is pick up a JIRA. Here's the list of open JIRAs for 0.1.0: https://issues.apache.org/jira/browse/TOREE-299?jql=project%20%3D%20TOREE%20AND%20resolution%20%3D%20Unresolved%20AND%20fixVersion%20%3D%200.1.0%20ORDER%20BY%20priority%20DESC Here's a

Discussion regarding our first release vote

2016-10-04 Thread Chip Senkbeil
Sure. On Wed, Oct 5, 2016 at 12:46 AM Luciano Resende wrote: > Can we move this discussion to public ? > > On Tue, Oct 4, 2016 at 10:27 PM, Chip Senkbeil > wrote: > > Was starting to read through this link: > http://incubator.apache.org/guides/releasemanagement.html#be

Re: [VOTE] Apache Toree 0.1.0 RC2

2016-10-12 Thread Chip Senkbeil
+1 On Wed, Oct 12, 2016 at 12:47 PM Marius van Niekerk < marius.v.niek...@gmail.com> wrote: > +1 > > On Tue, 11 Oct 2016 at 16:22 Gino Bustelo wrote: > > > Tagged as v0.1.0-rc2 and points to the commit. I was trying to avoid > overly > > tagging and reserving them for actual releases. Instead...

Re: Share Object across interpreters

2016-11-02 Thread Chip Senkbeil
While it isn't supported (we don't test its use in this case), you can store objects in a shared hashmap under the kernel object that is made available in each interpreter. The map is exposed as `kernel.data`, but the way you access and store data is different per language. The signature of the da

Re: Share Object across interpreters

2016-11-02 Thread Chip Senkbeil
> Mobile: (313) 910-9272 > > > > > > > > > On 11/2/16, 11:39 AM, "Chip Senkbeil" wrote: > > >While it isn't supported (we don't test its use in this case), you can > >store objects in a shared hashmap under the kernel object t

Re: [VOTE] Apache Toree 0.1.0 RC3

2016-11-02 Thread Chip Senkbeil
+1. - Manually installed using the pip package; verified that the install worked and the Scala option was available in the notebook. - Ran Scala code on the notebook. - Ran some simple parallelization, reduces, etc. using a local Spark cluster. - Verified that PySpark interpreter worked correctly

Re: Share Object across interpreters

2016-11-02 Thread Chip Senkbeil
7;, > '__new__', '__reduce__', '__reduce_ex__', '__repr__', '__setattr__', > '__sizeof__', '__str__', '__subclasshook__', '__weakref__', '_get_args', > 'command_header', 'contain

Re: [VOTE] Apache Toree 0.1.0 RC3

2016-11-11 Thread Chip Senkbeil
So, with three +1s, what do we need to do? Are there still things to address? Does this need to go to general Apache? This has been open for awhile. On Tue, Nov 8, 2016 at 2:31 PM Gino Bustelo wrote: > +1 > > We need to get this thing moving. > > On Fri, Nov 4, 2016 at 5:17 PM Hitesh Shah wrote

Re: [VOTE] Apache Toree 0.1.0 RC3

2016-11-29 Thread Chip Senkbeil
, check the archives there for an example of the vote thread, as > you > > need to add link to vote thread, cote result > > > > On Fri, Nov 11, 2016 at 7:03 PM Chip Senkbeil > > wrote: > > > >> So, with three +1s, what do we need to do? Are there still

Forbidden publishing to staging

2016-12-06 Thread Chip Senkbeil
Moved to dev. On Tue, Dec 6, 2016 at 12:23 PM Hitesh Shah wrote: > Lets move this conversation to dev@. > > thanks > -- Hitesh > > On Tue, Dec 6, 2016 at 8:52 AM, Chip Senkbeil > wrote: > > Both Gino and I have gotten forbidden errors when trying to publish Toree >

Re: Forbidden publishing to staging

2016-12-06 Thread Chip Senkbeil
maven I just configure the > settings.xml with credentials and it works... see some details on > http://maven.apache.org/developers/committer-settings.html > > On Tue, Dec 6, 2016 at 10:25 AM, Chip Senkbeil > wrote: > > > Moved to dev. > > > > On Tue, Dec 6, 2016 at 12:23 P

Re: Forbidden publishing to staging

2016-12-07 Thread Chip Senkbeil
> Are the jars being signed with your gpg key? For releases, unsigned jars > are not allowed so that might be something to check too. > > -- Hitesh > > > > On Tue, Dec 6, 2016 at 7:01 PM, Chip Senkbeil > wrote: > > > I've got my credentials configured, alth

Re: Forbidden publishing to staging

2016-12-07 Thread Chip Senkbeil
igned) java.io.IOException: Access to URL https://repository.apache.org/content/repositories/staging/org/apache/toree/kernel/toree-sql-interpreter_2.10/0.1.0-incubating/toree-sql-interpreter_2.10-0.1.0-incubating-sources.jar was refused by the server: Forbidden On Wed, Dec 7, 2016 at 7:27 AM Chip Sen

Re: Forbidden publishing to staging

2016-12-07 Thread Chip Senkbeil
n Wed, Dec 7, 2016 at 9:52 AM Chip Senkbeil wrote: > Yep, verified that the signatures are generated each jar, its sources jar, > its pom, and its javadoc jar. All credentials are in place, gpg passphrase > is being used correctly to sign the jars, and I'm still getting forbidden &

Re: Forbidden publishing to staging

2016-12-09 Thread Chip Senkbeil
ugh). You may wish to talk to the Infra > folks via the hipchat channel and/or file an infra ticket to get guidance > for both the questions. > > -- Hitesh > > > > On Wed, Dec 7, 2016 at 7:53 AM, Chip Senkbeil > wrote: > > > Should we have > > https://rep

Re: Forbidden publishing to staging

2016-12-12 Thread Chip Senkbeil
with the release. On Fri, Dec 9, 2016 at 8:26 AM Chip Senkbeil wrote: > Already created an issue - > https://issues.apache.org/jira/browse/INFRA-13061 - so, hopefully I'll > hear back soon. ;) > > Also, asked on the PredictionIO dev mailing list since it's a fairly >

Re: Evaluating Toree

2016-12-15 Thread Chip Senkbeil
If you want REST functionality, using something like Cloudera's Livy might be more useful: https://github.com/cloudera/livy Apache Toree is geared more towards dynamic applications that have a need to run a variety of jobs against Spark that are configured on the fly such as custom filtering and t

Re: toree install issue - No module named pyspark

2016-12-15 Thread Chip Senkbeil
It's showing your PYTHONPATH as /disk3/local/filecache/103/spark-assembly.jar. Toree is looking for pyspark on your PYTHONPATH. https://github.com/apache/incubator-toree/blob/master/pyspark-interpreter/src/main/scala/org/apache/toree/kernel/interpreter/pyspark/PySparkProcess.scala#L78 That code i

Should we start another release vote?

2017-01-04 Thread Chip Senkbeil
This is long overdue, but since the artifacts weren't in staging at the time of the vote for RC3, should we have another release vote?

Re: [VOTE] Apache Toree 0.1.0 RC3

2017-01-06 Thread Chip Senkbeil
Gino if he is ok with somebody else continuing this, > but > > if you know he is way or something, then it should be ok for you to > > continue, > > > > On Tue, Nov 29, 2016 at 7:10 AM, Chip Senkbeil > > wrote: > > > > > Does Gino need to be the one to

Where do the staging artifacts go?

2017-01-06 Thread Chip Senkbeil
I just published 0.1.0 artifacts to staging in preparation for an RC4 vote. I cannot tell where they have gone to include a link in the description. The root of the staging deployment is here: https://repository.apache.org/service/local/staging/deploy/maven2/org/apache/toree/ And I see successful

Re: Where do the staging artifacts go?

2017-01-09 Thread Chip Senkbeil
repo for toree. You need to select it and hit "Close" I believe to > publish to staging. On close, it will provide a maven repo url that someone > else can use as a repo url for trying it out. After the final vote, the > repo will need to be "released" > > thanks >

[VOTE] Apache Toree 0.1.0 RC4

2017-01-10 Thread Chip Senkbeil
Please vote to approve the release of the following candidate as Apache Toree version 0.1.0. Pay special attention to the LICENSE and NOTICE files since this is our first release. ## Information and Artifacts The tag to be voted on is v0.1.0-rc4 (1d526954ecaba1d5dc0f40ec555dd598b2b11df7), located

Re: [VOTE] Apache Toree 0.1.0 RC4

2017-01-10 Thread Chip Senkbeil
ve it a +1. On Tue, Jan 10, 2017 at 4:15 PM Chip Senkbeil wrote: > Please vote to approve the release of the following candidate as Apache > Toree version 0.1.0. Pay special attention to the LICENSE and NOTICE files > since this is our first release. > > ## Information and Artifac

Re: issue running toree kernel on mesos cluster

2017-01-12 Thread Chip Senkbeil
For some reason, I'm missing the first half of this thread. I only have Paco Nathan's email. I don't have one from Eszti and I don't see one in our mailing archive, either. Can someone repost his part? As for the runtime errors in Docker, we'd be happy to accept any and all contributions back into

[RESULT] [VOTE] Apache Toree 0.1.0 RC4

2017-01-13 Thread Chip Senkbeil
Voting is now closed. This vote has PASSED with 5 +1 votes and no 0 or -1 votes. This vote will now go to the IPMC list for a second 72-hour vote. Toree developers are encouraged to comment on the IPMC vote as well. +1: Chip Senkbeil Luciano Resende Marius van Niekerk Gino Bustelo Corey Stubbs 0

Re: [RESULT] [VOTE] Apache Toree 0.1.0 RC4

2017-01-13 Thread Chip Senkbeil
The IPMC vote thread is here: https://lists.apache.org/thread.html/f891ecb9452b6b34b27e0f2879efb570e3768f8d09943a57bdd6e9d8@ On Fri, Jan 13, 2017 at 4:26 PM Chip Senkbeil wrote: > Voting is now closed. This vote has PASSED with 5 +1 votes and no 0 or -1 > votes. This vote will now go

Re: [RESULT] [VOTE] Apache Toree 0.1.0 RC4

2017-01-16 Thread Chip Senkbeil
No votes as of yet and it closes later today. Should some of us comment on the thread to get activity again? On Fri, Jan 13, 2017 at 4:45 PM Chip Senkbeil wrote: > The IPMC vote thread is here: > https://lists.apache.org/thread.html/f891ecb9452b6b34b27e0f2879efb570e3768f8d09943a57bd

Re: [RESULT] [VOTE] Apache Toree 0.1.0 RC4

2017-01-16 Thread Chip Senkbeil
> > > On Mon, Jan 16, 2017 at 7:18 AM, Chip Senkbeil > wrote: > > > No votes as of yet and it closes later today. Should some of us comment > on > > the thread to get activity again? > > > > On Fri, Jan 13, 2017 at 4:45 PM Chip Senkbeil > > wrot

Close incubator vote

2017-01-25 Thread Chip Senkbeil
Do I need to add a reply closing the existing vote on general@incubator if we are preparing a new release? Marius and I have been addressing the issues they've mentioned on general@incubator in preparation for a new vote here followed by another vote on incubator. Just not sure if I need to do anyt

Re: Calling a vote again?

2017-02-01 Thread Chip Senkbeil
Sorry, had a deadline at work today. I need to clear up a couple of things before I cut new artefacts for a vote. On Wed, Feb 1, 2017, 10:14 AM Marius van Niekerk wrote: > I think we've cleared out the required static jar pieces. Should we call a > vote again? > > -Marius > -- > regards > Mariu

Podling Report

2017-02-01 Thread Chip Senkbeil
Looks like the report is due today. Marius, are you available to take care of it this month? I don't have time today.

Re: Podling Report

2017-02-02 Thread Chip Senkbeil
Guess we missed this one since it was due yesterday. Considering they really didn't like when we edited after the deadline earlier, we should just be listed as missing the report. On Wed, Feb 1, 2017, 11:12 PM Marius van Niekerk wrote: > Pretty sure the following is correct, my wiki account is b

Re: Podling Report

2017-02-03 Thread Chip Senkbeil
Thanks :) On Thu, Feb 2, 2017 at 9:56 AM Luciano Resende wrote: > I have uploaded the report to the wiki and signed off as a mentor, and will > take the blame if anyone complains about it :) > > On Thu, Feb 2, 2017 at 4:28 AM, Chip Senkbeil > wrote: > > > Guess we miss

Toree for 1.6.x is broken

2017-02-15 Thread Chip Senkbeil
Just built master, got all of the artifacts ready, blah blah blah. Tested by installing the artifact from https://dist.apache.org/repos/dist/dev/incubator/toree/0.1.0/rc5/toree-pip/ and now it's failing with not being able to bind to an ephemeral port for the sparkDriver. Can someone help me take a

Re: Toree for 1.6.x is broken

2017-02-15 Thread Chip Senkbeil
By master, I mean the 0.1.x branch. Was trying to get the next vote started. On Wed, Feb 15, 2017, 4:44 PM Chip Senkbeil wrote: > Just built master, got all of the artifacts ready, blah blah blah. Tested > by installing the artifact from > https://dist.apache.org/repos/dist/dev/incuba

Re: Toree for 1.6.x is broken

2017-02-16 Thread Chip Senkbeil
lnames<-, endsWith, intersect, rank, rbind, sample, > > startsWith, subset, summary, table, transform > > > On Thu, Feb 16, 2017 at 9:03 AM Corey Stubbs wrote: > > > I was able to run from the pip package just fine. > > > > On Wed, Feb 15, 2017 at 4:50 P

Re: Toree for 1.6.x is broken

2017-02-16 Thread Chip Senkbeil
did wrong when backporting the spark > 2.0 R things > > On Thu, 16 Feb 2017 at 10:18 Chip Senkbeil > wrote: > > > Turns out I needed to set my hostname on my machine to localhost. Doing > so > > fixed that error. > > > > As for the SparkR error, I'll t

[VOTE] Apache Toree 0.1.0 RC6

2017-02-16 Thread Chip Senkbeil
Please vote to approve the release of the following candidate as Apache Toree version 0.1.0. Pay special attention to the LICENSE and NOTICE files since this is our first release. ## Information and Artifacts The tag to be voted on is v0.1.0-rc6 (51fa49cb5898e0c5b7824f986382436b969cabc7), located

Re: [VOTE] Apache Toree 0.1.0 RC6

2017-02-16 Thread Chip Senkbeil
e no longer has the extra license info tacked onto the LICENSE file. I've also fixed the source release such that it is no longer dependent on being in a Git repository to be built nor does it require you to have sbt installed. On Thu, Feb 16, 2017 at 11:09 AM Chip Senkbeil wrote: > Ple

Re: Interpreter outputs

2017-02-16 Thread Chip Senkbeil
I'll take a look at them soon and give you some feedback. Was preparing the next vote for the 0.1.0 release, which is why I've been a bit distracted. On Thu, Feb 16, 2017 at 12:05 PM Ryan Blue wrote: > Hi everyone, > > I've been putting together a proof-of-concept Toree deployment for our > Spar

Re: Supported Scala versions

2017-02-16 Thread Chip Senkbeil
The 0.2.x branch (currently master) is for Scala 2.11 and Spark 2.x. The 0.1.x branch is for Scala 2.10 and Spark 1.x. On Thu, Feb 16, 2017 at 2:41 PM Jakob Odersky wrote: > Hi everyone, > > during a recent discussion with Marius > https://github.com/apache/incubator-toree/pull/93, I found out

Re: [VOTE] Apache Toree 0.1.0 RC6

2017-02-21 Thread Chip Senkbeil
sted with getting rid of some of the > bundled > > > pieces that were blocking for RC5. > > > > > > On Thu, Feb 16, 2017, 12:14 Chip Senkbeil > > wrote: > > > > > > I'll go ahead and give a +1 since I've done a bit of testing using > &g

[RESULT] [VOTE] Apache Toree 0.1.0 RC6

2017-02-21 Thread Chip Senkbeil
Voting is now closed. This vote has PASSED with 4 +1 votes and no 0 or -1 votes. This vote will now go to the IPMC list for a second 72-hour minimum vote. Toree developers are encouraged to comment on the IPMC vote as well. +1: Chip Senkbeil Marius van Niekerk Gino Bustelo Corey Stubbs 0: -1:

Re: [RESULT] [VOTE] Apache Toree 0.1.0 RC6

2017-02-21 Thread Chip Senkbeil
Vote thread on the incubator @general channel can be found here: https://lists.apache.org/thread.html/ecb5e40078f01c488ada52e776d57cd80e130164c1e31d8ded564ba2@ On Tue, Feb 21, 2017 at 2:05 PM Chip Senkbeil wrote: > Voting is now closed. This vote has PASSED with 4 +1 votes and no 0 or

Stale incubator vote thread

2017-02-24 Thread Chip Senkbeil
It's nearly been three days since the thread has been opened. I've seen other vote threads made after ours get some votes; so, I'm a little concerned that our thread has become a bit stale. Any mentor available to take a look at the thread and - if it looks good - provide a +1 to get the spotlight

Re: Stale incubator vote thread

2017-03-01 Thread Chip Senkbeil
Thanks, appreciate it! On Wed, Mar 1, 2017, 6:41 AM Luciano Resende wrote: > On Fri, Feb 24, 2017 at 7:25 AM, Chip Senkbeil > wrote: > > > It's nearly been three days since the thread has been opened. I've seen > > other vote threads made after ours g

Re: Best Practices for Creating and Merging PRs

2017-03-06 Thread Chip Senkbeil
We don't have access to the GitHub merge PR button, do we? That I'm aware of, Gino, Corey, and I have been manually merging fully-rebased PRs to keep a clean commit history. If the GitHub merge PR button was available, we could use the squash-and-rebase option, which provides a very clean way to b

Re: Stale incubator vote thread

2017-03-07 Thread Chip Senkbeil
It's been over two weeks since the vote started. We only have Luciano's vote. Is there anything we can do at this point? On Wed, Mar 1, 2017 at 6:07 AM Chip Senkbeil wrote: > Thanks, appreciate it! > > On Wed, Mar 1, 2017, 6:41 AM Luciano Resende wrote: > > On Fri

Lazy consensus for 0.1.0 release?

2017-03-15 Thread Chip Senkbeil
Given that we have only 1 vote (+1) in three weeks, should I go ahead and publish the release? I know Luciano was asking about that on @general incubator. Just want to get confirmation from mentors before doing so.

Re: Lazy consensus for 0.1.0 release?

2017-03-15 Thread Chip Senkbeil
y trying to provoque others to > review/vote. > > How about you send direct email to each mentor requesting their vote ? > > Also, it might be time to receuit more active mentors. > > > On Wed, Mar 15, 2017 at 1:40 PM Chip Senkbeil > wrote: > > > Given that we ha

Re: Github Integration for Toree repositories

2017-03-18 Thread Chip Senkbeil
That's great news! Thanks for getting that set up! I'll take a look on Monday to see how ghee integration works. On Sat, Mar 18, 2017, 3:59 PM Luciano Resende wrote: > I have worked with infra team to enhance the issue workflow for Toree. We > now have enabled Github integration that will update

Re: Lazy consensus for 0.1.0 release?

2017-03-22 Thread Chip Senkbeil
I've emailed all of our mentors and it's been a week with no response. Luciano, how do we go about getting additional, active mentors? We're being blocked on the release front purely from lack of votes. On Wed, Mar 15, 2017 at 4:04 PM Chip Senkbeil wrote: > Hitesh was our

Re: Lazy consensus for 0.1.0 release?

2017-03-28 Thread Chip Senkbeil
Hurray! Glad to hear from you again, Hitesh! On Tue, Mar 28, 2017 at 4:01 PM Hitesh Shah wrote: > Hi folks > > Apologies for the delay in this. I will take a look at the release later > today and comment on the vote. > > -- Hitesh > > On Wed, Mar 22, 2017 at 7:40 AM

Re: SQL interpreter

2017-04-03 Thread Chip Senkbeil
When refactoring our original interpreter codebase to support new languages such as Python and R, I wrote the broker service to abstract the process of communicating with another language's interpreter. When SQL was added, it was easier to add a stubbed-out broker service such that the interpreter

Re: Toree website

2017-04-03 Thread Chip Senkbeil
The branch https://github.com/apache/incubator-toree-website/tree/OverhaulSite was meant to replace the current master and is closer to the current website than the master branch. I know that Gino/Corey were working on content that was based on the branch, but they may have lost it. On Fri, Mar 3

Re: Uploading PIP for 0.1.0 release

2017-04-17 Thread Chip Senkbeil
I've gotten mixed messages regarding where the pip artifacts should go. Originally, we were going to publish them on https://pypi.python.org/pypi (which we were previously doing for dev snapshots), but there has been some issues with hosting externally from Apache? Is that still the case? Can we ho

Re: Uploading PIP for 0.1.0 release

2017-04-17 Thread Chip Senkbeil
What is the exact name that you want for the release? Previously, we were using just "toree", but do you want "apache-toree" or "apache-toree-incubating"? On Mon, Apr 17, 2017 at 10:47 AM Luciano Resende wrote: > On Mon, Apr 17, 2017 at 8:40 AM, Chip Senkbeil

Re: Uploading PIP for 0.1.0 release

2017-04-17 Thread Chip Senkbeil
t; > On Mon, Apr 17, 2017 at 9:50 AM, Chip Senkbeil > wrote: > >> What is the exact name that you want for the release? >> >> Previously, we were using just "toree", but do you want "apache-toree" or >> "apache-toree-incubating"? >&

Re: Uploading PIP for 0.1.0 release

2017-04-17 Thread Chip Senkbeil
docs and other stuff, right ? > > On Mon, Apr 17, 2017 at 11:57 AM, Chip Senkbeil > wrote: > >> It looks like all of our makefile work was updated awhile ago to use >> apache-toree. This must have been from an earlier conversation. I can >> update our release art

Re: Removing support for Scala 2.10

2017-11-04 Thread Chip Senkbeil
Go for it. On Sat, Nov 4, 2017, 3:08 PM Luciano Resende wrote: > The current master only works with Apache Spark 2.x which is based on Scala > 2.11 and moving towards Scala 2.12. > > Anyone opposed on removing Scala 2.10 from master ? > > -- > Luciano Resende > http://twitter.com/lresende1975 >

Re: Speeding up Toree Startup

2018-01-04 Thread Chip Senkbeil
At one point, we were going to make Toree highly pluggable using our then-new plugin framework. Things like an interpreter and a spark context would be initialized via plugins and anything needing them would be plugins dependent on those objects. The scala interpreter wasn't necessary for the spark

Re: [VOTE] Apache Toree 0.2.0 RC3

2018-01-19 Thread Chip Senkbeil
I just ran through the usual basic stuff and it looked fine. +1 On Thu, Jan 18, 2018 at 11:03 AM Luciano Resende wrote: > Off course, my +1 > > Any others? > > On Sun, Jan 14, 2018 at 6:30 PM, Luciano Resende > wrote: > > > Please vote to approve the release of Apache Toree 0.2.0-incubating > >

Re: Apache Toree 0.2.0-incubating release status

2018-08-14 Thread Chip Senkbeil
Who has ownership rights? Corey and Go no? I don't think I have them, but I'll check later today. On Mon, Aug 13, 2018, 11:23 PM Luciano Resende wrote: > The RC6 has been approved by the IPMC and I have started the process of > publishing the release which usually takes a day or so for replicati

Re: Apache Toree 0.2.0-incubating release status

2018-08-14 Thread Chip Senkbeil
Oh, I think I do have access to PyPi. Luciano, what email address do you want associated? Your gmail one? Your apache one? On Tue, Aug 14, 2018 at 10:21 AM Ryan Blue wrote: > Great news! Thank you for making this happen, Luciano. > > On Tue, Aug 14, 2018 at 3:29 AM Chip Senkbeil

Re: Apache Toree 0.2.0-incubating release status

2018-08-14 Thread Chip Senkbeil
ug 14, 2018 at 08:54 Chip Senkbeil > wrote: > >> Oh, I think I do have access to PyPi. Luciano, what email address do you >> want associated? Your gmail one? Your apache one? >> >> On Tue, Aug 14, 2018 at 10:21 AM Ryan Blue >> wrote: >> >>> Great

Re: Removing Toree specific support for Python and R

2018-09-25 Thread Chip Senkbeil
They served as experiments in a time where the functionality may have been useful, but that time has long since passed. +1 On Tue, Sep 25, 2018, 9:19 PM Gino Bustelo wrote: > +1 > > Spark’s support to share temp tables across sessions voids any need for > this multi-Lang support. > > Gino B. >

Re: [jira] [Commented] (TOREE-421) KernelSecurityManager doesn't allow users to create their own thread groups

2019-10-15 Thread Chip Senkbeil
This was an old implementation geared towards allowing us to manage all launched threads so we could interrupt/kill them on request. I'm not sure how useful this feature has been to folks, so my thought is that we either remove it entirely or make it a feature that can be enabled/disabled throu

Re: [jira] [Commented] (TOREE-421) KernelSecurityManager doesn't allow users to create their own thread groups

2019-10-20 Thread Chip Senkbeil
We only ever exposed the thread killing functionality through capturing the interrupt signal on the kernel process. This was to support the stop button in Jupyter notebooks. I can't remember if that code still exists as it was a bit flakey, relying on a Sun API to capture the signal and respond.

Re: [VOTE] Apache Toree 0.4.0 RC1

2020-07-17 Thread Chip Senkbeil
+1, LGTM. Did we want to update the release notes with the changes? I was using https://github.com/apache/incubator-toree/compare/v0.3.0-incubating...v0.4.0-incubating-rc1 to get a summary of what has changed since 0.3.0's release. On Thu, Jul 16, 2020 at 2:26 PM Luciano Resende wrote: > > Pleas

[jira] [Updated] (TOREE-257) Code submit does not support paste mode

2016-02-09 Thread Chip Senkbeil (JIRA)
[ https://issues.apache.org/jira/browse/TOREE-257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chip Senkbeil updated TOREE-257: Priority: Minor (was: Major) > Code submit does not support paste m

[jira] [Commented] (TOREE-257) Code submit does not support paste mode

2016-02-09 Thread Chip Senkbeil (JIRA)
[ https://issues.apache.org/jira/browse/TOREE-257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15139056#comment-15139056 ] Chip Senkbeil commented on TOREE-257: - Hm, I wonder what the better option woul

  1   2   >