Hi,
today I gave talk on a reproducibile workflow using notebooks at EuroScipy
2018. After the talk somebody pointed me to this intersting thread.
To answer some of the questions, yes notebooks can be run like scripts,
parametrized and organized in a pipeline that can be executed
Hi Bennet,
Jake VanderPlas recently re-upped his blog post on this --
https://jakevdp.github.io/blog/2017/03/03/reproducible-data-analysis-in-jupyter/
best,
—titus
> On Aug 30, 2018, at 7:51 AM, Bennet Fauber wrote:
>
> Just out of curiosity, how do notebooks play in the `reproducible
>
2018-08-24 16:47 EDT, Konrad Förstner :
> Beside the fact that this talk is it really funny, it raises a lot of
> issues that I can confirm from my experience: [...]
>
Hi everyone,
I realize there's been a lot of attempts already to solve this "hidden
state" problem at the software level, but I
Hi all,
having seen the discussion I feel obliged to add my own experience and
perspective, and - maybe more importantly - some moderating comments.
To set the scene, I have taught C, Matlab and Python since 2002 to a
variety of undergrad and postgraduate students at a university, but
always to
, 2018 7:36:58 AM
To: discuss
Subject: Re: [discuss] Slide of Joel Grus' JupyterCon Talk "I Don't Like
Notebooks"
I agree with what Simon wrote about hidden state, and I strongly feel that it
is a lesson/concept that we should emphasize more for workshop attendees,
especially those that
I agree with what Simon wrote about hidden state, and I strongly feel that
it is a lesson/concept that we should emphasize more for workshop
attendees, especially those that don't have a substantial amount of
experience with programming.
The notion that there even *is* such a thing as a hidden
Carol,
I don't think anyone is saying, "Tell people not to use notebooks."
The questions are about whether they improve the learning experience
for beginners. There is also the question of whether use of the GUI
somehow defeats the purpose of the shell lesson by contradicting what
is often said
Subject: Re: [discuss] Slide of Joel Grus' JupyterCon Talk "I Don't Like
Notebooks"
Hi Carol,
I don't think this is where the subthread about Conda is heading.
Jupyter notbooks is orthogonal to Anaconda. You can definitely have
Jupyter without Conda. From a teaching perspective,
We keep an introduction to the notebook in the 00 lesson of the Data
Carpentry python materials (spider also covered, courtesy of Katrin Tirol).
There’s also a more comprehensive intro to notebooks, contributed by Maxim
Belkin, in the extras for that repo. I know other workshops (Like SWC
python)
+1 for what Juan said.
I think most of the cognitive load of notebooks can be addressed by giving
people a crash course in Jupyter, and by narrating what you do, just like
SWC suggests that instructors narrate what they do at the command line or
in a REPL, e.g. "so I'm going to type print
Hi Carol,
I don't think this is where the subthread about Conda is heading.
Jupyter notbooks is orthogonal to Anaconda. You can definitely have
Jupyter without Conda. From a teaching perspective, both Conda and
Jupyter notebooks do a fine job. But just as it would be beneficial to
warn users
On Wed, Aug 29, 2018, at 7:06 PM, Waldman, Simon wrote:
> Use notebooks, but take care to explain that python != the notebook,
> similarly to explaining that git != github.
I usually do a quick demo of several ways of running Python: Python
REPL, IPython REPL, python my_script.py, notebook. I use
Wright via discuss
Sent: 29 August 2018 00:43
To: discuss@lists.carpentries.org
Subject: Re: [discuss] Slide of Joel Grus' JupyterCon Talk "I Don't Like
Notebooks"
Hi all-
I agree with what Christina said. Someone upthread asked if the notebook was
meant to compete with MatLab. But wi
till
>>>> be there in the log file). I added “-t” flag to “logstart” magic in order
>>>> to add timestamp to the logged inputs, because sometimes I work on a
>>>> notebook for a long time, and lose track of when I did what.
>>>>
>>>>
;>
>>> I would combine real software engineering (i.e. using modules, good
>>> coding practices) for the heavy-lifting codes, and use Jupyter to produce a
>>> record of my interactive session. I don’t put very long codes in Jupyter
>>> cells, because that become
call users
>> to be a little bit more savvy: to be able to interact with both the
>> modules/other python source files and the Jupyter notebook at the same time.
>>
>>
>>
>> --
>>
>> Wirawan Purwanto
>>
>> Computational Scientist, Research Comp
2018-08-28 12:27 EDT, Maxime Boissonneault <
maxime.boissonnea...@calculquebec.ca>:
> As a side-discussion, I think we should also be wary of using Anaconda,
> and tell users not to use it in a cluster environment. For reasons, see
> here :
> https://twitter.com/mboisso/status/1034476890353020928
Hi all,
There's positive discussion that has been started by Joel's talk. While I liked
his talk and there are some good points re: improving support for software
engineering best practices in Jupyter and JupyterLab notebooks, I'm a bit
concerned about the direction that this conversation is
These kinds of things are rather hard to track in time, because
everything is a moving target (conda and other package managers
constantly get updated, but also version of packages changes), but here
is a bit more details :
- The 10x performance difference was with a user code, which I
I'm very interested to see these examples? We use and advocate the use
of conda environments and I'm happy to be convinced otherwise.
Thanks,
Ashwin
On Tue, Aug 28, 2018 at 2:17 PM, Maxime Boissonneault
wrote:
> Regarding performance, we have example of code using Anaconda-provided
> packages
Regarding performance, we have example of code using Anaconda-provided
packages that run 10 times slower than the same code using locally built
packages, optimized for the cluster architectures. That's not *a bit*
slower, that's a lot slower.
Regarding "cheating on your partner", that analogy
carpentries.org>>
*Date: *Saturday, August 25, 2018 at 10:04 AM
*To: *"discuss@lists.carpentries.org
<mailto:discuss@lists.carpentries.org>"
mailto:discuss@lists.carpentries.org>>
*Subject: *Re: [discuss] Slide of Joel Grus' JupyterCon Talk "I
Don't Like
As a side-discussion, I think we should also be wary of using Anaconda,
and tell users not to use it in a cluster environment. For reasons, see
here :
https://twitter.com/mboisso/status/1034476890353020928
Maxime
On 2018-08-24 4:47 PM, Konrad Förstner wrote:
Dear all,
these are the slide
> Wirawan Purwanto
>
> Computational Scientist, Research Computing Group
>
> Information Technology Services
>
> Old Dominion University
>
>
>
>
>
> Norfolk, VA 23529
>
>
>
> From: Jory Schossau via discuss
> Reply-To: discuss
>
gt;> --
>>
>> Wirawan Purwanto
>>
>> Computational Scientist, Research Computing Group
>>
>> Information Technology Services
>>
>> Old Dominion University
>>
>> Norfolk, VA 23529
>>
>>
>>
>> From: Jory Schoss
, IT Services, University Of Manchester
From: Kevin Vilbig via discuss [discuss@lists.carpentries.org]
Sent: 28 August 2018 05:15
To: discuss
Subject: Re: [discuss] Slide of Joel Grus' JupyterCon Talk "I Don't Like
Notebooks"
All,
I do not like Jupyter
I agree with most of the points everyone's making here, and just wanted to
add some from my experiences as I both teach and use notebooks
professionally and have taught with spyder. (+ pro / - con)
I tried to at least address the same topics as in Joel Grus' talk.
Teaching [Undergraduate and
I think some of these issues are double-edged swords:
- Hidden states are bad and lead to bugs, but being able to access and
explore the execution state is really helpful for debugging and to avoid
re-executions. Of course you can use post-mortem debuggers to access the
final state of script, but
Hi all
Interesting views in there!
…as not a python guru (think dangerous scientific programmer, not software
engineer), I really like notebooks and use them all the time. It’s easy to
see how things run and kinda friendly.
I do have some process around graduating real code - ie notebooks are
I like the idea of notebooks more than I like actual notebooks. I tried to use
them in my analyses for a long time, but eventually gave up as there are too
many small annoyances (some that the talk goes over, others that it does not,
such as the fact that they do not integrate well with git).
Dear all,
these are the slide of Joel Grus' Jupyter Con talk "I Don't Like
Notebooks":
https://docs.google.com/presentation/d/1n2RlMdmv1p25Xy5thJUhkKGvjtV-dkAIsUXP-AL4ffI/edit#slide=id.g362da58057_0_1
Beside the fact that this talk is it really funny, it raises a lot of
issues that I can
31 matches
Mail list logo
