bump?
Russell Jurney @rjurney <http://twitter.com/rjurney>
russell.jur...@gmail.com LI <http://linkedin.com/in/russelljurney> FB
<http://facebook.com/jurney> datasyndrome.com
On Tue, Jul 18, 2017 at 4:36 PM, Russell Jurney
wrote:
> I created a JIRA to track this issue:
Thanks!
Russell Jurney @rjurney <http://twitter.com/rjurney>
russell.jur...@gmail.com LI <http://linkedin.com/in/russelljurney> FB
<http://facebook.com/jurney> datasyndrome.com
On Tue, Jul 18, 2017 at 8:29 PM, Maxime Beauchemin <
maximebeauche...@gmail.com> wrot
I am building Airflow and added a module to it. There is no
requirements.txt. How do I add a module to the project so that it can build?
Russell Jurney @rjurney <http://twitter.com/rjurney>
russell.jur...@gmail.com LI <http://linkedin.com/in/russelljurney> FB
<http://face
I created a JIRA to track this issue:
https://issues.apache.org/jira/browse/AIRFLOW-1425
Russell Jurney @rjurney <http://twitter.com/rjurney>
russell.jur...@gmail.com LI <http://linkedin.com/in/russelljurney> FB
<http://facebook.com/jurney> datasyndrome.com
On Tue, Jul 1
hanks!
Russell Jurney @rjurney <http://twitter.com/rjurney>
russell.jur...@gmail.com LI <http://linkedin.com/in/russelljurney> FB
<http://facebook.com/jurney> datasyndrome.com
Thanks much!
Russell Jurney @rjurney <http://twitter.com/rjurney>
russell.jur...@gmail.com LI <http://linkedin.com/in/russelljurney> FB
<http://facebook.com/jurney> datasyndrome.com
On Tue, Jul 18, 2017 at 2:40 PM, Arthur Wiedmer
wrote:
> That's true, just be careful
ill run at
localtime midnight from now on.
Thanks!
Russell Jurney @rjurney <http://twitter.com/rjurney>
russell.jur...@gmail.com LI <http://linkedin.com/in/russelljurney> FB
<http://facebook.com/jurney> datasyndrome.com
Our engineer Josh Watts has created a patch for 1.8.1 that adds UTC time
zones to the datetime.now()/datetime()/SQLAlchemy/Alembic datetime stuff.
He'll submit a pull request here shortly.
Russell Jurney @rjurney <http://twitter.com/rjurney>
russell.jur...@gmail.com LI <http://l
work.
Russell Jurney @rjurney <http://twitter.com/rjurney>
russell.jur...@gmail.com LI <http://linkedin.com/in/russelljurney> FB
<http://facebook.com/jurney> datasyndrome.com
On Wed, May 17, 2017 at 12:01 AM, Bolke de Bruin wrote:
> We probably need to use .utcnow() at most
I use for example:
self.logger.error(job.latest_heartbeat)
?
Russell Jurney @rjurney <http://twitter.com/rjurney>
russell.jur...@gmail.com LI <http://linkedin.com/in/russelljurney> FB
<http://facebook.com/jurney> datasyndrome.com
On Tue, May 16, 2017 at 3:40 PM, Russell Jurney
are offset-naive and offset-aware datetimes
What do I do?
Russell Jurney @rjurney <http://twitter.com/rjurney>
russell.jur...@gmail.com LI <http://linkedin.com/in/russelljurney> FB
<http://facebook.com/jurney> datasyndrome.com
On Tue, May 16, 2017 at 2:18 PM, Russell Jurney
wr
Thanks, we're trying that now!
Russell Jurney @rjurney <http://twitter.com/rjurney>
russell.jur...@gmail.com LI <http://linkedin.com/in/russelljurney> FB
<http://facebook.com/jurney> datasyndrome.com
On Tue, May 16, 2017 at 2:02 PM, Bolke de Bruin wrote:
> Did you
running. The airflow run/test commands work, but we get this
same error above when we click the activate button on the web app or
unpause the DAG from the CLI. We have wondered if our start date has to be
in the future maybe? We don't know.
Any help would be appreciated. Thanks!
Russell Jurney @rjurney <http://twitter.com/rjurney>
russell.jur...@gmail.com LI <http://linkedin.com/in/russelljurney> FB
<http://facebook.com/jurney> datasyndrome.com
Wow, this is actually quite complex owing to the unit tests...
Russell Jurney @rjurney <http://twitter.com/rjurney>
russell.jur...@gmail.com LI <http://linkedin.com/in/russelljurney> FB
<http://facebook.com/jurney> datasyndrome.com
On Thu, Apr 27, 2017 at 9:12 PM, Russell J
I created a JIRA: https://issues.apache.org/jira/browse/AIRFLOW-1159
Russell Jurney @rjurney <http://twitter.com/rjurney>
russell.jur...@gmail.com LI <http://linkedin.com/in/russelljurney> FB
<http://facebook.com/jurney> datasyndrome.com
On Thu, Apr 27, 2017 at 9:00 PM, Rus
Ok, after some more poking around I found that this is the docker-py 1.6
API, which is pretty old. I'm going to update it to the latest and see if I
can make it work, since we are using the newer docker API elsewhere.
Russell Jurney @rjurney <http://twitter.com/rjurney>
russell.jur..
and that doesn't match either.
Russell Jurney @rjurney <http://twitter.com/rjurney>
russell.jur...@gmail.com LI <http://linkedin.com/in/russelljurney> FB
<http://facebook.com/jurney> datasyndrome.com
that improves communication with Yarn.
>
> Bolke
>
> > On 18 Mar 2017, at 18:43, Russell Jurney
> wrote:
> >
> > Ruslan, thanks for your feedback.
> >
> > You mean the spark-submit context? Or like the SparkContext and
> > SparkSession? I don't th
ht be done?
If SparkContext was able to open the spark/pyspark console, then multiple
job submissions would be possible. I didn't have this in mind but an
InteractiveSparkContext or SparkConsoleContext might be able to do this?
Russell Jurney @rjurney <http://twitter.com/rjurney>
russel
works, but why not tailor something to spark-submit?
I'm open to doing the work, but I wanted to see what people though about it
and get feedback about things they would like to see in SparkOperator and
get any pointers people had to doing the implementation.
Russell Jurney @rjurney <http
Is there another way? Not using one.
On Sat, Mar 11, 2017 at 3:34 PM Maxime Beauchemin <
maximebeauche...@gmail.com> wrote:
> Virtualenv
>
> On Mar 11, 2017 3:22 PM, "Russell Jurney"
> wrote:
>
> > How can I get pip to install airflow in a particular direc
How can I get pip to install airflow in a particular directory?
Russell Jurney @rjurney <http://twitter.com/rjurney>
russell.jur...@gmail.com LI <http://linkedin.com/in/russelljurney> FB
<http://facebook.com/jurney> datasyndrome.com
Mine is kinda short, so three might be right.
Russell Jurney @rjurney <http://twitter.com/rjurney>
russell.jur...@gmail.com LI <http://linkedin.com/in/russelljurney> FB
<http://facebook.com/jurney> datasyndrome.com
On Fri, Mar 10, 2017 at 1:35 PM, Maxime Beauchemin <
maxim
Ok, I deleted all references to the dag_id of this task in dag_run, jobs
and task_instance.
The database doesn't seem to control this. What does?
---
Russell Jurney @rjurney <http://twitter.com/rjurney>
russell.jur...@gmail.com LI <http://linkedin.com/in/russelljurney> FB
<
at is causing
the job to run, but I don't know which table (there are lots!)? Is it just
the database, or is there a file some place that I need to edit?
Please help, because I run one thread on SQLite and so I can't get any
other tasks to run until I clear this one :(
---
Russell Jurney
March
> > 14th
> > > ? Please vote.
> > >
> > > √ we will have food and drinks.
> > > Please let me know if anybody has any special request, I will try to
> > > accommodate :)
> > >
> > > For presentations:
> > > 1) Disk recommission
Hadoop
> Node
> > and Disk Remediation". - Jayesh Senjaliya ( Paypal )
> > 2) Predictive Analytics with Airflow and PySpark - ( Russell Jurney )
> >
> >
> > Please send request to present to this email thread if you are interested
> > in presenting.
thread.
>
> Thanks
> Jayesh
>
> On Wed, Jan 25, 2017 at 7:50 PM, Russell Jurney
> wrote:
>
> > Is someone from Paypal likely to speak? Should we start a new thread
> with a
> > call for another speaker? There was mention of three being needed.
> >
>
t week.
>
> Thanks
> Jayesh
>
> On Wed, Jan 25, 2017 at 4:52 PM, Russell Jurney
> wrote:
>
> > Boris, would you be able to attend an evening meetup on the nights of
> 3/15
> > or 3/16? I think attendance would be better on one of those days, as many
> > peopl
t I am in Florida. 03/13 or 03/14 would work the best
> > > because first two days of Strata are training days and not very busy
> > >
> > > On Tue, Jan 24, 2017 at 10:33 PM, Russell Jurney <
> > russell.jur...@gmail.com
> > > >
> > > wro
ith a link to this event (and ping me if I don't see
>it) -- I'll then promote it on our twitter channel, etc...
>
> -s
>
> On Mon, Jan 23, 2017 at 4:42 PM, Jayesh Senjaliya
> wrote:
>
> > I am actually up for both, Paypal can host after Strata.
> >
> >
er way.
On Fri, Jan 20, 2017 at 1:10 PM, Russell Jurney
wrote:
> I think if we hold it in the evening, there is no requirement to buy a
> ticket to come to the meetup. Let me verify.
>
> On Fri, Jan 20, 2017 at 12:45 PM, Jayesh Senjaliya
> wrote:
>
>> Hi Russell,
>>
>
> - Jayesh
>
>
> On Fri, Jan 20, 2017 at 12:35 PM, Russell Jurney >
> wrote:
>
> > As I mentioned in the other thread, I am available to speak on Predictive
> > Analytics with Airflow and PySpark.
> >
> > Mid march has been suggested. What about t
reserve
> space accordingly. so that it dont become short notice for the community.
>
> Any thoughts/comments?
>
> Thanks
> Jayesh
>
--
Russell Jurney twitter.com/rjurney russell.jur...@gmail.com relato.io
sign up as a speaker.. You are also welcome
> to host a meet-up if you like.
> -s
>
> On Thu, Jan 19, 2017 at 4:39 PM, Russell Jurney
> wrote:
>
> > Hello! My name is Russell Jurney. I am a relatively new Airflow user and
> > just joined the group. I am an Azkaban refuge
Hello! My name is Russell Jurney. I am a relatively new Airflow user and
just joined the group. I am an Azkaban refugee, and an enemy of Oozie and
the tyranny of XML.
I wanted to tell you about my new book, out in pre-release, called Agile
Data Science 2.0 <http://bit.ly/agile_data_scie
36 matches
Mail list logo
