Hello,
I'm looking to create a PR to resolve
https://issues.apache.org/jira/browse/AIRFLOW-2690 and considering using
the library http://www.structlog.org/en/stable/.
What considerations do I need to take into account before I start on this
effort?
I’m ok with it if you say you are running it (prod?). We don’t use MySQL so I
cannot vouch for it.
Cheers
Bolke
> On 29 Oct 2018, at 23:14, Feng Lu wrote:
>
> I haven't tested the part where database tables are created with one flag but
> accessed under a different flag, the changes have
I haven't tested the part where database tables are created with one flag
but accessed under a different flag, the changes have been working for us
so far.
On Tue, Oct 23, 2018 at 10:09 PM Bolke de Bruin wrote:
> We only need it at table creation time or alter table time during which an
>
At the moment there is not a way to configure environmental variables on a
per-task basis, but it shouldn't be too hard to add that functionality.
Extra config options can be passed through the `executor_config` on any
operator:
Attaching the scheduler crash logs as well.
https://pastebin.com/B2WEJKRB
Regards,
Abhishek Sinha | m: +919035191078 | e: abhis...@infoworks.io
On Tue, Oct 30, 2018 at 12:19 AM Abhishek Sinha
wrote:
> Max,
>
> We always trigger the DAG externally. I am not sure if there is still any
>
Max,
We always trigger the DAG externally. I am not sure if there is still any
backfill involved.
Is there a way where I can find out in logs, if more than one instance of
scheduler is running?
On 29 October 2018 at 10:43:19 PM, Maxime Beauchemin (
maximebeauche...@gmail.com) wrote:
The
Can this be confirmed? Then I can have a look at it. Preferably with dag
definition code.
On the licensing requirements:
1. Indeed licensing header for markdown documents. It was suggested to use html
comments. I’m not sure how that renders with others like PDF though.
2. The licensing
The stacktrace seems to be pointing in that direction. Id check that first.
It seems like it **could** be a race condition with a backfill as well,
unclear.
It's still a bug though, and the scheduler should make sure to handle this
and not raise/crash.
On Mon, Oct 29, 2018, 10:05 AM Abhishek
Max,
I do not think there was more than one instance of scheduler running. Since
the scheduler crashed and it has been restarted, I cannot confirm it now.
Is there any log that can provide this information?
Could there be a different cause apart from multiple scheduler instances
running?
On 29
Abhishek, are you running more than one scheduler instance at once?
Max
On Mon, Oct 29, 2018 at 8:17 AM Abhishek Sinha
wrote:
> The issue is happening more frequently now. Can someone please look into
> this?
>
>
>
>
> On 24 September 2018 at 12:42:49 PM, Abhishek Sinha (abhis...@infoworks.io
The issue is happening more frequently now. Can someone please look into
this?
On 24 September 2018 at 12:42:49 PM, Abhishek Sinha (abhis...@infoworks.io)
wrote:
Can someone please help in looking into this issue? It is critical since
this has come up in one of our production environment.
Hi All,
Is there a way to provide env variables while launching K8 pod through K8
executor.
we need to pass some env variable which are referred inside our Airflow
Operator.
so can we provide custom env variable to docker run command while launching
task pod.
Currently it seems that it
I'm wondering if the current approach to edit models.py for each new hook is
the best way to go.
This issue is discussed in several Jira tickets:
https://issues.apache.org/jira/browse/AIRFLOW-1307
https://issues.apache.org/jira/browse/AIRFLOW-2316
The problem is that each new hooks requires to
I was going to make a start on the release, but two people have reported that
there might be an issue around non-UTC dags and the scheduler changing over
from Summer time.
> 08:45 Emmanuel> Hi there, we are currently experiencing a very strange issue
> : we have hourly DAGs with a start_date
14 matches
Mail list logo
