Separating the tests is where the effort lies. So having that as a consequence of splitting the packages would be nice. It has come up a couple of times but it was not picked up unfortunately.
B. > On 28 Jun 2018, at 08:32, Maxime Beauchemin <maximebeauche...@gmail.com> > wrote: > > It would be so nice to have a fast test suite. Having to wait for Travis > for up to an hour makes many workflows (like working on a release) super > painful. > > I spoke with folks at Astronomer recently about moving all operators and > hooks to another Python package that airflow would import. This would allow > for independent test suites and to have a more regular release cadence on > hooks and operators. What do you think? > > Max > > On Wed, Jun 27, 2018 at 11:18 PM Bolke de Bruin <bdbr...@gmail.com> wrote: > >> Arghhh. The downside of doing this late at night and wanting to go to >> bed... :-). Will make a new one >> >> Sent from my iPhone >> >>> On 28 Jun 2018, at 00:07, Chris Fei <cfe...@gmail.com> wrote: >>> >>> Great, thank you! I just took this for a quick spin and it looks like >>> there's DB migration task missing. The task you committed just recently, >>> 9635ae0956e7_index_faskfail.py, has a down_revision of 856955da8476 >>> which can't be found when running airflow initdb (seehttps:// >> github.com/apache/incubator-airflow/tree/v1-10-test/airflow/migrations/versions >> ). >>> Chris >>> >>> >>>> On Wed, Jun 27, 2018, at 5:09 PM, Bolke de Bruin wrote: >>>> Hi All, >>>> >>>> I have created a sdist package that is available at: >>>> >>>> >> http://people.apache.org/~bolke/apache-airflow-1.10.0b3+incubating.tar.gz >>>> < >> http://people.apache.org/~bolke/apache-airflow-1.10.0b3+incubating.tar.gz>> >> >>>> In order to distinguish it from an actual (apache) release it is: >>>> >>>> 1. Marked as beta (python package managers do not install beta >>>> versions by default - PEP 440)> 2. It is not signed >>>> 3. It is not at an official apache distribution location >>>> >>>> You can also put something like this in a requirements.txt file: >>>> >>>> git+ >>>> >> https://github.com/apache/incubator-airflow@v1-10-test#egg=apache-airflow[celery,crypto,emr,hive,hdfs,ldap,mysql,postgres,redis,slack,s3 >>>> < >> https://github.com/apache/incubator-airflow@v1-10-test#egg=apache-airflow[celery,crypto,emr,hive,hdfs,ldap,mysql,postgres,redis,slack,s3 >>> >>>> ]> <https://github.com/rodrigc/incubator-airflow@master#egg=apache- >>>> airflow[celery,crypto,emr,hive,hdfs,ldap,mysql,postgres,redis,slack,s- >>>> 3] >>>> < >> https://github.com/rodrigc/incubator-airflow@master#egg=apache-airflow[celery,crypto,emr,hive,hdfs,ldap,mysql,postgres,redis,slack,s3][1] >>> >>>>>> >>>> and then "pip install -r requirements.txt”. >>>> >>>> I hope that after this beta we can go to RC and start voting on 1.10.> >>>> Cheers >>>> Bolke >>> >>> >>> Links: >>> >>> 1. >> https://github.com/rodrigc/incubator-airflow@master#egg=apache-airflow[celery,crypto,emr,hive,hdfs,ldap,mysql,postgres,redis,slack,s3]%20%3Chttps://github.com/rodrigc/incubator-airflow@master#egg=apache-airflow[celery,crypto,emr,hive,hdfs,ldap,mysql,postgres,redis,slack,s3] >> <https://github.com/rodrigc/incubator-airflow@master#egg=apache-airflow[celery,crypto,emr,hive,hdfs,ldap,mysql,postgres,redis,slack,s3]%20%3Chttps://github.com/rodrigc/incubator-airflow@master%23egg=apache-airflow[celery,crypto,emr,hive,hdfs,ldap,mysql,postgres,redis,slack,s3]> >>
