date:20180606

Jenkins build is back to normal : beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #439

2018-06-06 Thread Apache Jenkins Server

See

[jira] [Work logged] (BEAM-4488) Contributor's guide needs to document how to install Python SDK from source

2018-06-06 Thread ASF GitHub Bot (JIRA)



 [ 
https://issues.apache.org/jira/browse/BEAM-4488?focusedWorklogId=109633=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-109633
 ]

ASF GitHub Bot logged work on BEAM-4488:


Author: ASF GitHub Bot
Created on: 07/Jun/18 04:31
Start Date: 07/Jun/18 04:31
Worklog Time Spent: 10m 
  Work Description: pabloem commented on a change in pull request #464: 
[BEAM-4488], [BEAM-4489], [BEAM-4490] Improvements to contribution guide
URL: https://github.com/apache/beam-site/pull/464#discussion_r193622173
 
 

 ##
 File path: src/contribute/index.md
 ##
 @@ -19,45 +19,59 @@ The Apache Beam community welcomes contributions from 
anyone!
 
 There are lots of opportunities:
 
- - write new examples
+ - ask or answer questions on [u...@beam.apache.org]({{ site.baseurl
+}}/community/contact-us/) or
+[stackoverflow](https://stackoverflow.com/questions/tagged/apache-beam)
+ - review proposed design ideas on [d...@beam.apache.org]({{ site.baseurl
+}}/community/contact-us/)
  - improve the documentation
+ - contribute bug reports
 
 Review comment:
   Maybe link Jira? : ) https://issues.apache.org/jira/projects/BEAM/issues


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 109633)
Time Spent: 50m  (was: 40m)

> Contributor's guide needs to document how to install Python SDK from source
> ---
>
> Key: BEAM-4488
> URL: https://issues.apache.org/jira/browse/BEAM-4488
> Project: Beam
>  Issue Type: Improvement
>  Components: sdk-py-core
>Reporter: Pablo Estrada
>Assignee: Alan Myrvold
>Priority: Major
>  Time Spent: 50m
>  Remaining Estimate: 0h
>
> Currently it is not documented, though it does appear in the quickstart



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Work logged] (BEAM-4488) Contributor's guide needs to document how to install Python SDK from source

2018-06-06 Thread ASF GitHub Bot (JIRA)



 [ 
https://issues.apache.org/jira/browse/BEAM-4488?focusedWorklogId=109632=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-109632
 ]

ASF GitHub Bot logged work on BEAM-4488:


Author: ASF GitHub Bot
Created on: 07/Jun/18 04:31
Start Date: 07/Jun/18 04:31
Worklog Time Spent: 10m 
  Work Description: pabloem commented on a change in pull request #464: 
[BEAM-4488], [BEAM-4489], [BEAM-4490] Improvements to contribution guide
URL: https://github.com/apache/beam-site/pull/464#discussion_r193622481
 
 

 ##
 File path: src/contribute/index.md
 ##
 @@ -78,29 +97,90 @@ necessary things to run those tests. For example:
 $ ./gradlew -p sdks/java/io/cassandra check
 $ ./gradlew -p runners/flink check
 
-### Testing the Python SDK
+You can see what build tasks are available with
+
+$ ./gradlew tasks
+
+or for a module,
+
+$ ./gradlew sdks/java/io/cassandra tasks
+
+### Developing with an IDE
+
+Generate an IDEA project .ipr file with:
+
+$ ./gradlew idea
+
+### Pull requests
+
+When your change is ready to be reviewed and merged, create a pull request.
+Format the pull request title like [BEAM-XXX] Fixes bug in 
ApproximateQuantiles,
 
 Review comment:
   Maybe add backticks or quotes for the title of the Pull Request?


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 109632)
Time Spent: 40m  (was: 0.5h)

> Contributor's guide needs to document how to install Python SDK from source
> ---
>
> Key: BEAM-4488
> URL: https://issues.apache.org/jira/browse/BEAM-4488
> Project: Beam
>  Issue Type: Improvement
>  Components: sdk-py-core
>Reporter: Pablo Estrada
>Assignee: Alan Myrvold
>Priority: Major
>  Time Spent: 40m
>  Remaining Estimate: 0h
>
> Currently it is not documented, though it does appear in the quickstart



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Work logged] (BEAM-4488) Contributor's guide needs to document how to install Python SDK from source

2018-06-06 Thread ASF GitHub Bot (JIRA)

[
https://issues.apache.org/jira/browse/BEAM-4488?focusedWorklogId=109631=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-109631
]

ASF GitHub Bot logged work on BEAM-4488:

Author: ASF GitHub Bot
Created on: 07/Jun/18 04:31
Start Date: 07/Jun/18 04:31
Worklog Time Spent: 10m
Work Description: pabloem commented on a change in pull request #464:
[BEAM-4488], [BEAM-4489], [BEAM-4490] Improvements to contribution guide
URL: https://github.com/apache/beam-site/pull/464#discussion_r193622831

##
File path: src/contribute/index.md
##
@@ -78,29 +97,90 @@ necessary things to run those tests. For example:
$ ./gradlew -p sdks/java/io/cassandra check
$ ./gradlew -p runners/flink check

-### Testing the Python SDK
+You can see what build tasks are available with
+
+$ ./gradlew tasks
+
+or for a module,
+
+$ ./gradlew sdks/java/io/cassandra tasks
+
+### Developing with an IDE
+
+Generate an IDEA project .ipr file with:
+
+$ ./gradlew idea
+
+### Pull requests
+
+When your change is ready to be reviewed and merged, create a pull request.
+Format the pull request title like [BEAM-XXX] Fixes bug in
ApproximateQuantiles,
+where you replace BEAM-XXX with the appropriate JIRA issue.
+This will automatically link the pull request to the issue.
+
+Pull requests can only be merged by a [beam committer]
+(http://people.apache.org/phonebook.html?unix=beam).
+To find a committer for your area, look for similar code merges or ask on
+[d...@beam.apache.org]({{ site.baseurl }}/community/contact-us/)
+
+Use @mention in the pull request to notify the reviewer.
+
+The pull request and any changes pushed to it will trigger precommit jobs.
+If a test fails and appears unrelated to your change, you can cause tests
+to be re-run by adding a single line comment on your PR
+
+ retest this please
+
+There are other trigger phrases for post-commit tests found in
+.testinfra/jenkins, but use these sparingly because postcommit
+tests consume shared development resources.
+
+### Developing with the Python SDK
+
+Gradle can build and test python, and is used by the Jenkins jobs, so needs to
+be maintained.

You can directly use the Python toolchain instead of having Gradle orchestrate
-it. This may be faster for you. We recommend setting up a virtual environment
-before testing your code.
+it, which may be faster for you, but it is your preference.
+If you do want to use Python tools directly, we recommend setting up a virtual
+environment before testing your code.

If you update any of the [cythonized](http://cython.org) files in Python SDK,
you must install the `cython` package before running following command to
properly test your code.

The following commands should be run in the `sdks/python` directory.
-This command runs all Python tests.
+This installs Python from source and includes the test and gcp dependencies.
+
+On macOS/Linix:
+
+$ virtualenv env
+$ . ./env/bin/activate
+(env) $ pip install .[gcp,test]

-$ python setup.py nosetests
+On Windows:
+
+> c:\Python27\python.exe -m virtualenv
+> env\Scripts\activate
+(env) > pip install .[gcp,test]
+
+This command runs all Python tests. The nose dependency is installed by [test]
in pip install.
+
+(env) $ python setup.py nosetests

You can use following command to run a single test method.

-$ python setup.py nosetests --tests :.
+(env) $ python setup.py nosetests --tests :.
+
+For example:
+(env) $ python setup.py nosetests --tests
apache_beam.io.textio_test:TextSourceTest.test_progress

-Example:
-$ python setup.py nosetests --tests
apache_beam.io.textio_test:TextSourceTest.test_progress
+You can deactivate the virtualenv when done.

-To check just for lint errors, run the following command.
+(env) $ deactivate
+$
+
+To check just for Python lint errors, run the following command.

Review comment:
We have `tox` commands that run lint tasks. I am not sure, but maybe it'd be
worth mentioning them

tox -e py27-lint # For python 2.7
tox -e py3-lint# For python 3
tox -e py27-lint3 # For python 2-3 compatibility

All of these run in precommits

This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.

1 2 3 >

1 - 100 of 226 matches

Mail list logo