Re: Contributor Request

2020-07-20 Thread Ashwin Ramaswami
Hi Matthew, You should be able to submit a patch by creating a PR at https://github.com/apache/beam -- you shouldn't need Contributor permissions to do so. Ashwin Ramaswami Student *Find me on my:* LinkedIn <https://www.linkedin.com/in/ashwin-r> | Website <https://epicfaace.github.io/&

Re: [PROPOSAL] Azure Filesystem for Beam Java SDK

2020-07-16 Thread Ashwin Ramaswami
Hi Etta, Have you thought about reusing the HadoopFileSystem to access Azure Blob Storage instead? It appears that Azure Blob Storage comes with a hdfs-compatible API with the wasb:// protocol. See https://issues.apache.org/jira/browse/BEAM-10103 Ashwin Ramaswami Student *Find me on my

Re: Jira components for cross-language transforms

2020-05-28 Thread Ashwin Ramaswami
What are some of the benefits / drawbacks of using cross-language transforms? Would a native Python transform perform better than a cross-language transform written in Java that is then used in a Python pipeline? Ashwin Ramaswami Student *Find me on my:* LinkedIn <https://www.linkedin.

Re: Semantic versioning

2020-05-28 Thread Ashwin Ramaswami
There's a "Breaking Changes" section on this blogpost: https://beam.apache.org/blog/beam-2.21.0/ (and really, for earlier minor versions too) Ashwin Ramaswami Student *Find me on my:* LinkedIn <https://www.linkedin.com/in/ashwin-r> | Website <https://epicfaace.github.i

Semantic versioning

2020-05-28 Thread Ashwin Ramaswami
Do we really use semantic versioning? It appears we introduced breaking changes from 2.20.0 -> 2.21.0. If not, we should update the documentation under "API Stability" on this page: https://beam.apache.org/get-started/downloads/ What would be a better way to word the way in which we decide

Proposal for reading from / writing to archive files

2020-05-27 Thread Ashwin Ramaswami
I have a requirement where I need to read from / write to archive files (such as .tar, .zip). Essentially, I'd like to treat the entire .zip file I read from as a filesystem, so that I can only get the files I need that are within the archive. This is useful, because some archive formats such

Contributor access to Beam JIRA

2020-05-25 Thread Ashwin Ramaswami
I'd like to work on some issues, assign issues to myself, and help close out old issues that are already resolved. Could you give me contributor access to the Beam JIRA?

Re: deploy_travis.sh ?

2020-05-24 Thread Ashwin Ramaswami
Not sure, but deploy_travis.sh seems to have been deleted in this commit: https://github.com/apache/beam-wheels/commit/40c0bd1a36d70736b84e925889cdad417e429fd4 On 2020/05/22 02:13:35, Austin Bennett wrote: > Hi All, > > Was digging into https://github.com/apache/beam-wheels after being

Re: Plan for dropping python 2 support

2020-05-24 Thread Ashwin Ramaswami
I'd like to help with this Python 2 -> 3 migration if possible. We're nearly halfway through 2020 now -- is there currently anything stopping us from doing this migration at the moment? Is this the right time to do so? On 2019/10/05 02:11:24, Valentyn Tymofieiev wrote: > On Fri, Oct 4, 2019