[jira] [Created] (BEAM-9076) [QST] How to make python sdk wheel package?

2020-01-08 Thread Keunhyun Oh (Jira)
Keunhyun Oh created BEAM-9076:
-

 Summary: [QST] How to make python sdk wheel package?
 Key: BEAM-9076
 URL: https://issues.apache.org/jira/browse/BEAM-9076
 Project: Beam
  Issue Type: Task
  Components: build-system
Affects Versions: 2.16.0
Reporter: Keunhyun Oh
 Fix For: Not applicable


How to make python sdk wheel package?

I've modified and tested beam's python sdks.

I've tried to run command to upload local built wheel package to my local 
repository like below.
{code:java}
$> python setup.py sdist bdist_wheel upload -r local{code}
Below files are not included in the package made by me.
{code:java}
./apache_beam/coders: coder_impl.cpython-36m-x86_64-linux-gnu.so
./apache_beam/coders: stream.cpython-36m-x86_64-linux-gnu.so
./apache_beam/metrics: execution.cpython-36m-x86_64-linux-gnu.soOnly in 
./apache_beam/runners: common.cpython-36m-x86_64-linux-gnu.so
./apache_beam/runners/worker: logger.cpython-36m-x86_64-linux-gnu.so
./apache_beam/runners/worker: opcounters.cpython-36m-x86_64-linux-gnu.so
./apache_beam/runners/worker: operations.cpython-36m-x86_64-linux-gnu.so
./apache_beam/runners/worker: statesampler_fast.cpython-36m-x86_64-linux-gnu.so
./apache_beam/transforms: cy_combiners.cpython-36m-x86_64-linux-gnu.so
./apache_beam/transforms: 
cy_dataflow_distribution_counter.cpython-36m-x86_64-linux-gnu.so
./apache_beam/utils: counters.cpython-36m-x86_64-linux-gnu.soOnly in 
./apache_beam/utils: windowed_value.cpython-36m-x86_64-linux-gnu.so
{code}
Please, let me know what is right command to make the wheel package?



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Updated] (BEAM-9076) [QST] How to make python sdk wheel package?

2020-01-08 Thread Keunhyun Oh (Jira)


 [ 
https://issues.apache.org/jira/browse/BEAM-9076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Keunhyun Oh updated BEAM-9076:
--
Description: 
How to make python sdk wheel package?

I've modified and tested beam's python sdks.

I've tried to run command to upload local built wheel package to my local 
repository like below.
{code:java}
$> python setup.py sdist bdist_wheel upload -r local{code}
Below files are not included in the package made by me.
{code:java}
./apache_beam/coders: coder_impl.cpython-36m-x86_64-linux-gnu.so
./apache_beam/coders: stream.cpython-36m-x86_64-linux-gnu.so
./apache_beam/metrics: execution.cpython-36m-x86_64-linux-gnu.so
./apache_beam/runners: common.cpython-36m-x86_64-linux-gnu.so
./apache_beam/runners/worker: logger.cpython-36m-x86_64-linux-gnu.so
./apache_beam/runners/worker: opcounters.cpython-36m-x86_64-linux-gnu.so
./apache_beam/runners/worker: operations.cpython-36m-x86_64-linux-gnu.so
./apache_beam/runners/worker: statesampler_fast.cpython-36m-x86_64-linux-gnu.so
./apache_beam/transforms: cy_combiners.cpython-36m-x86_64-linux-gnu.so
./apache_beam/transforms: 
cy_dataflow_distribution_counter.cpython-36m-x86_64-linux-gnu.so
./apache_beam/utils: counters.cpython-36m-x86_64-linux-gnu.so
./apache_beam/utils: windowed_value.cpython-36m-x86_64-linux-gnu.so
{code}
Please, let me know what is right command to make the wheel package?

  was:
How to make python sdk wheel package?

I've modified and tested beam's python sdks.

I've tried to run command to upload local built wheel package to my local 
repository like below.
{code:java}
$> python setup.py sdist bdist_wheel upload -r local{code}
Below files are not included in the package made by me.
{code:java}
./apache_beam/coders: coder_impl.cpython-36m-x86_64-linux-gnu.so
./apache_beam/coders: stream.cpython-36m-x86_64-linux-gnu.so
./apache_beam/metrics: execution.cpython-36m-x86_64-linux-gnu.soOnly in 
./apache_beam/runners: common.cpython-36m-x86_64-linux-gnu.so
./apache_beam/runners/worker: logger.cpython-36m-x86_64-linux-gnu.so
./apache_beam/runners/worker: opcounters.cpython-36m-x86_64-linux-gnu.so
./apache_beam/runners/worker: operations.cpython-36m-x86_64-linux-gnu.so
./apache_beam/runners/worker: statesampler_fast.cpython-36m-x86_64-linux-gnu.so
./apache_beam/transforms: cy_combiners.cpython-36m-x86_64-linux-gnu.so
./apache_beam/transforms: 
cy_dataflow_distribution_counter.cpython-36m-x86_64-linux-gnu.so
./apache_beam/utils: counters.cpython-36m-x86_64-linux-gnu.soOnly in 
./apache_beam/utils: windowed_value.cpython-36m-x86_64-linux-gnu.so
{code}
Please, let me know what is right command to make the wheel package?


> [QST] How to make python sdk wheel package?
> ---
>
> Key: BEAM-9076
> URL: https://issues.apache.org/jira/browse/BEAM-9076
> Project: Beam
>  Issue Type: Task
>  Components: build-system
>Affects Versions: 2.16.0
>Reporter: Keunhyun Oh
>Priority: Major
> Fix For: Not applicable
>
>
> How to make python sdk wheel package?
> I've modified and tested beam's python sdks.
> I've tried to run command to upload local built wheel package to my local 
> repository like below.
> {code:java}
> $> python setup.py sdist bdist_wheel upload -r local{code}
> Below files are not included in the package made by me.
> {code:java}
> ./apache_beam/coders: coder_impl.cpython-36m-x86_64-linux-gnu.so
> ./apache_beam/coders: stream.cpython-36m-x86_64-linux-gnu.so
> ./apache_beam/metrics: execution.cpython-36m-x86_64-linux-gnu.so
> ./apache_beam/runners: common.cpython-36m-x86_64-linux-gnu.so
> ./apache_beam/runners/worker: logger.cpython-36m-x86_64-linux-gnu.so
> ./apache_beam/runners/worker: opcounters.cpython-36m-x86_64-linux-gnu.so
> ./apache_beam/runners/worker: operations.cpython-36m-x86_64-linux-gnu.so
> ./apache_beam/runners/worker: 
> statesampler_fast.cpython-36m-x86_64-linux-gnu.so
> ./apache_beam/transforms: cy_combiners.cpython-36m-x86_64-linux-gnu.so
> ./apache_beam/transforms: 
> cy_dataflow_distribution_counter.cpython-36m-x86_64-linux-gnu.so
> ./apache_beam/utils: counters.cpython-36m-x86_64-linux-gnu.so
> ./apache_beam/utils: windowed_value.cpython-36m-x86_64-linux-gnu.so
> {code}
> Please, let me know what is right command to make the wheel package?



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (BEAM-9094) Support setting some options such as endpoint_url and credential infos for AWS S3 Filesystem in Python SDKs

2020-01-12 Thread Keunhyun Oh (Jira)
Keunhyun Oh created BEAM-9094:
-

 Summary: Support setting some options such as endpoint_url and 
credential infos for AWS S3 Filesystem in Python SDKs
 Key: BEAM-9094
 URL: https://issues.apache.org/jira/browse/BEAM-9094
 Project: Beam
  Issue Type: Improvement
  Components: io-ideas
Affects Versions: 2.19.0
Reporter: Keunhyun Oh


AWS S3 File System is implemented in BEAM-2572.

To use local s3 like minio, It is need to support setting some options such as 
endpoint_url and credential infos.

In my idea, it can be implemented to use environment variables.

 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)