[
https://issues.apache.org/jira/browse/PIG-5410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17977618#comment-17977618
]
Rohini Palaniswamy commented on PIG-5410:
-----------------------------------------
Attached [^PIG-5410-7.patch] where everything is treated as bytes in Python 3
as we worked on.
||Python 2||Python 3||
|str|bytes|
|unicode|str|
- Ran the TestStreaming.java and test_controller.py unit tests on both Python
2 and Python 3 and they all pass
cd test/python/streaming
python -m unittest test_controller.TestDeserializer; python -m unittest
test_controller.TestSerializeOutput; python -m unittest
test_controller.TestReadInput after exporting src/python/streaming to PYTHONPATH
- Ran the full suite of unit and e2e tests on Python 3 (on Hadoop2/3 clusters
using the mr/tez/spark exec modes) with the patch using internal CI and they
are good except for two tests that have float differences.
[~vnarayanan7],
Can you run the e2e tests on Python 2 and check ?
Will be working on getting a release build for 0.18 shortly after I commit this
patch.
> Support Python 3 for streaming_python
> -------------------------------------
>
> Key: PIG-5410
> URL: https://issues.apache.org/jira/browse/PIG-5410
> Project: Pig
> Issue Type: New Feature
> Reporter: Rohini Palaniswamy
> Assignee: Venkatasubrahmanian Narayanan
> Priority: Major
> Fix For: 0.18.0
>
> Attachments: PIG-5410-7.patch, PIG-5410-v2.patch, PIG-5410-v3.patch,
> PIG-5410-v4.patch, PIG-5410-v5.patch, PIG-5410-v6.patch, PIG-5410.patch,
> controller_venkat_cursor_changes.py, pig-5410-v02.patch
>
>
> Python 3 is incompatible with Python 2. We need to make it work with both.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
