[jira] Updated: (AVRO-451) Try to use hashlib in Python implementation and fall back to md5 if we can't find it
[ https://issues.apache.org/jira/browse/AVRO-451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Hammerbacher updated AVRO-451: --- Resolution: Fixed Status: Resolved (was: Patch Available) Committed revision 925135. Thanks, Bruce! Try to use hashlib in Python implementation and fall back to md5 if we can't find it Key: AVRO-451 URL: https://issues.apache.org/jira/browse/AVRO-451 Project: Avro Issue Type: Improvement Components: python Affects Versions: 1.3.0 Reporter: Jeff Hammerbacher Assignee: Bruce Mitchener Fix For: 1.3.2 Attachments: avro_python_hashlib.diff hashlib, new in 2.5, seems to be the better way to do things (http://docs.python.org/library/hashlib.html). We want to support Python 2.4, so the best way to handle this situation is to try to import hashlib and fall back to md5 if we can't find it (similar to the json/simplejson dance). -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Assigned: (AVRO-451) Try to use hashlib in Python implementation and fall back to md5 if we can't find it
[ https://issues.apache.org/jira/browse/AVRO-451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Hammerbacher reassigned AVRO-451: -- Assignee: Bruce Mitchener Try to use hashlib in Python implementation and fall back to md5 if we can't find it Key: AVRO-451 URL: https://issues.apache.org/jira/browse/AVRO-451 Project: Avro Issue Type: Improvement Components: python Affects Versions: 1.3.0 Reporter: Jeff Hammerbacher Assignee: Bruce Mitchener Fix For: 1.3.2 Attachments: avro_python_hashlib.diff hashlib, new in 2.5, seems to be the better way to do things (http://docs.python.org/library/hashlib.html). We want to support Python 2.4, so the best way to handle this situation is to try to import hashlib and fall back to md5 if we can't find it (similar to the json/simplejson dance). -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (AVRO-450) Python - Ruby interoperability failing with Mail client/server example
[
https://issues.apache.org/jira/browse/AVRO-450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12847281#action_12847281
]
Jeff Hammerbacher commented on AVRO-450:
Hey Jeff, do you plan on working on this ticket any time soon? I'd be happy to
help debug. Getting a third language into the RPC interop pantheon would
improve my peace of mind immeasurably.
Python - Ruby interoperability failing with Mail client/server example
Key: AVRO-450
URL: https://issues.apache.org/jira/browse/AVRO-450
Project: Avro
Issue Type: Bug
Components: python, ruby
Affects Versions: 1.3.0
Reporter: Patrick Hunt
Priority: Blocker
Errors are generated when attempting to have python client call ruby server
(and vice-versa). I noticed this issue when updating the quickstart, however
this is also happening with the 1.3.0 shipping code for the Mail example (in
test directory). I see this with both server-python/client-ruby and
server-ruby/client-python.
-
PYTHONPATH=../src python ./sample_http_client.py you me hello_world
/home/phunt/a/avro-src-1.3.0/lang/py/src/avro/protocol.py:20:
DeprecationWarning: the md5 module is deprecated; use hashlib instead
import md5
Traceback (most recent call last):
File ./sample_http_client.py, line 90, in module
result = requestor.request('send', params)
File /home/phunt/a/avro-src-1.3.0/lang/py/src/avro/ipc.py, line 138, in
request
call_response = self.transceiver.transceive(call_request)
File /home/phunt/a/avro-src-1.3.0/lang/py/src/avro/ipc.py, line 471, in
transceive
conn_success = self.conn.connect()
File /usr/lib/python2.6/httplib.py, line 704, in connect
self.timeout)
File /usr/lib/python2.6/socket.py, line 514, in create_connection
raise error, msg
socket.error: [Errno 111] Connection refused
---
RUBYLIB=../lib ruby -r 'rubygems' ./sample_ipc_server.rb
../lib/avro/ipc.rb:434:in `read_buffer_length': Socket read 0 bytes.
(Avro::IPC::ConnectionClosedException)
from ../lib/avro/ipc.rb:380:in `read_framed_message'
from ../lib/avro/ipc.rb:378:in `loop'
from ../lib/avro/ipc.rb:378:in `read_framed_message'
from ../lib/avro/ipc.rb:243:in `respond'
from ./sample_ipc_server.rb:84:in `handle'
from ./sample_ipc_server.rb:74:in `run'
from ./sample_ipc_server.rb:90
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (AVRO-423) HTTPTransceiver does not reuse connections
[ https://issues.apache.org/jira/browse/AVRO-423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Hammerbacher updated AVRO-423: --- Resolution: Fixed Status: Resolved (was: Patch Available) Committed revision 925147. Thanks, Eric! HTTPTransceiver does not reuse connections -- Key: AVRO-423 URL: https://issues.apache.org/jira/browse/AVRO-423 Project: Avro Issue Type: Improvement Components: python Affects Versions: 1.3.0 Reporter: Eric Evans Assignee: Eric Evans Fix For: 1.3.2 Attachments: AVRO-423.patch, v2-0001-AVRO-423.-reuse-existing-http-connections.txt, v2-0002-AVRO-423.-generate-connection-instances-in-transceiver.txt The Python libs HTTPTransceiver creates a new connection for each request. Patch to follow. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (AVRO-423) HTTPTransceiver does not reuse connections
[ https://issues.apache.org/jira/browse/AVRO-423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Hammerbacher updated AVRO-423: --- Issue Type: Improvement (was: Bug) HTTPTransceiver does not reuse connections -- Key: AVRO-423 URL: https://issues.apache.org/jira/browse/AVRO-423 Project: Avro Issue Type: Improvement Components: python Affects Versions: 1.3.0 Reporter: Eric Evans Assignee: Eric Evans Fix For: 1.3.2 Attachments: AVRO-423.patch, v2-0001-AVRO-423.-reuse-existing-http-connections.txt, v2-0002-AVRO-423.-generate-connection-instances-in-transceiver.txt The Python libs HTTPTransceiver creates a new connection for each request. Patch to follow. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Created: (AVRO-482) Improve and standardize process for publishing Python release artifacts to PyPI
Improve and standardize process for publishing Python release artifacts to PyPI --- Key: AVRO-482 URL: https://issues.apache.org/jira/browse/AVRO-482 Project: Avro Issue Type: Improvement Components: python Reporter: Jeff Hammerbacher We are now publishing Avro releases to PyPI. Let's make sure things work as planned. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Created: (AVRO-484) avro C++ HTTP rpc support
avro C++ HTTP rpc support - Key: AVRO-484 URL: https://issues.apache.org/jira/browse/AVRO-484 Project: Avro Issue Type: Improvement Components: c++ Reporter: Xing Jin Upon Scott Banachowski's request, this is to add HTTP transport support for the rpc usage of avro C++ version. The current implementation uses HTTP POST to send over a request body (of any content) and the server side responds with a standard HTTP response body (of any content). Current status: it only requires a user to provide a streambuf input and define a function that contains the business logic to generate the serialized content into a response streambuf. testhttpserver would be a good example there. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (AVRO-484) avro C++ HTTP rpc support
[ https://issues.apache.org/jira/browse/AVRO-484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12847572#action_12847572 ] Jeff Hammerbacher commented on AVRO-484: Hey Xing, Thanks for the contribution! http://hadoop.apache.org/avro/docs/current/spec.html#HTTP+as+Transport has the details on how to use HTTP for Avro RPC. Also, I don't see a patch attached, but you can implement the RPC interop tests to ensure you've got things working correctly. Currently only Java and Python have working RPC implementations. Thanks, Jeff avro C++ HTTP rpc support - Key: AVRO-484 URL: https://issues.apache.org/jira/browse/AVRO-484 Project: Avro Issue Type: Improvement Components: c++ Reporter: Xing Jin Upon Scott Banachowski's request, this is to add HTTP transport support for the rpc usage of avro C++ version. The current implementation uses HTTP POST to send over a request body (of any content) and the server side responds with a standard HTTP response body (of any content). Current status: it only requires a user to provide a streambuf input and define a function that contains the business logic to generate the serialized content into a response streambuf. testhttpserver would be a good example there. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (AVRO-484) avro C++ HTTP rpc support
[ https://issues.apache.org/jira/browse/AVRO-484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12847626#action_12847626 ] Scott Banachowski commented on AVRO-484: Thanks Xing! Jeff, regarding interop tests, that is the next step. I have spoken to Xing and while he made a lot of progress, he may not be able to work further on this for a while. So myself or another volunteer will need to get this patch to the point where interop tests work. The transport is working but I think it still needs the handshake to be implemented before interop will work. avro C++ HTTP rpc support - Key: AVRO-484 URL: https://issues.apache.org/jira/browse/AVRO-484 Project: Avro Issue Type: Improvement Components: c++ Reporter: Xing Jin Attachments: http.v2.patch Upon Scott Banachowski's request, this is to add HTTP transport support for the rpc usage of avro C++ version. The current implementation uses HTTP POST to send over a request body (of any content) and the server side responds with a standard HTTP response body (of any content). Current status: it only requires a user to provide a streambuf input and define a function that contains the business logic to generate the serialized content into a response streambuf. testhttpserver would be a good example there. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (AVRO-434) Implemented Object Container Writer for c++
[ https://issues.apache.org/jira/browse/AVRO-434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12847628#action_12847628 ] Scott Banachowski commented on AVRO-434: Thanks for the contribution Babak! At least it's a start for a missing piece. I'll try to get this further along, or volunteers are welcome. Implemented Object Container Writer for c++ --- Key: AVRO-434 URL: https://issues.apache.org/jira/browse/AVRO-434 Project: Avro Issue Type: Improvement Components: c++ Affects Versions: 1.4.0 Environment: c++ Reporter: Babak Salamat Assignee: Babak Salamat Fix For: 1.4.0 Attachments: avro-objcntr2.diff Original Estimate: 48h Remaining Estimate: 48h The code changes include classes for a null codec, object container, data blocks and object container writer. The changes have not been tested and further testing is required. I am submitting the changes because I may not be able to work on it further. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Created: (AVRO-485) JavaScript encoding/decoding
JavaScript encoding/decoding Key: AVRO-485 URL: https://issues.apache.org/jira/browse/AVRO-485 Project: Avro Issue Type: Wish Reporter: Bruce Mitchener It would be very nice to have Javascript encoding/decoding support. There are at least a couple of interested in streaming Avro-encoded data to a browser-based client. Working with binary data in JS is a bit ugly ... here's a sample: http://github.com/christkv/node-mongodb-native/blob/master/lib/mongodb/bson/binary_parser.js -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
