Wow changed to TBinaryProtocolAccelerated and it went down to 1.5 seconds.
Something very wrong with the default python implementation.
On 16 June 2016 at 20:34, Glenn Pierce <glenn.pie...@carnegosystems.com>
wrote:
> The important profile lines are
>
>ncalls <http://c
81.652
/usr/lib64/python2.7/socket.py:201(accept
<http://carneab4.memset.net:8000/?func_name=accept>)
2 963.303 481.652 963.303 481.652 {method 'accept' of
'_socket.socket' objects}
On 16 June 2016 at 20:01, Glenn Pierce <glenn.pie...@carnegosystems.com>
wrote:
> That co
; using the buffer.
>
> -Randy
>
>
> On Thu, Jun 16, 2016 at 9:08 AM, Glenn Pierce <
> glenn.pie...@carnegosystems.com> wrote:
>
> > Hi I wonder if someone could give advice on a performance issue I have.
> >
> > I have written a test case in Python
> >
Hi I wonder if someone could give advice on a performance issue I have.
I have written a test case in Python
The server is
class TestServerThriftHandler(object):
def getData(self):
with open('data.json', 'r') as f:
results = ujson.loads(f.read())
Hi can anyone think of a way to proxy a a thrift call.
Essentially what I want is for client calls on a master server to
forward the request on to other designated servers.
I was thinking of overriding
Transport and Server to forward certain calls on.
I guess I would have to override protocol
[
https://issues.apache.org/jira/browse/THRIFT-600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13532237#comment-13532237
]
Glenn Pierce commented on THRIFT-600:
-
May also effect parameters.
Ie
mapstring
[
https://issues.apache.org/jira/browse/THRIFT-600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13532237#comment-13532237
]
Glenn Pierce edited comment on THRIFT-600 at 12/14/12 11:08 AM
Will Pierce created THRIFT-1737:
---
Summary: UDP socket support for python
Key: THRIFT-1737
URL: https://issues.apache.org/jira/browse/THRIFT-1737
Project: Thrift
Issue Type: New Feature
[
https://issues.apache.org/jira/browse/THRIFT-1737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Will Pierce updated THRIFT-1737:
Attachment: THRIFT-1737-UDP-v1.diff
patch attached (v1)
UDP socket support
Belated +1, and also a big *Thank You* for helping move thrift forward
another step. We've come a long way!
-w
--
Will Pierce
On Mon, Oct 15, 2012 at 7:18 AM, Jake Farrell jfarr...@apache.org wrote:
With 3 binding +1's, 1 other +1 and no -1's the 0.9.0 release candidate
passes. I'll get
[
https://issues.apache.org/jira/browse/THRIFT-1115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Will Pierce resolved THRIFT-1115.
-
Resolution: Fixed
terrific!
python TBase class for dynamic (de)serialization
[
https://issues.apache.org/jira/browse/THRIFT-1604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13279362#comment-13279362
]
Will Pierce commented on THRIFT-1604:
-
(not that i like having to support python 2.4
[
https://issues.apache.org/jira/browse/THRIFT-1604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13279439#comment-13279439
]
Will Pierce commented on THRIFT-1604:
-
okie, i'm secretly happy to drop 2.4 support
[
https://issues.apache.org/jira/browse/THRIFT-600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Will Pierce updated THRIFT-600:
---
Attachment: THRIFT-600-FIX-DOUBLE-REGEX-V1.patch
The attached patch changes the lexer's regex
[
https://issues.apache.org/jira/browse/THRIFT-1528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13220311#comment-13220311
]
Will Pierce commented on THRIFT-1528:
-
i think the java and c# implementations should
[
https://issues.apache.org/jira/browse/THRIFT-1525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Will Pierce updated THRIFT-1525:
Attachment: THRIFT-1525.compactproto_rangechecks_v1.patch
Patch adds assertions to range check
[
https://issues.apache.org/jira/browse/THRIFT-1115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Will Pierce reopened THRIFT-1115:
-
missing import for TApplicationException, have 2 line patch
python TBase class
[
https://issues.apache.org/jira/browse/THRIFT-1115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13185383#comment-13185383
]
Will Pierce commented on THRIFT-1115:
-
Not yet. I'm in transit at the moment, but can
[
https://issues.apache.org/jira/browse/THRIFT-1480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Will Pierce updated THRIFT-1480:
Attachment: THRIFT-1480-pep8ify-v1.patch
python: remove tabs, adjust whitespace and address
[
https://issues.apache.org/jira/browse/THRIFT-1115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13121876#comment-13121876
]
Will Pierce commented on THRIFT-1115:
-
Thanks Christian, I'll update the test cases
[
https://issues.apache.org/jira/browse/THRIFT-1115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13096877#comment-13096877
]
Will Pierce commented on THRIFT-1115:
-
How does this look? The unit tests
[
https://issues.apache.org/jira/browse/THRIFT-1115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13088445#comment-13088445
]
Will Pierce commented on THRIFT-1115:
-
FYI, this latest patch significantly changes
[
https://issues.apache.org/jira/browse/THRIFT-1115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13084855#comment-13084855
]
Will Pierce commented on THRIFT-1115:
-
Here is sample comparison of the code
[
https://issues.apache.org/jira/browse/THRIFT-1262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Will Pierce updated THRIFT-1262:
Attachment: THRIFT-1262-python_compiler_revival_v1.patch
update python compiler to parse unions
Type: Improvement
Components: Python - Compiler
Reporter: Will Pierce
Attachments: THRIFT-1262-python_compiler_revival_v1.patch
This patch adds python-compiler parser support for Unions, * namespaces, and
oneway services in thrift files. The python compiler is still
[
https://issues.apache.org/jira/browse/THRIFT-1115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13039352#comment-13039352
]
Will Pierce commented on THRIFT-1115:
-
After thinking about this latest version
[
https://issues.apache.org/jira/browse/THRIFT-1115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13039502#comment-13039502
]
Will Pierce commented on THRIFT-1115:
-
Aha, the {{.im_func}} is the secret sauce
[
https://issues.apache.org/jira/browse/THRIFT-1115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Will Pierce updated THRIFT-1115:
Attachment: THRIFT-1115.python_dynamic_code_and_slots_v5.patch
version 5 of patch attached
[
https://issues.apache.org/jira/browse/THRIFT-1115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Will Pierce updated THRIFT-1115:
Attachment: THRIFT-1115.python_dynamic_code_and_slots_v4.patch
Hi David, thanks for the feedback
tests that all pass for me on
python 2.4 and 2.7...) I'd appreciate any additional feedback, or a
commit...
Thanks!
-W
--
J. Will Pierce
[
https://issues.apache.org/jira/browse/THRIFT-1115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Will Pierce updated THRIFT-1115:
Component/s: Build Process
python TBase class for dynamic (de)serialization, and __slots__
[
https://issues.apache.org/jira/browse/THRIFT-1115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13027455#comment-13027455
]
Will Pierce commented on THRIFT-1115:
-
Does the updated patch address all your
[
https://issues.apache.org/jira/browse/THRIFT-1115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Will Pierce updated THRIFT-1115:
Summary: python TBase class for dynamic (de)serialization, and __slots__
option for memory
[
https://issues.apache.org/jira/browse/THRIFT-1115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13021526#comment-13021526
]
Will Pierce commented on THRIFT-1115:
-
Took me some time to get back to this, but I
[
https://issues.apache.org/jira/browse/THRIFT-1115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13021531#comment-13021531
]
Will Pierce commented on THRIFT-1115:
-
Hmm, bad news. The TBase class needs
[
https://issues.apache.org/jira/browse/THRIFT-1115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13021545#comment-13021545
]
Will Pierce commented on THRIFT-1115:
-
David, at first I didn't understand what you
[
https://issues.apache.org/jira/browse/THRIFT-1115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Will Pierce updated THRIFT-1115:
Attachment: THRIFT-1115.python_dynamic_code_and_slots_v3.patch
Patch attached, version 3
[
https://issues.apache.org/jira/browse/THRIFT-1115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13014320#comment-13014320
]
Will Pierce commented on THRIFT-1115:
-
Thanks Bryan! I'm thinking of adding
[
https://issues.apache.org/jira/browse/THRIFT-1115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Will Pierce updated THRIFT-1115:
Attachment: THRIFT-1115.python_dynamic_code_and_slots_v2.patch
version 2 of this patch makes some
[
https://issues.apache.org/jira/browse/THRIFT-1115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Will Pierce updated THRIFT-1115:
Attachment: test_dynser.py
benchmarking script, copy it into trunk/test/py/ and use the same
[
https://issues.apache.org/jira/browse/THRIFT-1115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Will Pierce updated THRIFT-1115:
Attachment: test_size.py
Attaching test benchmarking script test_size.py that measures the RAM
[
https://issues.apache.org/jira/browse/THRIFT-1115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13011878#comment-13011878
]
Will Pierce commented on THRIFT-1115:
-
Results of testing default generated code
[
https://issues.apache.org/jira/browse/THRIFT-1115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13011898#comment-13011898
]
Will Pierce commented on THRIFT-1115:
-
FYI, the object instantiation time
[
https://issues.apache.org/jira/browse/THRIFT-1115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13011532#comment-13011532
]
Will Pierce commented on THRIFT-1115:
-
I forgot to mention, don't forget to re-run
/browse/THRIFT-1115
Project: Thrift
Issue Type: New Feature
Components: Python - Compiler, Python - Library
Reporter: Will Pierce
Assignee: Will Pierce
This patch adds several new features to the compiler for python and the python
libraries
[
https://issues.apache.org/jira/browse/THRIFT-1115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Will Pierce updated THRIFT-1115:
Attachment: THRIFT-1115.python_dynamic_code_and_slots_v1.patch
dynamic python object (de
[
https://issues.apache.org/jira/browse/THRIFT-1107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Will Pierce updated THRIFT-1107:
Attachment: test_isnotnone.py
Attaching benchmark test script: test_isnotnone.py
This takes
[
https://issues.apache.org/jira/browse/THRIFT-1107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13009988#comment-13009988
]
Will Pierce commented on THRIFT-1107:
-
Output from benchmark script
[
https://issues.apache.org/jira/browse/THRIFT-1107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Will Pierce updated THRIFT-1107:
Attachment: THRIFT-1107.compiler_generate_py_is_not_none.patch
Attached small patch to compiler
[
https://issues.apache.org/jira/browse/THRIFT-1094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13009271#comment-13009271
]
Will Pierce commented on THRIFT-1094:
-
Teerific! Thanks!
bug in TCompactProto
[
https://issues.apache.org/jira/browse/THRIFT-1103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13009283#comment-13009283
]
Will Pierce commented on THRIFT-1103:
-
Thanks for comitting THRIFT-1094, I'll update
[
https://issues.apache.org/jira/browse/THRIFT-1103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13009544#comment-13009544
]
Will Pierce commented on THRIFT-1103:
-
I updated the test suite to include running
[
https://issues.apache.org/jira/browse/THRIFT-1103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Will Pierce updated THRIFT-1103:
Attachment: THRIFT-1103.tzlibtransport_for_python_v1.patch
Patch attached. Adds
[
https://issues.apache.org/jira/browse/THRIFT-1094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Will Pierce updated THRIFT-1094:
Attachment: THRIFT-1094.python_compactproto_fix_and_tests_v2.patch
v2 of the patch attached
: Improvement
Components: Python - Library
Reporter: Will Pierce
Assignee: Will Pierce
The python TSSLSocket.py module has TSSLSocket and TSSLServerSocket for
outbound and inbound SSL connection wrapping.
This ticket is for a patch that makes several improvements:
* adds
[
https://issues.apache.org/jira/browse/THRIFT-1100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Will Pierce updated THRIFT-1100:
Attachment: THRIFT-1100.python_ssl_enhance_and_cert_validate.patch
patch attached:
adds lots
[
https://issues.apache.org/jira/browse/THRIFT-690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Will Pierce updated THRIFT-690:
---
Attachment: THRIFT-690.python_app_exception_codes_update.patch
This patch (THRIFT-690
Type: Bug
Components: Python - Library
Affects Versions: 0.6
Reporter: Will Pierce
Assignee: Will Pierce
The python implementation of TCompactProtocol has a bug in readMessageEnd, an
assert on its internal state being READ_VALUE when it's actually CLEAR. I
[
https://issues.apache.org/jira/browse/THRIFT-1094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Will Pierce updated THRIFT-1094:
Attachment: THRIFT-1094.python_compactproto_fix_and_tests.patch
patch attached. touches 2 lines
[
https://issues.apache.org/jira/browse/THRIFT-1094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13007443#comment-13007443
]
Will Pierce commented on THRIFT-1094:
-
looks like this readMessageEnd bug has been
- Compiler
Affects Versions: 0.6
Reporter: Will Pierce
Priority: Minor
The generated validate() method is indented to the wrong level, making it an
internal/unusable method inside the write() method of a struct
Looks like the line to generate the validator just needs to move
Versions: 0.6
Reporter: Will Pierce
The python TCompactProtocol implementation has a few bugs:
* In the writeBool method:
** the code has a typo in the spelling of AssertionError
** code fails when accessing a nonexistent types[] dict to encode the boolean
* The TType.STOP token was missing
[
https://issues.apache.org/jira/browse/THRIFT-1093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Will Pierce updated THRIFT-1093:
Attachment: THRIFT-1093.compactproto_encoding_bugs.patch
patch attached
several bugs in python
[
https://issues.apache.org/jira/browse/THRIFT-1088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Will Pierce updated THRIFT-1088:
Attachment: THRIFT-1088_python_new_style_classes_v2.patch
updated patch to work against trunk
[
https://issues.apache.org/jira/browse/THRIFT-1088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Will Pierce updated THRIFT-1088:
Attachment: runtest2.sh
Fixed runtest.sh (now called runtest2.sh) shell script so it will re-run
[
https://issues.apache.org/jira/browse/THRIFT-1088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13006390#comment-13006390
]
Will Pierce commented on THRIFT-1088:
-
% ./runtest2.sh
Building libraries
make[1
[
https://issues.apache.org/jira/browse/THRIFT-1088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Will Pierce updated THRIFT-1088:
Attachment: perftest.py
Thrift library python classes should be new-style classes
[
https://issues.apache.org/jira/browse/THRIFT-1088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Will Pierce updated THRIFT-1088:
Attachment: runtest.sh
Thrift library python classes should be new-style classes
[
https://issues.apache.org/jira/browse/THRIFT-1088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13005061#comment-13005061
]
Will Pierce commented on THRIFT-1088:
-
Here's the test results from my first stab
[
https://issues.apache.org/jira/browse/THRIFT-1088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13005070#comment-13005070
]
Will Pierce commented on THRIFT-1088:
-
To set up the perf test code, put perftest.py
Components: Python - Library
Affects Versions: 0.6
Reporter: Will Pierce
Priority: Minor
The included python thrift library classes (TType, TProtocolBase, etc...) are
all defined using old-style python class definitions. This makes it somewhat
more difficult
[
https://issues.apache.org/jira/browse/THRIFT-1088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Will Pierce updated THRIFT-1088:
Attachment: THRIFT-1088_pthon_new_style_classes.patch
svn diff attached, I am currently testing
[
https://issues.apache.org/jira/browse/THRIFT-1088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Will Pierce updated THRIFT-1088:
Patch Info: [Patch Available]
Thrift library python classes should be new-style classes
[
https://issues.apache.org/jira/browse/THRIFT-1088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13004693#comment-13004693
]
Will Pierce commented on THRIFT-1088:
-
Sure thing. Without fastbinary.so in play
[
https://issues.apache.org/jira/browse/THRIFT-1088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13004702#comment-13004702
]
Will Pierce commented on THRIFT-1088:
-
Quick question, when you say 'generated
75 matches
Mail list logo
