[grpc-io] Re: gRPC Java - async client waiting forever after the server closes the connection

2020-04-27 Thread 'Chengyuan Zhang' via grpc.io
Can you post some code snippet for how you implement it? Also, at what 
event is "server connection has been established" you are referring to?

On Monday, April 27, 2020 at 1:34:01 PM UTC-7 Sri wrote:

> I think I am doing something very obvious wrong. I have a bidi streaming 
> grpc async client. It isn't closing the connection and waiting forever even 
> after the server closed connection.
> Also any messages sent on the stream before the server connection has been 
> established are not received on the server after the connection is 
> established.
>
>

-- 
You received this message because you are subscribed to the Google Groups 
"grpc.io" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to grpc-io+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/grpc-io/99e53ea1-80fd-4ef8-ae3d-5d9a46c0a6dd%40googlegroups.com.


[grpc-io] gRPC Java - async client waiting forever after the server closes the connection

2020-04-27 Thread 'Sri' via grpc.io
I think I am doing something very obvious wrong. I have a bidi streaming 
grpc async client. It isn't closing the connection and waiting forever even 
after the server closed connection.
Also any messages sent on the stream before the server connection has been 
established are not received on the server after the connection is 
established.

-- 
You received this message because you are subscribed to the Google Groups 
"grpc.io" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to grpc-io+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/grpc-io/d2c9be3d-9217-452b-817c-56f780f72683%40googlegroups.com.


[grpc-io] Re: is there a way to limit the number concurrent gRPC Clients on server and drop additional clients when the limit is reached?

2020-04-27 Thread srikar.nadipally via grpc.io
Thanks, I will try those out

On Friday, April 24, 2020 at 3:44:14 PM UTC-4, Chengyuan Zhang wrote:
>
> Unfortunately, this hasn't been implemented, while it had been asked for 
> several times. See https://github.com/grpc/grpc-java/issues/1886 for 
> status and progresses about the discussion. You could comment (ping) on 
> that with descriptions about your use case. There may be other server 
> concurrency limiting solutions mentioned by other users in that discussion 
> interests you.
>
> FWIW, our service implementations used to have load reporting mechanisms 
> that servers report their load (e.g., # of requests, utilizations, etc) to 
> the balancer for load balancing purposes.
>
> On Friday, April 24, 2020 at 8:11:46 AM UTC-7 Sri wrote:
>
>> I want to limit the no.of concurrent clients a grpc server can serve, so 
>> that our load balancer can assign other servers to the client, is there a 
>> way to do this? I am speciifcally working with grpc java
>>
>> Thank you
>>
>

-- 
You received this message because you are subscribed to the Google Groups 
"grpc.io" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to grpc-io+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/grpc-io/fc2142d8-a836-40f3-938d-1c69ff4a7ec7%40googlegroups.com.


Re: [grpc-io] Large Files not able to upload even as chunks

2020-04-27 Thread vigneshdhanraj
Thanks Thomas,

Thought like upload request needs to be bytes and for reply used int, that 
is the issue thanks a lot. Issue solved :)

Thanks Team, it is my mistake.

On Tuesday, April 28, 2020 at 12:37:06 AM UTC+5:30, Thomas Mercier wrote:
>
> The maximum value of an int32 is 2,147,483,647. Why are you using a signed 
> type for length in the first place though?
>
> On Mon, Apr 27, 2020 at 12:01 PM VigneshDhanraj G  > wrote:
>
>> Thanks Michael,
>>
>> syntax = "proto3";
>>
>> service FileServer {
>>   rpc upload(stream Chunk) returns (Reply) {}
>>   rpc download(Request) returns (stream Chunk) {}
>> }
>>
>> message Chunk {
>>   bytes buffer = 1;
>> }
>>
>> message Request {
>>   string name = 1;
>> }
>>
>> message Reply {
>>   int32 length = 1;
>>
>> and my client.py
>>
>>
>> def get_file_chunks(filename):
>> with open(filename, 'rb') as f:
>> while True:
>> piece = f.read(CHUNK_SIZE);
>> if len(piece) == 0:
>> return
>> yield chunk_pb2.Chunk(buffer=piece)
>>
>>
>> def save_chunks_to_file(chunks, filename):
>> with open(filename, 'wb') as f:
>> for chunk in chunks:
>> f.write(chunk.buffer)
>>
>>
>> class FileClient:
>> def __init__(self, address):
>> channel = grpc.insecure_channel(address)
>> self.stub = chunk_pb2_grpc.FileServerStub(channel)
>>
>> def upload(self, in_file_name):
>> chunks_generator = get_file_chunks(in_file_name)
>> response = self.stub.upload(chunks_generator)
>> assert response.length == os.path.getsize(in_file_name)
>>
>> def download(self, target_name, out_file_name):
>> response = self.stub.download(chunk_pb2.Request(name=target_name))
>> save_chunks_to_file(response, out_file_name)
>>
>>
>> if __name__ == '__main__':
>> client = FileClient('localhost:')
>>
>> # demo for file uploading
>> in_file_name = sys.argv[1]
>> client.upload(in_file_name)
>>
>>
>>
>>
>> On Tuesday, April 28, 2020 at 12:13:47 AM UTC+5:30, Michael Webster wrote:
>>>
>>> Do you have any snippets you can share from your code?  I use 
>>> python-grpc in another project for transferring files and I've never had an 
>>> issue with files > 2gb, with 1mb chunks (local network operations).
>>>
>>> On Monday, April 27, 2020 at 7:08:50 PM UTC+1, VigneshDhanraj G wrote:

 Thanks Mya, 

 There is no any error on the server and  i am getting error if i upload 
 more than 2GB file, i am constanly uploading chunk on the storge.

 On Monday, April 27, 2020 at 8:42:50 PM UTC+5:30, Mya Pitzeruse wrote:
>
> Is there an associated error on the server? The error message suggests 
> a server error with an index out of bounds exception: 2^31. Only way I 
> could see something like that happening is if the file was being buffered 
> on the server side in memory.
>
> On Mon, Apr 27, 2020 at 6:56 AM VigneshDhanraj G  
> wrote:
>
>> Hi Team,
>>
>> I am not able to upload large files more than 2GB even after chunk. I 
>> have found the file is uploaded still exeception raised? Please help me 
>> to 
>> understand the issue here and way to fix this problem.
>>
>> Traceback (most recent call last):
>>   File "demo_client.py", line 12, in 
>> client.upload(in_file_name)
>>   File 
>> "/home/vigneshdhanraj/Project/grpc-upload/grpc-file-transfer/src/lib.py",
>>  
>> line 34, in upload
>> response = self.stub.upload(chunks_generator)
>>   File 
>> "/home/vigneshdhanraj/Project/grpc-upload/myenv/lib/python3.6/site-packages/grpc/_channel.py",
>>  
>> line 1011, in __call__
>> return _end_unary_response_blocking(state, call, False, None)
>>   File 
>> "/home/vigneshdhanraj/Project/grpc-upload/myenv/lib/python3.6/site-packages/grpc/_channel.py",
>>  
>> line 729, in _end_unary_response_blocking
>> raise _InactiveRpcError(state)
>> grpc._channel._InactiveRpcError: <_InactiveRpcError of RPC that 
>> terminated with:
>> status = StatusCode.UNKNOWN
>> details = "*Exception calling application: Value out of range: 
>> 2147483648*"
>> debug_error_string = 
>> "{"created":"@1587649701.194973268","description":"Error received from 
>> peer 
>> ipv6:[::1]:","file":"src/core/lib/surface/call.cc","file_line":1056,"grpc_message":"Exception
>>  
>> calling application: Value out of range: 2147483648","grpc_status":2}"
>>
>> Regards,
>> VigneshDhanraj G
>>
>> -- 
>> You received this message because you are subscribed to the Google 
>> Groups "grpc.io" group.
>> To unsubscribe from this group and stop receiving emails from it, 
>> send an email to grp...@googlegroups.com.
>> To view this discussion on the web visit 
>> https://groups.google.com/d/msgid/grpc-io/cbc945c2-6d3a-4d2b-a52f-2a6b59a9dfba%40googlegrou

Re: [grpc-io] Large Files not able to upload even as chunks

2020-04-27 Thread Thomas Mercier
The maximum value of an int32 is 2,147,483,647. Why are you using a signed
type for length in the first place though?

On Mon, Apr 27, 2020 at 12:01 PM VigneshDhanraj G <
vigneshdhanra...@gmail.com> wrote:

> Thanks Michael,
>
> syntax = "proto3";
>
> service FileServer {
>   rpc upload(stream Chunk) returns (Reply) {}
>   rpc download(Request) returns (stream Chunk) {}
> }
>
> message Chunk {
>   bytes buffer = 1;
> }
>
> message Request {
>   string name = 1;
> }
>
> message Reply {
>   int32 length = 1;
>
> and my client.py
>
>
> def get_file_chunks(filename):
> with open(filename, 'rb') as f:
> while True:
> piece = f.read(CHUNK_SIZE);
> if len(piece) == 0:
> return
> yield chunk_pb2.Chunk(buffer=piece)
>
>
> def save_chunks_to_file(chunks, filename):
> with open(filename, 'wb') as f:
> for chunk in chunks:
> f.write(chunk.buffer)
>
>
> class FileClient:
> def __init__(self, address):
> channel = grpc.insecure_channel(address)
> self.stub = chunk_pb2_grpc.FileServerStub(channel)
>
> def upload(self, in_file_name):
> chunks_generator = get_file_chunks(in_file_name)
> response = self.stub.upload(chunks_generator)
> assert response.length == os.path.getsize(in_file_name)
>
> def download(self, target_name, out_file_name):
> response = self.stub.download(chunk_pb2.Request(name=target_name))
> save_chunks_to_file(response, out_file_name)
>
>
> if __name__ == '__main__':
> client = FileClient('localhost:')
>
> # demo for file uploading
> in_file_name = sys.argv[1]
> client.upload(in_file_name)
>
>
>
>
> On Tuesday, April 28, 2020 at 12:13:47 AM UTC+5:30, Michael Webster wrote:
>>
>> Do you have any snippets you can share from your code?  I use python-grpc
>> in another project for transferring files and I've never had an issue with
>> files > 2gb, with 1mb chunks (local network operations).
>>
>> On Monday, April 27, 2020 at 7:08:50 PM UTC+1, VigneshDhanraj G wrote:
>>>
>>> Thanks Mya,
>>>
>>> There is no any error on the server and  i am getting error if i upload
>>> more than 2GB file, i am constanly uploading chunk on the storge.
>>>
>>> On Monday, April 27, 2020 at 8:42:50 PM UTC+5:30, Mya Pitzeruse wrote:

 Is there an associated error on the server? The error message suggests
 a server error with an index out of bounds exception: 2^31. Only way I
 could see something like that happening is if the file was being buffered
 on the server side in memory.

 On Mon, Apr 27, 2020 at 6:56 AM VigneshDhanraj G 
 wrote:

> Hi Team,
>
> I am not able to upload large files more than 2GB even after chunk. I
> have found the file is uploaded still exeception raised? Please help me to
> understand the issue here and way to fix this problem.
>
> Traceback (most recent call last):
>   File "demo_client.py", line 12, in 
> client.upload(in_file_name)
>   File
> "/home/vigneshdhanraj/Project/grpc-upload/grpc-file-transfer/src/lib.py",
> line 34, in upload
> response = self.stub.upload(chunks_generator)
>   File
> "/home/vigneshdhanraj/Project/grpc-upload/myenv/lib/python3.6/site-packages/grpc/_channel.py",
> line 1011, in __call__
> return _end_unary_response_blocking(state, call, False, None)
>   File
> "/home/vigneshdhanraj/Project/grpc-upload/myenv/lib/python3.6/site-packages/grpc/_channel.py",
> line 729, in _end_unary_response_blocking
> raise _InactiveRpcError(state)
> grpc._channel._InactiveRpcError: <_InactiveRpcError of RPC that
> terminated with:
> status = StatusCode.UNKNOWN
> details = "*Exception calling application: Value out of range:
> 2147483648*"
> debug_error_string =
> "{"created":"@1587649701.194973268","description":"Error received from 
> peer
> ipv6:[::1]:","file":"src/core/lib/surface/call.cc","file_line":1056,"grpc_message":"Exception
> calling application: Value out of range: 2147483648","grpc_status":2}"
>
> Regards,
> VigneshDhanraj G
>
> --
> You received this message because you are subscribed to the Google
> Groups "grpc.io" group.
> To unsubscribe from this group and stop receiving emails from it, send
> an email to grp...@googlegroups.com.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/grpc-io/cbc945c2-6d3a-4d2b-a52f-2a6b59a9dfba%40googlegroups.com
> 
> .
>


 --

 Mya Pitzeruse

 Principal Software Engineer - Service Infrastructure

 Gender Pronouns: She, Her, Hers

 mjp...@indeed.com


 Indeed - We help people get jobs.

 Indeed.com 

Re: [grpc-io] Large Files not able to upload even as chunks

2020-04-27 Thread VigneshDhanraj G
Thanks Michael,

syntax = "proto3";

service FileServer {
  rpc upload(stream Chunk) returns (Reply) {}
  rpc download(Request) returns (stream Chunk) {}
}

message Chunk {
  bytes buffer = 1;
}

message Request {
  string name = 1;
}

message Reply {
  int32 length = 1;

and my client.py


def get_file_chunks(filename):
with open(filename, 'rb') as f:
while True:
piece = f.read(CHUNK_SIZE);
if len(piece) == 0:
return
yield chunk_pb2.Chunk(buffer=piece)


def save_chunks_to_file(chunks, filename):
with open(filename, 'wb') as f:
for chunk in chunks:
f.write(chunk.buffer)


class FileClient:
def __init__(self, address):
channel = grpc.insecure_channel(address)
self.stub = chunk_pb2_grpc.FileServerStub(channel)

def upload(self, in_file_name):
chunks_generator = get_file_chunks(in_file_name)
response = self.stub.upload(chunks_generator)
assert response.length == os.path.getsize(in_file_name)

def download(self, target_name, out_file_name):
response = self.stub.download(chunk_pb2.Request(name=target_name))
save_chunks_to_file(response, out_file_name)


if __name__ == '__main__':
client = FileClient('localhost:')

# demo for file uploading
in_file_name = sys.argv[1]
client.upload(in_file_name)




On Tuesday, April 28, 2020 at 12:13:47 AM UTC+5:30, Michael Webster wrote:
>
> Do you have any snippets you can share from your code?  I use python-grpc 
> in another project for transferring files and I've never had an issue with 
> files > 2gb, with 1mb chunks (local network operations).
>
> On Monday, April 27, 2020 at 7:08:50 PM UTC+1, VigneshDhanraj G wrote:
>>
>> Thanks Mya, 
>>
>> There is no any error on the server and  i am getting error if i upload 
>> more than 2GB file, i am constanly uploading chunk on the storge.
>>
>> On Monday, April 27, 2020 at 8:42:50 PM UTC+5:30, Mya Pitzeruse wrote:
>>>
>>> Is there an associated error on the server? The error message suggests a 
>>> server error with an index out of bounds exception: 2^31. Only way I could 
>>> see something like that happening is if the file was being buffered on the 
>>> server side in memory.
>>>
>>> On Mon, Apr 27, 2020 at 6:56 AM VigneshDhanraj G  
>>> wrote:
>>>
 Hi Team,

 I am not able to upload large files more than 2GB even after chunk. I 
 have found the file is uploaded still exeception raised? Please help me to 
 understand the issue here and way to fix this problem.

 Traceback (most recent call last):
   File "demo_client.py", line 12, in 
 client.upload(in_file_name)
   File 
 "/home/vigneshdhanraj/Project/grpc-upload/grpc-file-transfer/src/lib.py", 
 line 34, in upload
 response = self.stub.upload(chunks_generator)
   File 
 "/home/vigneshdhanraj/Project/grpc-upload/myenv/lib/python3.6/site-packages/grpc/_channel.py",
  
 line 1011, in __call__
 return _end_unary_response_blocking(state, call, False, None)
   File 
 "/home/vigneshdhanraj/Project/grpc-upload/myenv/lib/python3.6/site-packages/grpc/_channel.py",
  
 line 729, in _end_unary_response_blocking
 raise _InactiveRpcError(state)
 grpc._channel._InactiveRpcError: <_InactiveRpcError of RPC that 
 terminated with:
 status = StatusCode.UNKNOWN
 details = "*Exception calling application: Value out of range: 
 2147483648*"
 debug_error_string = 
 "{"created":"@1587649701.194973268","description":"Error received from 
 peer 
 ipv6:[::1]:","file":"src/core/lib/surface/call.cc","file_line":1056,"grpc_message":"Exception
  
 calling application: Value out of range: 2147483648","grpc_status":2}"

 Regards,
 VigneshDhanraj G

 -- 
 You received this message because you are subscribed to the Google 
 Groups "grpc.io" group.
 To unsubscribe from this group and stop receiving emails from it, send 
 an email to grp...@googlegroups.com.
 To view this discussion on the web visit 
 https://groups.google.com/d/msgid/grpc-io/cbc945c2-6d3a-4d2b-a52f-2a6b59a9dfba%40googlegroups.com
  
 
 .

>>>
>>>
>>> -- 
>>>
>>> Mya Pitzeruse
>>>
>>> Principal Software Engineer - Service Infrastructure
>>>
>>> Gender Pronouns: She, Her, Hers
>>>
>>> mjp...@indeed.com
>>>
>>>
>>> Indeed - We help people get jobs.
>>>
>>> Indeed.com 
>>>
>>> Facebook   |  Twitter 
>>>   |  Instagram 
>>> 
>>>
>>

-- 
You received this message because you are subscribed to the Google Groups 
"grpc.io" group.
To unsubscribe from this group and stop receiving emails from it, send a

Re: [grpc-io] Re: gRPC C++ Installation Issue

2020-04-27 Thread Patrice Chalin
+Jan Tattermusch , Eric and I discussed
the following during our Docs WG meeting: to avoid users facing this
problem again, how about if we changed the min version of cmake from the
current 3.5.1 to, say, 3.13

cmake_minimum_required(VERSION 3.13)


in either the C++ hello world cmake config:

   -
   
https://github.com/grpc/grpc/blob/master/examples/cpp/helloworld/CMakeLists.txt#L20

and/or to the (top-level) grpc cmake config?

   - https://github.com/grpc/grpc/blob/master/CMakeLists.txt#L25

(and maybe the other C++ examples too?)

cc +Eric Anderson 


On Wed, Apr 22, 2020 at 11:38 AM John Leidel  wrote:

> Patrice, I updated CMake to something newer within range and the
> build+install appears to work.  I have some other issues to get ironed
> out in order to sync our external packages with the updated Cmake
> scripts, but I suspect this was the major issue.  Thanks for the help!
>
> best
> john
>
> On Wed, Apr 22, 2020 at 10:22 AM John Leidel 
> wrote:
> >
> > Patrice, thanks for the quick response.  I was, in fact, using the
> > updated C++ Quick Start directions.  However, I did find that my CMake
> > version was slightly out of date (3.10.X).  I'm updating CMake and
> > will report back as soon as I can get a clean build.
> >
> > On Wed, Apr 22, 2020 at 10:08 AM Patrice Chalin 
> wrote:
> > >
> > > Hi John,
> > >
> > > I recently updated the C++ Quick Start, which now describes how to
> "build and locally install gRPC before building and running this quick
> start’s Hello World example." I've tested the instructions on Ubuntu 18.04
> LTS and haven't had any issues. Maybe you can give those instructions a
> try? (Which version of cmake are you using? You'll need 3.13+.)
> > >
> > > Best,
> > > Patrice
> > >
> > > On Wednesday, April 22, 2020 at 11:00:01 AM UTC-4, John Leidel wrote:
> > >>
> > >> All, its been quite some time since I last built+installed gRPC from
> source.  I'm attempting to build+install on Ubuntu 18.04 LTS from source
> and I can't seem to get the libgrpc++* libraries to install.  I'm following
> the directions on the gRPC building guide, but regardless of the
> version/options I choose, the build refuses to install the necessary
> libraries.  So far, I've tried the current master branch (HEAD), v1.28.1,
> v.1.27.2, v.1.25.0 and they all fail.
> > >>
> > >> Build method:
> > >> $> git clone --recurse-submodules -b v1.28.1
> https://github.com/grpc/grpc
> > >> $> cd grpc
> > >> $> mkdir -p cmake/build
> > >> $> cd cmake/build
> > >> $> cmake -DCMAKE_INSTALL_PREFIX=/home/user/grpc -DgRPC_INSTALL=ON
> ../../
> > >> $> make -j
> > >> $> make install
> > >>
> > >> where `/home/user/grpc` is a directory within my home directory.
>  I see the following libs installed:
> > >> libcares.a  libprotobuf.a  libprotobuf-lite.a  libprotoc.a  libz.a
> libz.so
> > >>
> > >> libgrpc++.a (and its other variants) are built via cmake, but they're
> not installed.  As an aside, I also tried manually enabling the CPP plugin
> in the cmake build, but it delivers the same results.
> > >>
> > >> I've also tried building the helloworld test from within the source
> tree as directed by the instructions on Github.  It fails to find a cmake
> dependency from the install:
> > >> CMake Error at /home/user/grpc/lib/cmake/grpc/gRPCConfig.cmake:12
> (include):
> > >>   include could not find load file:
> > >>
> > >> /home/user/grpc/lib/cmake/grpc/gRPCTargets.cmake
> > >> Call Stack (most recent call first):
> > >>   CMakeLists.txt:116 (find_package)
> > >>
> > >>
> > >> Any thoughts?
> > >
> > > --
> > > You received this message because you are subscribed to the Google
> Groups "grpc.io" group.
> > > To unsubscribe from this group and stop receiving emails from it, send
> an email to grpc-io+unsubscr...@googlegroups.com.
> > > To view this discussion on the web visit
> https://groups.google.com/d/msgid/grpc-io/c002f687-423f-4e03-83ad-c6b11f806647%40googlegroups.com
> .
>

-- 
You received this message because you are subscribed to the Google Groups 
"grpc.io" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to grpc-io+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/grpc-io/CAGzN0bbbUpVoGo-mb9H0mgzXwkJw_fdCep_f7S2Jbz6b45jpdg%40mail.gmail.com.


Re: [grpc-io] Large Files not able to upload even as chunks

2020-04-27 Thread Michael Webster
Do you have any snippets you can share from your code?  I use python-grpc 
in another project for transferring files and I've never had an issue with 
files > 2gb, with 1mb chunks (local network operations).

On Monday, April 27, 2020 at 7:08:50 PM UTC+1, VigneshDhanraj G wrote:
>
> Thanks Mya, 
>
> There is no any error on the server and  i am getting error if i upload 
> more than 2GB file, i am constanly uploading chunk on the storge.
>
> On Monday, April 27, 2020 at 8:42:50 PM UTC+5:30, Mya Pitzeruse wrote:
>>
>> Is there an associated error on the server? The error message suggests a 
>> server error with an index out of bounds exception: 2^31. Only way I could 
>> see something like that happening is if the file was being buffered on the 
>> server side in memory.
>>
>> On Mon, Apr 27, 2020 at 6:56 AM VigneshDhanraj G  
>> wrote:
>>
>>> Hi Team,
>>>
>>> I am not able to upload large files more than 2GB even after chunk. I 
>>> have found the file is uploaded still exeception raised? Please help me to 
>>> understand the issue here and way to fix this problem.
>>>
>>> Traceback (most recent call last):
>>>   File "demo_client.py", line 12, in 
>>> client.upload(in_file_name)
>>>   File 
>>> "/home/vigneshdhanraj/Project/grpc-upload/grpc-file-transfer/src/lib.py", 
>>> line 34, in upload
>>> response = self.stub.upload(chunks_generator)
>>>   File 
>>> "/home/vigneshdhanraj/Project/grpc-upload/myenv/lib/python3.6/site-packages/grpc/_channel.py",
>>>  
>>> line 1011, in __call__
>>> return _end_unary_response_blocking(state, call, False, None)
>>>   File 
>>> "/home/vigneshdhanraj/Project/grpc-upload/myenv/lib/python3.6/site-packages/grpc/_channel.py",
>>>  
>>> line 729, in _end_unary_response_blocking
>>> raise _InactiveRpcError(state)
>>> grpc._channel._InactiveRpcError: <_InactiveRpcError of RPC that 
>>> terminated with:
>>> status = StatusCode.UNKNOWN
>>> details = "*Exception calling application: Value out of range: 
>>> 2147483648*"
>>> debug_error_string = 
>>> "{"created":"@1587649701.194973268","description":"Error received from peer 
>>> ipv6:[::1]:","file":"src/core/lib/surface/call.cc","file_line":1056,"grpc_message":"Exception
>>>  
>>> calling application: Value out of range: 2147483648","grpc_status":2}"
>>>
>>> Regards,
>>> VigneshDhanraj G
>>>
>>> -- 
>>> You received this message because you are subscribed to the Google 
>>> Groups "grpc.io" group.
>>> To unsubscribe from this group and stop receiving emails from it, send 
>>> an email to grp...@googlegroups.com.
>>> To view this discussion on the web visit 
>>> https://groups.google.com/d/msgid/grpc-io/cbc945c2-6d3a-4d2b-a52f-2a6b59a9dfba%40googlegroups.com
>>>  
>>> 
>>> .
>>>
>>
>>
>> -- 
>>
>> Mya Pitzeruse
>>
>> Principal Software Engineer - Service Infrastructure
>>
>> Gender Pronouns: She, Her, Hers
>>
>> mjp...@indeed.com
>>
>>
>> Indeed - We help people get jobs.
>>
>> Indeed.com 
>>
>> Facebook   |  Twitter 
>>   |  Instagram 
>> 
>>
>

-- 
You received this message because you are subscribed to the Google Groups 
"grpc.io" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to grpc-io+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/grpc-io/5734e8f3-5c2d-4690-ab2f-2cfa079ee5d1%40googlegroups.com.


Re: [grpc-io] Large Files not able to upload even as chunks

2020-04-27 Thread VigneshDhanraj G
Thanks Mya, 

There is no any error on the server and  i am getting error if i upload 
more than 2GB file, i am constanly uploading chunk on the storge.

On Monday, April 27, 2020 at 8:42:50 PM UTC+5:30, Mya Pitzeruse wrote:
>
> Is there an associated error on the server? The error message suggests a 
> server error with an index out of bounds exception: 2^31. Only way I could 
> see something like that happening is if the file was being buffered on the 
> server side in memory.
>
> On Mon, Apr 27, 2020 at 6:56 AM VigneshDhanraj G  > wrote:
>
>> Hi Team,
>>
>> I am not able to upload large files more than 2GB even after chunk. I 
>> have found the file is uploaded still exeception raised? Please help me to 
>> understand the issue here and way to fix this problem.
>>
>> Traceback (most recent call last):
>>   File "demo_client.py", line 12, in 
>> client.upload(in_file_name)
>>   File 
>> "/home/vigneshdhanraj/Project/grpc-upload/grpc-file-transfer/src/lib.py", 
>> line 34, in upload
>> response = self.stub.upload(chunks_generator)
>>   File 
>> "/home/vigneshdhanraj/Project/grpc-upload/myenv/lib/python3.6/site-packages/grpc/_channel.py",
>>  
>> line 1011, in __call__
>> return _end_unary_response_blocking(state, call, False, None)
>>   File 
>> "/home/vigneshdhanraj/Project/grpc-upload/myenv/lib/python3.6/site-packages/grpc/_channel.py",
>>  
>> line 729, in _end_unary_response_blocking
>> raise _InactiveRpcError(state)
>> grpc._channel._InactiveRpcError: <_InactiveRpcError of RPC that 
>> terminated with:
>> status = StatusCode.UNKNOWN
>> details = "*Exception calling application: Value out of range: 
>> 2147483648*"
>> debug_error_string = 
>> "{"created":"@1587649701.194973268","description":"Error received from peer 
>> ipv6:[::1]:","file":"src/core/lib/surface/call.cc","file_line":1056,"grpc_message":"Exception
>>  
>> calling application: Value out of range: 2147483648","grpc_status":2}"
>>
>> Regards,
>> VigneshDhanraj G
>>
>> -- 
>> You received this message because you are subscribed to the Google Groups 
>> "grpc.io" group.
>> To unsubscribe from this group and stop receiving emails from it, send an 
>> email to grp...@googlegroups.com .
>> To view this discussion on the web visit 
>> https://groups.google.com/d/msgid/grpc-io/cbc945c2-6d3a-4d2b-a52f-2a6b59a9dfba%40googlegroups.com
>>  
>> 
>> .
>>
>
>
> -- 
>
> Mya Pitzeruse
>
> Principal Software Engineer - Service Infrastructure
>
> Gender Pronouns: She, Her, Hers
>
> mjp...@indeed.com 
>
>
> Indeed - We help people get jobs.
>
> Indeed.com 
>
> Facebook   |  Twitter 
>   |  Instagram 
> 
>

-- 
You received this message because you are subscribed to the Google Groups 
"grpc.io" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to grpc-io+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/grpc-io/215b3eaa-d135-41ac-a49a-511107158784%40googlegroups.com.


Re: [grpc-io] Large Files not able to upload even as chunks

2020-04-27 Thread 'Mya Pitzeruse' via grpc.io
Is there an associated error on the server? The error message suggests a
server error with an index out of bounds exception: 2^31. Only way I could
see something like that happening is if the file was being buffered on the
server side in memory.

On Mon, Apr 27, 2020 at 6:56 AM VigneshDhanraj G 
wrote:

> Hi Team,
>
> I am not able to upload large files more than 2GB even after chunk. I have
> found the file is uploaded still exeception raised? Please help me to
> understand the issue here and way to fix this problem.
>
> Traceback (most recent call last):
>   File "demo_client.py", line 12, in 
> client.upload(in_file_name)
>   File
> "/home/vigneshdhanraj/Project/grpc-upload/grpc-file-transfer/src/lib.py",
> line 34, in upload
> response = self.stub.upload(chunks_generator)
>   File
> "/home/vigneshdhanraj/Project/grpc-upload/myenv/lib/python3.6/site-packages/grpc/_channel.py",
> line 1011, in __call__
> return _end_unary_response_blocking(state, call, False, None)
>   File
> "/home/vigneshdhanraj/Project/grpc-upload/myenv/lib/python3.6/site-packages/grpc/_channel.py",
> line 729, in _end_unary_response_blocking
> raise _InactiveRpcError(state)
> grpc._channel._InactiveRpcError: <_InactiveRpcError of RPC that terminated
> with:
> status = StatusCode.UNKNOWN
> details = "*Exception calling application: Value out of range:
> 2147483648*"
> debug_error_string =
> "{"created":"@1587649701.194973268","description":"Error received from peer
> ipv6:[::1]:","file":"src/core/lib/surface/call.cc","file_line":1056,"grpc_message":"Exception
> calling application: Value out of range: 2147483648","grpc_status":2}"
>
> Regards,
> VigneshDhanraj G
>
> --
> You received this message because you are subscribed to the Google Groups "
> grpc.io" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to grpc-io+unsubscr...@googlegroups.com.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/grpc-io/cbc945c2-6d3a-4d2b-a52f-2a6b59a9dfba%40googlegroups.com
> 
> .
>


-- 

Mya Pitzeruse

Principal Software Engineer - Service Infrastructure

Gender Pronouns: She, Her, Hers

mjp...@indeed.com


Indeed - We help people get jobs.

Indeed.com 

Facebook   |  Twitter
  |  Instagram


-- 
You received this message because you are subscribed to the Google Groups 
"grpc.io" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to grpc-io+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/grpc-io/CAHa8AVTchiFqpokohQjsQ%3D7eunj1um3Gxuq%3DN-k%3DJDmYJWa4Eg%40mail.gmail.com.


[grpc-io] Large Files not able to upload even as chunks

2020-04-27 Thread VigneshDhanraj G
Hi Team,

I am not able to upload large files more than 2GB even after chunk. I have 
found the file is uploaded still exeception raised? Please help me to 
understand the issue here and way to fix this problem.

Traceback (most recent call last):
  File "demo_client.py", line 12, in 
client.upload(in_file_name)
  File 
"/home/vigneshdhanraj/Project/grpc-upload/grpc-file-transfer/src/lib.py", 
line 34, in upload
response = self.stub.upload(chunks_generator)
  File 
"/home/vigneshdhanraj/Project/grpc-upload/myenv/lib/python3.6/site-packages/grpc/_channel.py",
 
line 1011, in __call__
return _end_unary_response_blocking(state, call, False, None)
  File 
"/home/vigneshdhanraj/Project/grpc-upload/myenv/lib/python3.6/site-packages/grpc/_channel.py",
 
line 729, in _end_unary_response_blocking
raise _InactiveRpcError(state)
grpc._channel._InactiveRpcError: <_InactiveRpcError of RPC that terminated 
with:
status = StatusCode.UNKNOWN
details = "*Exception calling application: Value out of range: 
2147483648*"
debug_error_string = 
"{"created":"@1587649701.194973268","description":"Error received from peer 
ipv6:[::1]:","file":"src/core/lib/surface/call.cc","file_line":1056,"grpc_message":"Exception
 
calling application: Value out of range: 2147483648","grpc_status":2}"

Regards,
VigneshDhanraj G

-- 
You received this message because you are subscribed to the Google Groups 
"grpc.io" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to grpc-io+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/grpc-io/cbc945c2-6d3a-4d2b-a52f-2a6b59a9dfba%40googlegroups.com.


[grpc-io] CompletionQueue life time in a async server

2020-04-27 Thread afshin . pir
Hi all

I was wondering if I should extend lifetime of a CompletionQueue according 
to lifetime of a rpc call in a async server or it has been checked 
internally. As an example, let's check the the simple async helloworld 
server here 
.
 
Now if we assume that processing phase takes a lot of time, two situation 
may happen:

   1. Application may go into stopping phase before we try to write back 
   results. From stopping phase, I mean when Shutdown() method is called for 
   Server and CompletionQueue. What happens if I write in a CompletionQueue 
*after 
   *it is shutdown? Will they just be ignored? I found in Shutdown() docs 
   that application should not enqueue anything after shutdown is called (and 
   I suppose Write() or Finish() enqueues). Does this mean that I should 
   manually check if a CompletionQueue is shutting down via a secondary 
   flag(because I could not find anything that shows a completion queue is 
   shutting down) before doing anything? 
   2. If I have set an Alarm on my CompletionQueue, should I cancel it 
   before shutting down the CompletionQueue? Because an alarm may expire after 
   I started shutting down the queue.
   
Since grpc samples are primitive, there are a lot of conditions that is not 
checked in them and I'm not sure what exactly happens in these case. Is 
these any example for a simple rpc request that handles these conditions 
better?

-- 
You received this message because you are subscribed to the Google Groups 
"grpc.io" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to grpc-io+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/grpc-io/538638c9-5171-4a78-afef-a58f4e349fb7%40googlegroups.com.