Re: [Pvfs2-developers] problems creating new trove-simple interface

2006-06-28 Thread Walter B. Ligon III
John, I'm not sure I completely understand what you are doing, but it SOUNDS to me like what you need is to write a distribution for your situation. You really shouldn't have to change Trove, as all it does is read or write the segments as dictated by the distribution. Writing a distributi

Re: [Pvfs2-developers] problems creating new trove-simple interface

2006-06-28 Thread Sam Lang
On June 28, 2006, at 9:46AM, John Bent wrote: Thanks Sam, Sadly, however, your suggestion did not just work directly out of the box. The servers are not at the correct logical offsets and are overwriting each other. Additionally, your approach suffers the same problem that mine did which

Re: [Pvfs2-developers] problems creating new trove-simple interface

2006-06-28 Thread Bradley W Settlemyer
Well, to my mind the problem is that the client won't know to divy up the requests to more than 1 server with the basic dist. But I'm not 100% certain that's accurate. If you have the client sending the work to all of the servers, then the basic dist will translate logical to physical offsets

Re: [Pvfs2-developers] problems creating new trove-simple interface

2006-06-28 Thread John Bent
Thanks Sam, Sadly, however, your suggestion did not just work directly out of the box. The servers are not at the correct logical offsets and are overwriting each other. Additionally, your approach suffers the same problem that mine did which is that each datafile (which is actually now the same

Re: [Pvfs2-developers] problems creating new trove-simple interface

2006-06-27 Thread Sam Lang
Hi John, I think the best way (others can correct me) to modify the pvfs2 code to get the trove layer to operate on the logical offsets and sizes is in the flow code (flowproto_multiqueue.c). My reasoning is that the flow layer converts the PVFS_Request structure into the physical offse

Re: [Pvfs2-developers] problems creating new trove-simple interface

2006-06-27 Thread John Bent
Ok, I've removed the footnote. Now I'm doing everything within the new trove layer and no longer doing it in the PINT_distribute although I did change some things slightly. The problem was that PINT_ADD_SEGMENT was combining the segments assuming they were in their own individual stripe. However

[Pvfs2-developers] problems creating new trove-simple interface

2006-06-27 Thread John Bent
Hello, I'm working on a pet research project in which I'm (somewhat abashedly) actually _removing_ functionality from PVFS2. What I'm trying to do is create a new trove interface in which requests to disk are no longer logically striped across multiple PVFS2 servers each with its own physical st