Re: [Pvfs2-developers] Re: [Pvfs2-users] OrangeFS on nodes with different storage space capacities.

2012-03-06 Thread Phil Carns
On 03/06/2012 12:20 AM, Andrew Savchenko wrote: Hello, On Wed, 22 Feb 2012 10:45:56 -0500 Becky Ligon wrote: Let us know how it goes. It goes not that well. For now I test on a double server setup on a single host (kernel 3.1.10). I can't get varstrip_dist to work at all. Due to some unknown

Re: [Pvfs2-developers] Re: Pvfs2-developers Digest, Vol 71, Issue 13

2012-01-27 Thread Phil Carns
It is in the range for server 10.10.8.10, actually. That part looks ok. It looks like you are setting up a configuration with exactly two servers; one that is dedicated to metadata and one that is dedicated to file data. Is that correct? -Phil On 01/27/2012 02:38 AM, Dimokritos Stamatakis

Re: [Pvfs2-developers] Re: pvfs2 check root handle failed error

2012-01-26 Thread Phil Carns
Hi Dimos, You might want to post your current conf file again. In there you should see a line that says something like RootHandle 1048576. That is the identifier for the root handle that pvfs2-ping is trying to find in the file system. If you then look a little further down in the

Re: [Pvfs2-developers] Re: Pvfs2-developers Digest, Vol 71, Issue 7

2012-01-24 Thread Phil Carns
-developers-ow...@beowulf-underground.org When replying, please edit your Subject line so it is more specific than Re: Contents of Pvfs2-developers digest... Today's Topics: 1. Re: pvfs2 server bind problem (Phil Carns

Re: [Pvfs2-developers] pvfs2 server bind problem

2012-01-23 Thread Phil Carns
Hi Dimos, By default (unless you use the TCPBindSpecific flag in the conf file, which you are not) the server should just try to bind to listen on *:3334, no matter what hostname or IP address you put in the conf file. In other words, it ignores the hostname and just listens for connections

Re: [Pvfs2-developers] question about pvfs2-cp

2011-11-23 Thread Phil Carns
Oh, and as a side note, will your protocol eventually support sizes larger than 8kb? You probably know this already, but 8kb won't be a very efficient access size for most hard drives, regardless of your network characteristics. -Phil On 11/23/2011 03:25 PM, Phil Carns wrote: Hi Mikhail

Re: [Pvfs2-developers] question about bmi_addr_drop

2011-10-25 Thread Phil Carns
The pvfs2-server daemon never calls that function directly; it is internal to BMI. Are you talking about the BMI_set_info(... BMI_DEC_ADDR_REF ...) calls instead? -Phil On 10/25/2011 07:39 AM, ?? wrote: Hi! In what cases pvfs2-server calls bmi_addr_drop? Can server call

Re: [Pvfs2-developers] PINT_client_wait_internal: Assertion `smcb' failed. (during write) orangefs-2.8.4

2011-10-17 Thread Phil Carns
On 10/17/2011 02:00 AM, Adam Yee wrote: Dear developers and users, The printed error message: api-server: src/client/sysint/client-state-machine.c:862: PINT_client_wait_internal: Assertion `smcb' failed. /var/log/messages Oct 16 22:54:29 server1 kernel: [ 3135.813404] api-server[10854]:

Re: [Pvfs2-developers] PINT_client_wait_internal: Assertion `smcb' failed. (during write) orangefs-2.8.4

2011-10-17 Thread Phil Carns
Great- I'm glad I was able to help. -Phil On 10/17/2011 06:58 PM, Adam Yee wrote: Phil! It was the offset type declared as an int instead of uint64_t. Thanks for getting back to me so quickly. Super helpful. Adam On Mon, Oct 17, 2011 at 12:43 PM, Phil Carns ca...@mcs.anl.gov mailto:ca

Re: [Pvfs2-developers] PVFS_sys_lookup causing a crash, v2.8.4

2011-10-10 Thread Phil Carns
Hi Adam, I don't have any guesses as to what's going wrong, but you might want to try running your application through valgrind to see if it gives you any further information. That segfault that you listed below might not be the original source of the problem. -Phil On 10/04/2011 07:25

Re: [Pvfs2-developers] question about bmi_post_recv_list

2011-09-26 Thread Phil Carns
Just to clarify, are you talking about multiple buffers in a single post_recv_list() call, or are there multiple calls to post_recv_list()? -Phil On 09/26/2011 07:55 AM, ?? wrote: Hi, my bmi method's post_recv_list function tryes to receive N messages. M messages received

Re: [Pvfs2-developers] question about bmi_post_sendunexpected_list

2011-09-26 Thread Phil Carns
That looks like a bug :) Good catch! -Phil On 09/26/2011 03:16 AM, ?? wrote: Hi, in bmi.c in function bmi_post_sendunexpected_list: if (tmp_ref-interface-post_send_list) { ret = tmp_ref-interface-post_sendunexpected_list( id, tmp_ref-method_addr, buffer_list, size_list,

Re: [Pvfs2-developers] Some quesions about the error:PVFS_EADDRINUSE

2011-07-25 Thread Phil Carns
Are you totally sure that the servers are exiting before you restart them? PVFS uses the SO_REUSEADDR socket option which is supposed to avoid this problem in most cases. -Phil On 07/24/2011 01:47 AM, ??? wrote: I made some small changes in the process of creating a file using

Re: [Pvfs2-developers] [SOLVED] Server memory leak

2011-07-08 Thread Phil Carns
belongs inside of the PINT_manager_complete_op function. Thoughts? Becky On Thu, Jul 7, 2011 at 5:06 PM, Benjamin Severs seversbenja...@gmail.com mailto:seversbenja...@gmail.com wrote: Thanks to some direction by Phil Carns, we've managed to correct the memory leak that was affecting

Re: [Pvfs2-developers] [SOLVED] Server memory leak

2011-07-08 Thread Phil Carns
On 07/08/2011 09:44 AM, Becky Ligon wrote: Thanks for explaining that. So, if we had just freed the op but not unregistered it, there still would have been a memory leak? Becky With the safe_register functions, yes. With the fast_register functions, no. -Phil

Re: [Pvfs2-developers] OrangeFS data corruption

2011-06-24 Thread Phil Carns
On 06/24/2011 10:15 AM, Michael Moore wrote: With some additional offline information from Benjamin the problem has been tracked down to dbpf_bstream_direct_write_op_svc(). The issue is that two write calls to different, contiguous, sections of the file occur without locking around retrieval of

Re: [Pvfs2-developers] OrangeFS data corruption

2011-06-24 Thread Phil Carns
On 06/24/2011 10:43 AM, Michael Moore wrote: On Fri, Jun 24, 2011 at 10:33 AM, Phil Carns ca...@mcs.anl.gov mailto:ca...@mcs.anl.gov wrote: On 06/24/2011 10:15 AM, Michael Moore wrote: With some additional offline information from Benjamin the problem has been

Re: [Pvfs2-developers] Precreate functions

2011-06-02 Thread Phil Carns
I share Michael's curiosity as well, but I think it might be possible to disable the precreate functionality using config file options if you really need to (not recommended): Set the FileStuffing option to no to prevent the file system from using the file stuffing optimization that relies on

Re: [Pvfs2-developers] Precreate functions

2011-06-02 Thread Phil Carns
how well it would fit. Michael On Thu, Jun 2, 2011 at 8:39 AM, Phil Carns ca...@mcs.anl.gov mailto:ca...@mcs.anl.gov wrote: I share Michael's curiosity as well, but I think it might be possible to disable the precreate functionality using config file options if you really need

Re: [Pvfs2-developers] duplicate entries in the attributes db

2011-05-12 Thread Phil Carns
Thanks Becky! -Phil On 05/12/2011 07:24 AM, Becky Ligon wrote: Thanks, Pbil. We will certainly double check it and then add it to the Orange-branch. Just FYI: we have a warning built into the config generator that Berkeley 4.8 is now recommended. Becky

Re: [Pvfs2-developers] Trouble removing bad files

2010-10-19 Thread Phil Carns
Removing the metadata object for a file does indeed produce the same symptoms we are seeing. It produces a similar effect on 2.8 as well. I believe I was working with Sam and possibly you on this a few weeks ago but had to drop it for something more urgent. Our conversation can be found

Re: [Pvfs2-developers] Trouble removing bad files

2010-10-11 Thread Phil Carns
, 2010 at 3:13 PM, Phil Carns ca...@mcs.anl.gov mailto:ca...@mcs.anl.gov wrote: Hi Bart, Can you run pvfs2-stat on one of the files, and also send along the fs.conf file? pvfs2-stat might be helpful because it shows the metadata handle value. We can compare that value

Re: [Pvfs2-developers] Trouble removing bad files

2010-10-11 Thread Phil Carns
for recent BDB releases, in case anyone else needs to build 2.6 on a modern box. I also found that I had to use the DBCacheType mmap option in the server config file. I can't get the kernel module working, so I stuck to command line utilities. -Phil On 10/11/2010 09:23 AM, Phil Carns wrote

Re: [Pvfs2-developers] Trouble removing bad files

2010-10-11 Thread Phil Carns
On 10/11/2010 11:11 AM, Phil Carns wrote: I'm not sure how you are getting there yet, but I am able to recreate this state on my laptop with a single server and the pvfs2 admin utilities. The following shows the creation of 4 files. I then get the metadata handle for one of them (via pvfs2

Re: [Pvfs2-developers] Trouble removing bad files

2010-10-11 Thread Phil Carns
- how to make pvfs2-rm safely remove what it can (even if via a force option) - how to get pvfs2-lsplus (and probably other utilities and/or kernel module as well) to report a sane error message instead of the Invalid object message The attached patch fixes the first problem (assuming I'm

Re: [Pvfs2-developers] Trouble removing bad files

2010-10-11 Thread Phil Carns
On 10/11/2010 11:42 AM, Phil Carns wrote: - how to make pvfs2-rm safely remove what it can (even if via a force option) - how to get pvfs2-lsplus (and probably other utilities and/or kernel module as well) to report a sane error message instead of the Invalid object message The attached

Re: [Pvfs2-developers] Trouble removing bad files

2010-10-07 Thread Phil Carns
Hi Bart, Can you run pvfs2-stat on one of the files, and also send along the fs.conf file? pvfs2-stat might be helpful because it shows the metadata handle value. We can compare that value to the handle ranges in the conf file to narrow down whether it is hitting a metadata object that has

Re: [Pvfs2-developers] quandry

2010-07-30 Thread Phil Carns
I think either changing the key or adding separate pools per type would work fine (and probably require a similar amount of work?). The former would mean modifying Trove. Trove does not currently expose the functionality needed to skip to a subset of keys and remove one (which would

Re: [Pvfs2-developers] [patch] dbpf alignment macros

2010-06-21 Thread Phil Carns
On 06/21/2010 11:51 AM, Bart Taylor wrote: Hey guys, We ran into some errors creating large files, and with some direction from Phil, tracked it down to the alignment macros in dbpf-bstream-direct.c. You can see the problem in a directory set to use one dfile with this command: strace dd

Re: [Pvfs2-developers] [patch] dbpf alignment macros

2010-06-21 Thread Phil Carns
Thanks Bart! The patch is in CVS now. This bug affects servers running on 32 bit machines that use the directio trove method. -Phil On 06/21/2010 11:51 AM, Bart Taylor wrote: Hey guys, We ran into some errors creating large files, and with some direction from Phil, tracked it down to the

Re: [Pvfs2-developers] Bad File Entries

2010-06-18 Thread Phil Carns
Hi Bart, Is this on 2.8.2? Do you happen to know how many servers are needed to trigger the problem? thanks, -Phil On 06/17/2010 04:08 PM, Bart Taylor wrote: Hey guys, We have had some problems in the past on 2.6 with file creations leaving bad files that we cannot delete. Most

Re: [Pvfs2-developers] Server core dump with 2.8 branch

2010-05-14 Thread Phil Carns
On Thu, May 13, 2010 at 3:13 PM, Phil Carns ca...@mcs.anl.gov mailto:ca...@mcs.anl.gov wrote: Whoops. Thanks for your patience Bart. Can you try one more time with this additional patch applied? If that fails I'll set up something here to try to reproduce it first hand

Re: [Pvfs2-developers] Server core dump with 2.8 branch

2010-05-13 Thread Phil Carns
Hey Bart, I haven't really tested this change yet, but can you try the attached patch and see if that seems to solve the problem? I think this is follow on to the same bug you guys reported earlier. I just missed another race issue caused by the last patch. -Phil On 05/12/2010 05:18 PM,

Re: [Pvfs2-developers] Server core dump with 2.8 branch

2010-05-13 Thread Phil Carns
was able to run a ping and statfs again, but as soon as I tried to write that file, the server stalled. What other information can I get you? Bart. On Thu, May 13, 2010 at 12:14 PM, Phil Carns ca...@mcs.anl.gov mailto:ca...@mcs.anl.gov wrote: Hey Bart

Re: [Pvfs2-developers] Problem upgrading from 2.6 to 2.8

2010-05-06 Thread Phil Carns
out 1+0 records in 0+0 records out Bart. On Mon, May 3, 2010 at 11:22 AM, Phil Carns ca...@mcs.anl.gov mailto:ca...@mcs.anl.gov wrote: Can you get a server into this state (where everything works except for strip size files), turn on verbose logging, and then try to create a big

Re: [Pvfs2-developers] Problem upgrading from 2.6 to 2.8

2010-05-06 Thread Phil Carns
Actually, it might be good if you could just send me the fs.conf file for your test setup. thanks, -Phil On 05/06/2010 02:26 PM, Phil Carns wrote: Thanks Bart. In your example, what are the names and ports of each of the servers involved? Are they all on the same node (with different ports

Re: [Pvfs2-developers] Problem upgrading from 2.6 to 2.8

2010-05-06 Thread Phil Carns
Ok, I think I was able to reproduce the same thing that you were seeing. Can you try the attached patch and let me know if it fixes things on your end too? thanks! -Phil On 05/06/2010 02:34 PM, Phil Carns wrote: Actually, it might be good if you could just send me the fs.conf file for your

Re: [Pvfs2-developers] Problem upgrading from 2.6 to 2.8

2010-05-03 Thread Phil Carns
on my situation? Bart. On Fri, Apr 16, 2010 at 1:39 PM, Phil Carns ca...@mcs.anl.gov mailto:ca...@mcs.anl.gov wrote: Sadly none of my test boxes will run 2.6 any more, but I have a theory about what the problem might be here. For some background

[Pvfs2-developers] unstable trunk

2010-04-19 Thread Phil Carns
Hi all, Just wanted to give a warning that there might be some unstable changes to BMI (networking) in CVS trunk for a little while. In particular, the current trunk TCP code is not compatibly with 2.8.x. thanks, -Phil ___ Pvfs2-developers mailing

Re: [Pvfs2-developers] Problem upgrading from 2.6 to 2.8

2010-04-16 Thread Phil Carns
Sadly none of my test boxes will run 2.6 any more, but I have a theory about what the problem might be here. For some background, the pvfs2-server daemon does these steps in order (among others): initializes BMI (networking), initializes Trove (storage), and then finally starts processing

[Pvfs2-developers] Re: [Pvfs2-users] Re: Timestamps updated erroneously

2010-04-14 Thread Phil Carns
Thanks for tracking that down, Bart. The patch is in CVS now. -Phil On 03/11/2010 10:36 AM, Bart Taylor wrote: After some further digging and off-list help from Phil, we determined that the pvfs2_inode structures were not being properly initialized. PVFS2 is using slab cache for the

Re: [Pvfs2-developers] PVFS 2.8.2 kernel panics

2010-03-29 Thread Phil Carns
I'm guessing it may be a conflict in the ioctl numbers across the two modules. It looks like the compat registration function is global: http://lxr.linux.no/#linux-bk+v2.6.9/fs/compat.c#L310 Maybe there is something in the error handling after that point that caused the actual panic. We

Re: [Pvfs2-developers] datetime gossip log format

2010-03-26 Thread Phil Carns
Sounds good. Its in trunk and 2-8 now. thanks, -Phil Michael Moore wrote: Attached is the patch for the gossip log format if anyone is interested in applying it. Michael On Tue, Mar 09, 2010 at 10:51:38AM -0500, Michael Moore wrote: Was there a reason for limiting the datetime format in

Re: [Pvfs2-developers] pvfs2-client-core behavior on failed remount

2010-02-11 Thread Phil Carns
by the BMI timeout and retry counts so it should be a reasonably long loop (I don't recall the defaults off hand, but should only be every couple minutes). Michael On Mon, Feb 08, 2010 at 01:51:16PM -0500, Phil Carns wrote: Hi Michael, Could you regenerate this patch with diff -Naupr (or cvs

Re: [Pvfs2-developers] Segfault during cancel op (previously kernel loop)

2010-02-08 Thread Phil Carns
of sm_p? Thanks, Michael On Wed, Jan 20, 2010 at 08:01:41AM -0600, Phil Carns wrote: Great! Thanks for testing it out. -Phil Michael Moore wrote: Thanks Phil, that appears to solve the problem! I tested it both against head and orange branch and didn't see any of the infinite looping or client

Re: [Pvfs2-developers] pvfs2-client-core behavior on failed remount

2010-02-08 Thread Phil Carns
Hi Michael, Could you regenerate this patch with diff -Naupr (or cvs diff -Naup)? The -u in particular makes it a little easier to read/apply. I think this is the same issue as described in this open trac entry, which would be great to knock out:

Re: [Pvfs2-developers] gossip_debug segv in dbpf-bstream.c

2010-02-08 Thread Phil Carns
Thanks Michael. I pushed this to trunk and the 2.8 branch with some comment changes. It actually looks like the 2.8 branch had a partial fix that wasn't in trunk for some reason, but they are synchronized now. -Phil Michael Moore wrote: I noticed a segfault occuring in dbpf-bstream when

Re: [Pvfs2-developers] gossip_debug segv in dbpf-bstream.c

2010-02-08 Thread Phil Carns
Oh, and that closes an old trac ticket as well: https://trac.mcs.anl.gov/projects/pvfs/ticket/106 Phil Carns wrote: Thanks Michael. I pushed this to trunk and the 2.8 branch with some comment changes. It actually looks like the 2.8 branch had a partial fix that wasn't in trunk for some

Re: [Pvfs2-developers] [patch] 64 bit mtime fix

2010-01-15 Thread Phil Carns
Thanks for the fix, Bart. It's in our CVS tree now. -Phil Bart Taylor wrote: Hey guys, Attached is a patch fixing some mtime inconsistencies we have seen along with a related logging update. The compatibility hack and No version found message in the get-attr state machine were being

Re: [Pvfs2-developers] Re: [patch] QLA monitor script checks for read only device

2009-12-09 Thread Phil Carns
Hi Bart, Should that dd command in there have an extra flag like oflag=direct to make sure it doesn't just write to the buffer cache when you check the device? oflag=fsync would probably work too. -Phil Bart Taylor wrote: I attached the patch this time. On Wed, Dec 9, 2009 at 10:27 AM,

Re: [Pvfs2-developers] [patch] SIGHUP fix

2009-12-04 Thread Phil Carns
Thanks Bart. This is integrated into CVS now. -Phil Bart Taylor wrote: Attached is a small patch that fixes a problem with handling SIGHUP signals. The server alias string is freed early in server.c, so garbage gets passed into PINT_parse_config when a SIGHUP is received. I moved the free

Re: [Pvfs2-developers] free() additions in pvfs2-server.c, dbpf-attr-cache.c

2009-11-11 Thread Phil Carns
Thanks Michael. Looks fine to me so I dropped the patch into trunk and pvfs-2-8-branch. -Phil Michael Moore wrote: While running valgrind I noticed two spots with memory not being free'd, but having fairly small impact. In pvfs2-server.c an array for holding BMI addresses of metadata

Re: [Pvfs2-developers] Create state machine in pvfs-2.8.1.

2009-10-05 Thread Phil Carns
Erik Nieto wrote: Hello Everybody: I have some questions about the create system interface operation in the 2.8.1 version of pvfs2. In the earlier version (pvfs-2.7.1), the state machine: 1.- First create a space for the metafile. 2.- Next, create the datafiles in the indicated

Re: [Pvfs2-developers] PVFS2: files with ?---?--? permissions

2009-09-17 Thread Phil Carns
-client-core root 20435 20434 0 Sep14 ?00:00:05 pvfs2-client-core --child -a 5 -n 5 --logtype file -L /tmp/pvfs2-client.log root 23623 19719 0 15:28 pts/200:00:00 grep pvfs Any thoughts??? greatly appreciated!!! -Amit -Original Message- From: Phil Carns [mailto:ca

Re: [Pvfs2-developers] PVFS2: files with ?---?--? permissions

2009-09-16 Thread Phil Carns
Becky Ligon wrote: Amit: This means that the PVFS system cannot access the attributes database containing the information about the particular file. It also means that the file is unusable. You need to determine which metadata server is having problems. If you don't have a backup, then you

Re: [Pvfs2-developers] EMERGENCY: Need help recovering one of our META/IO servers....

2009-09-14 Thread Phil Carns
Have you actually tried db_recover yet? It can fix some things even without a transaction log. I would recommend making a backup of your .db files first. After you have tried Kevin's suggestion, you can go into the directory for the collection (where the dataspace_attributes.db and

Re: [Pvfs2-developers] Latest kernel missing class_device_create

2009-09-11 Thread Phil Carns
Hi Nick, I just put a variation on your patch into cvs trunk. It needed a few tweaks to work on RHEL4, which has an odd variation on what class functions are available. -Phil Nicholas Mills wrote: All, In src/kernel/linux-2.6/devpvfs2-req.c:1037 there is a call to class_device_create().

Re: [Pvfs2-developers] help with changes to configure and configure.in....

2009-09-09 Thread Phil Carns
Becky Ligon wrote: I have modified the configure script by adding src/apps/user/module.mk to the list of files in the definition of $ac_config_files. I also modified configure.in by adding src/apps/user/module.mk to the definition of AC_OUTPUT. Do I need to commit both files to CVS? Are these

Re: [Pvfs2-developers] Client hangs with 2.8.1

2009-08-26 Thread Phil Carns
The patch looks good to me. I went ahead and committed it to cvs trunk. Thanks for tracking that down! -Phil David Metheny wrote: For the RHEL3 systems (2.4.21-27 smp) this was configured with –disable-epoll, since the systems don’t support epoll. Attaching with gdb to the

Re: [Pvfs2-developers] pvfs2-stat question

2009-07-24 Thread Phil Carns
That sounds like a bug to me. -Phil Kevin Harms wrote: Is there any reason for pvfs2-stat not to return a non-zero exit code when the path doesn't exist? That seems to behavior of a stat shell command. fs1:~/bin # pvfs2-stat /pvfs2/path PVFS_sys_lookup: No such file or directory (error

Re: [Pvfs2-developers] [patch] pvsf2-ls

2009-07-22 Thread Phil Carns
Bart and I hashed through this a little more off list and got a slightly modified version of this patch committed to cvs trunk. Thanks Bart! -Phil Bart Taylor wrote: Hey guys, I attached a patch for pvfs2-ls that does a few things. First, there is an off by one error from my previous patch

Re: [Pvfs2-developers] patch: Filesystem-qla-monitor patch

2009-07-21 Thread Phil Carns
Thanks David! Patch is in cvs trunk now. -Phil David Metheny wrote: The attached patch fixes the cases where the Filesytem-qla-monitor script prints out message “ERROR: Filesystem-qla-monitor must specify fsname!” on a call with command ‘meta-data’. The operation check for ‘meta-data’

Re: [Pvfs2-developers] pvfs kernel module compilation fix for 2.6.30

2009-06-30 Thread Phil Carns
Thanks Dries. It looks like fs_struct.h goes back even into the 2.4 series. I went ahead and dropped the change into CVS trunk. -Phil Dries Kimpe wrote: It seems in that, in 2.6.30, fs_struct.h is no longer included from some other headers, causing acl.c (src/kernel/linux-2.6/acl.c) to fail

Re: [Pvfs2-developers] patch: PVFS2 group permission checking for groups with large number of members

2009-06-30 Thread Phil Carns
failed at around 200 members of a group, and since the system can't determine the correct size via sysconf, I just picked something that would take a long time to break. -Original Message- From: Phil Carns [mailto:pca...@gmail.com] On Behalf Of Phil Carns Sent: Tuesday, March 24, 2009 9:40

Re: [Pvfs2-developers] Trove DBPF error

2009-05-28 Thread Phil Carns
There is actually an admin tool (pvfs2-rm-object) that does what Kevin described (used for testing pvfs2-fsck mainly). That can be used to get rid of each handle/object in the file, but that would still leave a directory entry to get rid of... Does pvfs2-rm not remove the entire file? It

Re: [Pvfs2-developers] Question in pvfs I/O

2009-04-21 Thread Phil Carns
Hi Christina, I answered some of your specific questions in line below: Christina Patrick wrote: Hi All, I am doing a project where I need to implement simple prefetching in pvfs. While I was going through the pvfs code, I couldn't understand the following and hence have to ask the below

Re: [Pvfs2-developers] Copy commands segfault on 2.4 kernels

2009-04-07 Thread Phil Carns
Hi Bart, From your strace output, my guess is that cp is running into trouble with the value of one of the fstat() fields, but its hard to say which one. Are you able to reproduce this reliably? Could you run the strace again with the -v option to see if it gives a full listing of what

Re: [Pvfs2-developers] Is there a patch for flow proto errors?

2009-04-03 Thread Phil Carns
03/30 15:18] handle_io_error: flow proto 0x487d8f0 error cleanup finished, error_code: -1073741959 - Elaine -Original Message- From: Phil Carns [mailto:pca...@gmail.com] On Behalf Of Phil Carns Sent: Monday, March 30, 2009 3:15 PM To: Elaine Quarles Cc: pvfs2-developers@beowulf

Re: [Pvfs2-developers] Compiling Kernel Module (make kmod) on OpenSuSE 11.1

2009-04-01 Thread Phil Carns
I just mentioned this on another thread on pvfs2-users, but I'm not sure if you are having the same problem or not. Could you try compiling the cvs trunk version of PVFS and let us know if that fixes the problem? Instructions for how to check out the cvs code can be found here:

Re: [Pvfs2-developers] [patch] Enabling TCPBindSpecific

2009-02-22 Thread Phil Carns
Thanks Bart. The patch is applied to trunk now with a minor update to the --help description. -Phil Bart Taylor wrote: Hey guys, Attached is a small patch that allows you to enable the TCPBindSpecific option when running pvfs2-genconfig. It can help simplify setting up a file system with

[Pvfs2-developers] Re: shadowed function declarations in 2.8.0

2009-02-22 Thread Phil Carns
Thanks Kyle. Patch is applied in cvs trunk now. -Phil Kyle Schochenmaier wrote: While compiling 2.8.0 I ran into some shadowed function declaration warnings, I believe the correct solution is to just rename the offending functions/variables, however the compiler is supposed to use the correct

Re: [Pvfs2-developers] Patch for recursive pvfs2-ls

2009-02-02 Thread Phil Carns
Thanks Bart! The patch has been applied to PVFS trunk. -Phil Bart Taylor wrote: Hey guys, Attached are two patches for giving pvfs2-lsplus (now just pvfs2-ls) a recursive option. One patch is for pvfs2-lsplus against pvfs-2-6-branch and the other is for pvfs2-ls against HEAD. The output

Re: [Pvfs2-developers] question RE readdir rewind bug

2009-01-15 Thread Phil Carns
What version of PVFS are you testing (or is it trunk)? We have had a couple of permutations of this bug in the past, but I hope it is sorted out now in trunk. -Phil Walter Ligon wrote: Hey, I was looking at the readdir rewind bug and wondering, could this be responsible for reporting the

Re: [Pvfs2-developers] pvfs2-cli can't identify protocol

2009-01-12 Thread Phil Carns
pvfs2-cli 14793 root8r DIR 0,200 5654 infinibandevent Thank you, Amit -Original Message- From: Phil Carns [mailto:pca...@gmail.com] On Behalf Of Phil Carns Sent: Thursday, January 08, 2009 2:25 PM To: Kumar, Amit H. Cc: 'Rob Ross'; pvfs2-developers

Re: [Pvfs2-developers] bmi testcontext/testunexpected

2009-01-06 Thread Phil Carns
thread. Nawab, in the zoidfs init code after initializing BMI you need to call: int check = 0; BMI_set_info(0, BMI_TCP_CHECK_UNEXPECTED, check); -sam On Dec 23, 2008, at 2:01 PM, Phil Carns wrote: Sam Lang wrote: Hi All, I think Nawab has found a bug (or untested code path) in the BMI tcp method

Re: [Pvfs2-developers] bmi testcontext/testunexpected

2008-12-23 Thread Phil Carns
Sam Lang wrote: Hi All, I think Nawab has found a bug (or untested code path) in the BMI tcp method. He's running a daemon that both receives unexpected requests (as a server), and receives expected responses (as a client). In the BMI_testcontext call, if there aren't any completed

Re: [Pvfs2-developers] patch: for 2.7.1 tag to compile/support RHEL3 2.4.x kernels

2008-12-08 Thread Phil Carns
Thanks David; patch is now applied to CVS trunk. I hope the source code still fits on your punch cards :) -Phil David Metheny wrote: This patch #defines out the immutable code during the builds for 2.4.x kernels. I’m hoping our support of PVFS2 on 2.4.x kernels is nearing the end, but it

Re: [Pvfs2-developers] patch for trusted networks

2008-12-03 Thread Phil Carns
Thanks Bart. I committed a slightly modified version of your patch to cvs trunk. -Phil Bart Taylor wrote: Hey guys, This patch fixes an issue with trusted networks. If the TrustedNetworks field is present in the conf file but there is no value, the file system is unreachable from any

Re: [Pvfs2-developers] Re: patch for client data corruption with 2.4 kernels

2008-11-24 Thread Phil Carns
Thanks Bart. I applied the patches to cvs trunk. -Phil Bart Taylor wrote: I neglected the header file; attached is an additional patch to catch it. Both of these patches should apply cleanly to head. Bart. On Thu, Nov 20, 2008 at 1:54 PM, Bart Taylor [EMAIL PROTECTED] mailto:[EMAIL

Re: [Pvfs2-developers] bmi-tcp doubt

2008-11-24 Thread Phil Carns
Hi Ankur, This patch fixes the code so that it does the right thing if you just return an error code from the tcp_accept_init() function. It is already applied to cvs trunk. thanks, -Phil Phil Carns wrote: For an immediate solution you can just mimic the logic in the BIG KLUDGE comment

Re: [Pvfs2-developers] Re: patch for client data corruption with 2.4kernels

2008-11-21 Thread Phil Carns
Maybe the memory accounting is just handled differently in RHEL5? -Phil David Metheny wrote: I'm running the same types of tests I did with a RHEL3 and RHEL4 system. But not seeing the same results on the RHEL5 systems. So... I'm not sure if it really is a problem or not. Watching 'top' or

Re: [Pvfs2-developers] bmi-tcp doubt

2008-11-20 Thread Phil Carns
Hi Ankur, I think we could clean up this path some. Just to clarify what you are looking for though, are you planning to send a response all the way back to the client? The server does not normally send a response back for a failed unexpected message. In the case you describe, you would

Re: [Pvfs2-developers] bmi-tcp doubt

2008-11-20 Thread Phil Carns
- Original Message - From: Phil Carns [EMAIL PROTECTED] To: Ankur G Pai [EMAIL PROTECTED] Cc: pvfs2-developers@beowulf-underground.org Sent: Thursday, November 20, 2008 10:07:44 AM GMT -05:00 Columbia Subject: Re: [Pvfs2-developers] bmi-tcp doubt Hi Ankur, I think we could clean up this path some

Re: [Pvfs2-developers] bmi-tcp doubt

2008-11-20 Thread Phil Carns
: Disregarding the connection is fine with me. But what do I return from bmi_tcp.c. If I return 0, the client call completes. If I return -1, server crashes. So if I want to disregard the request, what do I return from tcp_accept_init() ? Thanks, Ankur - Original Message - From: Phil Carns [EMAIL

Re: [Pvfs2-developers] concurrent metadata and pvfs2-lsplus improvements

2008-11-10 Thread Phil Carns
Phil Carns wrote: Rob Ross wrote: Should we just replace pvfs2-ls with pvfs2-lsplus? -- Rob I don't know of any reason not to. They are feature equivalent in terms of command line arguments and output format. -Phil This is done now in CVS. I don't know if anyone needs it, but make

Re: [Pvfs2-developers] Listing performance patch

2008-11-04 Thread Phil Carns
Just a quick update for anyone following this bug report. So far I haven't been able to reproduce this yet on a single server file system using either 2.6.3 (patched to increase dirent count) or trunk code. We are still trying to narrow down what the key factor is. -Phil Phil Carns wrote

Re: [Pvfs2-developers] Listing performance patch

2008-11-03 Thread Phil Carns
the MAX_DIRENT_COUNT in the src/kernel/linux2.6/pvfs2-dev-proto.h and put it back at 0x0020 (32) and reran the test. The 'ls -Rl' consistently runs in about an hour now, and finishes correctly. -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Phil Carns

Re: [Pvfs2-developers] readdir count and token position

2008-10-15 Thread Phil Carns
FYI, I reduced the limit (in the kernel only, not pvfs2-ls) down to 96 for the time being in cvs trunk. This avoids the token rewind problem triggered by bonnie++, but hopefully still keeps some of the ls speed improvement. -Phil Phil Carns wrote: We recently applied a patch from Bart

Re: [Pvfs2-developers] PVFS2 Removal of large files

2008-10-14 Thread Phil Carns
those jobs didn't quite stop accesses to the jobs memory. Phil Carns sent me a patch to fix this. I've ran a small sample of tests on a single PVFS2 server with a separate machine for the PVFS2 client. Both machines are running RHEL4 U7 i386 WS. The short version is that there was little affect

Re: [Pvfs2-developers] Re: [Pvfs-developers] Pvfs client-server communication doubt

2008-10-09 Thread Phil Carns
Pai, Ankur G wrote: Hi Phil, Thanks a lot for replying. So here is the deal. I am working on an enhanced PVFS with an entirely new set of state machines added to create a new struct called ecreate. Its working fine (all state machines and everything). Unfortunately, the guy who made these

Re: [Pvfs2-developers] SSL symbols and PVFS2

2008-10-03 Thread Phil Carns
Hi Brad, There is a --without-openssl option to PVFS that keeps it from using those symbols altogether. That's helped me in a couple of cases where it was hard to drag the ssl libraries around. -Phil Bradley Settlemyer wrote: Hello, Has there been any thought on trying to drag in the

Re: [Pvfs2-developers] PVFS2 Removal of large files

2008-10-03 Thread Phil Carns
It sounds like there are really two problems in this case: a) the remove takes a long time b) trove won't work on other metadata operations until the remove completes I don't know if this is a good idea or not, but here is a potential quick way to make the remove work in the background:

Re: [Pvfs2-developers] Listing performance patch

2008-09-11 Thread Phil Carns
entries than filldir() can consume. -Phil Rob Ross wrote: Has the internal kernel value changed since we last looked? Rob On Sep 4, 2008, at 4:16 PM, Phil Carns wrote: Sam Lang wrote: Hi Bart, Thanks for the patch. For users with that many files in a directory, using pvfs2-ls is probably

Re: [Pvfs2-developers] Listing performance patch

2008-09-11 Thread Phil Carns
) = 4080 getdents64(3, /* 132 entries */, 4096) = 3168 getdents64(3, /* 0 entries */, 4096)= 0 So even with just 300 entries your patch takes us from 11 getdents system calls down to 3 to do an ls. Thanks! -Phil Phil Carns wrote: I looked at the code a little just now. The getdents

Re: [Pvfs2-developers] Listing performance patch

2008-09-04 Thread Phil Carns
Sam Lang wrote: Hi Bart, Thanks for the patch. For users with that many files in a directory, using pvfs2-ls is probably a good alternative. The kernel does readdir requests 32 entries at a time, so increasing MAX_NUM_DIRENTS won't help for ls. Long listings requires getting the size of

Re: [Pvfs2-developers] Patch for PVFS2 heartbeat resource script (add [-a alias] to file system creation command)

2008-08-04 Thread Phil Carns
Thanks David, and good catch on both counts. The patch has been committed to trunk. -Phil David Metheny wrote: Attached is a patch against the trunk CVS for the PVFS2 example resource heartbeat script. The patch changes the location of the pvfs2-server and pvfs2-check-server executable

Re: [Pvfs2-developers] Error with concurrent opens

2008-08-01 Thread Phil Carns
we never got a chance to test it. Sam added an op_release in namei.c to fix a kmem_cache leak, and it sneaked in twice without warning. Taking that out fixed the problem. Bart. On Tue, Jul 29, 2008 at 8:03 AM, Phil Carns [EMAIL PROTECTED] mailto:[EMAIL PROTECTED] wrote: I'm having

Re: [Pvfs2-developers] Error with concurrent opens

2008-07-25 Thread Phil Carns
Phil Carns wrote: Bart Taylor wrote: I am having a problem with an LTP test from the 20080630 set of LTP tests. The 'openfile01' test does 10 threaded opens of 10 files. It is attached in case you need a copy. The test completes successfully, but an 'ls' command immediately after that hangs

Re: [Pvfs2-developers] Error with concurrent opens

2008-07-24 Thread Phil Carns
Bart Taylor wrote: I am having a problem with an LTP test from the 20080630 set of LTP tests. The 'openfile01' test does 10 threaded opens of 10 files. It is attached in case you need a copy. The test completes successfully, but an 'ls' command immediately after that hangs and cannot be

Re: [Pvfs2-developers] Long file names

2008-07-21 Thread Phil Carns
not seem to make a difference. I do not see any log message, client or kernel, that indicate what is happening. The pvfs2-client-core does die after the long file name commands run though. Bart. On Mon, Jun 30, 2008 at 2:10 PM, Phil Carns [EMAIL PROTECTED] mailto:[EMAIL PROTECTED] wrote

  1   2   3   >