aufs3 GIT release

2014-06-15 Thread sfjro

o news
- branch aufs3.15 is created
- there seems to exist a problem in tmpfs-idr.patch in
  aufs3-standalone.git. I am still investigating with Nikolay Pertsev
  and Guan Xin.
- aufs will start supporting fallocate(2) systemcall in next release.

o pre-announce
  I have a plan to remove CONFIG_AUFS_SP_IATTR and fs/aufs/f_op_sp.c.
  fs/aufs/f_op_sp.c is rather tricky, but it is just for maintain the
  timestamp of FIFO only. Recently I noticed that I will be able to make
  it unnecessary by customizing i_op-update_time() which was introduced
  in linux-3.5.

o bugfix
- handling an error in opening a FIFO
- handling an error in opening a FIFO, the internal list
  These two fixes are less important since the problem happens only if
  CONFIG_AUFS_SP_IATTR is enabled.
- bugfix remap_file_pages(2)
  This fix is done in aufs3-mmap.patch. The fixed problem is the
  incorrect path under /proc after you issue remap_file_pages(2)
  systemcall.


J. R. Okajima


- aufs3-linux.git#aufs3.9 branch
  aufs: bugfix, handling an error in opening a FIFO

- aufs3-linux.git#aufs3.10..aufs3.x-rcN branch
  Addition to above,
  aufs: bugfix, handling an error in opening a FIFO, the internal list

- aufs3-standalone.git
  ditto

- aufs-util.git
  nothing

--
HPCC Systems Open Source Big Data Platform from LexisNexis Risk Solutions
Find What Matters Most in Your Big Data with HPCC Systems
Open Source. Fast. Scalable. Simple. Ideal for Dirty Data.
Leverages Graph Analysis for Fast Processing  Easy Data Exploration
http://p.sf.net/sfu/hpccsystems


Re: WARNING at lib/idr.c:527

2014-06-15 Thread sfjro
Nikolay Pertsev:
 Notice, how shmem_evict_inode outputs only 3 first times.
 And... You right, I do not see anything from shmem_get_inode()...

That is a mystery.
Anyway here is a new and consolidated patch. Apply this after all aufs
patches you use and tmpfs-idr.patch. In other words, revert all patches
I've sent via mail.
And post the kernel log until idr_remove called for id=%d which is not
allocated msg. Note that no stacktrace will be printed by idr_remove()
but several warnings and stacktraces are added by this patch.


J. R. Okajima



a.patch.bz2
Description: BZip2 compressed data
--
HPCC Systems Open Source Big Data Platform from LexisNexis Risk Solutions
Find What Matters Most in Your Big Data with HPCC Systems
Open Source. Fast. Scalable. Simple. Ideal for Dirty Data.
Leverages Graph Analysis for Fast Processing  Easy Data Exploration
http://p.sf.net/sfu/hpccsystems

Re: WARNING at lib/idr.c:527

2014-06-15 Thread Nikolay Pertsev

   J. R. Okajima:

 Anyway here is a new and consolidated patch. Apply this after all aufs
 patches you use and tmpfs-idr.patch. In other words, revert all patches
 I've sent via mail.

   I am sorry, but when I tried to patch I got following result (Hunk #4 FAILED
   at 1161.):
   test-comp linux # patch  30-debug.patch -p1 --verbose
   Hmm...  Looks like a unified diff to me...
   The text leading up to this was:
   --
   |diff --git a/fs/dcache.c b/fs/dcache.c
   |index 581e93d..4231b85 100644
   |--- a/fs/dcache.c
   |+++ b/fs/dcache.c
   --
   Patching file fs/dcache.c using Plan A...
   Hunk #1 succeeded at 14.
   Hunk #2 succeeded at 280 (offset -32 lines).
   Hunk #3 succeeded at 301 (offset -32 lines).
   Hunk #4 FAILED at 1161.
   1 out of 4 hunks FAILED -- saving rejects to file fs/dcache.c.rej
   Hmm...  The next patch looks like a unified diff to me...
   The text leading up to this was:
   --
   |diff --git a/include/linux/shmem_fs.h b/include/linux/shmem_fs.h
   |index ca658a8..035f52c 100644
   |--- a/include/linux/shmem_fs.h
   |+++ b/include/linux/shmem_fs.h
   --
   Patching file include/linux/shmem_fs.h using Plan A...
   Hunk #1 succeeded at 26.
   Hmm...  The next patch looks like a unified diff to me...
   The text leading up to this was:
   --
   |diff --git a/lib/idr.c b/lib/idr.c
   |index bfe4db4..9e64a65 100644
   |--- a/lib/idr.c
   |+++ b/lib/idr.c
   --
   Patching file lib/idr.c using Plan A...
   Hunk #1 succeeded at 26.
   Hunk #2 succeeded at 40.
   Hunk #3 succeeded at 528.
   Hmm...  The next patch looks like a unified diff to me...
   The text leading up to this was:
   --
   |diff --git a/mm/shmem.c b/mm/shmem.c
   |index ecd2314..f5a9a5a 100644
   |--- a/mm/shmem.c
   |+++ b/mm/shmem.c
   --
   Patching file mm/shmem.c using Plan A...
   Hunk #1 succeeded at 21.
   Hunk #2 succeeded at 652 (offset -8 lines).
   Hunk #3 succeeded at 1438 (offset -17 lines).
   Hunk #4 succeeded at 2075 (offset -29 lines).
   Hunk #5 succeeded at 2632 (offset -22 lines).
   Hmm...  Ignoring the trailing garbage.
   done
   This is fs/dcache.c.rej file:
   --- fs/dcache.c
   +++ fs/dcache.c
   @@ -1161,6 +1175,13 @@
   Â Â Â Â  Â Â Â  Â Â Â  if (inode) {
   Â Â Â Â  Â Â Â  Â Â Â  Â Â Â  dentry-d_inode = NULL;
   Â Â Â Â  Â Â Â  Â Â Â  Â Â Â  hlist_del_init(dentry-d_alias);
   +Â Â Â  Â Â Â  Â Â Â  Â Â Â  if (inode-i_sb-s_magic == TMPFS_MAGIC
   +Â Â Â  Â Â Â  Â Â Â  Â Â Â  Â Â Â   inode-i_ino == 0x08000) {
   +Â Â Â  Â Â Â  Â Â Â  Â Â Â  Â Â Â  pr_info(%s %p i%lu 0%o %p\n,
   +Â Â Â   Â Â Â   Â Â Â   Â Â Â   Â Â Â  Â Â Â  dentry-[1]d_name.name,
   inode-i_sb,
   +Â Â Â  Â Â Â  Â Â Â  Â Â Â  Â Â Â  Â Â Â  inode-i_ino, inode-i_mode,
   inode);
   +Â Â Â   Â Â Â   Â Â Â   Â Â Â   Â Â Â   WARN_ON_ONCE(dentry-d_sb  !=
   inode-i_sb);
   +Â Â Â  Â Â Â  Â Â Â  Â Â Â  }
   Â Â Â Â  Â Â Â  Â Â Â  Â Â Â  if (dentry-d_op  dentry-d_op-d_iput)
   Â Â Â Â  Â Â Â  Â Â Â  Â Â Â  Â Â Â  dentry-d_op-d_iput(dentry, inode);
   Â Â Â Â  Â Â Â  Â Â Â  Â Â Â  else
   If  I  understand  correctly  there  should  be  function  static void
   shrink_dcache_for_umount_subtree(struct dentry *dentry)
   But I do not have this function in dcache.c
   I use Gentoo provided aufs-sources 3.14.6. Neither my sources nor master
   Github sources
   ([2]https://github.com/torvalds/linux/blob/master/fs/dcache.c) have this
   function. I also did not find it in any aufs patches.
   What did I do wrong?
   --
   Use GNU/Linux

References

   1. http://d_name.name/
   2. https://github.com/torvalds/linux/blob/master/fs/dcache.c
--
HPCC Systems Open Source Big Data Platform from LexisNexis Risk Solutions
Find What Matters Most in Your Big Data with HPCC Systems
Open Source. Fast. Scalable. Simple. Ideal for Dirty Data.
Leverages Graph Analysis for Fast Processing  Easy Data Exploration
http://p.sf.net/sfu/hpccsystems

Re: WARNING at lib/idr.c:527

2014-06-15 Thread sfjro

Nikolay Pertsev:
 I am sorry, but when I tried to patch I got following result (Hunk #4
 FAILED at 1161.):

Ah, I forgot that you are 3.14. The base of the debug patch is 3.12.x.


 If I understand correctly there should be function static void
 shrink_dcache_for_umount_subtree(struct dentry *dentry)

 But I do not have this function in dcache.c

Ok. For now, you can ignore this signle patch-failure and proceed the test.


 I use Gentoo provided aufs-sources 3.14.6. Neither my sources nor master
 Github sources (https://github.com/torvalds/linux/blob/master/fs/dcache.c)
 have this function. I also did not find it in any aufs patches.

Where can I get the kernel source files you are using?
I've just checked http://sources.gentoo.org/, but I could not get its 
structure...


J. R. Okajima

--
HPCC Systems Open Source Big Data Platform from LexisNexis Risk Solutions
Find What Matters Most in Your Big Data with HPCC Systems
Open Source. Fast. Scalable. Simple. Ideal for Dirty Data.
Leverages Graph Analysis for Fast Processing  Easy Data Exploration
http://p.sf.net/sfu/hpccsystems