This is the mail archive of the libc-hacker@sources.redhat.com mailing list for the glibc project.

Note that libc-hacker is a closed list. You may look at the archives of this list, but subscription and posting are not open.


Index Nav: [Date Index] [Subject Index] [Author Index] [Thread Index]
Message Nav: [Date Prev] [Date Next] [Thread Prev] [Thread Next]
Other format: [Raw text]

statvfs suggestion


Hi Uli,

[There's no pressure at all, since the coreutils work around this problem
 simply by using statfs on glibc systems, but I feel I should at least
 report the problem.  Other applications may well be affected. ]

For some time, now the coreutils have been avoiding the use of glibc's
statvfs because it has an undesirable side-effect in some cases.
When df used statvfs, it would sometimes hang unnecessarily due to a
problem with an unrelated hard mount.  That was because statvfs stats
a directory for each entry in /proc/mounts, in order, until it finds
one with matching device number.  Of course, that would make df hang if
even one of the file systems listed in /proc/mounts before the desired
one is hard-mounted, but not available.

What do you think about changing internal_statvfs.c so that it first
reads/saves all entries from /proc/mounts without stat'ing each
corresponding directory?  Then it can stop if any mount point matches
the name of the file.

This is a relatively important optimization, not just for the case
mentioned above that would make df hang unnecessarily, but also to avoid
the potential O(N^2) stat/mount operations that you'd currently incur
when iterating with getmntent, and calling statvfs on each mount point.

Here's some actual code demonstrating the problem, but not the hang:

  $ cat statvfs-glibc-test.c
  #include <stdlib.h>
  #include <sys/statvfs.h>

  int
  main (int argc, char **argv)
  {
    struct statvfs fsd;
    exit (statvfs (argv[1], &fsd));
  }

Note that it will stat the 10 or so directories
before the desired one, while it could have stat'ed only
the selected one in this case, since the file argument, "/my",
to statvfs matches the name of a mount point:

  $ cat /proc/mounts
  rootfs / rootfs rw 0 0
  /dev2/root2 / ext3 rw 0 0
  proc /proc proc rw 0 0
  devpts /dev/pts devpts rw 0 0
  /dev/hda5 /tmp ext3 rw 0 0
  /dev/hda3 /_boot ext3 rw 0 0
  /dev/hda2 /var ext3 rw 0 0
  /dev/hda7 /u ext3 rw 0 0
  tmpfs /t tmpfs rw 0 0
  /dev/hdc2 /misc ext3 rw 0 0
  /dev/hdc3 /nobak ext3 rw 0 0
  /dev/hdc4 /my ext3 rw 0 0
  /dev/hde2 /e-root ext3 rw 0 0
  /dev/hde3 /e ext3 rw 0 0
  /dev/hdg2 /g-root ext3 rw 0 0
  /dev/hdg3 /g ext3 rw 0 0
  automount(pid475) /mnt/auto autofs rw 0 0
  usb /proc/bus/usb usbdevfs rw 0 0

  $ strace -e stat64,open ./a.out /my
  ...
  stat64("/my", {st_mode=S_IFDIR|0755, st_size=4096, ...}) = 0
  open("/proc/mounts", O_RDONLY)          = 3
  stat64("/", {st_mode=S_IFDIR|0755, st_size=4096, ...}) = 0
  stat64("/", {st_mode=S_IFDIR|0755, st_size=4096, ...}) = 0
  stat64("/proc", {st_mode=S_IFDIR|0555, st_size=0, ...}) = 0
  stat64("/dev/pts", {st_mode=S_IFDIR|0755, st_size=0, ...}) = 0
  stat64("/tmp", {st_mode=S_IFDIR|S_ISVTX|0777, st_size=8192, ...}) = 0
  stat64("/_boot", {st_mode=S_IFDIR|0755, st_size=1024, ...}) = 0
  stat64("/var", {st_mode=S_IFDIR|0755, st_size=4096, ...}) = 0
  stat64("/u", {st_mode=S_IFDIR|S_ISGID|0775, st_size=4096, ...}) = 0
  stat64("/t", {st_mode=S_IFDIR|S_ISVTX|0777, st_size=340, ...}) = 0
  stat64("/misc", {st_mode=S_IFDIR|0755, st_size=4096, ...}) = 0
  stat64("/nobak", {st_mode=S_IFDIR|0755, st_size=4096, ...}) = 0
  stat64("/my", {st_mode=S_IFDIR|0755, st_size=4096, ...}) = 0

Jim


Index Nav: [Date Index] [Subject Index] [Author Index] [Thread Index]
Message Nav: [Date Prev] [Date Next] [Thread Prev] [Thread Next]