lkml.org 
[lkml]   [2013]   [Mar]   [7]   [last100]   RSS Feed
Views: [wrap][no wrap]   [headers]  [forward] 
 
Messages in this thread
/
SubjectRe: BUG: soft lockup on all kernels after 2.6.3x
From
Date
On Thu, 2013-03-07 at 16:54 +0400, Alexey Vlasov wrote:
> Hi,
>
> On Sat, Feb 09, 2013 at 07:07:53AM -0800, Eric Dumazet wrote:
> > >
> > > I used 2.6.2x kernel for a long time on my shared hosting and I didn't
> > > have any problems. Kernels worked well and server uptime was about 2-3
> > > years.
> > >
> > > ...
> > >
> > > it doesn't happen on an empty server, only on loaded ones. Unfortunately
> > > I don't know how to provoke such hanging artificially.
> > >
>
> > Your traces dont contain symbols, its quite hard to guess the issue.
>
> Well the server got high loaded and began to crash almost once a day.
>
> =====
> BUG: soft lockup - CPU#1 stuck for 23s! [httpd:21686]
> Call Trace:
> [<ffffffff8110bba5>] ? mntput_no_expire+0x25/0x170
> [<ffffffff810f9389>] ? path_lookupat+0x189/0x890
> [<ffffffff810f9b67>] ? filename_lookup.clone.39+0xd7/0xe0
> [<ffffffff810fc85c>] ? user_path_at_empty+0x5c/0xb0
> [<ffffffff8102b5f9>] ? __do_page_fault+0x1b9/0x480
> [<ffffffff810f146e>] ? vfs_fstatat+0x3e/0x90
> [<ffffffff810c54bf>] ? remove_vma+0x5f/0x70
> [<ffffffff810f168f>] ? sys_newstat+0x1f/0x50
> [<ffffffff814b09c2>] ? page_fault+0x22/0x30
> [<ffffffff814b0f49>] ? system_call_fastpath+0x18/0x1d
> =====
>
> There's a full trace in attachment.
>


Seems a VFS issue.

A "umount" is done, blocking almost all other cpus in lg_local_lock()

What are gr_xxxx symbols ?

Mar 7 00:50:00 l25 [1735187.889877] [<ffffffff8110e118>] ? is_path_reachable+0x48/0x60
Mar 7 00:50:00 l25 [1735187.889880] [<ffffffff8110e163>] ? path_is_under+0x33/0x60
Mar 7 00:50:00 l25 [1735187.889887] [<ffffffff812257a4>] ? gr_is_outside_chroot+0x54/0x70
Mar 7 00:50:00 l25 [1735187.889890] [<ffffffff81225815>] ? gr_chroot_fchdir+0x55/0x80
Mar 7 00:50:00 l25 [1735187.889894] [<ffffffff810f9b2e>] ? filename_lookup.clone.39+0x9e/0xe0
Mar 7 00:50:00 l25 [1735187.889897] [<ffffffff810fc85c>] ? user_path_at_empty+0x5c/0xb0
Mar 7 00:50:00 l25 [1735187.889903] [<ffffffff8102b5f9>] ? __do_page_fault+0x1b9/0x480
Mar 7 00:50:00 l25 [1735187.889907] [<ffffffff814b09c2>] ? page_fault+0x22/0x30
Mar 7 00:50:00 l25 [1735187.889910] [<ffffffff810f146e>] ? vfs_fstatat+0x3e/0x90
Mar 7 00:50:00 l25 [1735187.889914] [<ffffffff812278cb>] ? gr_learn_resource+0x3b/0x1e0
Mar 7 00:50:00 l25 [1735187.889918] [<ffffffff810f168f>] ? sys_newstat+0x1f/0x50
Mar 7 00:50:00 l25 [1735187.889922] [<ffffffff810ea4b4>] ? filp_close+0x54/0x80
Mar 7 00:50:00 l25 [1735187.889925] [<ffffffff814b09c2>] ? page_fault+0x22/0x30
Mar 7 00:50:00 l25 [1735187.889928] [<ffffffff814b0f49>] ? system_call_fastpath+0x18/0x1d




\
 
 \ /
  Last update: 2013-03-07 18:01    [W:0.216 / U:0.032 seconds]
©2003-2020 Jasper Spaans|hosted at Digital Ocean and TransIP|Read the blog|Advertise on this site