lkml.org 
[lkml]   [2018]   [Nov]   [10]   [last100]   RSS Feed
Views: [wrap][no wrap]   [headers]  [forward] 
 
Messages in this thread
    /
    SubjectRe: [PATCH 3/3] lockdep: Use line-buffered printk() for lockdep messages.
    From
    Date
    On 2018/11/10 0:43, Petr Mladek wrote:
    >> + * Line buffered printk() tries to assign a buffer when printk() from a new
    >> + * context identifier comes in. And it automatically releases that buffer when
    >> + * one of three conditions listed below became true.
    >> + *
    >> + * (1) printk() from that context identifier emitted '\n' as the last
    >> + * character of output.
    >> + * (2) printk() from that context identifier tried to print a too long line
    >> + * which cannot be stored into a buffer.
    >> + * (3) printk() from a new context identifier noticed that some context
    >> + * identifier is reserving a buffer for more than 10 seconds without
    >> + * emitting '\n'.
    >> + *
    >> + * Since (3) is based on a heuristic that somebody forgot to emit '\n' as the
    >> + * last character of output(), pr_cont()/KERN_CONT users are expected to emit
    >> + * '\n' within 10 seconds even if they reserved a buffer.
    >
    > This is my main concern about this approach. It is so easy to omit
    > the final '\n'.

    If it is so easy to forget the final '\n', there will be a lot of implicit
    pr_cont() users (because pr_cont() assumes that previous printk() omitted the
    final '\n'), and "I am going to investigate much more pr_cont() users." will
    be insufficient for getting meaningful conclusion.

    Checking "lack of the the final '\n'" means that we need to check
    "all printk() users who are not emitting the final '\n'" and evaluate
    "whether there is a possibility that subsequent printk() will not be
    called from that context due to e.g. conditional branches". That is an
    impossible task for anybody, for there might be out-of-tree code doing it.

    >
    > They are currently delayed until another printk(). Even this is bad.
    > Unfortunately we could not setup timer from printk() because it
    > would add more locks into the game.

    We could use interval timer for flushing incomplete line.
    But updating printk() users to always end with '\n' will be preferable.

    >
    > This patch will make it worse. They might get delayed by 10s or even
    > more. Many other lines might appear in between. Also the code is
    > more tricky[*].

    If there are a lot of implicit pr_cont() users (who are omitting
    the final '\n' in previous printk()), we can try to find them (and
    fix them) by "reporting the location of printk() which omitted the
    final '\n'" instead of "flushing the partial line from different
    processes" when "try_buffered_printk() (or an interval timer) found
    that some buffer is holding a partial line for more than 10 seconds".

    >
    >
    > Sign, I am really unhappy how the buffered_printk() conversion
    > looks in lockdep.c. But I still think that the approach is more
    > reliable. I am going to investigate much more pr_cont() users.

    If there is a possibility that subsequent printk() will not be called from
    that context due to e.g. conditional branches, we will need to flush after
    previous printk() in order to eliminate possibility of failing to flush.

    That is asking printk() users to fix previous printk() so that partial
    line is always flushed (with '\n' or without '\n').

    > I wonder how many would be that complicated. I do not want
    > to give up just because one use-case that was complicated
    > even before.
    >
    >
    > [*] The buffer can get written and flushed by different processes.
    > It is not trivial to do it correctly a lockless way.
    >
    > The proposed locking looks right on the first glance. But
    > the code is a bit scary ;-)

    try_buffered_printk() will be a good hook for finding implicit
    pr_cont() users who are omitting the final '\n', for we can find them
    without making changes to printk() users.

    try_buffered_printk() hook can offload atomic-but-complicated task
    (converting e.g. %pSOMETHING to %s) to outside of logbuf_lock, and
    reduce the period of holding logbuf_lock.

    Since try_buffered_printk() serves as a hook, if we ignore the offloading
    atomic-but-complicated task, we can eliminate try_buffered_printk() after
    we updated printk() users to always end with '\n'.

    \
     
     \ /
      Last update: 2018-11-10 03:42    [W:4.024 / U:1.164 seconds]
    ©2003-2020 Jasper Spaans|hosted at Digital Ocean and TransIP|Read the blog|Advertise on this site