lkml.org 
[lkml]   [2023]   [Oct]   [22]   [last100]   RSS Feed
Views: [wrap][no wrap]   [headers]  [forward] 
 
Messages in this thread
/
Date
From
SubjectRe: [PERFORMANCE]fs: sendfile suffer performance degradation when buffer size have performance impact on underling IO



At 2023-10-23 06:53:17, "Dave Chinner" <david@fromorbit.com> wrote:

>
>O_DSYNC is the problem here.
>
>This forces an IO to disk for every write IO submission from
>sendfile to the filesystem. For synchronous IO (as in "waiting for
>completion before sending the next IO), a larger IO size will
>*always* move data faster to storage.
>
>FWIW, you'll get the same behaviour if you use O_DIRECT for either
>source or destination file with sendfile - synchronous 64kB IOs are
>a massive performance limitation even without O_DSYNC.
>
>IOWs, don't use sendfile like this. Use buffered IO and
>sendfile(fd); fdatasync(fd); if you need data integrity guarantees
>and you won't see any perf problems resulting from the size of the
>internal sendfile buffer....
>
>-Dave.
>--
>Dave Chinner
>david@fromorbit.com

Thanks for the information, and Yes, buffered IO shows no significant
performance difference.
Feel that this usage caveat should be recorded in the "NOTE" section of man page for sendfile.

Thanks
David


\
 
 \ /
  Last update: 2023-10-23 04:19    [W:6.556 / U:0.004 seconds]
©2003-2020 Jasper Spaans|hosted at Digital Ocean and TransIP|Read the blog|Advertise on this site