lkml.org 
[lkml]   [2003]   [Feb]   [24]   [last100]   RSS Feed
Views: [wrap][no wrap]   [headers]  [forward] 
 
Messages in this thread
    /
    From
    SubjectRe: Minutes from Feb 21 LSE Call
    Date
    On Mon, 24 Feb 2003 09:25:33 MST, yodaiken@fsmlabs.com wrote:
    > It's interesting to me that the people supporting the scale up do not
    > carefully do such benchmarks and indeed have a rather cavilier attitude
    > to testing and benchmarking: or perhaps they don't think it's worth
    > publishing.

    I'm afraid it is the latter half that is closer to correct. Within
    IBM's Linux Technology Center, we have a good sized performance team
    and a tightly coupled set of developers who can internally share a
    lot of real benchmark data. Unfortunately, the rules of SPEC and TPC
    don't allow us to release data unless it is carefully (and time-
    consumingly) audited, and IBM has a history of not dumping the output
    of a few hundred runs of benchmarks out in the open and then claiming
    that it is all valid, without doing a lot of internal validation first.

    I'm sure other large companies doing Linux stuff have similar hurdles.
    In some cases, ours are probably higher than average (IBM as an
    entity has zero interest in pissing of the TPC or SPEC).

    We do have a few papers out there, check OLS for the large database
    workload one that steps through 2.4 performance changes (stock
    2.4 vs. a set of patches we pushed to UL & RHAT) that increase
    database performance about, oh, I forget, 5-fold... And there
    is occasional other data sent out on web server stuff, some
    microbenchmark data (see the continuing stream of data from mbligh,
    for instance). Also, the contest data, OSDL data, etc. etc.
    shows comparisons and trends for anyone who cares to pay attention.

    It *would* be nice if someone could publish a compedium of performance
    data, but that would be asking a lot...

    gerrit
    -
    To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
    the body of a message to majordomo@vger.kernel.org
    More majordomo info at http://vger.kernel.org/majordomo-info.html
    Please read the FAQ at http://www.tux.org/lkml/

    \
     
     \ /
      Last update: 2005-03-22 13:33    [W:6.536 / U:0.040 seconds]
    ©2003-2020 Jasper Spaans|hosted at Digital Ocean and TransIP|Read the blog|Advertise on this site