lkml.org 
[lkml]   [2023]   [Dec]   [21]   [last100]   RSS Feed
Views: [wrap][no wrap]   [headers]  [forward] 
 
Messages in this thread
    /
    From
    Subject[PATCH v5 0/4] kvm: arm64: allow the VM to select DEVICE_* and NORMAL_NC for IO memory
    Date
    From: Ankit Agrawal <ankita@nvidia.com>

    Currently, KVM for ARM64 maps at stage 2 memory that is considered device
    with DEVICE_nGnRE memory attributes; this setting overrides (per
    ARM architecture [1]) any device MMIO mapping present at stage 1,
    resulting in a set-up whereby a guest operating system cannot
    determine device MMIO mapping memory attributes on its own but
    it is always overridden by the KVM stage 2 default.

    This set-up does not allow guest operating systems to select device
    memory attributes independently from KVM stage-2 mappings
    (refer to [1], "Combining stage 1 and stage 2 memory type attributes"),
    which turns out to be an issue in that guest operating systems
    (e.g. Linux) may request to map devices MMIO regions with memory
    attributes that guarantee better performance (e.g. gathering
    attribute - that for some devices can generate larger PCIe memory
    writes TLPs) and specific operations (e.g. unaligned transactions)
    such as the NormalNC memory type.

    The default device stage 2 mapping was chosen in KVM for ARM64 since
    it was considered safer (i.e. it would not allow guests to trigger
    uncontained failures ultimately crashing the machine) but this
    turned out to be asynchronous (SError) defeating the purpose.

    For these reasons, relax the KVM stage 2 device memory attributes
    from DEVICE_nGnRE to Normal-NC.

    Generalizing to other devices may be problematic, however. E.g.
    GICv2 VCPU interface, which is effectively a shared peripheral, can
    allow a guest to affect another guest's interrupt distribution. Hence
    limit the change to VFIO PCI as caution. This is achieved by
    making the VFIO PCI core module set a flag that is tested by KVM
    to activate the code. This could be extended to other devices in
    the future once that is deemed safe.

    [1] section D8.5 - DDI0487J_a_a-profile_architecture_reference_manual.pdf

    Applied over v6.7-rc3.

    History
    =======
    v4 -> v5
    - Moved the cover letter description text to patch 1/4.
    - Cleaned up stage2_set_prot_attr() based on Marc Zyngier suggestions.
    - Moved the mm header file changes to a separate patch.
    - Rebased to v6.7-rc3.

    v3 -> v4
    - Moved the vfio-pci change to use the VM_VFIO_ALLOW_WC into
    separate patch.
    - Added check to warn on the case NORMAL_NC and DEVICE are
    set simultaneously.
    - Fixed miscellaneous nitpicks suggested in v3.

    v2 -> v3
    - Added a new patch (and converted to patch series) suggested by
    Catalin Marinas to ensure the code changes are restricted to
    VFIO PCI devices.
    - Introduced VM_VFIO_ALLOW_WC flag for VFIO PCI to communicate
    with VMM.
    - Reverted GIC mapping to DEVICE.

    v1 -> v2
    - Updated commit log to the one posted by
    Lorenzo Pieralisi <lpieralisi@kernel.org> (Thanks!)
    - Added new flag to represent the NORMAL_NC setting. Updated
    stage2_set_prot_attr() to handle new flag.

    v4 Link:
    https://lore.kernel.org/all/20231218090719.22250-1-ankita@nvidia.com/

    Signed-off-by: Ankit Agrawal <ankita@nvidia.com>
    Suggested-by: Jason Gunthorpe <jgg@nvidia.com>
    Acked-by: Catalin Marinas <catalin.marinas@arm.com>
    Tested-by: Ankit Agrawal <ankita@nvidia.com>

    Ankit Agrawal (4):
    kvm: arm64: introduce new flag for non-cacheable IO memory
    mm: introduce new flag to indicate wc safe
    kvm: arm64: set io memory s2 pte as normalnc for vfio pci devices
    vfio: convey kvm that the vfio-pci device is wc safe

    arch/arm64/include/asm/kvm_pgtable.h | 2 ++
    arch/arm64/include/asm/memory.h | 2 ++
    arch/arm64/kvm/hyp/pgtable.c | 23 ++++++++++++++++++-----
    arch/arm64/kvm/mmu.c | 18 ++++++++++++++----
    drivers/vfio/pci/vfio_pci_core.c | 3 ++-
    include/linux/mm.h | 14 ++++++++++++++
    6 files changed, 52 insertions(+), 10 deletions(-)

    --
    2.17.1


    \
     
     \ /
      Last update: 2023-12-21 16:43    [W:7.387 / U:0.096 seconds]
    ©2003-2020 Jasper Spaans|hosted at Digital Ocean and TransIP|Read the blog|Advertise on this site