Messages in this thread | | | Date | Sat, 30 Jul 2022 04:16:08 -0700 | Subject | Re: [syzbot] INFO: rcu detected stall in net_tx_action | From | syzbot <> |
| |
Hello,
syzbot tried to test the proposed patch but the build/boot failed:
3347][ T1] gre: GRE over IPv4 demultiplexor driver [ 13.619124][ T1] ip_gre: GRE over IPv4 tunneling driver [ 13.631725][ T1] IPv4 over IPsec tunneling driver [ 13.640899][ T1] ipt_CLUSTERIP: ClusterIP Version 0.8 loaded successfully [ 13.648512][ T1] Initializing XFRM netlink socket [ 13.654216][ T1] IPsec XFRM device driver [ 13.661054][ T1] NET: Registered PF_INET6 protocol family [ 13.679714][ T1] Segment Routing with IPv6 [ 13.684244][ T1] RPL Segment Routing with IPv6 [ 13.690226][ T1] mip6: Mobile IPv6 [ 13.698639][ T1] sit: IPv6, IPv4 and MPLS over IPv4 tunneling driver [ 13.712191][ T1] ip6_gre: GRE over IPv6 tunneling driver [ 13.721733][ T1] NET: Registered PF_PACKET protocol family [ 13.728154][ T1] NET: Registered PF_KEY protocol family [ 13.734540][ T1] Bridge firewalling registered [ 13.740978][ T1] NET: Registered PF_X25 protocol family [ 13.746924][ T1] X25: Linux Version 0.2 [ 13.795301][ T1] NET: Registered PF_NETROM protocol family [ 13.848772][ T1] NET: Registered PF_ROSE protocol family [ 13.854996][ T1] NET: Registered PF_AX25 protocol family [ 13.860824][ T1] can: controller area network core [ 13.866436][ T1] NET: Registered PF_CAN protocol family [ 13.872096][ T1] can: raw protocol [ 13.876009][ T1] can: broadcast manager protocol [ 13.881188][ T1] can: netlink gateway - max_hops=1 [ 13.886852][ T1] can: SAE J1939 [ 13.890404][ T1] can: isotp protocol [ 13.894929][ T1] Bluetooth: RFCOMM TTY layer initialized [ 13.900900][ T1] Bluetooth: RFCOMM socket layer initialized [ 13.907196][ T1] Bluetooth: RFCOMM ver 1.11 [ 13.911864][ T1] Bluetooth: BNEP (Ethernet Emulation) ver 1.3 [ 13.918198][ T1] Bluetooth: BNEP filters: protocol multicast [ 13.924303][ T1] Bluetooth: BNEP socket layer initialized [ 13.930379][ T1] Bluetooth: CMTP (CAPI Emulation) ver 1.0 [ 13.936749][ T1] Bluetooth: CMTP socket layer initialized [ 13.936766][ T1] Bluetooth: HIDP (Human Interface Emulation) ver 1.2 [ 13.936797][ T1] Bluetooth: HIDP socket layer initialized [ 13.941357][ T1] NET: Registered PF_RXRPC protocol family [ 13.961443][ T1] Key type rxrpc registered [ 13.966003][ T1] Key type rxrpc_s registered [ 13.972441][ T1] NET: Registered PF_KCM protocol family [ 13.978717][ T1] lec:lane_module_init: lec.c: initialized [ 13.984564][ T1] mpoa:atm_mpoa_init: mpc.c: initialized [ 13.990961][ T1] l2tp_core: L2TP core driver, V2.0 [ 13.996263][ T1] l2tp_ppp: PPPoL2TP kernel driver, V2.0 [ 14.001954][ T1] l2tp_ip: L2TP IP encapsulation support (L2TPv3) [ 14.008954][ T1] l2tp_netlink: L2TP netlink interface [ 14.014687][ T1] l2tp_eth: L2TP ethernet pseudowire support (L2TPv3) [ 14.021503][ T1] l2tp_ip6: L2TP IP encapsulation support for IPv6 (L2TPv3) [ 14.029452][ T1] NET: Registered PF_PHONET protocol family [ 14.036072][ T1] 8021q: 802.1Q VLAN Support v1.8 [ 14.053536][ T1] DCCP: Activated CCID 2 (TCP-like) [ 14.059597][ T1] DCCP: Activated CCID 3 (TCP-Friendly Rate Control) [ 14.069073][ T1] sctp: Hash tables configured (bind 32/56) [ 14.077557][ T1] NET: Registered PF_RDS protocol family [ 14.084307][ T1] Registered RDS/infiniband transport [ 14.091043][ T1] Registered RDS/tcp transport [ 14.096039][ T1] tipc: Activated (version 2.0.0) [ 14.101965][ T1] NET: Registered PF_TIPC protocol family [ 14.108528][ T1] tipc: Started in single node mode [ 14.114783][ T1] NET: Registered PF_SMC protocol family [ 14.121190][ T1] 9pnet: Installing 9P2000 support [ 14.127289][ T1] NET: Registered PF_CAIF protocol family [ 14.138968][ T1] NET: Registered PF_IEEE802154 protocol family [ 14.146086][ T1] Key type dns_resolver registered [ 14.151586][ T1] Key type ceph registered [ 14.157602][ T1] libceph: loaded (mon/osd proto 15/24) [ 14.166085][ T1] batman_adv: B.A.T.M.A.N. advanced 2021.2 (compatibility version 15) loaded [ 14.175270][ T1] openvswitch: Open vSwitch switching datapath [ 14.185311][ T1] NET: Registered PF_VSOCK protocol family [ 14.191809][ T1] mpls_gso: MPLS GSO support [ 14.207214][ T1] IPI shorthand broadcast: enabled [ 14.212607][ T1] AVX2 version of gcm_enc/dec engaged. [ 14.218734][ T1] AES CTR mode by8 optimization enabled [ 14.232847][ T1] sched_clock: Marking stable (14200464125, 32247819)->(14235442173, -2730229) [ 14.243629][ T1] registered taskstats version 1 [ 14.258146][ T1] Loading compiled-in X.509 certificates [ 14.266298][ T1] Loaded X.509 cert 'Build time autogenerated kernel key: f850c787ad998c396ae089c083b940ff0a9abb77' [ 14.277236][ C0] ------------[ cut here ]------------ [ 14.277267][ C0] hrtimer hog tick_sched_timer ran longer than 1 tick [ 14.277332][ C0] WARNING: CPU: 0 PID: 1 at kernel/time/hrtimer.c:1690 __hrtimer_run_queues+0xbf5/0x1230 [ 14.277391][ C0] Modules linked in: [ 14.277399][ C0] CPU: 0 PID: 1 Comm: swapper/0 Not tainted 5.14.0-rc5-syzkaller #0 [ 14.277414][ C0] Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 07/22/2022 [ 14.277422][ C0] RIP: 0010:__hrtimer_run_queues+0xbf5/0x1230 [ 14.277441][ C0] Code: 10 00 0f 0b e9 70 f6 ff ff bd 01 00 00 00 e8 b2 44 10 00 48 8b 34 24 48 c7 c7 a0 cd 8d 89 c6 05 0b 9e f2 0b 01 e8 75 c9 82 07 <0f> 0b e8 94 44 10 00 31 ff 89 ee e8 cb 4a 10 00 40 84 ed 0f 84 00 [ 14.277454][ C0] RSP: 0000:ffffc90000007e20 EFLAGS: 00010086 [ 14.277466][ C0] RAX: 0000000000000000 RBX: 0000000000000000 RCX: 0000000000000000 [ 14.277474][ C0] RDX: ffff888140160000 RSI: ffffffff815d8865 RDI: fffff52000000fb6 [ 14.277483][ C0] RBP: 0000000000000001 R08: 0000000000000000 R09: 0000000000000001 [ 14.277491][ C0] R10: ffffffff815d269e R11: 0000000000000000 R12: ffff8880b9c26d60 [ 14.277500][ C0] R13: ffff8880b9c26488 R14: ffff8880b9c26440 R15: ffff8880b9c263c0 [ 14.277510][ C0] FS: 0000000000000000(0000) GS:ffff8880b9c00000(0000) knlGS:0000000000000000 [ 14.277523][ C0] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 14.277532][ C0] CR2: ffff88823ffff000 CR3: 000000000b68e000 CR4: 00000000003506f0 [ 14.277541][ C0] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 14.277549][ C0] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 14.277557][ C0] Call Trace: [ 14.277562][ C0] <IRQ> [ 14.277566][ C0] ? get_cpu_iowait_time_us+0x3f0/0x3f0 [ 14.277589][ C0] ? hrtimer_sleeper_start_expires+0x80/0x80 [ 14.277605][ C0] ? ktime_get_update_offsets_now+0x3eb/0x5c0 [ 14.277624][ C0] hrtimer_interrupt+0x31c/0x790 [ 14.277647][ C0] __sysvec_apic_timer_interrupt+0x146/0x530 [ 14.277664][ C0] sysvec_apic_timer_interrupt+0x8e/0xc0 [ 14.277688][ C0] </IRQ> [ 14.277693][ C0] asm_sysvec_apic_timer_interrupt+0x12/0x20 [ 14.277709][ C0] RIP: 0010:__sanitizer_cov_trace_pc+0x0/0x60 [ 14.277724][ C0] Code: 01 f0 4d 89 03 e9 63 fd ff ff b9 ff ff ff ff ba 08 00 00 00 4d 8b 03 48 0f bd ca 49 8b 45 00 48 63 c9 e9 64 ff ff ff 0f 1f 00 <65> 8b 05 59 33 8c 7e 89 c1 48 8b 34 24 81 e1 00 01 00 00 65 48 8b [ 14.277736][ C0] RSP: 0000:ffffc90000c67b18 EFLAGS: 00000293 [ 14.277747][ C0] RAX: 0000000000000000 RBX: 0000000000000000 RCX: 0000000000000000 [ 14.277757][ C0] RDX: ffff888140160000 RSI: ffffffff815d55f3 RDI: 0000000000000003 [ 14.277769][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffffff8fcb98a7 [ 14.277778][ C0] R10: ffffffff815d55e9 R11: 0000000000000000 R12: ffffffff8432d7f0 [ 14.277786][ C0] R13: 0000000000000200 R14: dffffc0000000000 R15: ffffc90000c67b78 [ 14.277796][ C0] ? univ8250_console_exit+0x70/0x70 [ 14.277813][ C0] ? console_unlock+0x7b9/0xc40 [ 14.277828][ C0] ? console_unlock+0x7c3/0xc40 [ 14.277842][ C0] ? __sanitizer_cov_trace_const_cmp8+0x1d/0x70 [ 14.277856][ C0] console_unlock+0x7c9/0xc40 [ 14.277872][ C0] ? devkmsg_read+0x7d0/0x7d0 [ 14.277886][ C0] ? lock_release+0x720/0x720 [ 14.277904][ C0] ? vprintk+0x8d/0x260 [ 14.277918][ C0] ? vprintk+0x8d/0x260 [ 14.277933][ C0] vprintk_emit+0x1ca/0x560 [ 14.277948][ C0] vprintk+0x8d/0x260 [ 14.277961][ C0] printk+0xba/0xed [ 14.277978][ C0] ? record_print_text.cold+0x16/0x16 [ 14.277997][ C0] ? copy_regset_to_user+0x160/0x160 [ 14.278016][ C0] load_certificate_list.cold+0x8f/0xa1 [ 14.278031][ C0] ? context_tracking_init+0x86/0x86 [ 14.278046][ C0] do_one_initcall+0x103/0x650 [ 14.278062][ C0] ? perf_trace_initcall_level+0x400/0x400 [ 14.278076][ C0] ? parameq+0xf0/0x170 [ 14.278089][ C0] ? asm_common_interrupt+0x1e/0x40 [ 14.278110][ C0] kernel_init_freeable+0x6b8/0x741 [ 14.278128][ C0] ? rest_init+0x3e0/0x3e0 [ 14.278141][ C0] kernel_init+0x1a/0x1d0 [ 14.278152][ C0] ? rest_init+0x3e0/0x3e0 [ 14.278163][ C0] ret_from_fork+0x1f/0x30 [ 14.278186][ C0] Kernel panic - not syncing: panic_on_warn set ... [ 14.278193][ C0] CPU: 0 PID: 1 Comm: swapper/0 Not tainted 5.14.0-rc5-syzkaller #0 [ 14.278206][ C0] Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 07/22/2022 [ 14.278213][ C0] Call Trace: [ 14.278217][ C0] <IRQ> [ 14.278221][ C0] dump_stack_lvl+0xcd/0x134 [ 14.278240][ C0] panic+0x306/0x73d [ 14.278252][ C0] ? __warn_printk+0xf3/0xf3 [ 14.278269][ C0] ? __warn.cold+0x1a/0x44 [ 14.278282][ C0] ? __hrtimer_run_queues+0xbf5/0x1230 [ 14.278299][ C0] __warn.cold+0x35/0x44 [ 14.278312][ C0] ? __hrtimer_run_queues+0xbf5/0x1230 [ 14.278328][ C0] report_bug+0x1bd/0x210 [ 14.278344][ C0] handle_bug+0x3c/0x60 [ 14.278364][ C0] exc_invalid_op+0x14/0x40 [ 14.278378][ C0] asm_exc_invalid_op+0x12/0x20 [ 14.278390][ C0] RIP: 0010:__hrtimer_run_queues+0xbf5/0x1230 [ 14.278407][ C0] Code: 10 00 0f 0b e9 70 f6 ff ff bd 01 00 00 00 e8 b2 44 10 00 48 8b 34 24 48 c7 c7 a0 cd 8d 89 c6 05 0b 9e f2 0b 01 e8 75 c9 82 07 <0f> 0b e8 94 44 10 00 31 ff 89 ee e8 cb 4a 10 00 40 84 ed 0f 84 00 [ 14.278419][ C0] RSP: 0000:ffffc90000007e20 EFLAGS: 00010086 [ 14.278430][ C0] RAX: 0000000000000000 RBX: 0000000000000000 RCX: 0000000000000000 [ 14.278438][ C0] RDX: ffff888140160000 RSI: ffffffff815d8865 RDI: fffff52000000fb6 [ 14.278447][ C0] RBP: 0000000000000001 R08: 0000000000000000 R09: 0000000000000001 [ 14.278455][ C0] R10: ffffffff815d269e R11: 0000000000000000 R12: ffff8880b9c26d60 [ 14.278464][ C0] R13: ffff8880b9c26488 R14: ffff8880b9c26440 R15: ffff8880b9c263c0 [ 14.278476][ C0] ? wake_up_klogd.part.0+0x8e/0xd0 [ 14.278490][ C0] ? vprintk+0x95/0x260 [ 14.278504][ C0] ? get_cpu_iowait_time_us+0x3f0/0x3f0 [ 14.278524][ C0] ? hrtimer_sleeper_start_expires+0x80/0x80 [ 14.278540][ C0] ? ktime_get_update_offsets_now+0x3eb/0x5c0 [ 14.278559][ C0] hrtimer_interrupt+0x31c/0x790 [ 14.278581][ C0] __sysvec_apic_timer_interrupt+0x146/0x530 [ 14.278597][ C0] sysvec_apic_timer_interrupt+0x8e/0xc0 [ 14.278614][ C0] </IRQ> [ 14.278619][ C0] asm_sysvec_apic_timer_interrupt+0x12/0x20 [ 14.278633][ C0] RIP: 0010:__sanitizer_cov_trace_pc+0x0/0x60 [ 14.278647][ C0] Code: 01 f0 4d 89 03 e9 63 fd ff ff b9 ff ff ff ff ba 08 00 00 00 4d 8b 03 48 0f bd ca 49 8b 45 00 48 63 c9 e9 64 ff ff ff 0f 1f 00 <65> 8b 05 59 33 8c 7e 89 c1 48 8b 34 24 81 e1 00 01 00 00 65 48 8b [ 14.278659][ C0] RSP: 0000:ffffc90000c67b18 EFLAGS: 00000293 [ 14.278669][ C0] RAX: 0000000000000000 RBX: 0000000000000000 RCX: 0000000000000000 [ 14.278677][ C0] RDX: ffff888140160000 RSI: ffffffff815d55f3 RDI: 0000000000000003 [ 14.278686][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffffff8fcb98a7 [ 14.278694][ C0] R10: ffffffff815d55e9 R11: 0000000000000000 R12: ffffffff8432d7f0 [ 14.278703][ C0] R13: 0000000000000200 R14: dffffc0000000000 R15: ffffc90000c67b78 [ 14.278713][ C0] ? univ8250_console_exit+0x70/0x70 [ 14.278727][ C0] ? console_unlock+0x7b9/0xc40 [ 14.278741][ C0] ? console_unlock+0x7c3/0xc40 [ 14.278755][ C0] ? __sanitizer_cov_trace_const_cmp8+0x1d/0x70 [ 14.278769][ C0] console_unlock+0x7c9/0xc40 [ 14.278785][ C0] ? devkmsg_read+0x7d0/0x7d0 [ 14.278798][ C0] ? lock_release+0x720/0x720 [ 14.278815][ C0] ? vprintk+0x8d/0x260 [ 14.278828][ C0] ? vprintk+0x8d/0x260 [ 14.278843][ C0] vprintk_emit+0x1ca/0x560 [ 14.278858][ C0] vprintk+0x8d/0x260 [ 14.278871][ C0] printk+0xba/0xed [ 14.278885][ C0] ? record_print_text.cold+0x16/0x16 [ 14.278905][ C0] ? copy_regset_to_user+0x160/0x160 [ 14.278922][ C0] load_certificate_list.cold+0x8f/0xa1 [ 14.278936][ C0] ? context_tracking_init+0x86/0x86 [ 14.278949][ C0] do_one_initcall+0x103/0x650 [ 14.278964][ C0] ? perf_trace_initcall_level+0x400/0x400 [ 14.278982][ C0] ? parameq+0xf0/0x170 [ 14.278995][ C0] ? asm_common_interrupt+0x1e/0x40 [ 14.279015][ C0] kernel_init_freeable+0x6b8/0x741 [ 14.279032][ C0] ? rest_init+0x3e0/0x3e0 [ 14.279044][ C0] kernel_init+0x1a/0x1d0 [ 14.279055][ C0] ? rest_init+0x3e0/0x3e0 [ 14.279066][ C0] ret_from_fork+0x1f/0x30 [ 14.279390][ C0] Kernel Offset: disabled [ 15.085281][ C0] Rebooting in 86400 seconds..
syzkaller build log: go env (err=<nil>) GO111MODULE="auto" GOARCH="amd64" GOBIN="" GOCACHE="/syzkaller/.cache/go-build" GOENV="/syzkaller/.config/go/env" GOEXE="" GOEXPERIMENT="" GOFLAGS="" GOHOSTARCH="amd64" GOHOSTOS="linux" GOINSECURE="" GOMODCACHE="/syzkaller/jobs/linux/gopath/pkg/mod" GONOPROXY="" GONOSUMDB="" GOOS="linux" GOPATH="/syzkaller/jobs/linux/gopath" GOPRIVATE="" GOPROXY="https://proxy.golang.org,direct" GOROOT="/usr/local/go" GOSUMDB="sum.golang.org" GOTMPDIR="" GOTOOLDIR="/usr/local/go/pkg/tool/linux_amd64" GOVCS="" GOVERSION="go1.17" GCCGO="gccgo" AR="ar" CC="gcc" CXX="g++" CGO_ENABLED="1" GOMOD="/syzkaller/jobs/linux/gopath/src/github.com/google/syzkaller/go.mod" CGO_CFLAGS="-g -O2" CGO_CPPFLAGS="" CGO_CXXFLAGS="-g -O2" CGO_FFLAGS="-g -O2" CGO_LDFLAGS="-g -O2" PKG_CONFIG="pkg-config" GOGCCFLAGS="-fPIC -m64 -pthread -fmessage-length=0 -fdebug-prefix-map=/tmp/go-build3435624800=/tmp/go-build -gno-record-gcc-switches"
git status (err=<nil>) HEAD detached at 9d2ab5dfe nothing to commit, working tree clean
go list -f '{{.Stale}}' ./sys/syz-sysgen | grep -q false || go install ./sys/syz-sysgen make .descriptions bin/syz-sysgen touch .descriptions GOOS=linux GOARCH=amd64 go build "-ldflags=-s -w -X github.com/google/syzkaller/prog.GitRevision=9d2ab5dfe7727dfea4b9b279f4edf731acb386ef -X 'github.com/google/syzkaller/prog.gitRevisionDate=20210626-071149'" "-tags=syz_target syz_os_linux syz_arch_amd64 " -o ./bin/linux_amd64/syz-fuzzer github.com/google/syzkaller/syz-fuzzer GOOS=linux GOARCH=amd64 go build "-ldflags=-s -w -X github.com/google/syzkaller/prog.GitRevision=9d2ab5dfe7727dfea4b9b279f4edf731acb386ef -X 'github.com/google/syzkaller/prog.gitRevisionDate=20210626-071149'" "-tags=syz_target syz_os_linux syz_arch_amd64 " -o ./bin/linux_amd64/syz-execprog github.com/google/syzkaller/tools/syz-execprog GOOS=linux GOARCH=amd64 go build "-ldflags=-s -w -X github.com/google/syzkaller/prog.GitRevision=9d2ab5dfe7727dfea4b9b279f4edf731acb386ef -X 'github.com/google/syzkaller/prog.gitRevisionDate=20210626-071149'" "-tags=syz_target syz_os_linux syz_arch_amd64 " -o ./bin/linux_amd64/syz-stress github.com/google/syzkaller/tools/syz-stress mkdir -p ./bin/linux_amd64 gcc -o ./bin/linux_amd64/syz-executor executor/executor.cc \ -m64 -O2 -pthread -Wall -Werror -Wparentheses -Wunused-const-variable -Wframe-larger-than=16384 -static -fpermissive -w -DGOOS_linux=1 -DGOARCH_amd64=1 \ -DHOSTGOOS_linux=1 -DGIT_REVISION=\"9d2ab5dfe7727dfea4b9b279f4edf731acb386ef\"
Error text is too large and was truncated, full error text is at: https://syzkaller.appspot.com/x/error.txt?x=14ce83da080000
Tested on:
commit: f80e2148 hrtimer: Unbreak hrtimer_force_reprogram() git tree: https://git.kernel.org/pub/scm/linux/kernel/git/netdev/net.git kernel config: https://syzkaller.appspot.com/x/.config?x=31eef52c6517a0c2 dashboard link: https://syzkaller.appspot.com/bug?extid=3ba0493d523d007b3819 compiler: gcc (Debian 10.2.1-6) 10.2.1 20210110, GNU ld (GNU Binutils for Debian) 2.35.2 patch: https://syzkaller.appspot.com/x/patch.diff?x=16b49b22080000
| |