BUG: spinlock lockup while performing FS operations and detectedstalls on CPUs / tasks.

Ok. I set up a network console and got the output

# nc -u -l -p 6969
---
SysRq : Changing Loglevel
Loglevel set to 9
INFO: rcu_preempt_state detected stalls on CPUs/tasks: { 0 1 4}
(detected by 5, t=60092 jiffies)
INFO: rcu_bh_state detected stalls on CPUs/tasks: { 0 1 4} (detected by
2, t=60138 jiffies)
INFO: task mc:6679 blocked for more than 120 seconds.
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
mc D 000000000082b8fd 0 6679 6527 0x00000000
0000000000005000 0000000000000000 ffff8804184dbf40 0000000000000000
0000000000000000 0000000000000000 0000000000000000 ffff88042fff9e00
0000000000000001 00000000000213da 0000000091827364 ffff8804198c3aa0
Call Trace:
[] ? xfs_vm_readpages+0x18/0x20
[] ? __do_page_cache_readahead+0x20d/0x2c0
[] ? __do_page_cache_readahead+0xb5/0x2c0
[] ? ra_submit+0x1c/0x20
[] ? ondemand_readahead+0x106/0x2b0
[] ? page_cache_sync_readahead+0x2c/0x40
[] ? generic_file_aio_read+0x428/0x770
[] ? xfs_ilock+0xa5/0xb0
[] ? xfs_file_aio_read+0x122/0x250
[] ? do_sync_read+0xd2/0x110
[] ? security_file_permission+0x8c/0xa0
[] ? vfs_read+0xc3/0x170
[] ? sys_read+0x4c/0x90
[] ? system_call_fastpath+0x16/0x1b
2 locks held by mc/6679:
#0: (xfs_iolock_active){.+.+.+}, at: []
xfs_ilock+0xa5/0xb0
#1: (&(&conf->device_lock)->rlock){..-...}, at: []
release_stripe+0x32/0x60
INFO: task kworker/1:2:6722 blocked for more than 120 seconds.
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
kworker/1:2 D 0000000000000000 0 6722 2 0x00000000
ffff8802fafd3c50 0000000000000046 ffffffff81495b05 0000000000000002
ffff8802fafd3c10 0000000000000046 0000000000010b40 ffff88041a820f30
0000000000010b40 ffff8802fafd3fd8 ffff8802fafd2000 0000000000004000
Call Trace:
[] ? schedule+0x695/0xa10
[] ? load_balance+0xd1/0x830
[] ? mark_held_locks+0x72/0xa0
[] mutex_lock_nested+0x167/0x380
[] ? flush_commit_list+0x138/0x6e0
[] ? trace_hardirqs_on_caller+0x12d/0x170
[] flush_commit_list+0x138/0x6e0
[] flush_async_commits+0x5a/0x70
[] process_one_work+0x18b/0x440
[] ? process_one_work+0x12a/0x440
[] ? get_list_bitmap+0xc0/0xc0
[] worker_thread+0x162/0x340
[] ? manage_workers.clone.25+0x230/0x230
[] kthread+0x96/0xa0
[] kernel_thread_helper+0x4/0x10
[] ? finish_task_switch+0x80/0x110
[] ? retint_restore_args+0xe/0xe
[] ? __init_kthread_worker+0x70/0x70
[] ? gs_change+0xb/0xb
3 locks held by kworker/1:2/6722:
#0: (reiserfs){.+.+..}, at: []
process_one_work+0x12a/0x440
#1: ((&(&journal->j_work)->work)){+.+...}, at: []
process_one_work+0x12a/0x440
#2: (&jl->j_commit_mutex){+.+...}, at: []
flush_commit_list+0x138/0x6e0
BUG: spinlock lockup on CPU#4, mc/6679, ffff880419895200
Pid: 6679, comm: mc Tainted: G W 3.0.4-gentoo-r1 #8
Call Trace:
[] do_raw_spin_lock+0x156/0x170
[] _raw_spin_lock_irqsave+0x49/0x60
[] ? release_stripe+0x32/0x60
[] ? _raw_spin_unlock_irqrestore+0x3d/0x70
[] release_stripe+0x32/0x60
[] raid5_end_write_request+0xcf/0x120
[] bio_endio+0x18/0x30
[] req_bio_endio.clone.39+0x8b/0xd0
[] blk_update_request+0xf3/0x500
[] ? blk_update_request+0x329/0x500
[] ? ata_scsi_qc_complete+0x65/0x460
[] blk_update_bidi_request+0x2f/0x90
[] blk_end_bidi_request+0x2a/0x80
[] blk_end_request+0xb/0x10
[] scsi_io_completion+0x97/0x5d0
[] scsi_finish_command+0xb2/0xe0
[] scsi_softirq_done+0x9d/0x130
[] blk_done_softirq+0x7d/0x90
[] __do_softirq+0xa8/0x140
[] call_softirq+0x1c/0x30
[] do_softirq+0x85/0xc0
[] irq_exit+0x9e/0xc0
[] do_IRQ+0x61/0xd0
[] common_interrupt+0x13/0x13
[] ? _raw_spin_unlock_irq+0x31/0x60
[] ? _raw_spin_unlock_irq+0x2b/0x60
[] scsi_request_fn+0x34e/0x400
[] __blk_run_queue+0x19/0x20
[] cfq_insert_request+0x345/0x4d0
[] __elv_add_request+0x126/0x1e0
[] blk_flush_plug_list+0x1b0/0x200
[] schedule+0x432/0xa10
[] ? mark_held_locks+0x72/0xa0
[] ? get_parent_ip+0x11/0x50
[] ? sub_preempt_count+0x95/0xd0
[] get_active_stripe+0x312/0x6f0
[] ? try_to_wake_up+0x2d0/0x2d0
[] make_request+0x1a8/0x720
[] ? wake_up_bit+0x40/0x40
[] md_make_request+0x16e/0x2f0
[] ? md_make_request+0x58/0x2f0
[] generic_make_request+0x14c/0x2f0
[] submit_bio+0x61/0xd0
[] do_mpage_readpage+0x317/0x650
[] ? __lru_cache_add+0x76/0xc0
[] mpage_readpages+0xfc/0x150
[] ? xfs_get_blocks_direct+0x20/0x20
[] ? xfs_get_blocks_direct+0x20/0x20
[] xfs_vm_readpages+0x18/0x20
[] __do_page_cache_readahead+0x20d/0x2c0
[] ? __do_page_cache_readahead+0xb5/0x2c0
[] ra_submit+0x1c/0x20
[] ondemand_readahead+0x106/0x2b0
[] page_cache_sync_readahead+0x2c/0x40
[] generic_file_aio_read+0x428/0x770
[] ? xfs_ilock+0xa5/0xb0
[] xfs_file_aio_read+0x122/0x250
[] do_sync_read+0xd2/0x110
[] ? security_file_permission+0x8c/0xa0
[] vfs_read+0xc3/0x170
[] sys_read+0x4c/0x90
[] system_call_fastpath+0x16/0x1b
BUG: spinlock lockup on CPU#1, sync_supers/152, ffff880419895200
Pid: 152, comm: sync_supers Tainted: G W 3.0.4-gentoo-r1 #8
Call Trace:
[] do_raw_spin_lock+0x156/0x170
[] _raw_spin_lock_irq+0x44/0x50
[] ? get_active_stripe+0x31a/0x6f0
[] get_active_stripe+0x31a/0x6f0
[] ? try_to_wake_up+0x2d0/0x2d0
[] make_request+0x1a8/0x720
[] ? wake_up_bit+0x40/0x40
[] md_make_request+0x16e/0x2f0
[] ? md_make_request+0x58/0x2f0
[] ? kmem_cache_alloc+0x33/0xc0
[] generic_make_request+0x14c/0x2f0
[] submit_bio+0x61/0xd0
[] submit_bh+0xe6/0x120
[] write_ordered_chunk+0x5b/0x90
[] add_to_chunk+0x4c/0x80
[] ? add_to_chunk+0x80/0x80
[] write_ordered_buffers.clone.31+0x8d/0x2a0
[] ? trace_hardirqs_on+0xd/0x10
[] flush_commit_list+0x1bf/0x6e0
[] do_journal_end.clone.34+0xdb4/0xf20
[] ? bdi_sched_wait+0x10/0x10
[] journal_end_sync+0x64/0x70
[] reiserfs_sync_fs+0x58/0x70
[] ? down_read+0x2f/0x50
[] reiserfs_write_super+0xe/0x10
[] sync_supers+0xfa/0x100
[] bdi_sync_supers+0x41/0x60
[] ? bdi_sched_wait+0x10/0x10
[] kthread+0x96/0xa0
[] kernel_thread_helper+0x4/0x10
[] ? finish_task_switch+0x80/0x110
[] ? retint_restore_args+0xe/0xe
[] ? __init_kthread_worker+0x70/0x70
[] ? gs_change+0xb/0xb
SysRq : Emergency Sync
SysRq : Trigger a crash
BUG: unable to handle kernel NULL pointer dereference at (null)
IP: [] sysrq_handle_crash+0x11/0x20
PGD 419dc2067 PUD 41996d067 PMD 0
Oops: 0002 [#1] PREEMPT SMP
CPU 2
Modules linked in: netconsole snd_hrtimer nfsd it87 hwmon_vid
ipt_MASQUERADE iptable_nat nf_nat nf_conntrack_ipv4 nf_defrag_ipv4
xt_TCPMSS xt_tcpmss ipt_REJECT ipv6 iptable_filter snd_seq_midi
snd_seq_oss snd_seq_midi_event snd_seq snd_pcm_oss snd_mixer_oss
binfmt_misc snd_hda_codec_hdmi tuner tea5767 tda8290 tda18271 tda827x
tuner_xc2028 xc5000 tda9887 tuner_simple tuner_types mt20xx tea5761
snd_ice1724 snd_hda_codec_realtek snd_rawmidi snd_seq_device
snd_ice17xx_ak4xxx snd_hda_intel joydev snd_ac97_codec snd_hda_codec
ac97_bus saa7134 snd_ak4xxx_adda snd_ak4114 snd_pt2258 snd_i2c
snd_ak4113 videobuf_dma_sg snd_hwdep k10temp snd_pcm videobuf_core
v4l2_common videodev parport_pc v4l2_compat_ioctl32 processor snd_timer
sp5100_tco parport snd tveeprom thermal_sys button hwmon i2c_piix4 r8169
mii snd_page_alloc i2c_core scsi_transport_iscsi fuse nfs auth_rpcgss
lockd sunrpc jfs ext4 jbd2 ext3 jbd ext2 mbcache scsi_wait_scan
hid_monterey hid_microsoft hid_logitech hid_ezkey hid_cypress
hid_chicony hid_cherry hid_belkin hid_apple hid_a4tech usbhid
usb_storage scsi_transport_fc scsi_tgt sr_mod cdrom sg sata_nv
pata_jmicron pata_atiixp pata_amd

Pid: 0, comm: kworker/0:1 Tainted: G W 3.0.4-gentoo-r1 #8
Gigabyte Technology Co., Ltd. GA-870A-UD3/GA-870A-UD3
RIP: 0010:[] []
sysrq_handle_crash+0x11/0x20
RSP: 0018:ffff88042fc83a28 EFLAGS: 00010096
RAX: 0000000000000010 RBX: 0000000000000063 RCX: 0000000000000000
RDX: 000000000000e7e6 RSI: 0000000000000001 RDI: 0000000000000063
RBP: ffff88042fc83a28 R08: 0000000000000001 R09: 0000000000000000
R10: 00000000000000c3 R11: 0000000000000001 R12: ffffffff818a3560
R13: 0000000000000082 R14: 0000000000000009 R15: 0000000000000001
FS: 00007f22d8459720(0000) GS:ffff88042fc80000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
CR2: 0000000000000000 CR3: 000000041d637000 CR4: 00000000000006e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Process kworker/0:1 (pid: 0, threadinfo ffff88042d8dc000, task
ffff88042d8adb20)
Stack:
ffff88042fc83a68 ffffffff8129a889 0000000000000002 ffff88041980ac00
0000000000000000 0000000000000001 0000000000000000 000000000000002e
ffff88042fc83aa8 ffffffff8129a9e6 0000000000000001 ffffffff0000002e
Call Trace:

[] __handle_sysrq+0x119/0x180
[] sysrq_filter+0xa6/0x1a0
[] input_pass_event+0xc5/0x120
[] ? input_handler_for_each_handle+0xc0/0xc0
[] input_handle_event+0x83/0x530
[] input_event+0x67/0x90
[] hidinput_hid_event+0x150/0x380
[] hid_process_event+0x10d/0x150
[] hid_report_raw_event+0x3bd/0x430
[] hid_input_report+0x1b9/0x250
[] hid_irq_in+0x1db/0x230 [usbhid]
[] usb_hcd_giveback_urb+0x3f/0xa0
[] finish_urb+0x99/0x130
[] takeback_td+0x11d/0x140
[] dl_done_list+0x15f/0x170
[] ohci_irq+0x26c/0x310
[] ? _raw_spin_unlock+0x30/0x60
[] usb_hcd_irq+0x3f/0xb0
[] handle_irq_event_percpu+0x43/0x150
[] handle_irq_event+0x43/0x70
[] ? _raw_spin_lock+0x3e/0x50
[] ? handle_fasteoi_irq+0x19/0xd0
[] handle_fasteoi_irq+0x55/0xd0
[] handle_irq+0x1d/0x30
[] do_IRQ+0x58/0xd0
[] common_interrupt+0x13/0x13

[] ? default_idle+0x33/0x60
[] ? default_idle+0x31/0x60
[] amd_e400_idle+0x51/0x100
[] cpu_idle+0x56/0xb0
[] start_secondary+0x1ae/0x1b3
Code: e2 04 83 e0 8f 09 d0 88 41 03 c9 c3 66 66 66 66 66 2e 0f 1f 84 00
00 00 00 00 55 c7 05 a1 3a 72 00 01 00 00 00 48 89 e5 0f ae f8 04
25 00 00 00 00 01 c9 c3 0f 1f 44 00 00 55 31 c0 48 89 e5
RIP [] sysrq_handle_crash+0x11/0x20
RSP
CR2: 0000000000000000
---[ end trace 9072890fe59b0c99 ]---
Kernel panic - not syncing: Fatal exception in interrupt
Pid: 0, comm: kworker/0:1 Tainted: G D W 3.0.4-gentoo-r1 #8
Call Trace:
[] panic+0x96/0x1a0
[] ? kmsg_dump+0xed/0x140
[] oops_end+0xda/0xe0
[] no_context+0xf0/0x260
[] __bad_area_nosemaphore+0x11d/0x1d0
[] bad_area_nosemaphore+0xe/0x10
[] do_page_fault+0x2b0/0x430
[] ? _raw_spin_unlock_irqrestore+0x3d/0x70
[] ? console_unlock+0x1a2/0x200
[] ? trace_hardirqs_off_thunk+0x3a/0x3c
[] page_fault+0x1f/0x30
[] ? sysrq_handle_crash+0x11/0x20
[] __handle_sysrq+0x119/0x180
[] sysrq_filter+0xa6/0x1a0
[] input_pass_event+0xc5/0x120
[] ? input_handler_for_each_handle+0xc0/0xc0
[] input_handle_event+0x83/0x530
[] input_event+0x67/0x90
[] hidinput_hid_event+0x150/0x380
[] hid_process_event+0x10d/0x150
[] hid_report_raw_event+0x3bd/0x430
[] hid_input_report+0x1b9/0x250
[] hid_irq_in+0x1db/0x230 [usbhid]
[] usb_hcd_giveback_urb+0x3f/0xa0
[] finish_urb+0x99/0x130
[] takeback_td+0x11d/0x140
[] dl_done_list+0x15f/0x170
[] ohci_irq+0x26c/0x310
[] ? _raw_spin_unlock+0x30/0x60
[] usb_hcd_irq+0x3f/0xb0
[] handle_irq_event_percpu+0x43/0x150
[] handle_irq_event+0x43/0x70
[] ? _raw_spin_lock+0x3e/0x50
[] ? handle_fasteoi_irq+0x19/0xd0
[] handle_fasteoi_irq+0x55/0xd0
[] handle_irq+0x1d/0x30
[] do_IRQ+0x58/0xd0
[] common_interrupt+0x13/0x13
[] ? default_idle+0x33/0x60
[] ? default_idle+0x31/0x60
[] amd_e400_idle+0x51/0x100
[] cpu_idle+0x56/0xb0
[] start_secondary+0x1ae/0x1b3



---
Gentoo Linux user
Paramonov Valeriy