SuperMicro X9DRH-iF (CSE-216BA-R920LPB, BPN-SAS-213A) 2x E5-2667v2 @3.3GHz (8 cores with 2 HT) 256GB GB 1600MHz ECC 3x LSI 9207-8i 14x HGST HUC109090CSS600 (900GB, 10K) 10x Intel DC S3700 (400GB, SSD) Solaris 11.1 SRU 21.4 filebench 1.4.8 (0.175.1.0.0.24.2) as is with 'set $dir=/pool1/test' Bay layout: H H H H H H H S S S S S H H H H H H H S S S S S 3 2 1 0 7 6 5 4 | 3 2 1 0 7 6 5 4 | 3 2 1 0 7 6 5 4 04:00 82:00 83:00 1 1 1 1 1 1 1 1 1 1 2 2 2 2 0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1 2 3 > diskinfo -oDn D:devchassis-path n:occupant-part --------------------------- ----------------------- /dev/chassis/SYS/HDD0/disk HITACHI-HUC109090CSS600 /dev/chassis/SYS/HDD1/disk HITACHI-HUC109090CSS600 /dev/chassis/SYS/HDD2/disk HITACHI-HUC109090CSS600 /dev/chassis/SYS/HDD3/disk HITACHI-HUC109090CSS600 /dev/chassis/SYS/HDD4/disk HITACHI-HUC109090CSS600 /dev/chassis/SYS/HDD5/disk HITACHI-HUC109090CSS600 /dev/chassis/SYS/HDD6/disk HITACHI-HUC109090CSS600 /dev/chassis/SYS/HDD7/disk ATA-INTEL-SSDSC2BA40 /dev/chassis/SYS/HDD8/disk ATA-INTEL-SSDSC2BA40 /dev/chassis/SYS/HDD9/disk ATA-INTEL-SSDSC2BA40 /dev/chassis/SYS/HDD10/disk ATA-INTEL-SSDSC2BA40 /dev/chassis/SYS/HDD11/disk ATA-INTEL-SSDSC2BA40 /dev/chassis/SYS/HDD12/disk HITACHI-HUC109090CSS600 /dev/chassis/SYS/HDD13/disk HITACHI-HUC109090CSS600 /dev/chassis/SYS/HDD14/disk HITACHI-HUC109090CSS600 /dev/chassis/SYS/HDD15/disk HITACHI-HUC109090CSS600 /dev/chassis/SYS/HDD16/disk HITACHI-HUC109090CSS600 /dev/chassis/SYS/HDD17/disk HITACHI-HUC109090CSS600 /dev/chassis/SYS/HDD18/disk HITACHI-HUC109090CSS600 /dev/chassis/SYS/HDD19/disk ATA-INTEL-SSDSC2BA40 /dev/chassis/SYS/HDD20/disk ATA-INTEL-SSDSC2BA40 /dev/chassis/SYS/HDD21/disk ATA-INTEL-SSDSC2BA40 /dev/chassis/SYS/HDD22/disk ATA-INTEL-SSDSC2BA40 /dev/chassis/SYS/HDD23/disk ATA-INTEL-SSDSC2BA40 > + /net/software/export/install/dos/flashutils.dsk/lsi/etc/diskutil.sh -s Name Index Slot Seg:Bus:Dev:Fn WWN Model S/N Firmware BIOS Ports DevPath mpt_sas0 1 1 00:04:00:00 500605b0089f17f0 SAS9207-8i SV4082XXXX 18.00.00.00-IT 7.35.00.00 (2013.11.15) 8 /pci@0,0/pci8086,e08@3/pci1000,3020@0 mpt_sas1 2 6 00:82:00:00 500605b0089f1900 SAS9207-8i SV4082XXXX 18.00.00.00-IT 7.35.00.00 (2013.11.15) 8 /pci@79,0/pci8086,e04@2/pci1000,3020@0 mpt_sas2 3 7 00:83:00:00 500605b0089ec880 SAS9207-8i SV4082XXXX 18.00.00.00-IT 7.35.00.00 (2013.11.15) 8 /pci@79,0/pci8086,e06@2,2/pci1000,3020@0 sd3: 'HITACHI HUC109090CSS600 ' S/N: KPHXXXXX Tunables: throttle-max (max #cmds allowed in transport) : 256 controller-type : 2 (SCSI ComnCmdSet) retries-notready (# of tries before error) : 2 retries-busy (# of tries before cmd failing) : 5 retries-reset (# of tries before reset) : 2 timeout-releasereservation : 5 throttle-min (min #cmds allowed in transport) : 8 disksort (lba sorting enabled) : true reset-lun (device supports lun reset) : false cache-nonvolatile (suppress cache flush) : false power-condition (power condition enabled) : true delay-busy (µs to wait before retry throttled cmd): 500 retries-timeout (# of times to retry a normal op) : 5 rmw-type : 0 (RMW with warn) emulation-rmw (rmw forced) : false physical-block-size [byte] : 512 mmc-gesn-polling (geteventstatuspolling enabled) : 1 Misc: System blocksize [byte] : 512 Sd logical blocksize [byte] : 512 Sd system blocks : 1758174768 Command timeout (Timeout for completion) : 60 Max. DMA transfer size : 1048576 Is SSD : 0 Sync cache command supported : 1 Sync nv cache supported : 0 Sync nv cache required : 0 Write cache enabled : 1 Adaptive throttling enabled : 0 Power Management enabled : 1 Power Management supported : 0 Is Hotpluggable : 0 Current Power Level : 3 sd4: 'ATA INTEL SSDSC2BA40' S/N: BTTV313XXXXX Tunables: throttle-max (max #cmds allowed in transport) : 256 controller-type : 2 (SCSI ComnCmdSet) retries-notready (# of tries before error) : 1 retries-busy (# of tries before cmd failing) : 3 retries-reset (# of tries before reset) : 1 timeout-releasereservation : 5 throttle-min (min #cmds allowed in transport) : 8 disksort (lba sorting enabled) : true reset-lun (device supports lun reset) : false cache-nonvolatile (suppress cache flush) : false power-condition (power condition enabled) : true delay-busy (µs to wait before retry throttled cmd): 500 retries-timeout (# of times to retry a normal op) : 3 rmw-type : 0 (RMW with warn) emulation-rmw (rmw forced) : false physical-block-size [byte] : 4096 mmc-gesn-polling (geteventstatuspolling enabled) : 1 Misc: System blocksize [byte] : 512 Sd logical blocksize [byte] : 512 Sd system blocks : 781422768 Command timeout (Timeout for completion) : 60 Max. DMA transfer size : 1048576 Is SSD : 1 Sync cache command supported : 1 Sync nv cache supported : 0 Sync nv cache required : 0 Write cache enabled : 1 Adaptive throttling enabled : 1 Power Management enabled : 1 Power Management supported : 1 Is Hotpluggable : 0 Current Power Level : 1 setenv DEV /dev/chassis/SYS # HDD tests + zpool create -o failmode=continue -O atime=off -O compression=on pool1 \ mirror $DEV/HDD2/disk $DEV/HDD14/disk \ mirror $DEV/HDD3/disk $DEV/HDD15/disk \ mirror $DEV/HDD4/disk $DEV/HDD16/disk \ mirror $DEV/HDD5/disk $DEV/HDD17/disk \ mirror $DEV/HDD6/disk $DEV/HDD18/disk \ spare $DEV/HDD1/disk $DEV/HDD13/disk \ log $DEV/HDD7/disk $DEV/HDD19/disk # SDD test + zpool create -o failmode=continue -O atime=off -O compression=on pool1 \ mirror $DEV/HDD8 $DEV/HDD20 \ mirror $DEV/HDD9 $DEV/HDD21 \ mirror $DEV/HDD10 $DEV/HDD22 \ mirror $DEV/HDD11 $DEV/HDD23 \ spare $DEV/HDD1/disk $DEV/HDD13/disk Linux/3.13.0-32-generic #57-Ubuntu SMP Tue Jul 15 03:51:08 UTC 2014 x86_64 =========================================================================== HDDs: + parted $DEV/HDD$I/disk mklabel gpt + parted -a none $DEV/HDD$I/disk mkpart primary 256s 1758158335s + parted -a none $DEV/HDD$I/disk mkpart primary 1758158336s 1758174719s + mdadm --create /dev/md0 --auto md --level=10 --chunk=128 \ --raid-devices=10 --spare-devices=2 \ $DEV/HDD2/p1 $DEV/HDD14/p1 \ $DEV/HDD3/p1 $DEV/HDD15/p1 \ $DEV/HDD4/p1 $DEV/HDD16/p1 \ $DEV/HDD5/p1 $DEV/HDD17/p1 \ $DEV/HDD6/p1 $DEV/HDD18/p1 \ $DEV/HDD1/p1 $DEV/HDD13/p1 \ $DEV/HDD1/p1 $DEV/HDD13/p1 + /sbin/mdadm --detail /dev/md0 /dev/md0: Version : 1.2 Creation Time : Tue Aug 19 06:42:37 2014 Raid Level : raid10 Array Size : 4394738560 (4191.15 GiB 4500.21 GB) Used Dev Size : 878947712 (838.23 GiB 900.04 GB) Raid Devices : 10 Total Devices : 12 Persistence : Superblock is persistent Update Time : Tue Aug 19 06:42:37 2014 State : clean, resyncing Active Devices : 10 Working Devices : 12 Failed Devices : 0 Spare Devices : 2 Layout : near=2 Chunk Size : 128K Resync Status : 0% complete Name : baal:0 (local to host baal) UUID : fba062dc:df587ce5:1f4a75e8:c3682b34 Events : 0 Number Major Minor RaidDevice State 0 8 33 0 active sync /dev/sdc1 1 8 209 1 active sync /dev/sdn1 2 8 17 2 active sync /dev/sdb1 3 8 193 3 active sync /dev/sdm1 4 8 113 4 active sync /dev/sdh1 5 65 1 5 active sync /dev/sdq1 6 8 97 6 active sync /dev/sdg1 7 65 49 7 active sync /dev/sdt1 8 8 81 8 active sync /dev/sdf1 9 65 33 9 active sync /dev/sds1 10 8 49 - spare /dev/sdd1 11 8 225 - spare /dev/sdo1 # 5 "internal mirrors" * 200MB ~= 1 GB max expected sync rate: # default is 200MB! echo '1000000' | + tee /sys/block/md0/md/sync_speed_max cat /proc/mdstat Personalities : [linear] [multipath] [raid0] [raid1] [raid6] [raid5] [raid4] [raid10] md0 : active raid10 sdo1[11](S) sdd1[10](S) sds1[9] sdf1[8] sdt1[7] sdg1[6] sdq1[5] sdh1[4] sdm1[3] sdb1[2] sdn1[1] sdc1[0] 4394738560 blocks super 1.2 128K chunks 2 near-copies [10/10] [UUUUUUUUUU] [>....................] resync = 1.2% (55620992/4394738560) finish=75.3min speed=960154K/sec + mkfs.xfs -f -l logdev=$DEV/HDD7/p1,size=2136997888 -L pool1 /dev/md0 meta-data=/dev/md0 isize=256 agcount=32, agsize=34333888 blks = sectsz=512 attr=2, projid32bit=0 data = bsize=4096 blocks=1098684416, imaxpct=5 = sunit=32 swidth=160 blks naming =version 2 bsize=4096 ascii-ci=0 log =/dev/chassis/SYS/HDD7/p1 bsize=4096 blocks=521728, version=2 = sectsz=512 sunit=32 blks, lazy-count=1 realtime =none extsz=4096 blocks=0, rtextents=0 SSDs: + parted $DEV/HDD$I/disk mklabel gpt + parted -a none $DEV/HDD$I/disk mkpart primary 256s 781406207s + parted -a none $DEV/HDD$I/disk mkpart primary 781406208s 781422591s + mdadm --create /dev/md1 --auto md --level=10 --chunk=128 --raid-devices=8 \ $DEV/HDD8/p1 $DEV/HDD20/p1 \ $DEV/HDD9/p1 $DEV/HDD21/p1 \ $DEV/HDD10/p1 $DEV/HDD22/p1 \ $DEV/HDD11/p1 $DEV/HDD23/p1 # 4 "internal mirrors" * 400MB ~= 1.6 GB max expected sync rate: echo '2000000' | + tee /sys/block/md0/md/sync_speed_max cat /proc/mdstat Personalities : [linear] [multipath] [raid0] [raid1] [raid6] [raid5] [raid4] [raid10] md1 : active raid10 sdu1[7] sdj1[6] sdv1[5] sdk1[4] sdw1[3] sdl1[2] sdx1[1] sdi1[0] 1562286592 blocks super 1.2 128K chunks 2 near-copies [8/8] [UUUUUUUU] [=>...................] resync = 9.0% (140760832/1562286592) finish=17.5min speed=1345112K/sec cat /proc/mdstat Personalities : [linear] [multipath] [raid0] [raid1] [raid6] [raid5] [raid4] [raid10] md1 : active raid10 sdu1[7] sdj1[6] sdv1[5] sdk1[4] sdw1[3] sdl1[2] sdx1[1] sdi1[0] 1562286592 blocks super 1.2 128K chunks 2 near-copies [8/8] [UUUUUUUU] [=================>...] resync = 89.7% (1401887296/1562286592) finish=1.9min speed=1342188K/sec + /sbin/mdadm --detail /dev/md1 /dev/md1: Version : 1.2 Creation Time : Wed Aug 20 23:28:10 2014 Raid Level : raid10 Array Size : 1562286592 (1489.91 GiB 1599.78 GB) Used Dev Size : 390571648 (372.48 GiB 399.95 GB) Raid Devices : 8 Total Devices : 8 Persistence : Superblock is persistent Update Time : Wed Aug 20 23:48:15 2014 State : clean Active Devices : 8 Working Devices : 8 Failed Devices : 0 Spare Devices : 0 Layout : near=2 Chunk Size : 128K Name : baal:1 (local to host baal) UUID : 7e8cdc29:96d48008:459c93cc:81f96923 Events : 17 Number Major Minor RaidDevice State 0 8 129 0 active sync /dev/sdi1 1 65 113 1 active sync /dev/sdx1 2 8 177 2 active sync /dev/sdl1 3 65 97 3 active sync /dev/sdw1 4 8 161 4 active sync /dev/sdk1 5 65 81 5 active sync /dev/sdv1 6 8 145 6 active sync /dev/sdj1 7 65 65 7 active sync /dev/sdu1 + /sbin/mdadm --detail /dev/md1 /dev/md1: Version : 1.2 Creation Time : Wed Aug 20 23:28:10 2014 Raid Level : raid10 Array Size : 1562286592 (1489.91 GiB 1599.78 GB) Used Dev Size : 390571648 (372.48 GiB 399.95 GB) Raid Devices : 8 Total Devices : 8 Persistence : Superblock is persistent Update Time : Wed Aug 20 23:48:15 2014 State : clean Active Devices : 8 Working Devices : 8 Failed Devices : 0 Spare Devices : 0 Layout : near=2 Chunk Size : 128K Name : baal:1 (local to host baal) UUID : 7e8cdc29:96d48008:459c93cc:81f96923 Events : 17 Number Major Minor RaidDevice State 0 8 129 0 active sync /dev/sdi1 1 65 113 1 active sync /dev/sdx1 2 8 177 2 active sync /dev/sdl1 3 65 97 3 active sync /dev/sdw1 4 8 161 4 active sync /dev/sdk1 5 65 81 5 active sync /dev/sdv1 6 8 145 6 active sync /dev/sdj1 7 65 65 7 active sync /dev/sdu1 + mkfs.xfs -f /dev/md1 meta-data=/dev/md1 isize=256 agcount=32, agsize=12205376 blks = sectsz=4096 attr=2, projid32bit=0 data = bsize=4096 blocks=390571648, imaxpct=5 = sunit=32 swidth=128 blks naming =version 2 bsize=4096 ascii-ci=0 log =internal log bsize=4096 blocks=190708, version=2 = sectsz=4096 sunit=1 blks, lazy-count=1 realtime =none extsz=4096 blocks=0, rtextents=0 10xHGST + 2SSD log mirror + mdadm --create /dev/md3 --auto md --level=10 --chunk=128 --raid-devices=2 \ $DEV/HDD7/p1 $DEV/HDD19/p1 cat /proc/mdstat Personalities : [linear] [multipath] [raid0] [raid1] [raid6] [raid5] [raid4] [raid10] md3 : active raid10 sdr1[1] sde1[0] 390571648 blocks super 1.2 2 near-copies [2/2] [UU] [=>...................] resync = 9.6% (37683840/390571648) finish=10.3min speed=565336K/sec + mkfs.xfs -f -L pool1 -l logdev=/dev/md3,size=2136997888 /dev/md0 =============================================================================== For xfs2 and btrfs tests kernel was updated to 3.17.0-031700rc1-generic #201408161335 SMP Sat Aug 16 17:36:29 UTC 2014 x86_64 and xfsprogs to 3.2.1. In addition for mkfs.xfs the new V5 options -m crc=1,finobt=1 were used. NOTE: btrfs SSD tests with "advanced" features like compression, noatime, nobarrier never completed, because sooner or later btrfs kernel workers deadlocked (causing the NMI watchdog to jump in with "BUG: soft lockup" permanently, but even that couldn't fix it). So we tried several times, but without any luck - we always had to reboot the machine to get back to a stable environment. So it seems, that btrfs is nothing to consider for fast storage/fast machines, but might be ok for 1-2 slow SATA HDDs! =============================================================================== + mkfs.btrfs -f -d raid10 -m raid10 -L pool1 \ $DEV/HDD2/disk $DEV/HDD14/disk \ $DEV/HDD3/disk $DEV/HDD15/disk \ $DEV/HDD4/disk $DEV/HDD16/disk \ $DEV/HDD5/disk $DEV/HDD17/disk \ $DEV/HDD6/disk $DEV/HDD18/disk \ + mkfs.btrfs -f -d raid10 -m raid10 -L pool1 \ $DEV/HDD8/disk $DEV/HDD20/disk \ $DEV/HDD9/disk $DEV/HDD21/disk \ $DEV/HDD10/disk $DEV/HDD22/disk \ $DEV/HDD11/disk $DEV/HDD23/disk WARNING! - Btrfs v3.14.1 IS EXPERIMENTAL WARNING! - see http://btrfs.wiki.kernel.org before using Performing full device TRIM (372.61GiB) ... Turning ON incompat feature 'extref': increased hardlink limit per file to 65536 Performing full device TRIM (372.61GiB) ... adding device /dev/chassis/SYS/HDD20/disk id 2 Performing full device TRIM (372.61GiB) ... adding device /dev/chassis/SYS/HDD9/disk id 3 Performing full device TRIM (372.61GiB) ... adding device /dev/chassis/SYS/HDD21/disk id 4 Performing full device TRIM (372.61GiB) ... adding device /dev/chassis/SYS/HDD10/disk id 5 Performing full device TRIM (372.61GiB) ... adding device /dev/chassis/SYS/HDD22/disk id 6 Performing full device TRIM (372.61GiB) ... adding device /dev/chassis/SYS/HDD11/disk id 7 Performing full device TRIM (372.61GiB) ... adding device /dev/chassis/SYS/HDD23/disk id 8 fs created label pool1 on /dev/chassis/SYS/HDD8/disk nodesize 16384 leafsize 16384 sectorsize 4096 size 2.91TiB [11679.633960] sd 1:0:0:0: [sdi] [11679.633968] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE [11679.633970] sd 1:0:0:0: [sdi] [11679.633972] Sense Key : Illegal Request [current] [11679.633975] Info fld=0x2e800000 [11679.633976] sd 1:0:0:0: [sdi] [11679.633979] Add. Sense: Logical block address out of range [11679.633980] sd 1:0:0:0: [sdi] CDB: [11679.633981] Unmap/Read sub-channel: 42 00 00 00 00 00 00 00 18 00 [11679.633986] end_request: critical target error, dev sdi, sector 780140544 [11679.653442] BTRFS: device label pool1 devid 1 transid 3 /dev/chassis/SYS/HDD8/disk [11710.399797] sd 2:0:7:0: [sdx] [11710.399802] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE [11710.399804] sd 2:0:7:0: [sdx] [11710.399804] Sense Key : Illegal Request [current] [11710.399806] Info fld=0x2e800000 [11710.399807] sd 2:0:7:0: [sdx] [11710.399808] Add. Sense: Logical block address out of range [11710.399809] sd 2:0:7:0: [sdx] CDB: [11710.399809] Unmap/Read sub-channel: 42 00 00 00 00 00 00 00 18 00 [11710.399813] end_request: critical target error, dev sdx, sector 780140544 [11710.408268] BTRFS: device label pool1 devid 2 transid 3 /dev/chassis/SYS/HDD20/disk [11741.078002] sd 1:0:3:0: [sdl] [11741.078007] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE [11741.078008] sd 1:0:3:0: [sdl] [11741.078009] Sense Key : Illegal Request [current] [11741.078010] Info fld=0x2e800000 [11741.078012] sd 1:0:3:0: [sdl] [11741.078013] Add. Sense: Logical block address out of range [11741.078014] sd 1:0:3:0: [sdl] CDB: [11741.078015] Unmap/Read sub-channel: 42 00 00 00 00 00 00 00 18 00 [11741.078019] end_request: critical target error, dev sdl, sector 780140544 [11741.086468] BTRFS: device label pool1 devid 3 transid 3 /dev/chassis/SYS/HDD9/disk [11771.773339] sd 2:0:6:0: [sdw] [11771.773344] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE [11771.773345] sd 2:0:6:0: [sdw] [11771.773346] Sense Key : Illegal Request [current] [11771.773348] Info fld=0x2e800000 [11771.773348] sd 2:0:6:0: [sdw] [11771.773349] Add. Sense: Logical block address out of range [11771.773350] sd 2:0:6:0: [sdw] CDB: [11771.773351] Unmap/Read sub-channel: 42 00 00 00 00 00 00 00 18 00 [11771.773354] end_request: critical target error, dev sdw, sector 780140544 [11771.781785] BTRFS: device label pool1 devid 4 transid 3 /dev/chassis/SYS/HDD21/disk [11802.517032] sd 1:0:2:0: [sdk] [11802.517037] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE [11802.517038] sd 1:0:2:0: [sdk] [11802.517039] Sense Key : Illegal Request [current] [11802.517041] Info fld=0x2e800000 [11802.517042] sd 1:0:2:0: [sdk] [11802.517043] Add. Sense: Logical block address out of range [11802.517044] sd 1:0:2:0: [sdk] CDB: [11802.517044] Unmap/Read sub-channel: 42 00 00 00 00 00 00 00 18 00 [11802.517048] end_request: critical target error, dev sdk, sector 780140544 [11802.525490] BTRFS: device label pool1 devid 5 transid 3 /dev/chassis/SYS/HDD10/disk [11833.263708] sd 2:0:5:0: [sdv] [11833.263713] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE [11833.263714] sd 2:0:5:0: [sdv] [11833.263715] Sense Key : Illegal Request [current] [11833.263716] Info fld=0x2e800000 [11833.263717] sd 2:0:5:0: [sdv] [11833.263718] Add. Sense: Logical block address out of range [11833.263719] sd 2:0:5:0: [sdv] CDB: [11833.263720] Unmap/Read sub-channel: 42 00 00 00 00 00 00 00 18 00 [11833.263723] end_request: critical target error, dev sdv, sector 780140544 [11833.271978] BTRFS: device label pool1 devid 6 transid 3 /dev/chassis/SYS/HDD22/disk [11863.969203] sd 1:0:1:0: [sdj] [11863.969208] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE [11863.969209] sd 1:0:1:0: [sdj] [11863.969210] Sense Key : Illegal Request [current] [11863.969212] Info fld=0x2e800000 [11863.969213] sd 1:0:1:0: [sdj] [11863.969214] Add. Sense: Logical block address out of range [11863.969215] sd 1:0:1:0: [sdj] CDB: [11863.969216] Unmap/Read sub-channel: 42 00 00 00 00 00 00 00 18 00 [11863.969220] end_request: critical target error, dev sdj, sector 780140544 [11863.977659] BTRFS: device label pool1 devid 7 transid 3 /dev/chassis/SYS/HDD11/disk [11894.684610] sd 2:0:4:0: [sdu] [11894.684616] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE [11894.684617] sd 2:0:4:0: [sdu] [11894.684618] Sense Key : Illegal Request [current] [11894.684620] Info fld=0x2e800000 [11894.684621] sd 2:0:4:0: [sdu] [11894.684622] Add. Sense: Logical block address out of range [11894.684623] sd 2:0:4:0: [sdu] CDB: [11894.684624] Unmap/Read sub-channel: 42 00 00 00 00 00 00 00 18 00 [11894.684628] end_request: critical target error, dev sdu, sector 780140544 [11894.693014] BTRFS: device label pool1 devid 8 transid 3 /dev/chassis/SYS/HDD23/disk [12287.229853] BTRFS info (device sdu): disk space caching is enabled [12287.229855] BTRFS: flagging fs with big metadata feature [12287.232703] BTRFS: detected SSD devices, enabling SSD mode [12287.234343] BTRFS: creating UUID tree Aug 22 00:03:21 baal kernel: [ 6966.051868] NMI watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [kworker/u65:17:8308] Aug 22 00:03:21 baal kernel: [ 6966.059851] Modules linked in: 8021q garp stp mrp llc rfcomm bnep bluetooth joydev x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel kvm crct10dif_pclmul crc32_pclmul ghash_clmulni_intel aesni_intel aes_x86_64 lrw gf128mul glue_helper ablk_helper cryptd nfsd mei_me mei auth_rpcgss lpc_ich nfs_acl sb_edac nfs ioatdma lockd edac_core sunrpc fscache ipmi_si ipmi_msghandler wmi mac_hid parport_pc ppdev lp parport xfs libcrc32c btrfs raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq igb i2c_algo_bit raid1 hid_generic e1000e mpt2sas dca raid0 usbhid raid_class ptp multipath hid scsi_transport_sas pps_core linear Aug 22 00:03:21 baal kernel: [ 6966.059898] CPU: 0 PID: 8308 Comm: kworker/u65:17 Not tainted 3.17.0-031700rc1-generic #201408161335 Aug 22 00:03:21 baal kernel: [ 6966.059899] Hardware name: WBS F224A-DE5/X9DRH-iF, BIOS 3.0b 04/28/2014 Aug 22 00:03:21 baal kernel: [ 6966.059918] Workqueue: btrfs-endio-write normal_work_helper [btrfs] Aug 22 00:03:21 baal kernel: [ 6966.059920] task: ffff881fcc479400 ti: ffff88169fcf8000 task.ti: ffff88169fcf8000 Aug 22 00:03:21 baal kernel: [ 6966.059921] RIP: 0010:[] [] queue_read_lock_slowpath+0xa7/0xd0 Aug 22 00:03:21 baal kernel: [ 6966.059926] RSP: 0018:ffff88169fcfb958 EFLAGS: 00000202 Aug 22 00:03:21 baal kernel: [ 6966.059927] RAX: 00000000000047d6 RBX: 0000000000000000 RCX: 0000000000005358 Aug 22 00:03:21 baal kernel: [ 6966.059929] RDX: ffff881be586ed88 RSI: 0000000000005358 RDI: ffff881be586ed8c Aug 22 00:03:21 baal kernel: [ 6966.059930] RBP: ffff88169fcfb958 R08: 0000000000005356 R09: 0000000000000000 Aug 22 00:03:21 baal kernel: [ 6966.059931] R10: ffff881be5adde70 R11: 0000000000000000 R12: 0000000000000000 Aug 22 00:03:21 baal kernel: [ 6966.059933] R13: 0000000000000000 R14: ffff881be586ed98 R15: 0000000000000000 Aug 22 00:03:21 baal kernel: [ 6966.059934] FS: 0000000000000000(0000) GS:ffff881fffc00000(0000) knlGS:0000000000000000 Aug 22 00:03:21 baal kernel: [ 6966.059936] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 00:03:21 baal kernel: [ 6966.059937] CR2: 00007fffec171c8c CR3: 0000000001c16000 CR4: 00000000001407f0 Aug 22 00:03:21 baal kernel: [ 6966.059939] Stack: Aug 22 00:03:21 baal kernel: [ 6966.059940] ffff88169fcfb968 ffffffff817a178d ffff88169fcfb988 ffffffffc0536b44 Aug 22 00:03:21 baal kernel: [ 6966.059942] 0000000000000002 ffffffffffffffec ffff88169fcfb9a8 ffffffffc04d447a Aug 22 00:03:21 baal kernel: [ 6966.059944] ffff8816c0cbc090 0000000000000001 ffff88169fcfba48 ffffffffc04d9bc2 Aug 22 00:03:21 baal kernel: [ 6966.059947] Call Trace: Aug 22 00:03:21 baal kernel: [ 6966.059952] [] _raw_read_lock+0x1d/0x30 Aug 22 00:03:21 baal kernel: [ 6966.059967] [] btrfs_clear_lock_blocking_rw+0x54/0x100 [btrfs] Aug 22 00:03:21 baal kernel: [ 6966.059977] [] btrfs_clear_path_blocking+0x3a/0x80 [btrfs] Aug 22 00:03:21 baal kernel: [ 6966.059986] [] btrfs_search_slot+0x572/0x880 [btrfs] Aug 22 00:03:21 baal kernel: [ 6966.059999] [] ? release_extent_buffer+0x36/0xe0 [btrfs] Aug 22 00:03:21 baal kernel: [ 6966.060009] [] btrfs_next_old_leaf+0x21f/0x460 [btrfs] Aug 22 00:03:21 baal kernel: [ 6966.060017] [] btrfs_next_leaf+0x10/0x20 [btrfs] Aug 22 00:03:21 baal kernel: [ 6966.060027] [] __btrfs_drop_extents+0x1e2/0xdf0 [btrfs] Aug 22 00:03:21 baal kernel: [ 6966.060037] [] ? merge_state.part.31+0xd2/0x140 [btrfs] Aug 22 00:03:21 baal kernel: [ 6966.060047] [] insert_reserved_file_extent.constprop.63+0xab/0x310 [btrfs] Aug 22 00:03:21 baal kernel: [ 6966.060056] [] ? start_transaction.part.35+0x80/0x530 [btrfs] Aug 22 00:03:21 baal kernel: [ 6966.060065] [] btrfs_finish_ordered_io+0x475/0x580 [btrfs] Aug 22 00:03:21 baal kernel: [ 6966.060073] [] finish_ordered_fn+0x15/0x20 [btrfs] Aug 22 00:03:21 baal kernel: [ 6966.060083] [] normal_work_helper+0x79/0x1b0 [btrfs] Aug 22 00:03:21 baal kernel: [ 6966.060087] [] process_one_work+0x17f/0x490 Aug 22 00:03:21 baal kernel: [ 6966.060089] [] worker_thread+0x11b/0x3f0 Aug 22 00:03:21 baal kernel: [ 6966.060091] [] ? create_worker+0x1e0/0x1e0 Aug 22 00:03:21 baal kernel: [ 6966.060094] [] kthread+0xc9/0xe0 Aug 22 00:03:21 baal kernel: [ 6966.060096] [] ? flush_kthread_worker+0x90/0x90 Aug 22 00:03:21 baal kernel: [ 6966.060098] [] ret_from_fork+0x7c/0xb0 Aug 22 00:03:21 baal kernel: [ 6966.060100] [] ? flush_kthread_worker+0x90/0x90 Aug 22 00:03:21 baal kernel: [ 6966.060101] Code: 01 0f 1f 00 74 e8 e8 15 c3 6c 00 5d c3 8b 07 3c ff 0f 1f 00 75 d8 f3 90 8b 02 3c ff 74 f8 5d c3 83 e1 fe 0f b7 f1 b8 00 80 00 00 <44> 0f b7 42 04 66 44 39 c1 74 88 f3 90 83 e8 01 75 ee 0f 1f 80 Aug 22 00:03:21 baal kernel: [ 6966.091827] NMI watchdog: BUG: soft lockup - CPU#4 stuck for 22s! [kworker/u65:5:8077] Aug 22 00:03:21 baal kernel: [ 6966.099732] Modules linked in: 8021q garp stp mrp llc rfcomm bnep bluetooth joydev x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel kvm crct10dif_pclmul crc32_pclmul ghash_clmulni_intel aesni_intel aes_x86_64 lrw gf128mul glue_helper ablk_helper cryptd nfsd mei_me mei auth_rpcgss lpc_ich nfs_acl sb_edac nfs ioatdma lockd edac_core sunrpc fscache ipmi_si ipmi_msghandler wmi mac_hid parport_pc ppdev lp parport xfs libcrc32c btrfs raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq igb i2c_algo_bit raid1 hid_generic e1000e mpt2sas dca raid0 usbhid raid_class ptp multipath hid scsi_transport_sas pps_core linear Aug 22 00:03:21 baal kernel: [ 6966.099764] CPU: 4 PID: 8077 Comm: kworker/u65:5 Tainted: G L 3.17.0-031700rc1-generic #201408161335 Aug 22 00:03:21 baal kernel: [ 6966.099765] Hardware name: WBS F224A-DE5/X9DRH-iF, BIOS 3.0b 04/28/2014 Aug 22 00:03:21 baal kernel: [ 6966.099778] Workqueue: btrfs-endio-write normal_work_helper [btrfs] Aug 22 00:03:21 baal kernel: [ 6966.099780] task: ffff881fcfe70000 ti: ffff8816a6060000 task.ti: ffff8816a6060000 Aug 22 00:03:21 baal kernel: [ 6966.099781] RIP: 0010:[] [] queue_write_lock_slowpath+0x72/0xd0 Aug 22 00:03:21 baal kernel: [ 6966.099784] RSP: 0018:ffff8816a6063978 EFLAGS: 00000206 Aug 22 00:03:21 baal kernel: [ 6966.099786] RAX: 0000000000000101 RBX: 0000000000000000 RCX: 00000000000000ff Aug 22 00:03:21 baal kernel: [ 6966.099787] RDX: ffff881be586ed88 RSI: 0000000000000101 RDI: ffff881be586ed8c Aug 22 00:03:21 baal kernel: [ 6966.099788] RBP: ffff8816a6063978 R08: 0000000000005356 R09: 0000000000000000 Aug 22 00:03:21 baal kernel: [ 6966.099789] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 Aug 22 00:03:21 baal kernel: [ 6966.099791] R13: ffff881fffc945c0 R14: ffff881fd2d4ad38 R15: 0000000000000000 Aug 22 00:03:21 baal kernel: [ 6966.099792] FS: 0000000000000000(0000) GS:ffff881fffc80000(0000) knlGS:0000000000000000 Aug 22 00:03:21 baal kernel: [ 6966.099793] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 00:03:21 baal kernel: [ 6966.099795] CR2: 00007ffff7a87ec0 CR3: 0000000001c16000 CR4: 00000000001407e0 Aug 22 00:03:21 baal kernel: [ 6966.099796] Stack: Aug 22 00:03:21 baal kernel: [ 6966.099797] ffff8816a6063988 ffffffff817a1665 ffff8816a60639f8 ffffffffc0536ff9 Aug 22 00:03:21 baal kernel: [ 6966.099799] ffff8816a60639c8 ffffffff00000000 ffff881fcfe70000 ffffffff810b3f50 Aug 22 00:03:21 baal kernel: [ 6966.099801] ffff8816a60639b8 ffff8816a60639b8 ffff8816a6063a18 ffff881e5f74d000 Aug 22 00:03:21 baal kernel: [ 6966.099803] Call Trace: Aug 22 00:03:21 baal kernel: [ 6966.099806] [] _raw_write_lock+0x25/0x30 Aug 22 00:03:21 baal kernel: [ 6966.099820] [] btrfs_tree_lock+0xc9/0x1d0 [btrfs] Aug 22 00:03:21 baal kernel: [ 6966.099824] [] ? add_wait_queue+0x60/0x60 Aug 22 00:03:21 baal kernel: [ 6966.099834] [] btrfs_lock_root_node+0x3b/0x50 [btrfs] Aug 22 00:03:21 baal kernel: [ 6966.099841] [] btrfs_search_slot+0x787/0x880 [btrfs] Aug 22 00:03:21 baal kernel: [ 6966.099850] [] btrfs_lookup_file_extent+0x38/0x40 [btrfs] Aug 22 00:03:21 baal kernel: [ 6966.099860] [] __btrfs_drop_extents+0x151/0xdf0 [btrfs] Aug 22 00:03:21 baal kernel: [ 6966.099868] [] ? btrfs_search_slot+0x747/0x880 [btrfs] Aug 22 00:03:21 baal kernel: [ 6966.099871] [] ? kmem_cache_alloc+0x1b3/0x1f0 Aug 22 00:03:21 baal kernel: [ 6966.099880] [] ? btrfs_alloc_path+0x1a/0x20 [btrfs] Aug 22 00:03:21 baal kernel: [ 6966.099889] [] ? btrfs_alloc_path+0x1a/0x20 [btrfs] Aug 22 00:03:21 baal kernel: [ 6966.099901] [] insert_reserved_file_extent.constprop.63+0xab/0x310 [btrfs] Aug 22 00:03:21 baal kernel: [ 6966.099911] [] ? start_transaction.part.35+0x80/0x530 [btrfs] Aug 22 00:03:21 baal kernel: [ 6966.099923] [] btrfs_finish_ordered_io+0x475/0x580 [btrfs] Aug 22 00:03:21 baal kernel: [ 6966.099936] [] ? end_compressed_bio_write+0x31/0xf0 [btrfs] Aug 22 00:03:21 baal kernel: [ 6966.099947] [] finish_ordered_fn+0x15/0x20 [btrfs] Aug 22 00:03:21 baal kernel: [ 6966.099959] [] normal_work_helper+0x79/0x1b0 [btrfs] Aug 22 00:03:21 baal kernel: [ 6966.099962] [] process_one_work+0x17f/0x490 Aug 22 00:03:21 baal kernel: [ 6966.099964] [] worker_thread+0x11b/0x3f0 Aug 22 00:03:21 baal kernel: [ 6966.099966] [] ? create_worker+0x1e0/0x1e0 Aug 22 00:03:21 baal kernel: [ 6966.099968] [] kthread+0xc9/0xe0 Aug 22 00:03:21 baal kernel: [ 6966.099971] [] ? flush_kthread_worker+0x90/0x90 Aug 22 00:03:21 baal kernel: [ 6966.099973] [] ret_from_fork+0x7c/0xb0 Aug 22 00:03:21 baal kernel: [ 6966.099975] [] ? flush_kthread_worker+0x90/0x90 Aug 22 00:03:21 baal kernel: [ 6966.099976] Code: 00 f3 90 8b 0a 84 c9 66 90 75 f6 89 ce 89 c8 83 ce 01 f0 0f b1 32 39 c8 75 e7 b9 ff 00 00 00 eb 0a 0f 1f 84 00 00 00 00 00 f3 90 <8b> 02 83 f8 01 75 f7 f0 0f b1 0a 83 f8 01 75 ee eb b3 0f 1f 40 Aug 22 00:03:21 baal kernel: [ 6966.347578] NMI watchdog: BUG: soft lockup - CPU#16 stuck for 22s! [kworker/u65:8:8293] Aug 22 00:03:21 baal kernel: [ 6966.355566] Modules linked in: 8021q garp stp mrp llc rfcomm bnep bluetooth joydev x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel kvm crct10dif_pclmul crc32_pclmul ghash_clmulni_intel aesni_intel aes_x86_64 lrw gf128mul glue_helper ablk_helper cryptd nfsd mei_me mei auth_rpcgss lpc_ich nfs_acl sb_edac nfs ioatdma lockd edac_core sunrpc fscache ipmi_si ipmi_msghandler wmi mac_hid parport_pc ppdev lp parport xfs libcrc32c btrfs raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq igb i2c_algo_bit raid1 hid_generic e1000e mpt2sas dca raid0 usbhid raid_class ptp multipath hid scsi_transport_sas pps_core linear Aug 22 00:03:21 baal kernel: [ 6966.355613] CPU: 16 PID: 8293 Comm: kworker/u65:8 Tainted: G L 3.17.0-031700rc1-generic #201408161335 Aug 22 00:03:21 baal kernel: [ 6966.355614] Hardware name: WBS F224A-DE5/X9DRH-iF, BIOS 3.0b 04/28/2014 Aug 22 00:03:21 baal kernel: [ 6966.355633] Workqueue: btrfs-endio-write normal_work_helper [btrfs] Aug 22 00:03:21 baal kernel: [ 6966.355634] task: ffff881fcc478000 ti: ffff881fd0960000 task.ti: ffff881fd0960000 Aug 22 00:03:21 baal kernel: [ 6966.355636] RIP: 0010:[] [] queue_read_lock_slowpath+0xb4/0xd0 Aug 22 00:03:21 baal kernel: [ 6966.355641] RSP: 0018:ffff881fd0963958 EFLAGS: 00000202 Aug 22 00:03:21 baal kernel: [ 6966.355642] RAX: 0000000000007b11 RBX: 0000000000000000 RCX: 000000000000535a Aug 22 00:03:21 baal kernel: [ 6966.355643] RDX: ffff881be586ed88 RSI: 000000000000535a RDI: ffff881be586ed8c Aug 22 00:03:21 baal kernel: [ 6966.355645] RBP: ffff881fd0963958 R08: 0000000000005356 R09: 0000000000000000 Aug 22 00:03:21 baal kernel: [ 6966.355646] R10: ffff881be5adde70 R11: 0000000000000000 R12: 0000000000000000 Aug 22 00:03:21 baal kernel: [ 6966.355647] R13: 0000000000000000 R14: ffff881be586ed98 R15: 0000000000000000 Aug 22 00:03:21 baal kernel: [ 6966.355649] FS: 0000000000000000(0000) GS:ffff881fffd00000(0000) knlGS:0000000000000000 Aug 22 00:03:21 baal kernel: [ 6966.355650] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 00:03:21 baal kernel: [ 6966.355652] CR2: 00007ffff7fdd000 CR3: 0000000001c16000 CR4: 00000000001407e0 Aug 22 00:03:21 baal kernel: [ 6966.355653] Stack: Aug 22 00:03:21 baal kernel: [ 6966.355654] ffff881fd0963968 ffffffff817a178d ffff881fd0963988 ffffffffc0536b44 Aug 22 00:03:21 baal kernel: [ 6966.355656] 0000000000000002 ffffffffffffffec ffff881fd09639a8 ffffffffc04d447a Aug 22 00:03:21 baal kernel: [ 6966.355658] ffff881567e2d870 0000000000000001 ffff881fd0963a48 ffffffffc04d9bc2 Aug 22 00:03:21 baal kernel: [ 6966.355661] Call Trace: Aug 22 00:03:21 baal kernel: [ 6966.355666] [] _raw_read_lock+0x1d/0x30 Aug 22 00:03:21 baal kernel: [ 6966.355679] [] btrfs_clear_lock_blocking_rw+0x54/0x100 [btrfs] Aug 22 00:03:21 baal kernel: [ 6966.355688] [] btrfs_clear_path_blocking+0x3a/0x80 [btrfs] Aug 22 00:03:21 baal kernel: [ 6966.355698] [] btrfs_search_slot+0x572/0x880 [btrfs] Aug 22 00:03:21 baal kernel: [ 6966.355710] [] ? release_extent_buffer+0x36/0xe0 [btrfs] Aug 22 00:03:21 baal kernel: [ 6966.355720] [] btrfs_next_old_leaf+0x21f/0x460 [btrfs] Aug 22 00:03:21 baal kernel: [ 6966.355730] [] btrfs_next_leaf+0x10/0x20 [btrfs] Aug 22 00:03:21 baal kernel: [ 6966.355742] [] __btrfs_drop_extents+0x1e2/0xdf0 [btrfs] Aug 22 00:03:21 baal kernel: [ 6966.355754] [] ? merge_state.part.31+0x135/0x140 [btrfs] Aug 22 00:03:21 baal kernel: [ 6966.355763] [] insert_reserved_file_extent.constprop.63+0xab/0x310 [btrfs] Aug 22 00:03:21 baal kernel: [ 6966.355772] [] ? start_transaction.part.35+0x80/0x530 [btrfs] Aug 22 00:03:21 baal kernel: [ 6966.355781] [] btrfs_finish_ordered_io+0x475/0x580 [btrfs] Aug 22 00:03:21 baal kernel: [ 6966.355792] [] ? end_compressed_bio_write+0x31/0xf0 [btrfs] Aug 22 00:03:21 baal kernel: [ 6966.355801] [] finish_ordered_fn+0x15/0x20 [btrfs] Aug 22 00:03:21 baal kernel: [ 6966.355810] [] normal_work_helper+0x79/0x1b0 [btrfs] Aug 22 00:03:21 baal kernel: [ 6966.355814] [] process_one_work+0x17f/0x490 Aug 22 00:03:21 baal kernel: [ 6966.355816] [] worker_thread+0x11b/0x3f0 Aug 22 00:03:21 baal kernel: [ 6966.355819] [] ? create_worker+0x1e0/0x1e0 Aug 22 00:03:21 baal kernel: [ 6966.355821] [] kthread+0xc9/0xe0 Aug 22 00:03:21 baal kernel: [ 6966.355823] [] ? flush_kthread_worker+0x90/0x90 Aug 22 00:03:21 baal kernel: [ 6966.355826] [] ret_from_fork+0x7c/0xb0 Aug 22 00:03:21 baal kernel: [ 6966.355828] [] ? flush_kthread_worker+0x90/0x90 Aug 22 00:03:21 baal kernel: [ 6966.355829] Code: 8b 07 3c ff 0f 1f 00 75 d8 f3 90 8b 02 3c ff 74 f8 5d c3 83 e1 fe 0f b7 f1 b8 00 80 00 00 44 0f b7 42 04 66 44 39 c1 74 88 f3 90 <83> e8 01 75 ee 0f 1f 80 00 00 00 00 eb e0 90 90 90 90 90 90 90 Aug 22 00:03:21 baal kernel: [ 6966.363561] NMI watchdog: BUG: soft lockup - CPU#17 stuck for 22s! [kworker/u65:9:8294] Aug 22 00:03:21 baal kernel: [ 6966.371549] Modules linked in: 8021q garp stp mrp llc rfcomm bnep bluetooth joydev x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel kvm crct10dif_pclmul crc32_pclmul ghash_clmulni_intel aesni_intel aes_x86_64 lrw gf128mul glue_helper ablk_helper cryptd nfsd mei_me mei auth_rpcgss lpc_ich nfs_acl sb_edac nfs ioatdma lockd edac_core sunrpc fscache ipmi_si ipmi_msghandler wmi mac_hid parport_pc ppdev lp parport xfs libcrc32c btrfs raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq igb i2c_algo_bit raid1 hid_generic e1000e mpt2sas dca raid0 usbhid raid_class ptp multipath hid scsi_transport_sas pps_core linear Aug 22 00:03:21 baal kernel: [ 6966.371571] CPU: 17 PID: 8294 Comm: kworker/u65:9 Tainted: G L 3.17.0-031700rc1-generic #201408161335 Aug 22 00:03:21 baal kernel: [ 6966.371572] Hardware name: WBS F224A-DE5/X9DRH-iF, BIOS 3.0b 04/28/2014 Aug 22 00:03:21 baal kernel: [ 6966.371582] Workqueue: btrfs-endio-write normal_work_helper [btrfs] Aug 22 00:03:21 baal kernel: [ 6966.371584] task: ffff881fcc47da00 ti: ffff881fd007c000 task.ti: ffff881fd007c000 Aug 22 00:03:21 baal kernel: [ 6966.371585] RIP: 0010:[] [] queue_write_lock_slowpath+0x74/0xd0 Aug 22 00:03:21 baal kernel: [ 6966.371587] RSP: 0018:ffff881fd007fa98 EFLAGS: 00000206 Aug 22 00:03:21 baal kernel: [ 6966.371588] RAX: 0000000000000201 RBX: 0000000000000085 RCX: 00000000000000ff Aug 22 00:03:21 baal kernel: [ 6966.371589] RDX: ffff881be5778198 RSI: 0000000000000301 RDI: ffff881be577819c Aug 22 00:03:21 baal kernel: [ 6966.371590] RBP: ffff881fd007fa98 R08: 00000000000004ec R09: 0000000000000000 Aug 22 00:03:21 baal kernel: [ 6966.371591] R10: ffff881be5adde70 R11: 0000000000000000 R12: ffffffff8179d67e Aug 22 00:03:21 baal kernel: [ 6966.371591] R13: ffff881fd007fa78 R14: 0000000000000000 R15: ffff883fcf5bb738 Aug 22 00:03:21 baal kernel: [ 6966.371592] FS: 0000000000000000(0000) GS:ffff881fffd20000(0000) knlGS:0000000000000000 Aug 22 00:03:21 baal kernel: [ 6966.371593] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 00:03:21 baal kernel: [ 6966.371594] CR2: 00007ffff7ff4000 CR3: 0000000001c16000 CR4: 00000000001407e0 Aug 22 00:03:21 baal kernel: [ 6966.371595] Stack: Aug 22 00:03:21 baal kernel: [ 6966.371595] ffff881fd007faa8 ffffffff817a1665 ffff881fd007fb18 ffffffffc0536ff9 Aug 22 00:03:21 baal kernel: [ 6966.371597] ffff881fd007fab8 ffff8826b8783000 ffff881fd007fc9f ffff8810bf55a090 Aug 22 00:03:21 baal kernel: [ 6966.371598] 0000000000000059 0000000200000007 0000000000000002 ffff8810bf55a090 Aug 22 00:03:21 baal kernel: [ 6966.371599] Call Trace: Aug 22 00:03:21 baal kernel: [ 6966.371602] [] _raw_write_lock+0x25/0x30 Aug 22 00:03:21 baal kernel: [ 6966.371611] [] btrfs_tree_lock+0xc9/0x1d0 [btrfs] Aug 22 00:03:21 baal kernel: [ 6966.371617] [] btrfs_search_slot+0x531/0x880 [btrfs] Aug 22 00:03:21 baal kernel: [ 6966.371623] [] btrfs_insert_empty_items+0x78/0xd0 [btrfs] Aug 22 00:03:21 baal kernel: [ 6966.371631] [] insert_reserved_file_extent.constprop.63+0x145/0x310 [btrfs] Aug 22 00:03:21 baal kernel: [ 6966.371638] [] ? start_transaction.part.35+0x80/0x530 [btrfs] Aug 22 00:03:21 baal kernel: [ 6966.371646] [] btrfs_finish_ordered_io+0x475/0x580 [btrfs] Aug 22 00:03:21 baal kernel: [ 6966.371654] [] ? end_compressed_bio_write+0x31/0xf0 [btrfs] Aug 22 00:03:21 baal kernel: [ 6966.371661] [] finish_ordered_fn+0x15/0x20 [btrfs] Aug 22 00:03:21 baal kernel: [ 6966.371668] [] normal_work_helper+0x79/0x1b0 [btrfs] Aug 22 00:03:21 baal kernel: [ 6966.371670] [] process_one_work+0x17f/0x490 Aug 22 00:03:21 baal kernel: [ 6966.371672] [] worker_thread+0x11b/0x3f0 Aug 22 00:03:21 baal kernel: [ 6966.371674] [] ? create_worker+0x1e0/0x1e0 Aug 22 00:03:21 baal kernel: [ 6966.371675] [] kthread+0xc9/0xe0 Aug 22 00:03:21 baal kernel: [ 6966.371676] [] ? flush_kthread_worker+0x90/0x90 Aug 22 00:03:21 baal kernel: [ 6966.371678] [] ret_from_fork+0x7c/0xb0 Aug 22 00:03:21 baal kernel: [ 6966.371680] [] ? flush_kthread_worker+0x90/0x90 Aug 22 00:03:21 baal kernel: [ 6966.371680] Code: 90 8b 0a 84 c9 66 90 75 f6 89 ce 89 c8 83 ce 01 f0 0f b1 32 39 c8 75 e7 b9 ff 00 00 00 eb 0a 0f 1f 84 00 00 00 00 00 f3 90 8b 02 <83> f8 01 75 f7 f0 0f b1 0a 83 f8 01 75 ee eb b3 0f 1f 40 00 8b Aug 22 00:03:22 baal kernel: [ 6966.391534] NMI watchdog: BUG: soft lockup - CPU#19 stuck for 22s! [kworker/u65:2:10071] Aug 22 00:03:22 baal kernel: [ 6966.399611] Modules linked in: 8021q garp stp mrp llc rfcomm bnep bluetooth joydev x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel kvm crct10dif_pclmul crc32_pclmul ghash_clmulni_intel aesni_intel aes_x86_64 lrw gf128mul glue_helper ablk_helper cryptd nfsd mei_me mei auth_rpcgss lpc_ich nfs_acl sb_edac nfs ioatdma lockd edac_core sunrpc fscache ipmi_si ipmi_msghandler wmi mac_hid parport_pc ppdev lp parport xfs libcrc32c btrfs raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq igb i2c_algo_bit raid1 hid_generic e1000e mpt2sas dca raid0 usbhid raid_class ptp multipath hid scsi_transport_sas pps_core linear Aug 22 00:03:22 baal kernel: [ 6966.399631] CPU: 19 PID: 10071 Comm: kworker/u65:2 Tainted: G L 3.17.0-031700rc1-generic #201408161335 Aug 22 00:03:22 baal kernel: [ 6966.399632] Hardware name: WBS F224A-DE5/X9DRH-iF, BIOS 3.0b 04/28/2014 Aug 22 00:03:22 baal kernel: [ 6966.399642] Workqueue: btrfs-endio-write normal_work_helper [btrfs] Aug 22 00:03:22 baal kernel: [ 6966.399643] task: ffff881fcfa9d000 ti: ffff881567b7c000 task.ti: ffff881567b7c000 Aug 22 00:03:22 baal kernel: [ 6966.399644] RIP: 0010:[] [] queue_read_lock_slowpath+0xb4/0xd0 Aug 22 00:03:22 baal kernel: [ 6966.399647] RSP: 0018:ffff881567b7f978 EFLAGS: 00000206 Aug 22 00:03:22 baal kernel: [ 6966.399648] RAX: 000000000000295b RBX: 0000000000000000 RCX: 000000000000535c Aug 22 00:03:22 baal kernel: [ 6966.399648] RDX: ffff881be586ed88 RSI: 000000000000535c RDI: ffff881be586ed8c Aug 22 00:03:22 baal kernel: [ 6966.399649] RBP: ffff881567b7f978 R08: 0000000000005356 R09: 0000000000000001 Aug 22 00:03:22 baal kernel: [ 6966.399650] R10: ffff881fd04e2aa0 R11: 0000000000001000 R12: 0000000000000000 Aug 22 00:03:22 baal kernel: [ 6966.399651] R13: ffff881fffd745c0 R14: 0000001300000000 R15: 0000000000000000 Aug 22 00:03:22 baal kernel: [ 6966.399652] FS: 0000000000000000(0000) GS:ffff881fffd60000(0000) knlGS:0000000000000000 Aug 22 00:03:22 baal kernel: [ 6966.399652] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 00:03:22 baal kernel: [ 6966.399653] CR2: 00007ffff7ff4000 CR3: 0000000001c16000 CR4: 00000000001407e0 Aug 22 00:03:22 baal kernel: [ 6966.399654] Stack: Aug 22 00:03:22 baal kernel: [ 6966.399655] ffff881567b7f988 ffffffff817a178d ffff881567b7f9f8 ffffffffc0536c37 Aug 22 00:03:22 baal kernel: [ 6966.399656] 0000000000000013 ffff881fcfa9d530 0000000100000000 ffff881fcfa9d5f0 Aug 22 00:03:22 baal kernel: [ 6966.399657] ffff881567b7f9d8 ffff881fffd745c0 0000000000000000 ffff881e5f74d000 Aug 22 00:03:22 baal kernel: [ 6966.399659] Call Trace: Aug 22 00:03:22 baal kernel: [ 6966.399661] [] _raw_read_lock+0x1d/0x30 Aug 22 00:03:22 baal kernel: [ 6966.399670] [] btrfs_tree_read_lock+0x47/0x120 [btrfs] Aug 22 00:03:22 baal kernel: [ 6966.399676] [] btrfs_read_lock_root_node+0x3b/0x50 [btrfs] Aug 22 00:03:22 baal kernel: [ 6966.399682] [] btrfs_search_slot+0x447/0x880 [btrfs] Aug 22 00:03:22 baal kernel: [ 6966.399689] [] btrfs_lookup_file_extent+0x38/0x40 [btrfs] Aug 22 00:03:22 baal kernel: [ 6966.399697] [] __btrfs_drop_extents+0x151/0xdf0 [btrfs] Aug 22 00:03:22 baal kernel: [ 6966.399702] [] ? btrfs_search_slot+0x747/0x880 [btrfs] Aug 22 00:03:22 baal kernel: [ 6966.399705] [] ? kmem_cache_alloc+0x1b3/0x1f0 Aug 22 00:03:22 baal kernel: [ 6966.399711] [] ? btrfs_alloc_path+0x1a/0x20 [btrfs] Aug 22 00:03:22 baal kernel: [ 6966.399716] [] ? btrfs_alloc_path+0x1a/0x20 [btrfs] Aug 22 00:03:22 baal kernel: [ 6966.399723] [] insert_reserved_file_extent.constprop.63+0xab/0x310 [btrfs] Aug 22 00:03:22 baal kernel: [ 6966.399730] [] ? start_transaction.part.35+0x80/0x530 [btrfs] Aug 22 00:03:22 baal kernel: [ 6966.399737] [] btrfs_finish_ordered_io+0x475/0x580 [btrfs] Aug 22 00:03:22 baal kernel: [ 6966.399745] [] ? end_compressed_bio_write+0x31/0xf0 [btrfs] Aug 22 00:03:22 baal kernel: [ 6966.399752] [] finish_ordered_fn+0x15/0x20 [btrfs] Aug 22 00:03:22 baal kernel: [ 6966.399759] [] normal_work_helper+0x79/0x1b0 [btrfs] Aug 22 00:03:22 baal kernel: [ 6966.399761] [] process_one_work+0x17f/0x490 Aug 22 00:03:22 baal kernel: [ 6966.399763] [] worker_thread+0x11b/0x3f0 Aug 22 00:03:22 baal kernel: [ 6966.399764] [] ? create_worker+0x1e0/0x1e0 Aug 22 00:03:22 baal kernel: [ 6966.399766] [] kthread+0xc9/0xe0 Aug 22 00:03:22 baal kernel: [ 6966.399767] [] ? flush_kthread_worker+0x90/0x90 Aug 22 00:03:22 baal kernel: [ 6966.399769] [] ret_from_fork+0x7c/0xb0 Aug 22 00:03:22 baal kernel: [ 6966.399770] [] ? flush_kthread_worker+0x90/0x90 Aug 22 00:03:22 baal kernel: [ 6966.399771] Code: 8b 07 3c ff 0f 1f 00 75 d8 f3 90 8b 02 3c ff 74 f8 5d c3 83 e1 fe 0f b7 f1 b8 00 80 00 00 44 0f b7 42 04 66 44 39 c1 74 88 f3 90 <83> e8 01 75 ee 0f 1f 80 00 00 00 00 eb e0 90 90 90 90 90 90 90 Aug 22 00:03:22 baal kernel: [ 6966.403522] NMI watchdog: BUG: soft lockup - CPU#20 stuck for 22s! [kworker/u65:11:8296] Aug 22 00:03:22 baal kernel: [ 6966.411594] Modules linked in: 8021q garp stp mrp llc rfcomm bnep bluetooth joydev x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel kvm crct10dif_pclmul crc32_pclmul ghash_clmulni_intel aesni_intel aes_x86_64 lrw gf128mul glue_helper ablk_helper cryptd nfsd mei_me mei auth_rpcgss lpc_ich nfs_acl sb_edac nfs ioatdma lockd edac_core sunrpc fscache ipmi_si ipmi_msghandler wmi mac_hid parport_pc ppdev lp parport xfs libcrc32c btrfs raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq igb i2c_algo_bit raid1 hid_generic e1000e mpt2sas dca raid0 usbhid raid_class ptp multipath hid scsi_transport_sas pps_core linear Aug 22 00:03:22 baal kernel: [ 6966.411625] CPU: 20 PID: 8296 Comm: kworker/u65:11 Tainted: G L 3.17.0-031700rc1-generic #201408161335 Aug 22 00:03:22 baal kernel: [ 6966.411627] Hardware name: WBS F224A-DE5/X9DRH-iF, BIOS 3.0b 04/28/2014 Aug 22 00:03:22 baal kernel: [ 6966.411639] Workqueue: btrfs-endio-write normal_work_helper [btrfs] Aug 22 00:03:22 baal kernel: [ 6966.411640] task: ffff881fcc478a00 ti: ffff881fd005c000 task.ti: ffff881fd005c000 Aug 22 00:03:22 baal kernel: [ 6966.411642] RIP: 0010:[] [] queue_read_lock_slowpath+0xb2/0xd0 Aug 22 00:03:22 baal kernel: [ 6966.411645] RSP: 0018:ffff881fd005f958 EFLAGS: 00000202 Aug 22 00:03:22 baal kernel: [ 6966.411646] RAX: 00000000000067b9 RBX: 0000000000000000 RCX: 00000000000004ee Aug 22 00:03:22 baal kernel: [ 6966.411647] RDX: ffff881be5778198 RSI: 00000000000004ee RDI: ffff881be577819c Aug 22 00:03:22 baal kernel: [ 6966.411648] RBP: ffff881fd005f958 R08: 00000000000004ec R09: 0000000000000000 Aug 22 00:03:22 baal kernel: [ 6966.411650] R10: ffff88380cf01d48 R11: 0000000000000003 R12: 00000000000145c0 Aug 22 00:03:22 baal kernel: [ 6966.411651] R13: ffff883fcb390380 R14: 00000000000145c0 R15: ffff881fd005ffd8 Aug 22 00:03:22 baal kernel: [ 6966.411653] FS: 0000000000000000(0000) GS:ffff881fffd80000(0000) knlGS:0000000000000000 Aug 22 00:03:22 baal kernel: [ 6966.411654] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 00:03:22 baal kernel: [ 6966.411655] CR2: 00007ffff7fe2000 CR3: 0000000001c16000 CR4: 00000000001407e0 Aug 22 00:03:22 baal kernel: [ 6966.411656] Stack: Aug 22 00:03:22 baal kernel: [ 6966.411657] ffff881fd005f968 ffffffff817a178d ffff881fd005f988 ffffffffc0536b44 Aug 22 00:03:22 baal kernel: [ 6966.411659] 0000000000000001 ffffffffffffffe8 ffff881fd005f9a8 ffffffffc04d447a Aug 22 00:03:22 baal kernel: [ 6966.411662] ffff8810bf5411b0 0000000000000000 ffff881fd005fa48 ffffffffc04d9bc2 Aug 22 00:03:22 baal kernel: [ 6966.411664] Call Trace: Aug 22 00:03:22 baal kernel: [ 6966.411667] [] _raw_read_lock+0x1d/0x30 Aug 22 00:03:22 baal kernel: [ 6966.411677] [] btrfs_clear_lock_blocking_rw+0x54/0x100 [btrfs] Aug 22 00:03:22 baal kernel: [ 6966.411684] [] btrfs_clear_path_blocking+0x3a/0x80 [btrfs] Aug 22 00:03:22 baal kernel: [ 6966.411692] [] btrfs_search_slot+0x572/0x880 [btrfs] Aug 22 00:03:22 baal kernel: [ 6966.411701] [] ? release_extent_buffer+0x36/0xe0 [btrfs] Aug 22 00:03:22 baal kernel: [ 6966.411709] [] btrfs_next_old_leaf+0x21f/0x460 [btrfs] Aug 22 00:03:22 baal kernel: [ 6966.411716] [] btrfs_next_leaf+0x10/0x20 [btrfs] Aug 22 00:03:22 baal kernel: [ 6966.411726] [] __btrfs_drop_extents+0x1e2/0xdf0 [btrfs] Aug 22 00:03:22 baal kernel: [ 6966.411736] [] ? merge_state.part.31+0xd2/0x140 [btrfs] Aug 22 00:03:22 baal kernel: [ 6966.411746] [] insert_reserved_file_extent.constprop.63+0xab/0x310 [btrfs] Aug 22 00:03:22 baal kernel: [ 6966.411754] [] ? start_transaction.part.35+0x80/0x530 [btrfs] Aug 22 00:03:22 baal kernel: [ 6966.411763] [] btrfs_finish_ordered_io+0x475/0x580 [btrfs] Aug 22 00:03:22 baal kernel: [ 6966.411771] [] finish_ordered_fn+0x15/0x20 [btrfs] Aug 22 00:03:22 baal kernel: [ 6966.411781] [] normal_work_helper+0x79/0x1b0 [btrfs] Aug 22 00:03:22 baal kernel: [ 6966.411783] [] process_one_work+0x17f/0x490 Aug 22 00:03:22 baal kernel: [ 6966.411786] [] worker_thread+0x11b/0x3f0 Aug 22 00:03:22 baal kernel: [ 6966.411788] [] ? create_worker+0x1e0/0x1e0 Aug 22 00:03:22 baal kernel: [ 6966.411790] [] kthread+0xc9/0xe0 Aug 22 00:03:22 baal kernel: [ 6966.411792] [] ? flush_kthread_worker+0x90/0x90 Aug 22 00:03:22 baal kernel: [ 6966.411795] [] ret_from_fork+0x7c/0xb0 Aug 22 00:03:22 baal kernel: [ 6966.411797] [] ? flush_kthread_worker+0x90/0x90 Aug 22 00:03:22 baal kernel: [ 6966.411798] Code: 5d c3 8b 07 3c ff 0f 1f 00 75 d8 f3 90 8b 02 3c ff 74 f8 5d c3 83 e1 fe 0f b7 f1 b8 00 80 00 00 44 0f b7 42 04 66 44 39 c1 74 88 90 83 e8 01 75 ee 0f 1f 80 00 00 00 00 eb e0 90 90 90 90 90 Aug 22 00:03:34 baal kernel: [ 6978.407788] NMI watchdog: BUG: soft lockup - CPU#21 stuck for 23s! [btrfs-transacti:8241] Aug 22 00:03:34 baal kernel: [ 6978.415945] Modules linked in: 8021q garp stp mrp llc rfcomm bnep bluetooth joydev x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel kvm crct10dif_pclmul crc32_pclmul ghash_clmulni_intel aesni_intel aes_x86_64 lrw gf128mul glue_helper ablk_helper cryptd nfsd mei_me mei auth_rpcgss lpc_ich nfs_acl sb_edac nfs ioatdma lockd edac_core sunrpc fscache ipmi_si ipmi_msghandler wmi mac_hid parport_pc ppdev lp parport xfs libcrc32c btrfs raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq igb i2c_algo_bit raid1 hid_generic e1000e mpt2sas dca raid0 usbhid raid_class ptp multipath hid scsi_transport_sas pps_core linear Aug 22 00:03:34 baal kernel: [ 6978.415979] CPU: 21 PID: 8241 Comm: btrfs-transacti Tainted: G L 3.17.0-031700rc1-generic #201408161335 Aug 22 00:03:34 baal kernel: [ 6978.415980] Hardware name: WBS F224A-DE5/X9DRH-iF, BIOS 3.0b 04/28/2014 Aug 22 00:03:34 baal kernel: [ 6978.415981] task: ffff883fca42c600 ti: ffff883fc71b8000 task.ti: ffff883fc71b8000 Aug 22 00:03:34 baal kernel: [ 6978.415982] RIP: 0010:[] [] queue_read_lock_slowpath+0xac/0xd0 Aug 22 00:03:34 baal kernel: [ 6978.415987] RSP: 0018:ffff883fc71bbaf8 EFLAGS: 00000202 Aug 22 00:03:34 baal kernel: [ 6978.415988] RAX: 00000000000051e0 RBX: ffff881e5f74f800 RCX: 000000000000535e Aug 22 00:03:34 baal kernel: [ 6978.415989] RDX: ffff881be586ed88 RSI: 000000000000535e RDI: ffff881be586ed8c Aug 22 00:03:34 baal kernel: [ 6978.415990] RBP: ffff883fc71bbaf8 R08: 0000000000005356 R09: 0000000000000001 Aug 22 00:03:34 baal kernel: [ 6978.415990] R10: 0000000000000002 R11: 0000000000000003 R12: 00000000000003d0 Aug 22 00:03:34 baal kernel: [ 6978.415991] R13: ffff883fc71bbbd4 R14: 0000275b00000001 R15: 0000000000000011 Aug 22 00:03:34 baal kernel: [ 6978.415992] FS: 0000000000000000(0000) GS:ffff881fffda0000(0000) knlGS:0000000000000000 Aug 22 00:03:34 baal kernel: [ 6978.415993] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 00:03:34 baal kernel: [ 6978.415994] CR2: 00007ffff7fee000 CR3: 0000000001c16000 CR4: 00000000001407e0 Aug 22 00:03:34 baal kernel: [ 6978.415995] Stack: Aug 22 00:03:34 baal kernel: [ 6978.415996] ffff883fc71bbb08 ffffffff817a178d ffff883fc71bbb78 ffffffffc0536c37 Aug 22 00:03:34 baal kernel: [ 6978.415997] ffff88387d939000 000000017d939000 ffff881be5771f38 ffff881f8d34b090 Aug 22 00:03:34 baal kernel: [ 6978.415998] ffff883852b58800 ffff88387d939000 0000000000000000 ffff881e5f74d000 Aug 22 00:03:34 baal kernel: [ 6978.416000] Call Trace: Aug 22 00:03:34 baal kernel: [ 6978.416004] [] _raw_read_lock+0x1d/0x30 Aug 22 00:03:34 baal kernel: [ 6978.416020] [] btrfs_tree_read_lock+0x47/0x120 [btrfs] Aug 22 00:03:34 baal kernel: [ 6978.416026] [] btrfs_read_lock_root_node+0x3b/0x50 [btrfs] Aug 22 00:03:34 baal kernel: [ 6978.416032] [] btrfs_search_slot+0x447/0x880 [btrfs] Aug 22 00:03:34 baal kernel: [ 6978.416039] [] btrfs_lookup_inode+0x2f/0xa0 [btrfs] Aug 22 00:03:34 baal kernel: [ 6978.416042] [] ? read_tsc+0x9/0x10 Aug 22 00:03:34 baal kernel: [ 6978.416044] [] ? ktime_get+0x46/0xb0 Aug 22 00:03:34 baal kernel: [ 6978.416053] [] __btrfs_update_delayed_inode+0x69/0x2e0 [btrfs] Aug 22 00:03:34 baal kernel: [ 6978.416059] [] ? __btrfs_run_delayed_refs+0x33/0x5f0 [btrfs] Aug 22 00:03:34 baal kernel: [ 6978.416067] [] __btrfs_run_delayed_items+0x192/0x1e0 [btrfs] Aug 22 00:03:34 baal kernel: [ 6978.416075] [] btrfs_run_delayed_items+0x13/0x20 [btrfs] Aug 22 00:03:34 baal kernel: [ 6978.416082] [] btrfs_commit_transaction.part.34+0x1a3/0xa10 [btrfs] Aug 22 00:03:34 baal kernel: [ 6978.416088] [] ? btrfs_run_delayed_refs.part.83+0x230/0x290 [btrfs] Aug 22 00:03:34 baal kernel: [ 6978.416095] [] btrfs_commit_transaction+0x46/0x80 [btrfs] Aug 22 00:03:34 baal kernel: [ 6978.416102] [] transaction_kthread+0x1d5/0x250 [btrfs] Aug 22 00:03:34 baal kernel: [ 6978.416108] [] ? open_ctree+0x1f70/0x1f70 [btrfs] Aug 22 00:03:34 baal kernel: [ 6978.416110] [] kthread+0xc9/0xe0 Aug 22 00:03:34 baal kernel: [ 6978.416111] [] ? flush_kthread_worker+0x90/0x90 Aug 22 00:03:34 baal kernel: [ 6978.416113] [] ret_from_fork+0x7c/0xb0 Aug 22 00:03:34 baal kernel: [ 6978.416115] [] ? flush_kthread_worker+0x90/0x90 Aug 22 00:03:34 baal kernel: [ 6978.416115] Code: e8 e8 15 c3 6c 00 5d c3 8b 07 3c ff 0f 1f 00 75 d8 f3 90 8b 02 3c ff 74 f8 5d c3 83 e1 fe 0f b7 f1 b8 00 80 00 00 44 0f b7 42 04 <66> 44 39 c1 74 88 f3 90 83 e8 01 75 ee 0f 1f 80 00 00 00 00 eb Aug 22 00:03:37 baal kernel: [ 6982.220059] NMI watchdog: BUG: soft lockup - CPU#8 stuck for 22s! [kworker/u66:17:8275] Aug 22 00:03:37 baal kernel: [ 6982.228047] Modules linked in: 8021q garp stp mrp llc rfcomm bnep bluetooth joydev x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel kvm crct10dif_pclmul crc32_pclmul ghash_clmulni_intel aesni_intel aes_x86_64 lrw gf128mul glue_helper ablk_helper cryptd nfsd mei_me mei auth_rpcgss lpc_ich nfs_acl sb_edac nfs ioatdma lockd edac_core sunrpc fscache ipmi_si ipmi_msghandler wmi mac_hid parport_pc ppdev lp parport xfs libcrc32c btrfs raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq igb i2c_algo_bit raid1 hid_generic e1000e mpt2sas dca raid0 usbhid raid_class ptp multipath hid scsi_transport_sas pps_core linear Aug 22 00:03:37 baal kernel: [ 6982.228093] CPU: 8 PID: 8275 Comm: kworker/u66:17 Tainted: G L 3.17.0-031700rc1-generic #201408161335 Aug 22 00:03:37 baal kernel: [ 6982.228094] Hardware name: WBS F224A-DE5/X9DRH-iF, BIOS 3.0b 04/28/2014 Aug 22 00:03:37 baal kernel: [ 6982.228114] Workqueue: btrfs-endio-write normal_work_helper [btrfs] Aug 22 00:03:37 baal kernel: [ 6982.228116] task: ffff883fc2ae5a00 ti: ffff8825fb6e0000 task.ti: ffff8825fb6e0000 Aug 22 00:03:37 baal kernel: [ 6982.228118] RIP: 0010:[] [] queue_read_lock_slowpath+0xac/0xd0 Aug 22 00:03:37 baal kernel: [ 6982.228123] RSP: 0018:ffff8825fb6e3978 EFLAGS: 00000202 Aug 22 00:03:37 baal kernel: [ 6982.228124] RAX: 00000000000015fb RBX: 0000000000001000 RCX: 0000000000005362 Aug 22 00:03:37 baal kernel: [ 6982.228126] RDX: ffff881be586ed88 RSI: 0000000000005362 RDI: ffff881be586ed8c Aug 22 00:03:37 baal kernel: [ 6982.228127] RBP: ffff8825fb6e3978 R08: 0000000000005356 R09: 0000000000000001 Aug 22 00:03:37 baal kernel: [ 6982.228129] R10: ffff881fd04e3260 R11: 000000000000007d R12: 0000000000001000 Aug 22 00:03:37 baal kernel: [ 6982.228130] R13: ffffea00a517b600 R14: 01ffffff813a5190 R15: ffff88166ff8c700 Aug 22 00:03:37 baal kernel: [ 6982.228132] FS: 0000000000000000(0000) GS:ffff88407fc00000(0000) knlGS:0000000000000000 Aug 22 00:03:37 baal kernel: [ 6982.228133] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 00:03:37 baal kernel: [ 6982.228135] CR2: 00007ffff7ff4000 CR3: 0000000001c16000 CR4: 00000000001407e0 Aug 22 00:03:37 baal kernel: [ 6982.228136] Stack: Aug 22 00:03:37 baal kernel: [ 6982.228137] ffff8825fb6e3988 ffffffff817a178d ffff8825fb6e39f8 ffffffffc0536c37 Aug 22 00:03:37 baal kernel: [ 6982.228140] ffff88407fc345c0 0000000000000000 ffff88166ff8c700 00000001ca5e5000 Aug 22 00:03:37 baal kernel: [ 6982.228142] ffff8825fb6e3a18 ffff883fce6ea098 ffffffff81c30100 ffff881e5f74d000 Aug 22 00:03:37 baal kernel: [ 6982.228144] Call Trace: Aug 22 00:03:37 baal kernel: [ 6982.228149] [] _raw_read_lock+0x1d/0x30 Aug 22 00:03:37 baal kernel: [ 6982.228165] [] btrfs_tree_read_lock+0x47/0x120 [btrfs] Aug 22 00:03:37 baal kernel: [ 6982.228175] [] btrfs_read_lock_root_node+0x3b/0x50 [btrfs] Aug 22 00:03:37 baal kernel: [ 6982.228185] [] btrfs_search_slot+0x447/0x880 [btrfs] Aug 22 00:03:37 baal kernel: [ 6982.228197] [] btrfs_lookup_file_extent+0x38/0x40 [btrfs] Aug 22 00:03:37 baal kernel: [ 6982.228210] [] __btrfs_drop_extents+0x151/0xdf0 [btrfs] Aug 22 00:03:37 baal kernel: [ 6982.228214] [] ? ttwu_do_wakeup+0x2c/0x100 Aug 22 00:03:37 baal kernel: [ 6982.228219] [] ? kmem_cache_alloc+0x1b3/0x1f0 Aug 22 00:03:37 baal kernel: [ 6982.228229] [] ? btrfs_alloc_path+0x1a/0x20 [btrfs] Aug 22 00:03:37 baal kernel: [ 6982.228238] [] ? btrfs_alloc_path+0x1a/0x20 [btrfs] Aug 22 00:03:37 baal kernel: [ 6982.228250] [] insert_reserved_file_extent.constprop.63+0xab/0x310 [btrfs] Aug 22 00:03:37 baal kernel: [ 6982.228261] [] ? start_transaction.part.35+0x80/0x530 [btrfs] Aug 22 00:03:37 baal kernel: [ 6982.228273] [] btrfs_finish_ordered_io+0x475/0x580 [btrfs] Aug 22 00:03:37 baal kernel: [ 6982.228287] [] ? end_compressed_bio_write+0x31/0xf0 [btrfs] Aug 22 00:03:37 baal kernel: [ 6982.228298] [] finish_ordered_fn+0x15/0x20 [btrfs] Aug 22 00:03:37 baal kernel: [ 6982.228310] [] normal_work_helper+0x79/0x1b0 [btrfs] Aug 22 00:03:37 baal kernel: [ 6982.228314] [] process_one_work+0x17f/0x490 Aug 22 00:03:37 baal kernel: [ 6982.228317] [] worker_thread+0x11b/0x3f0 Aug 22 00:03:37 baal kernel: [ 6982.228319] [] ? create_worker+0x1e0/0x1e0 Aug 22 00:03:37 baal kernel: [ 6982.228322] [] kthread+0xc9/0xe0 Aug 22 00:03:37 baal kernel: [ 6982.228324] [] ? flush_kthread_worker+0x90/0x90 Aug 22 00:03:37 baal kernel: [ 6982.228327] [] ret_from_fork+0x7c/0xb0 Aug 22 00:03:37 baal kernel: [ 6982.228329] [] ? flush_kthread_worker+0x90/0x90 Aug 22 00:03:37 baal kernel: [ 6982.228330] Code: e8 e8 15 c3 6c 00 5d c3 8b 07 3c ff 0f 1f 00 75 d8 f3 90 8b 02 3c ff 74 f8 5d c3 83 e1 fe 0f b7 f1 b8 00 80 00 00 44 0f b7 42 04 <66> 44 39 c1 74 88 f3 90 83 e8 01 75 ee 0f 1f 80 00 00 00 00 eb Aug 22 00:03:37 baal kernel: [ 6982.232046] NMI watchdog: BUG: soft lockup - CPU#9 stuck for 22s! [kworker/u66:6:8968] Aug 22 00:03:37 baal kernel: [ 6982.239943] Modules linked in: 8021q garp stp mrp llc rfcomm bnep bluetooth joydev x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel kvm crct10dif_pclmul crc32_pclmul ghash_clmulni_intel aesni_intel aes_x86_64 lrw gf128mul glue_helper ablk_helper cryptd nfsd mei_me mei auth_rpcgss lpc_ich nfs_acl sb_edac nfs ioatdma lockd edac_core sunrpc fscache ipmi_si ipmi_msghandler wmi mac_hid parport_pc ppdev lp parport xfs libcrc32c btrfs raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq igb i2c_algo_bit raid1 hid_generic e1000e mpt2sas dca raid0 usbhid raid_class ptp multipath hid scsi_transport_sas pps_core linear Aug 22 00:03:37 baal kernel: [ 6982.239964] CPU: 9 PID: 8968 Comm: kworker/u66:6 Tainted: G L 3.17.0-031700rc1-generic #201408161335 Aug 22 00:03:37 baal kernel: [ 6982.239965] Hardware name: WBS F224A-DE5/X9DRH-iF, BIOS 3.0b 04/28/2014 Aug 22 00:03:37 baal kernel: [ 6982.239976] Workqueue: btrfs-endio-write normal_work_helper [btrfs] Aug 22 00:03:37 baal kernel: [ 6982.239978] task: ffff883fca42b200 ti: ffff8827ef310000 task.ti: ffff8827ef310000 Aug 22 00:03:37 baal kernel: [ 6982.239978] RIP: 0010:[] [] queue_read_lock_slowpath+0xb4/0xd0 Aug 22 00:03:37 baal kernel: [ 6982.239981] RSP: 0018:ffff8827ef313978 EFLAGS: 00000206 Aug 22 00:03:37 baal kernel: [ 6982.239982] RAX: 0000000000001b57 RBX: 0000000000000000 RCX: 000000000000536e Aug 22 00:03:37 baal kernel: [ 6982.239982] RDX: ffff881be586ed88 RSI: 000000000000536e RDI: ffff881be586ed8c Aug 22 00:03:37 baal kernel: [ 6982.239983] RBP: ffff8827ef313978 R08: 0000000000005356 R09: 0000000000000001 Aug 22 00:03:37 baal kernel: [ 6982.239984] R10: ffff881fd04e3260 R11: ffffc9002ea87aa4 R12: ffffea00da31a800 Aug 22 00:03:37 baal kernel: [ 6982.239985] R13: ffff88407fc37a18 R14: ffff88407fff8f00 R15: ffff88407fff8f00 Aug 22 00:03:37 baal kernel: [ 6982.239986] FS: 0000000000000000(0000) GS:ffff88407fc20000(0000) knlGS:0000000000000000 Aug 22 00:03:37 baal kernel: [ 6982.239987] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 00:03:37 baal kernel: [ 6982.239987] CR2: 00007ffff7ff4000 CR3: 0000000001c16000 CR4: 00000000001407e0 Aug 22 00:03:37 baal kernel: [ 6982.239988] Stack: Aug 22 00:03:37 baal kernel: [ 6982.239989] ffff8827ef313988 ffffffff817a178d ffff8827ef3139f8 ffffffffc0536c37 Aug 22 00:03:37 baal kernel: [ 6982.239990] ffff8827ef3139a8 0000000000000002 0000000000000002 0000000000000000 Aug 22 00:03:37 baal kernel: [ 6982.239991] 0000000000000052 0000000000000000 ffff8827ef313b48 ffff881e5f74d000 Aug 22 00:03:37 baal kernel: [ 6982.239993] Call Trace: Aug 22 00:03:37 baal kernel: [ 6982.239995] [] _raw_read_lock+0x1d/0x30 Aug 22 00:03:37 baal kernel: [ 6982.240004] [] btrfs_tree_read_lock+0x47/0x120 [btrfs] Aug 22 00:03:37 baal kernel: [ 6982.240010] [] btrfs_read_lock_root_node+0x3b/0x50 [btrfs] Aug 22 00:03:37 baal kernel: [ 6982.240015] [] btrfs_search_slot+0x447/0x880 [btrfs] Aug 22 00:03:37 baal kernel: [ 6982.240022] [] btrfs_lookup_file_extent+0x38/0x40 [btrfs] Aug 22 00:03:37 baal kernel: [ 6982.240030] [] __btrfs_drop_extents+0x151/0xdf0 [btrfs] Aug 22 00:03:37 baal kernel: [ 6982.240034] [] ? flush_pending+0x4e/0x90 Aug 22 00:03:37 baal kernel: [ 6982.240036] [] ? kmem_cache_alloc+0x1b3/0x1f0 Aug 22 00:03:37 baal kernel: [ 6982.240042] [] ? btrfs_alloc_path+0x1a/0x20 [btrfs] Aug 22 00:03:37 baal kernel: [ 6982.240047] [] ? btrfs_alloc_path+0x1a/0x20 [btrfs] Aug 22 00:03:37 baal kernel: [ 6982.240054] [] insert_reserved_file_extent.constprop.63+0xab/0x310 [btrfs] Aug 22 00:03:37 baal kernel: [ 6982.240061] [] ? start_transaction.part.35+0x80/0x530 [btrfs] Aug 22 00:03:37 baal kernel: [ 6982.240068] [] btrfs_finish_ordered_io+0x475/0x580 [btrfs] Aug 22 00:03:37 baal kernel: [ 6982.240074] [] finish_ordered_fn+0x15/0x20 [btrfs] Aug 22 00:03:37 baal kernel: [ 6982.240082] [] normal_work_helper+0x79/0x1b0 [btrfs] Aug 22 00:03:37 baal kernel: [ 6982.240084] [] process_one_work+0x17f/0x490 Aug 22 00:03:37 baal kernel: [ 6982.240086] [] worker_thread+0x11b/0x3f0 Aug 22 00:03:37 baal kernel: [ 6982.240087] [] ? create_worker+0x1e0/0x1e0 Aug 22 00:03:37 baal kernel: [ 6982.240089] [] kthread+0xc9/0xe0 Aug 22 00:03:37 baal kernel: [ 6982.240090] [] ? flush_kthread_worker+0x90/0x90 Aug 22 00:03:37 baal kernel: [ 6982.240092] [] ret_from_fork+0x7c/0xb0 Aug 22 00:03:37 baal kernel: [ 6982.240093] [] ? flush_kthread_worker+0x90/0x90 Aug 22 00:03:37 baal kernel: [ 6982.240094] Code: 8b 07 3c ff 0f 1f 00 75 d8 f3 90 8b 02 3c ff 74 f8 5d c3 83 e1 fe 0f b7 f1 b8 00 80 00 00 44 0f b7 42 04 66 44 39 c1 74 88 f3 90 <83> e8 01 75 ee 0f 1f 80 00 00 00 00 eb e0 90 90 90 90 90 90 90 Aug 22 00:03:37 baal kernel: [ 6982.248031] NMI watchdog: BUG: soft lockup - CPU#10 stuck for 22s! [kworker/u66:15:8273] Aug 22 00:03:37 baal kernel: [ 6982.256100] Modules linked in: 8021q garp stp mrp llc rfcomm bnep bluetooth joydev x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel kvm crct10dif_pclmul crc32_pclmul ghash_clmulni_intel aesni_intel aes_x86_64 lrw gf128mul glue_helper ablk_helper cryptd nfsd mei_me mei auth_rpcgss lpc_ich nfs_acl sb_edac nfs ioatdma lockd edac_core sunrpc fscache ipmi_si ipmi_msghandler wmi mac_hid parport_pc ppdev lp parport xfs libcrc32c btrfs raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq igb i2c_algo_bit raid1 hid_generic e1000e mpt2sas dca raid0 usbhid raid_class ptp multipath hid scsi_transport_sas pps_core linear Aug 22 00:03:37 baal kernel: [ 6982.256120] CPU: 10 PID: 8273 Comm: kworker/u66:15 Tainted: G L 3.17.0-031700rc1-generic #201408161335 Aug 22 00:03:37 baal kernel: [ 6982.256121] Hardware name: WBS F224A-DE5/X9DRH-iF, BIOS 3.0b 04/28/2014 Aug 22 00:03:37 baal kernel: [ 6982.256131] Workqueue: btrfs-endio-write normal_work_helper [btrfs] Aug 22 00:03:37 baal kernel: [ 6982.256132] task: ffff883fc2ae1400 ti: ffff883fc3134000 task.ti: ffff883fc3134000 Aug 22 00:03:37 baal kernel: [ 6982.256133] RIP: 0010:[] [] queue_read_lock_slowpath+0xac/0xd0 Aug 22 00:03:37 baal kernel: [ 6982.256135] RSP: 0018:ffff883fc3137978 EFLAGS: 00000202 Aug 22 00:03:37 baal kernel: [ 6982.256136] RAX: 000000000000715d RBX: ffffea00a96c8a80 RCX: 0000000000005368 Aug 22 00:03:37 baal kernel: [ 6982.256137] RDX: ffff881be586ed88 RSI: 0000000000005368 RDI: ffff881be586ed8c Aug 22 00:03:37 baal kernel: [ 6982.256137] RBP: ffff883fc3137978 R08: 0000000000005356 R09: 0000000000000001 Aug 22 00:03:37 baal kernel: [ 6982.256138] R10: ffff881fd04e3260 R11: 0000000000000000 R12: ffff881fcce94500 Aug 22 00:03:37 baal kernel: [ 6982.256139] R13: ffff88407fc57a18 R14: ffff88407fff8f00 R15: ffff88407fff8f00 Aug 22 00:03:37 baal kernel: [ 6982.256140] FS: 0000000000000000(0000) GS:ffff88407fc40000(0000) knlGS:0000000000000000 Aug 22 00:03:37 baal kernel: [ 6982.256141] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 00:03:37 baal kernel: [ 6982.256142] CR2: 00007ffff7ff4000 CR3: 0000000001c16000 CR4: 00000000001407e0 Aug 22 00:03:37 baal kernel: [ 6982.256142] Stack: Aug 22 00:03:37 baal kernel: [ 6982.256143] ffff883fc3137988 ffffffff817a178d ffff883fc31379f8 ffffffffc0536c37 Aug 22 00:03:37 baal kernel: [ 6982.256144] 0000000000011250 ffff883fcbeb4630 ffff883fc3137a08 ffff883fc2ae1400 Aug 22 00:03:37 baal kernel: [ 6982.256146] ffff883fc31379c8 ffffffff81175605 ffff883fc3137a48 ffff881e5f74d000 Aug 22 00:03:37 baal kernel: [ 6982.256147] Call Trace: Aug 22 00:03:37 baal kernel: [ 6982.256149] [] _raw_read_lock+0x1d/0x30 Aug 22 00:03:37 baal kernel: [ 6982.256159] [] btrfs_tree_read_lock+0x47/0x120 [btrfs] Aug 22 00:03:37 baal kernel: [ 6982.256162] [] ? mempool_alloc_slab+0x15/0x20 Aug 22 00:03:37 baal kernel: [ 6982.256168] [] btrfs_read_lock_root_node+0x3b/0x50 [btrfs] Aug 22 00:03:37 baal kernel: [ 6982.256173] [] btrfs_search_slot+0x447/0x880 [btrfs] Aug 22 00:03:37 baal kernel: [ 6982.256182] [] ? clear_extent_bit+0x1b3/0x370 [btrfs] Aug 22 00:03:37 baal kernel: [ 6982.256189] [] btrfs_lookup_file_extent+0x38/0x40 [btrfs] Aug 22 00:03:37 baal kernel: [ 6982.256196] [] __btrfs_drop_extents+0x151/0xdf0 [btrfs] Aug 22 00:03:37 baal kernel: [ 6982.256206] [] ? btrfs_bio_counter_dec+0x2a/0x60 [btrfs] Aug 22 00:03:37 baal kernel: [ 6982.256207] [] ? kmem_cache_alloc+0x1b3/0x1f0 Aug 22 00:03:37 baal kernel: [ 6982.256213] [] ? btrfs_alloc_path+0x1a/0x20 [btrfs] Aug 22 00:03:37 baal kernel: [ 6982.256218] [] ? btrfs_alloc_path+0x1a/0x20 [btrfs] Aug 22 00:03:37 baal kernel: [ 6982.256225] [] insert_reserved_file_extent.constprop.63+0xab/0x310 [btrfs] Aug 22 00:03:37 baal kernel: [ 6982.256232] [] ? start_transaction.part.35+0x80/0x530 [btrfs] Aug 22 00:03:37 baal kernel: [ 6982.256239] [] btrfs_finish_ordered_io+0x475/0x580 [btrfs] Aug 22 00:03:37 baal kernel: [ 6982.256246] [] ? async_cow_free+0x28/0x30 [btrfs] Aug 22 00:03:37 baal kernel: [ 6982.256252] [] finish_ordered_fn+0x15/0x20 [btrfs] Aug 22 00:03:37 baal kernel: [ 6982.256260] [] normal_work_helper+0x79/0x1b0 [btrfs] Aug 22 00:03:37 baal kernel: [ 6982.256262] [] process_one_work+0x17f/0x490 Aug 22 00:03:37 baal kernel: [ 6982.256263] [] worker_thread+0x11b/0x3f0 Aug 22 00:03:37 baal kernel: [ 6982.256265] [] ? create_worker+0x1e0/0x1e0 Aug 22 00:03:37 baal kernel: [ 6982.256266] [] kthread+0xc9/0xe0 Aug 22 00:03:37 baal kernel: [ 6982.256268] [] ? flush_kthread_worker+0x90/0x90 Aug 22 00:03:37 baal kernel: [ 6982.256269] [] ret_from_fork+0x7c/0xb0 Aug 22 00:03:37 baal kernel: [ 6982.256271] [] ? flush_kthread_worker+0x90/0x90 Aug 22 00:03:37 baal kernel: [ 6982.256271] Code: e8 e8 15 c3 6c 00 5d c3 8b 07 3c ff 0f 1f 00 75 d8 f3 90 8b 02 3c ff 74 f8 5d c3 83 e1 fe 0f b7 f1 b8 00 80 00 00 44 0f b7 42 04 <66> 44 39 c1 74 88 f3 90 83 e8 01 75 ee 0f 1f 80 00 00 00 00 eb Aug 22 00:03:37 baal kernel: [ 6982.287992] NMI watchdog: BUG: soft lockup - CPU#13 stuck for 22s! [kworker/u66:22:8280] Aug 22 00:03:37 baal kernel: [ 6982.296065] Modules linked in: 8021q garp stp mrp llc rfcomm bnep bluetooth joydev x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel kvm crct10dif_pclmul crc32_pclmul ghash_clmulni_intel aesni_intel aes_x86_64 lrw gf128mul glue_helper ablk_helper cryptd nfsd mei_me mei auth_rpcgss lpc_ich nfs_acl sb_edac nfs ioatdma lockd edac_core sunrpc fscache ipmi_si ipmi_msghandler wmi mac_hid parport_pc ppdev lp parport xfs libcrc32c btrfs raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq igb i2c_algo_bit raid1 hid_generic e1000e mpt2sas dca raid0 usbhid raid_class ptp multipath hid scsi_transport_sas pps_core linear Aug 22 00:03:37 baal kernel: [ 6982.296086] CPU: 13 PID: 8280 Comm: kworker/u66:22 Tainted: G L 3.17.0-031700rc1-generic #201408161335 Aug 22 00:03:37 baal kernel: [ 6982.296087] Hardware name: WBS F224A-DE5/X9DRH-iF, BIOS 3.0b 04/28/2014 Aug 22 00:03:37 baal kernel: [ 6982.296097] Workqueue: btrfs-endio-write normal_work_helper [btrfs] Aug 22 00:03:37 baal kernel: [ 6982.296098] task: ffff883fcb0fda00 ti: ffff883fc1dc8000 task.ti: ffff883fc1dc8000 Aug 22 00:03:37 baal kernel: [ 6982.296099] RIP: 0010:[] [] queue_read_lock_slowpath+0xb0/0xd0 Aug 22 00:03:37 baal kernel: [ 6982.296101] RSP: 0018:ffff883fc1dcb978 EFLAGS: 00000202 Aug 22 00:03:37 baal kernel: [ 6982.296102] RAX: 0000000000003c59 RBX: 0000000000001000 RCX: 0000000000005366 Aug 22 00:03:37 baal kernel: [ 6982.296103] RDX: ffff881be586ed88 RSI: 0000000000005366 RDI: ffff881be586ed8c Aug 22 00:03:37 baal kernel: [ 6982.296104] RBP: ffff883fc1dcb978 R08: 0000000000005356 R09: 0000000000000001 Aug 22 00:03:37 baal kernel: [ 6982.296104] R10: ffff881fd04e3260 R11: ffff881fd2825400 R12: 0000000000001000 Aug 22 00:03:37 baal kernel: [ 6982.296105] R13: ffffea00a248f140 R14: 01ffffff813a5190 R15: ffff88380b6b0e00 Aug 22 00:03:37 baal kernel: [ 6982.296106] FS: 0000000000000000(0000) GS:ffff88407fca0000(0000) knlGS:0000000000000000 Aug 22 00:03:37 baal kernel: [ 6982.296107] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 00:03:37 baal kernel: [ 6982.296108] CR2: 00007ffff7ff4000 CR3: 0000000001c16000 CR4: 00000000001407e0 Aug 22 00:03:37 baal kernel: [ 6982.296108] Stack: Aug 22 00:03:37 baal kernel: [ 6982.296109] ffff883fc1dcb988 ffffffff817a178d ffff883fc1dcb9f8 ffffffffc0536c37 Aug 22 00:03:37 baal kernel: [ 6982.296110] 0000000000011250 0000000000000000 ffff88380b6b0e00 00000001cffc5000 Aug 22 00:03:37 baal kernel: [ 6982.296112] ffff883fc1dcba18 ffff883fce68c098 ffffffff81c30100 ffff881e5f74d000 Aug 22 00:03:37 baal kernel: [ 6982.296113] Call Trace: Aug 22 00:03:37 baal kernel: [ 6982.296116] [] _raw_read_lock+0x1d/0x30 Aug 22 00:03:37 baal kernel: [ 6982.296125] [] btrfs_tree_read_lock+0x47/0x120 [btrfs] Aug 22 00:03:37 baal kernel: [ 6982.296130] [] btrfs_read_lock_root_node+0x3b/0x50 [btrfs] Aug 22 00:03:37 baal kernel: [ 6982.296136] [] btrfs_search_slot+0x447/0x880 [btrfs] Aug 22 00:03:37 baal kernel: [ 6982.296143] [] btrfs_lookup_file_extent+0x38/0x40 [btrfs] Aug 22 00:03:37 baal kernel: [ 6982.296151] [] __btrfs_drop_extents+0x151/0xdf0 [btrfs] Aug 22 00:03:37 baal kernel: [ 6982.296153] [] ? kmem_cache_alloc+0x1b3/0x1f0 Aug 22 00:03:37 baal kernel: [ 6982.296158] [] ? btrfs_alloc_path+0x1a/0x20 [btrfs] Aug 22 00:03:37 baal kernel: [ 6982.296164] [] ? btrfs_alloc_path+0x1a/0x20 [btrfs] Aug 22 00:03:37 baal kernel: [ 6982.296171] [] insert_reserved_file_extent.constprop.63+0xab/0x310 [btrfs] Aug 22 00:03:37 baal kernel: [ 6982.296178] [] ? start_transaction.part.35+0x80/0x530 [btrfs] Aug 22 00:03:37 baal kernel: [ 6982.296185] [] btrfs_finish_ordered_io+0x475/0x580 [btrfs] Aug 22 00:03:37 baal kernel: [ 6982.296191] [] finish_ordered_fn+0x15/0x20 [btrfs] Aug 22 00:03:37 baal kernel: [ 6982.296199] [] normal_work_helper+0x79/0x1b0 [btrfs] Aug 22 00:03:37 baal kernel: [ 6982.296201] [] process_one_work+0x17f/0x490 Aug 22 00:03:37 baal kernel: [ 6982.296202] [] worker_thread+0x11b/0x3f0 Aug 22 00:03:37 baal kernel: [ 6982.296204] [] ? create_worker+0x1e0/0x1e0 Aug 22 00:03:37 baal kernel: [ 6982.296205] [] kthread+0xc9/0xe0 Aug 22 00:03:37 baal kernel: [ 6982.296207] [] ? flush_kthread_worker+0x90/0x90 Aug 22 00:03:37 baal kernel: [ 6982.296208] [] ret_from_fork+0x7c/0xb0 Aug 22 00:03:37 baal kernel: [ 6982.296210] [] ? flush_kthread_worker+0x90/0x90 Aug 22 00:03:37 baal kernel: [ 6982.296210] Code: 6c 00 5d c3 8b 07 3c ff 0f 1f 00 75 d8 f3 90 8b 02 3c ff 74 f8 5d c3 83 e1 fe 0f b7 f1 b8 00 80 00 00 44 0f b7 42 04 66 44 39 c1 <74> 88 f3 90 83 e8 01 75 ee 0f 1f 80 00 00 00 00 eb e0 90 90 90 Aug 22 00:03:37 baal kernel: [ 6982.303977] NMI watchdog: BUG: soft lockup - CPU#14 stuck for 22s! [kworker/u66:21:8279] Aug 22 00:03:37 baal kernel: [ 6982.312051] Modules linked in: 8021q garp stp mrp llc rfcomm bnep bluetooth joydev x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel kvm crct10dif_pclmul crc32_pclmul ghash_clmulni_intel aesni_intel aes_x86_64 lrw gf128mul glue_helper ablk_helper cryptd nfsd mei_me mei auth_rpcgss lpc_ich nfs_acl sb_edac nfs ioatdma lockd edac_core sunrpc fscache ipmi_si ipmi_msghandler wmi mac_hid parport_pc ppdev lp parport xfs libcrc32c btrfs raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq igb i2c_algo_bit raid1 hid_generic e1000e mpt2sas dca raid0 usbhid raid_class ptp multipath hid scsi_transport_sas pps_core linear Aug 22 00:03:37 baal kernel: [ 6982.312071] CPU: 14 PID: 8279 Comm: kworker/u66:21 Tainted: G L 3.17.0-031700rc1-generic #201408161335 Aug 22 00:03:37 baal kernel: [ 6982.312072] Hardware name: WBS F224A-DE5/X9DRH-iF, BIOS 3.0b 04/28/2014 Aug 22 00:03:37 baal kernel: [ 6982.312082] Workqueue: btrfs-endio-write normal_work_helper [btrfs] Aug 22 00:03:37 baal kernel: [ 6982.312083] task: ffff883fcb0f8a00 ti: ffff883fc168c000 task.ti: ffff883fc168c000 Aug 22 00:03:37 baal kernel: [ 6982.312084] RIP: 0010:[] [] queue_read_lock_slowpath+0xb4/0xd0 Aug 22 00:03:37 baal kernel: [ 6982.312086] RSP: 0018:ffff883fc168f978 EFLAGS: 00000202 Aug 22 00:03:37 baal kernel: [ 6982.312087] RAX: 0000000000000518 RBX: 0000000000000000 RCX: 000000000000536c Aug 22 00:03:37 baal kernel: [ 6982.312088] RDX: ffff881be586ed88 RSI: 000000000000536c RDI: ffff881be586ed8c Aug 22 00:03:37 baal kernel: [ 6982.312089] RBP: ffff883fc168f978 R08: 0000000000005356 R09: 0000000000000001 Aug 22 00:03:37 baal kernel: [ 6982.312089] R10: ffff881fd04e3260 R11: ffffc9002ebc3aa4 R12: ffffea00a517d980 Aug 22 00:03:37 baal kernel: [ 6982.312090] R13: ffff88407fcd7a18 R14: ffff88407fff8f00 R15: ffff88407fff8f00 Aug 22 00:03:37 baal kernel: [ 6982.312091] FS: 0000000000000000(0000) GS:ffff88407fcc0000(0000) knlGS:0000000000000000 Aug 22 00:03:37 baal kernel: [ 6982.312092] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 00:03:37 baal kernel: [ 6982.312093] CR2: 00007ffff7ff4000 CR3: 0000000001c16000 CR4: 00000000001407e0 Aug 22 00:03:37 baal kernel: [ 6982.312094] Stack: Aug 22 00:03:37 baal kernel: [ 6982.312094] ffff883fc168f988 ffffffff817a178d ffff883fc168f9f8 ffffffffc0536c37 Aug 22 00:03:37 baal kernel: [ 6982.312096] ffff883fc168f9a8 0000000000000002 0000000000000002 0000000000000000 Aug 22 00:03:37 baal kernel: [ 6982.312097] 0000000000000052 0000000000000000 ffff883fc168fb48 ffff881e5f74d000 Aug 22 00:03:37 baal kernel: [ 6982.312098] Call Trace: Aug 22 00:03:37 baal kernel: [ 6982.312101] [] _raw_read_lock+0x1d/0x30 Aug 22 00:03:37 baal kernel: [ 6982.312110] [] btrfs_tree_read_lock+0x47/0x120 [btrfs] Aug 22 00:03:37 baal kernel: [ 6982.312116] [] btrfs_read_lock_root_node+0x3b/0x50 [btrfs] Aug 22 00:03:37 baal kernel: [ 6982.312121] [] btrfs_search_slot+0x447/0x880 [btrfs] Aug 22 00:03:37 baal kernel: [ 6982.312129] [] btrfs_lookup_file_extent+0x38/0x40 [btrfs] Aug 22 00:03:37 baal kernel: [ 6982.312137] [] __btrfs_drop_extents+0x151/0xdf0 [btrfs] Aug 22 00:03:37 baal kernel: [ 6982.312139] [] ? flush_pending+0x4e/0x90 Aug 22 00:03:37 baal kernel: [ 6982.312141] [] ? kmem_cache_alloc+0x1b3/0x1f0 Aug 22 00:03:37 baal kernel: [ 6982.312146] [] ? btrfs_alloc_path+0x1a/0x20 [btrfs] Aug 22 00:03:37 baal kernel: [ 6982.312151] [] ? btrfs_alloc_path+0x1a/0x20 [btrfs] Aug 22 00:03:37 baal kernel: [ 6982.312159] [] insert_reserved_file_extent.constprop.63+0xab/0x310 [btrfs] Aug 22 00:03:37 baal kernel: [ 6982.312165] [] ? start_transaction.part.35+0x80/0x530 [btrfs] Aug 22 00:03:37 baal kernel: [ 6982.312172] [] btrfs_finish_ordered_io+0x475/0x580 [btrfs] Aug 22 00:03:37 baal kernel: [ 6982.312179] [] finish_ordered_fn+0x15/0x20 [btrfs] Aug 22 00:03:37 baal kernel: [ 6982.312186] [] normal_work_helper+0x79/0x1b0 [btrfs] Aug 22 00:03:37 baal kernel: [ 6982.312188] [] process_one_work+0x17f/0x490 Aug 22 00:03:37 baal kernel: [ 6982.312190] [] worker_thread+0x11b/0x3f0 Aug 22 00:03:37 baal kernel: [ 6982.312192] [] ? create_worker+0x1e0/0x1e0 Aug 22 00:03:37 baal kernel: [ 6982.312193] [] kthread+0xc9/0xe0 Aug 22 00:03:37 baal kernel: [ 6982.312194] [] ? flush_kthread_worker+0x90/0x90 Aug 22 00:03:37 baal kernel: [ 6982.312196] [] ret_from_fork+0x7c/0xb0 Aug 22 00:03:37 baal kernel: [ 6982.312197] [] ? flush_kthread_worker+0x90/0x90 Aug 22 00:03:37 baal kernel: [ 6982.312198] Code: 8b 07 3c ff 0f 1f 00 75 d8 f3 90 8b 02 3c ff 74 f8 5d c3 83 e1 fe 0f b7 f1 b8 00 80 00 00 44 0f b7 42 04 66 44 39 c1 74 88 f3 90 <83> e8 01 75 ee 0f 1f 80 00 00 00 00 eb e0 90 90 90 90 90 90 90 Aug 22 00:03:37 baal kernel: [ 6982.315965] NMI watchdog: BUG: soft lockup - CPU#15 stuck for 22s! [kworker/u66:30:8355] Aug 22 00:03:37 baal kernel: [ 6982.324040] Modules linked in: 8021q garp stp mrp llc rfcomm bnep bluetooth joydev x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel kvm crct10dif_pclmul crc32_pclmul ghash_clmulni_intel aesni_intel aes_x86_64 lrw gf128mul glue_helper ablk_helper cryptd nfsd mei_me mei auth_rpcgss lpc_ich nfs_acl sb_edac nfs ioatdma lockd edac_core sunrpc fscache ipmi_si ipmi_msghandler wmi mac_hid parport_pc ppdev lp parport xfs libcrc32c btrfs raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq igb i2c_algo_bit raid1 hid_generic e1000e mpt2sas dca raid0 usbhid raid_class ptp multipath hid scsi_transport_sas pps_core linear Aug 22 00:03:37 baal kernel: [ 6982.324072] CPU: 15 PID: 8355 Comm: kworker/u66:30 Tainted: G L 3.17.0-031700rc1-generic #201408161335 Aug 22 00:03:37 baal kernel: [ 6982.324073] Hardware name: WBS F224A-DE5/X9DRH-iF, BIOS 3.0b 04/28/2014 Aug 22 00:03:37 baal kernel: [ 6982.324085] Workqueue: btrfs-endio-write normal_work_helper [btrfs] Aug 22 00:03:37 baal kernel: [ 6982.324087] task: ffff883fcbf5da00 ti: ffff882475f58000 task.ti: ffff882475f58000 Aug 22 00:03:37 baal kernel: [ 6982.324088] RIP: 0010:[] [] queue_read_lock_slowpath+0xa7/0xd0 Aug 22 00:03:37 baal kernel: [ 6982.324091] RSP: 0018:ffff882475f5b978 EFLAGS: 00000202 Aug 22 00:03:37 baal kernel: [ 6982.324093] RAX: 00000000000071d6 RBX: ffffea00e79dea80 RCX: 000000000000536a Aug 22 00:03:37 baal kernel: [ 6982.324094] RDX: ffff881be586ed88 RSI: 000000000000536a RDI: ffff881be586ed8c Aug 22 00:03:37 baal kernel: [ 6982.324095] RBP: ffff882475f5b978 R08: 0000000000005356 R09: 0000000000000001 Aug 22 00:03:37 baal kernel: [ 6982.324097] R10: ffff881fd04e3260 R11: 0000000000000000 R12: ffff881fcce94500 Aug 22 00:03:37 baal kernel: [ 6982.324098] R13: ffff88407fcf7a18 R14: ffff88407fff8f00 R15: ffff88407fff8f00 Aug 22 00:03:37 baal kernel: [ 6982.324100] FS: 0000000000000000(0000) GS:ffff88407fce0000(0000) knlGS:0000000000000000 Aug 22 00:03:37 baal kernel: [ 6982.324101] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 00:03:37 baal kernel: [ 6982.324103] CR2: 00007ffff7ff4000 CR3: 0000000001c16000 CR4: 00000000001407e0 Aug 22 00:03:37 baal kernel: [ 6982.324104] Stack: Aug 22 00:03:37 baal kernel: [ 6982.324105] ffff882475f5b988 ffffffff817a178d ffff882475f5b9f8 ffffffffc0536c37 Aug 22 00:03:37 baal kernel: [ 6982.324107] 0000000000011250 ffff883fcbeb4630 ffff882475f5ba08 ffff883fcbf5da00 Aug 22 00:03:37 baal kernel: [ 6982.324109] ffff882475f5b9c8 ffffffff81175605 ffff882475f5ba48 ffff881e5f74d000 Aug 22 00:03:37 baal kernel: [ 6982.324112] Call Trace: Aug 22 00:03:37 baal kernel: [ 6982.324115] [] _raw_read_lock+0x1d/0x30 Aug 22 00:03:37 baal kernel: [ 6982.324126] [] btrfs_tree_read_lock+0x47/0x120 [btrfs] Aug 22 00:03:37 baal kernel: [ 6982.324129] [] ? mempool_alloc_slab+0x15/0x20 Aug 22 00:03:37 baal kernel: [ 6982.324139] [] btrfs_read_lock_root_node+0x3b/0x50 [btrfs] Aug 22 00:03:37 baal kernel: [ 6982.324148] [] btrfs_search_slot+0x447/0x880 [btrfs] Aug 22 00:03:37 baal kernel: [ 6982.324161] [] ? clear_extent_bit+0x1b3/0x370 [btrfs] Aug 22 00:03:37 baal kernel: [ 6982.324170] [] btrfs_lookup_file_extent+0x38/0x40 [btrfs] Aug 22 00:03:37 baal kernel: [ 6982.324180] [] __btrfs_drop_extents+0x151/0xdf0 [btrfs] Aug 22 00:03:37 baal kernel: [ 6982.324192] [] ? btrfs_bio_counter_dec+0x2a/0x60 [btrfs] Aug 22 00:03:37 baal kernel: [ 6982.324194] [] ? kmem_cache_alloc+0x1b3/0x1f0 Aug 22 00:03:37 baal kernel: [ 6982.324203] [] ? btrfs_alloc_path+0x1a/0x20 [btrfs] Aug 22 00:03:37 baal kernel: [ 6982.324212] [] ? btrfs_alloc_path+0x1a/0x20 [btrfs] Aug 22 00:03:37 baal kernel: [ 6982.324224] [] insert_reserved_file_extent.constprop.63+0xab/0x310 [btrfs] Aug 22 00:03:37 baal kernel: [ 6982.324235] [] ? start_transaction.part.35+0x80/0x530 [btrfs] Aug 22 00:03:37 baal kernel: [ 6982.324246] [] btrfs_finish_ordered_io+0x475/0x580 [btrfs] Aug 22 00:03:37 baal kernel: [ 6982.324257] [] ? async_cow_free+0x28/0x30 [btrfs] Aug 22 00:03:37 baal kernel: [ 6982.324267] [] finish_ordered_fn+0x15/0x20 [btrfs] Aug 22 00:03:37 baal kernel: [ 6982.324279] [] normal_work_helper+0x79/0x1b0 [btrfs] Aug 22 00:03:37 baal kernel: [ 6982.324282] [] process_one_work+0x17f/0x490 Aug 22 00:03:37 baal kernel: [ 6982.324284] [] worker_thread+0x11b/0x3f0 Aug 22 00:03:37 baal kernel: [ 6982.324287] [] ? create_worker+0x1e0/0x1e0 Aug 22 00:03:37 baal kernel: [ 6982.324289] [] kthread+0xc9/0xe0 Aug 22 00:03:37 baal kernel: [ 6982.324291] [] ? flush_kthread_worker+0x90/0x90 Aug 22 00:03:37 baal kernel: [ 6982.324294] [] ret_from_fork+0x7c/0xb0 Aug 22 00:03:37 baal kernel: [ 6982.324296] [] ? flush_kthread_worker+0x90/0x90 Aug 22 00:03:37 baal kernel: [ 6982.324297] Code: 01 0f 1f 00 74 e8 e8 15 c3 6c 00 5d c3 8b 07 3c ff 0f 1f 00 75 d8 f3 90 8b 02 3c ff 74 f8 5d c3 83 e1 fe 0f b7 f1 b8 00 80 00 00 <44> 0f b7 42 04 66 44 39 c1 74 88 f3 90 83 e8 01 75 ee 0f 1f 80 Aug 22 00:03:38 baal kernel: [ 6982.447836] NMI watchdog: BUG: soft lockup - CPU#24 stuck for 22s! [kworker/u66:13:8271] Aug 22 00:03:38 baal kernel: [ 6982.455906] Modules linked in: 8021q garp stp mrp llc rfcomm bnep bluetooth joydev x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel kvm crct10dif_pclmul crc32_pclmul ghash_clmulni_intel aesni_intel aes_x86_64 lrw gf128mul glue_helper ablk_helper cryptd nfsd mei_me mei auth_rpcgss lpc_ich nfs_acl sb_edac nfs ioatdma lockd edac_core sunrpc fscache ipmi_si ipmi_msghandler wmi mac_hid parport_pc ppdev lp parport xfs libcrc32c btrfs raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq igb i2c_algo_bit raid1 hid_generic e1000e mpt2sas dca raid0 usbhid raid_class ptp multipath hid scsi_transport_sas pps_core linear Aug 22 00:03:38 baal kernel: [ 6982.455937] CPU: 24 PID: 8271 Comm: kworker/u66:13 Tainted: G L 3.17.0-031700rc1-generic #201408161335 Aug 22 00:03:38 baal kernel: [ 6982.455938] Hardware name: WBS F224A-DE5/X9DRH-iF, BIOS 3.0b 04/28/2014 Aug 22 00:03:38 baal kernel: [ 6982.455949] Workqueue: btrfs-endio-write normal_work_helper [btrfs] Aug 22 00:03:38 baal kernel: [ 6982.455951] task: ffff883fc2ae1e00 ti: ffff883843af0000 task.ti: ffff883843af0000 Aug 22 00:03:38 baal kernel: [ 6982.455952] RIP: 0010:[] [] queue_read_lock_slowpath+0xb4/0xd0 Aug 22 00:03:38 baal kernel: [ 6982.455955] RSP: 0018:ffff883843af3978 EFLAGS: 00000212 Aug 22 00:03:38 baal kernel: [ 6982.455956] RAX: 0000000000001ea2 RBX: 0000000000001000 RCX: 0000000000005364 Aug 22 00:03:38 baal kernel: [ 6982.455958] RDX: ffff881be586ed88 RSI: 0000000000005364 RDI: ffff881be586ed8c Aug 22 00:03:38 baal kernel: [ 6982.455959] RBP: ffff883843af3978 R08: 0000000000005356 R09: 0000000000000001 Aug 22 00:03:38 baal kernel: [ 6982.455960] R10: ffff881fd04e3260 R11: 000000000000007d R12: 0000000000001000 Aug 22 00:03:38 baal kernel: [ 6982.455961] R13: ffffea00a5170680 R14: 01ffffff813a5190 R15: ffff882f52a76d00 Aug 22 00:03:38 baal kernel: [ 6982.455963] FS: 0000000000000000(0000) GS:ffff88407fd00000(0000) knlGS:0000000000000000 Aug 22 00:03:38 baal kernel: [ 6982.455965] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 00:03:38 baal kernel: [ 6982.455966] CR2: 00007ffff7fe6000 CR3: 0000000001c16000 CR4: 00000000001407e0 Aug 22 00:03:38 baal kernel: [ 6982.455967] Stack: Aug 22 00:03:38 baal kernel: [ 6982.455968] ffff883843af3988 ffffffff817a178d ffff883843af39f8 ffffffffc0536c37 Aug 22 00:03:38 baal kernel: [ 6982.455970] ffff883843af39b8 0000000000000000 ffff882f52a76d00 00000001cffc5000 Aug 22 00:03:38 baal kernel: [ 6982.455972] ffff883843af3a18 ffff883fce68c098 ffffffff81c30100 ffff881e5f74d000 Aug 22 00:03:38 baal kernel: [ 6982.455975] Call Trace: Aug 22 00:03:38 baal kernel: [ 6982.455977] [] _raw_read_lock+0x1d/0x30 Aug 22 00:03:38 baal kernel: [ 6982.455989] [] btrfs_tree_read_lock+0x47/0x120 [btrfs] Aug 22 00:03:38 baal kernel: [ 6982.455999] [] btrfs_read_lock_root_node+0x3b/0x50 [btrfs] Aug 22 00:03:38 baal kernel: [ 6982.456008] [] btrfs_search_slot+0x447/0x880 [btrfs] Aug 22 00:03:38 baal kernel: [ 6982.456019] [] btrfs_lookup_file_extent+0x38/0x40 [btrfs] Aug 22 00:03:38 baal kernel: [ 6982.456031] [] __btrfs_drop_extents+0x151/0xdf0 [btrfs] Aug 22 00:03:38 baal kernel: [ 6982.456034] [] ? kmem_cache_alloc+0x1b3/0x1f0 Aug 22 00:03:38 baal kernel: [ 6982.456041] [] ? btrfs_alloc_path+0x1a/0x20 [btrfs] Aug 22 00:03:38 baal kernel: [ 6982.456048] [] ? btrfs_alloc_path+0x1a/0x20 [btrfs] Aug 22 00:03:38 baal kernel: [ 6982.456057] [] insert_reserved_file_extent.constprop.63+0xab/0x310 [btrfs] Aug 22 00:03:38 baal kernel: [ 6982.456066] [] ? start_transaction.part.35+0x80/0x530 [btrfs] Aug 22 00:03:38 baal kernel: [ 6982.456075] [] btrfs_finish_ordered_io+0x475/0x580 [btrfs] Aug 22 00:03:38 baal kernel: [ 6982.456085] [] ? end_compressed_bio_write+0x31/0xf0 [btrfs] Aug 22 00:03:38 baal kernel: [ 6982.456094] [] finish_ordered_fn+0x15/0x20 [btrfs] Aug 22 00:03:38 baal kernel: [ 6982.456103] [] normal_work_helper+0x79/0x1b0 [btrfs] Aug 22 00:03:38 baal kernel: [ 6982.456106] [] process_one_work+0x17f/0x490 Aug 22 00:03:38 baal kernel: [ 6982.456108] [] worker_thread+0x11b/0x3f0 Aug 22 00:03:38 baal kernel: [ 6982.456111] [] ? create_worker+0x1e0/0x1e0 Aug 22 00:03:38 baal kernel: [ 6982.456113] [] kthread+0xc9/0xe0 Aug 22 00:03:38 baal kernel: [ 6982.456115] [] ? flush_kthread_worker+0x90/0x90 Aug 22 00:03:38 baal kernel: [ 6982.456118] [] ret_from_fork+0x7c/0xb0 Aug 22 00:03:38 baal kernel: [ 6982.456120] [] ? flush_kthread_worker+0x90/0x90 Aug 22 00:03:38 baal kernel: [ 6982.456121] Code: 8b 07 3c ff 0f 1f 00 75 d8 f3 90 8b 02 3c ff 74 f8 5d c3 83 e1 fe 0f b7 f1 b8 00 80 00 00 44 0f b7 42 04 66 44 39 c1 74 88 f3 90 <83> e8 01 75 ee 0f 1f 80 00 00 00 00 eb e0 90 90 90 90 90 90 90 Aug 22 00:03:38 baal kernel: [ 6982.503781] NMI watchdog: BUG: soft lockup - CPU#28 stuck for 22s! [kworker/u66:19:8277] Aug 22 00:03:38 baal kernel: [ 6982.511857] Modules linked in: 8021q garp stp mrp llc rfcomm bnep bluetooth joydev x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel kvm crct10dif_pclmul crc32_pclmul ghash_clmulni_intel aesni_intel aes_x86_64 lrw gf128mul glue_helper ablk_helper cryptd nfsd mei_me mei auth_rpcgss lpc_ich nfs_acl sb_edac nfs ioatdma lockd edac_core sunrpc fscache ipmi_si ipmi_msghandler wmi mac_hid parport_pc ppdev lp parport xfs libcrc32c btrfs raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq igb i2c_algo_bit raid1 hid_generic e1000e mpt2sas dca raid0 usbhid raid_class ptp multipath hid scsi_transport_sas pps_core linear Aug 22 00:03:38 baal kernel: [ 6982.511877] CPU: 28 PID: 8277 Comm: kworker/u66:19 Tainted: G L 3.17.0-031700rc1-generic #201408161335 Aug 22 00:03:38 baal kernel: [ 6982.511878] Hardware name: WBS F224A-DE5/X9DRH-iF, BIOS 3.0b 04/28/2014 Aug 22 00:03:38 baal kernel: [ 6982.511888] Workqueue: btrfs-endio-write normal_work_helper [btrfs] Aug 22 00:03:38 baal kernel: [ 6982.511889] task: ffff883fc2ae4600 ti: ffff88277ee6c000 task.ti: ffff88277ee6c000 Aug 22 00:03:38 baal kernel: [ 6982.511890] RIP: 0010:[] [] queue_read_lock_slowpath+0xb4/0xd0 Aug 22 00:03:38 baal kernel: [ 6982.511892] RSP: 0018:ffff88277ee6f978 EFLAGS: 00000216 Aug 22 00:03:38 baal kernel: [ 6982.511893] RAX: 00000000000056fd RBX: 0000000000001000 RCX: 0000000000005360 Aug 22 00:03:38 baal kernel: [ 6982.511894] RDX: ffff881be586ed88 RSI: 0000000000005360 RDI: ffff881be586ed8c Aug 22 00:03:38 baal kernel: [ 6982.511895] RBP: ffff88277ee6f978 R08: 0000000000005356 R09: 0000000000000001 Aug 22 00:03:38 baal kernel: [ 6982.511895] R10: ffff881fd04e3260 R11: 0000000000000000 R12: 0000000000001000 Aug 22 00:03:38 baal kernel: [ 6982.511896] R13: ffffea00da31c2c0 R14: 01ffffff813a5190 R15: ffff88166ff8d300 Aug 22 00:03:38 baal kernel: [ 6982.511897] FS: 0000000000000000(0000) GS:ffff88407fd80000(0000) knlGS:0000000000000000 Aug 22 00:03:38 baal kernel: [ 6982.511898] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 00:03:38 baal kernel: [ 6982.511899] CR2: 00007ffff7ff3000 CR3: 0000000001c16000 CR4: 00000000001407e0 Aug 22 00:03:38 baal kernel: [ 6982.511900] Stack: Aug 22 00:03:38 baal kernel: [ 6982.511900] ffff88277ee6f988 ffffffff817a178d ffff88277ee6f9f8 ffffffffc0536c37 Aug 22 00:03:38 baal kernel: [ 6982.511902] 0000000000000011 0000000000000000 ffff88166ff8d300 00000001ca5e5000 Aug 22 00:03:38 baal kernel: [ 6982.511903] ffff88277ee6fa18 ffff883fce6ea098 ffffffff81c30100 ffff881e5f74d000 Aug 22 00:03:38 baal kernel: [ 6982.511904] Call Trace: Aug 22 00:03:38 baal kernel: [ 6982.511907] [] _raw_read_lock+0x1d/0x30 Aug 22 00:03:38 baal kernel: [ 6982.511916] [] btrfs_tree_read_lock+0x47/0x120 [btrfs] Aug 22 00:03:38 baal kernel: [ 6982.511922] [] btrfs_read_lock_root_node+0x3b/0x50 [btrfs] Aug 22 00:03:38 baal kernel: [ 6982.511928] [] btrfs_search_slot+0x447/0x880 [btrfs] Aug 22 00:03:38 baal kernel: [ 6982.511931] [] ? update_cpu_capacity+0x60/0x170 Aug 22 00:03:38 baal kernel: [ 6982.511938] [] btrfs_lookup_file_extent+0x38/0x40 [btrfs] Aug 22 00:03:38 baal kernel: [ 6982.511946] [] __btrfs_drop_extents+0x151/0xdf0 [btrfs] Aug 22 00:03:38 baal kernel: [ 6982.511948] [] ? kmem_cache_alloc+0x1b3/0x1f0 Aug 22 00:03:38 baal kernel: [ 6982.511953] [] ? btrfs_alloc_path+0x1a/0x20 [btrfs] Aug 22 00:03:38 baal kernel: [ 6982.511958] [] ? btrfs_alloc_path+0x1a/0x20 [btrfs] Aug 22 00:03:38 baal kernel: [ 6982.511965] [] insert_reserved_file_extent.constprop.63+0xab/0x310 [btrfs] Aug 22 00:03:38 baal kernel: [ 6982.511972] [] ? start_transaction.part.35+0x80/0x530 [btrfs] Aug 22 00:03:38 baal kernel: [ 6982.511979] [] btrfs_finish_ordered_io+0x475/0x580 [btrfs] Aug 22 00:03:38 baal kernel: [ 6982.511985] [] finish_ordered_fn+0x15/0x20 [btrfs] Aug 22 00:03:38 baal kernel: [ 6982.511993] [] normal_work_helper+0x79/0x1b0 [btrfs] Aug 22 00:03:38 baal kernel: [ 6982.511995] [] process_one_work+0x17f/0x490 Aug 22 00:03:38 baal kernel: [ 6982.511997] [] worker_thread+0x11b/0x3f0 Aug 22 00:03:38 baal kernel: [ 6982.511998] [] ? create_worker+0x1e0/0x1e0 Aug 22 00:03:38 baal kernel: [ 6982.512000] [] kthread+0xc9/0xe0 Aug 22 00:03:38 baal kernel: [ 6982.512001] [] ? flush_kthread_worker+0x90/0x90 Aug 22 00:03:38 baal kernel: [ 6982.512003] [] ret_from_fork+0x7c/0xb0 Aug 22 00:03:38 baal kernel: [ 6982.512004] [] ? flush_kthread_worker+0x90/0x90 Aug 22 00:03:38 baal kernel: [ 6982.512005] Code: 8b 07 3c ff 0f 1f 00 75 d8 f3 90 8b 02 3c ff 74 f8 5d c3 83 e1 fe 0f b7 f1 b8 00 80 00 00 44 0f b7 42 04 66 44 39 c1 74 88 f3 90 <83> e8 01 75 ee 0f 1f 80 00 00 00 00 eb e0 90 90 90 90 90 90 90 Aug 22 00:03:49 baal kernel: [ 6994.024517] NMI watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [kworker/u65:17:8308] Aug 22 00:03:49 baal kernel: [ 6994.032503] Modules linked in: 8021q garp stp mrp llc rfcomm bnep bluetooth joydev x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel kvm crct10dif_pclmul crc32_pclmul ghash_clmulni_intel aesni_intel aes_x86_64 lrw gf128mul glue_helper ablk_helper cryptd nfsd mei_me mei auth_rpcgss lpc_ich nfs_acl sb_edac nfs ioatdma lockd edac_core sunrpc fscache ipmi_si ipmi_msghandler wmi mac_hid parport_pc ppdev lp parport xfs libcrc32c btrfs raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq igb i2c_algo_bit raid1 hid_generic e1000e mpt2sas dca raid0 usbhid raid_class ptp multipath hid scsi_transport_sas pps_core linear Aug 22 00:03:49 baal kernel: [ 6994.032534] CPU: 0 PID: 8308 Comm: kworker/u65:17 Tainted: G L 3.17.0-031700rc1-generic #201408161335 Aug 22 00:03:49 baal kernel: [ 6994.032535] Hardware name: WBS F224A-DE5/X9DRH-iF, BIOS 3.0b 04/28/2014 Aug 22 00:03:49 baal kernel: [ 6994.032549] Workqueue: btrfs-endio-write normal_work_helper [btrfs] Aug 22 00:03:49 baal kernel: [ 6994.032551] task: ffff881fcc479400 ti: ffff88169fcf8000 task.ti: ffff88169fcf8000 Aug 22 00:03:49 baal kernel: [ 6994.032552] RIP: 0010:[] [] queue_read_lock_slowpath+0xb4/0xd0 Aug 22 00:03:49 baal kernel: [ 6994.032555] RSP: 0018:ffff88169fcfb958 EFLAGS: 00000202 Aug 22 00:03:49 baal kernel: [ 6994.032557] RAX: 0000000000007eb2 RBX: 0000000000000000 RCX: 0000000000005358 Aug 22 00:03:49 baal kernel: [ 6994.032558] RDX: ffff881be586ed88 RSI: 0000000000005358 RDI: ffff881be586ed8c Aug 22 00:03:49 baal kernel: [ 6994.032559] RBP: ffff88169fcfb958 R08: 0000000000005356 R09: 0000000000000000 Aug 22 00:03:49 baal kernel: [ 6994.032561] R10: ffff881be5adde70 R11: 0000000000000000 R12: 0000000000000000 Aug 22 00:03:49 baal kernel: [ 6994.032562] R13: 0000000000000000 R14: ffff881be586ed98 R15: 0000000000000000 Aug 22 00:03:49 baal kernel: [ 6994.032563] FS: 0000000000000000(0000) GS:ffff881fffc00000(0000) knlGS:0000000000000000 Aug 22 00:03:49 baal kernel: [ 6994.032565] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 00:03:49 baal kernel: [ 6994.032566] CR2: 00007fffec171c8c CR3: 0000000001c16000 CR4: 00000000001407f0 Aug 22 00:03:49 baal kernel: [ 6994.032567] Stack: Aug 22 00:03:49 baal kernel: [ 6994.032568] ffff88169fcfb968 ffffffff817a178d ffff88169fcfb988 ffffffffc0536b44 Aug 22 00:03:49 baal kernel: [ 6994.032570] 0000000000000002 ffffffffffffffec ffff88169fcfb9a8 ffffffffc04d447a Aug 22 00:03:49 baal kernel: [ 6994.032573] ffff8816c0cbc090 0000000000000001 ffff88169fcfba48 ffffffffc04d9bc2 Aug 22 00:03:49 baal kernel: [ 6994.032575] Call Trace: Aug 22 00:03:49 baal kernel: [ 6994.032578] [] _raw_read_lock+0x1d/0x30 Aug 22 00:03:49 baal kernel: [ 6994.032590] [] btrfs_clear_lock_blocking_rw+0x54/0x100 [btrfs] Aug 22 00:03:49 baal kernel: [ 6994.032600] [] btrfs_clear_path_blocking+0x3a/0x80 [btrfs] Aug 22 00:03:49 baal kernel: [ 6994.032607] [] btrfs_search_slot+0x572/0x880 [btrfs] Aug 22 00:03:49 baal kernel: [ 6994.032617] [] ? release_extent_buffer+0x36/0xe0 [btrfs] Aug 22 00:03:49 baal kernel: [ 6994.032625] [] btrfs_next_old_leaf+0x21f/0x460 [btrfs] Aug 22 00:03:49 baal kernel: [ 6994.032632] [] btrfs_next_leaf+0x10/0x20 [btrfs] Aug 22 00:03:49 baal kernel: [ 6994.032642] [] __btrfs_drop_extents+0x1e2/0xdf0 [btrfs] Aug 22 00:03:49 baal kernel: [ 6994.032652] [] ? merge_state.part.31+0xd2/0x140 [btrfs] Aug 22 00:03:49 baal kernel: [ 6994.032662] [] insert_reserved_file_extent.constprop.63+0xab/0x310 [btrfs] Aug 22 00:03:49 baal kernel: [ 6994.032670] [] ? start_transaction.part.35+0x80/0x530 [btrfs] Aug 22 00:03:49 baal kernel: [ 6994.032679] [] btrfs_finish_ordered_io+0x475/0x580 [btrfs] Aug 22 00:03:49 baal kernel: [ 6994.032688] [] finish_ordered_fn+0x15/0x20 [btrfs] Aug 22 00:03:49 baal kernel: [ 6994.032697] [] normal_work_helper+0x79/0x1b0 [btrfs] Aug 22 00:03:49 baal kernel: [ 6994.032701] [] process_one_work+0x17f/0x490 Aug 22 00:03:49 baal kernel: [ 6994.032704] [] worker_thread+0x11b/0x3f0 Aug 22 00:03:49 baal kernel: [ 6994.032706] [] ? create_worker+0x1e0/0x1e0 Aug 22 00:03:49 baal kernel: [ 6994.032708] [] kthread+0xc9/0xe0 Aug 22 00:03:49 baal kernel: [ 6994.032710] [] ? flush_kthread_worker+0x90/0x90 Aug 22 00:03:49 baal kernel: [ 6994.032712] [] ret_from_fork+0x7c/0xb0 Aug 22 00:03:49 baal kernel: [ 6994.032714] [] ? flush_kthread_worker+0x90/0x90 Aug 22 00:03:49 baal kernel: [ 6994.032715] Code: 8b 07 3c ff 0f 1f 00 75 d8 f3 90 8b 02 3c ff 74 f8 5d c3 83 e1 fe 0f b7 f1 b8 00 80 00 00 44 0f b7 42 04 66 44 39 c1 74 88 f3 90 <83> e8 01 75 ee 0f 1f 80 00 00 00 00 eb e0 90 90 90 90 90 90 90 Aug 22 00:03:49 baal kernel: [ 6994.064477] NMI watchdog: BUG: soft lockup - CPU#4 stuck for 22s! [kworker/u65:5:8077] Aug 22 00:03:49 baal kernel: [ 6994.072376] Modules linked in: 8021q garp stp mrp llc rfcomm bnep bluetooth joydev x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel kvm crct10dif_pclmul crc32_pclmul ghash_clmulni_intel aesni_intel aes_x86_64 lrw gf128mul glue_helper ablk_helper cryptd nfsd mei_me mei auth_rpcgss lpc_ich nfs_acl sb_edac nfs ioatdma lockd edac_core sunrpc fscache ipmi_si ipmi_msghandler wmi mac_hid parport_pc ppdev lp parport xfs libcrc32c btrfs raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq igb i2c_algo_bit raid1 hid_generic e1000e mpt2sas dca raid0 usbhid raid_class ptp multipath hid scsi_transport_sas pps_core linear Aug 22 00:03:49 baal kernel: [ 6994.072406] CPU: 4 PID: 8077 Comm: kworker/u65:5 Tainted: G L 3.17.0-031700rc1-generic #201408161335 Aug 22 00:03:49 baal kernel: [ 6994.072409] Hardware name: WBS F224A-DE5/X9DRH-iF, BIOS 3.0b 04/28/2014 Aug 22 00:03:49 baal kernel: [ 6994.072422] Workqueue: btrfs-endio-write normal_work_helper [btrfs] Aug 22 00:03:49 baal kernel: [ 6994.072424] task: ffff881fcfe70000 ti: ffff8816a6060000 task.ti: ffff8816a6060000 Aug 22 00:03:49 baal kernel: [ 6994.072425] RIP: 0010:[] [] queue_write_lock_slowpath+0x72/0xd0 Aug 22 00:03:49 baal kernel: [ 6994.072428] RSP: 0018:ffff8816a6063978 EFLAGS: 00000206 Aug 22 00:03:49 baal kernel: [ 6994.072429] RAX: 0000000000000101 RBX: 0000000000000000 RCX: 00000000000000ff Aug 22 00:03:49 baal kernel: [ 6994.072431] RDX: ffff881be586ed88 RSI: 0000000000000101 RDI: ffff881be586ed8c Aug 22 00:03:49 baal kernel: [ 6994.072432] RBP: ffff8816a6063978 R08: 0000000000005356 R09: 0000000000000000 Aug 22 00:03:49 baal kernel: [ 6994.072433] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 Aug 22 00:03:49 baal kernel: [ 6994.072435] R13: ffff881fffc945c0 R14: ffff881fd2d4ad38 R15: 0000000000000000 Aug 22 00:03:49 baal kernel: [ 6994.072436] FS: 0000000000000000(0000) GS:ffff881fffc80000(0000) knlGS:0000000000000000 Aug 22 00:03:49 baal kernel: [ 6994.072438] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 00:03:49 baal kernel: [ 6994.072439] CR2: 00007ffff7a87ec0 CR3: 0000000001c16000 CR4: 00000000001407e0 Aug 22 00:03:49 baal kernel: [ 6994.072440] Stack: Aug 22 00:03:49 baal kernel: [ 6994.072441] ffff8816a6063988 ffffffff817a1665 ffff8816a60639f8 ffffffffc0536ff9 Aug 22 00:03:49 baal kernel: [ 6994.072443] ffff8816a60639c8 ffffffff00000000 ffff881fcfe70000 ffffffff810b3f50 Aug 22 00:03:49 baal kernel: [ 6994.072445] ffff8816a60639b8 ffff8816a60639b8 ffff8816a6063a18 ffff881e5f74d000 Aug 22 00:03:49 baal kernel: [ 6994.072448] Call Trace: Aug 22 00:03:49 baal kernel: [ 6994.072452] [] _raw_write_lock+0x25/0x30 Aug 22 00:03:49 baal kernel: [ 6994.072465] [] btrfs_tree_lock+0xc9/0x1d0 [btrfs] Aug 22 00:03:49 baal kernel: [ 6994.072469] [] ? add_wait_queue+0x60/0x60 Aug 22 00:03:49 baal kernel: [ 6994.072479] [] btrfs_lock_root_node+0x3b/0x50 [btrfs] Aug 22 00:03:49 baal kernel: [ 6994.072488] [] btrfs_search_slot+0x787/0x880 [btrfs] Aug 22 00:03:49 baal kernel: [ 6994.072499] [] btrfs_lookup_file_extent+0x38/0x40 [btrfs] Aug 22 00:03:49 baal kernel: [ 6994.072511] [] __btrfs_drop_extents+0x151/0xdf0 [btrfs] Aug 22 00:03:49 baal kernel: [ 6994.072518] [] ? btrfs_search_slot+0x747/0x880 [btrfs] Aug 22 00:03:49 baal kernel: [ 6994.072522] [] ? kmem_cache_alloc+0x1b3/0x1f0 Aug 22 00:03:49 baal kernel: [ 6994.072528] [] ? btrfs_alloc_path+0x1a/0x20 [btrfs] Aug 22 00:03:49 baal kernel: [ 6994.072535] [] ? btrfs_alloc_path+0x1a/0x20 [btrfs] Aug 22 00:03:49 baal kernel: [ 6994.072544] [] insert_reserved_file_extent.constprop.63+0xab/0x310 [btrfs] Aug 22 00:03:49 baal kernel: [ 6994.072553] [] ? start_transaction.part.35+0x80/0x530 [btrfs] Aug 22 00:03:49 baal kernel: [ 6994.072562] [] btrfs_finish_ordered_io+0x475/0x580 [btrfs] Aug 22 00:03:49 baal kernel: [ 6994.072573] [] ? end_compressed_bio_write+0x31/0xf0 [btrfs] Aug 22 00:03:49 baal kernel: [ 6994.072581] [] finish_ordered_fn+0x15/0x20 [btrfs] Aug 22 00:03:49 baal kernel: [ 6994.072591] [] normal_work_helper+0x79/0x1b0 [btrfs] Aug 22 00:03:49 baal kernel: [ 6994.072594] [] process_one_work+0x17f/0x490 Aug 22 00:03:49 baal kernel: [ 6994.072596] [] worker_thread+0x11b/0x3f0 Aug 22 00:03:49 baal kernel: [ 6994.072598] [] ? create_worker+0x1e0/0x1e0 Aug 22 00:03:49 baal kernel: [ 6994.072600] [] kthread+0xc9/0xe0 Aug 22 00:03:49 baal kernel: [ 6994.072602] [] ? flush_kthread_worker+0x90/0x90 Aug 22 00:03:49 baal kernel: [ 6994.072605] [] ret_from_fork+0x7c/0xb0 Aug 22 00:03:49 baal kernel: [ 6994.072607] [] ? flush_kthread_worker+0x90/0x90 Aug 22 00:03:49 baal kernel: [ 6994.072608] Code: 00 f3 90 8b 0a 84 c9 66 90 75 f6 89 ce 89 c8 83 ce 01 f0 0f b1 32 39 c8 75 e7 b9 ff 00 00 00 eb 0a 0f 1f 84 00 00 00 00 00 f3 90 <8b> 02 83 f8 01 75 f7 f0 0f b1 0a 83 f8 01 75 ee eb b3 0f 1f 40 Aug 22 00:03:49 baal kernel: [ 6994.320227] NMI watchdog: BUG: soft lockup - CPU#16 stuck for 22s! [kworker/u65:8:8293] Aug 22 00:03:49 baal kernel: [ 6994.328211] Modules linked in: 8021q garp stp mrp llc rfcomm bnep bluetooth joydev x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel kvm crct10dif_pclmul crc32_pclmul ghash_clmulni_intel aesni_intel aes_x86_64 lrw gf128mul glue_helper ablk_helper cryptd nfsd mei_me mei auth_rpcgss lpc_ich nfs_acl sb_edac nfs ioatdma lockd edac_core sunrpc fscache ipmi_si ipmi_msghandler wmi mac_hid parport_pc ppdev lp parport xfs libcrc32c btrfs raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq igb i2c_algo_bit raid1 hid_generic e1000e mpt2sas dca raid0 usbhid raid_class ptp multipath hid scsi_transport_sas pps_core linear Aug 22 00:03:49 baal kernel: [ 6994.328241] CPU: 16 PID: 8293 Comm: kworker/u65:8 Tainted: G L 3.17.0-031700rc1-generic #201408161335 Aug 22 00:03:49 baal kernel: [ 6994.328242] Hardware name: WBS F224A-DE5/X9DRH-iF, BIOS 3.0b 04/28/2014 Aug 22 00:03:49 baal kernel: [ 6994.328252] Workqueue: btrfs-endio-write normal_work_helper [btrfs] Aug 22 00:03:49 baal kernel: [ 6994.328253] task: ffff881fcc478000 ti: ffff881fd0960000 task.ti: ffff881fd0960000 Aug 22 00:03:49 baal kernel: [ 6994.328254] RIP: 0010:[] [] queue_read_lock_slowpath+0xb4/0xd0 Aug 22 00:03:49 baal kernel: [ 6994.328257] RSP: 0018:ffff881fd0963958 EFLAGS: 00000202 Aug 22 00:03:49 baal kernel: [ 6994.328259] RAX: 0000000000000618 RBX: 0000000000000000 RCX: 000000000000535a Aug 22 00:03:49 baal kernel: [ 6994.328260] RDX: ffff881be586ed88 RSI: 000000000000535a RDI: ffff881be586ed8c Aug 22 00:03:49 baal kernel: [ 6994.328261] RBP: ffff881fd0963958 R08: 0000000000005356 R09: 0000000000000000 Aug 22 00:03:49 baal kernel: [ 6994.328263] R10: ffff881be5adde70 R11: 0000000000000000 R12: 0000000000000000 Aug 22 00:03:49 baal kernel: [ 6994.328264] R13: 0000000000000000 R14: ffff881be586ed98 R15: 0000000000000000 Aug 22 00:03:49 baal kernel: [ 6994.328265] FS: 0000000000000000(0000) GS:ffff881fffd00000(0000) knlGS:0000000000000000 Aug 22 00:03:49 baal kernel: [ 6994.328267] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 00:03:49 baal kernel: [ 6994.328268] CR2: 00007ffff7fdd000 CR3: 0000000001c16000 CR4: 00000000001407e0 Aug 22 00:03:49 baal kernel: [ 6994.328269] Stack: Aug 22 00:03:49 baal kernel: [ 6994.328270] ffff881fd0963968 ffffffff817a178d ffff881fd0963988 ffffffffc0536b44 Aug 22 00:03:49 baal kernel: [ 6994.328272] 0000000000000002 ffffffffffffffec ffff881fd09639a8 ffffffffc04d447a Aug 22 00:03:49 baal kernel: [ 6994.328274] ffff881567e2d870 0000000000000001 ffff881fd0963a48 ffffffffc04d9bc2 Aug 22 00:03:49 baal kernel: [ 6994.328276] Call Trace: Aug 22 00:03:49 baal kernel: [ 6994.328279] [] _raw_read_lock+0x1d/0x30 Aug 22 00:03:49 baal kernel: [ 6994.328288] [] btrfs_clear_lock_blocking_rw+0x54/0x100 [btrfs] Aug 22 00:03:49 baal kernel: [ 6994.328295] [] btrfs_clear_path_blocking+0x3a/0x80 [btrfs] Aug 22 00:03:49 baal kernel: [ 6994.328303] [] btrfs_search_slot+0x572/0x880 [btrfs] Aug 22 00:03:49 baal kernel: [ 6994.328312] [] ? release_extent_buffer+0x36/0xe0 [btrfs] Aug 22 00:03:49 baal kernel: [ 6994.328320] [] btrfs_next_old_leaf+0x21f/0x460 [btrfs] Aug 22 00:03:49 baal kernel: [ 6994.328327] [] btrfs_next_leaf+0x10/0x20 [btrfs] Aug 22 00:03:49 baal kernel: [ 6994.328337] [] __btrfs_drop_extents+0x1e2/0xdf0 [btrfs] Aug 22 00:03:49 baal kernel: [ 6994.328347] [] ? merge_state.part.31+0x135/0x140 [btrfs] Aug 22 00:03:49 baal kernel: [ 6994.328356] [] insert_reserved_file_extent.constprop.63+0xab/0x310 [btrfs] Aug 22 00:03:49 baal kernel: [ 6994.328365] [] ? start_transaction.part.35+0x80/0x530 [btrfs] Aug 22 00:03:49 baal kernel: [ 6994.328374] [] btrfs_finish_ordered_io+0x475/0x580 [btrfs] Aug 22 00:03:49 baal kernel: [ 6994.328384] [] ? end_compressed_bio_write+0x31/0xf0 [btrfs] Aug 22 00:03:49 baal kernel: [ 6994.328393] [] finish_ordered_fn+0x15/0x20 [btrfs] Aug 22 00:03:49 baal kernel: [ 6994.328402] [] normal_work_helper+0x79/0x1b0 [btrfs] Aug 22 00:03:49 baal kernel: [ 6994.328405] [] process_one_work+0x17f/0x490 Aug 22 00:03:49 baal kernel: [ 6994.328408] [] worker_thread+0x11b/0x3f0 Aug 22 00:03:49 baal kernel: [ 6994.328410] [] ? create_worker+0x1e0/0x1e0 Aug 22 00:03:49 baal kernel: [ 6994.328412] [] kthread+0xc9/0xe0 Aug 22 00:03:49 baal kernel: [ 6994.328414] [] ? flush_kthread_worker+0x90/0x90 Aug 22 00:03:49 baal kernel: [ 6994.328417] [] ret_from_fork+0x7c/0xb0 Aug 22 00:03:49 baal kernel: [ 6994.328419] [] ? flush_kthread_worker+0x90/0x90 Aug 22 00:03:49 baal kernel: [ 6994.328420] Code: 8b 07 3c ff 0f 1f 00 75 d8 f3 90 8b 02 3c ff 74 f8 5d c3 83 e1 fe 0f b7 f1 b8 00 80 00 00 44 0f b7 42 04 66 44 39 c1 74 88 f3 90 <83> e8 01 75 ee 0f 1f 80 00 00 00 00 eb e0 90 90 90 90 90 90 90 Aug 22 00:03:49 baal kernel: [ 6994.336211] NMI watchdog: BUG: soft lockup - CPU#17 stuck for 22s! [kworker/u65:9:8294] Aug 22 00:03:49 baal kernel: [ 6994.344194] Modules linked in: 8021q garp stp mrp llc rfcomm bnep bluetooth joydev x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel kvm crct10dif_pclmul crc32_pclmul ghash_clmulni_intel aesni_intel aes_x86_64 lrw gf128mul glue_helper ablk_helper cryptd nfsd mei_me mei auth_rpcgss lpc_ich nfs_acl sb_edac nfs ioatdma lockd edac_core sunrpc fscache ipmi_si ipmi_msghandler wmi mac_hid parport_pc ppdev lp parport xfs libcrc32c btrfs raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq igb i2c_algo_bit raid1 hid_generic e1000e mpt2sas dca raid0 usbhid raid_class ptp multipath hid scsi_transport_sas pps_core linear Aug 22 00:03:49 baal kernel: [ 6994.344215] CPU: 17 PID: 8294 Comm: kworker/u65:9 Tainted: G L 3.17.0-031700rc1-generic #201408161335 Aug 22 00:03:49 baal kernel: [ 6994.344216] Hardware name: WBS F224A-DE5/X9DRH-iF, BIOS 3.0b 04/28/2014 Aug 22 00:03:49 baal kernel: [ 6994.344226] Workqueue: btrfs-endio-write normal_work_helper [btrfs] Aug 22 00:03:49 baal kernel: [ 6994.344227] task: ffff881fcc47da00 ti: ffff881fd007c000 task.ti: ffff881fd007c000 Aug 22 00:03:49 baal kernel: [ 6994.344228] RIP: 0010:[] [] queue_write_lock_slowpath+0x74/0xd0 Aug 22 00:03:49 baal kernel: [ 6994.344230] RSP: 0018:ffff881fd007fa98 EFLAGS: 00000206 Aug 22 00:03:49 baal kernel: [ 6994.344231] RAX: 0000000000000201 RBX: 0000000000000085 RCX: 00000000000000ff Aug 22 00:03:49 baal kernel: [ 6994.344231] RDX: ffff881be5778198 RSI: 0000000000000301 RDI: ffff881be577819c Aug 22 00:03:49 baal kernel: [ 6994.344232] RBP: ffff881fd007fa98 R08: 00000000000004ec R09: 0000000000000000 Aug 22 00:03:49 baal kernel: [ 6994.344233] R10: ffff881be5adde70 R11: 0000000000000000 R12: ffffffff8179d67e Aug 22 00:03:49 baal kernel: [ 6994.344234] R13: ffff881fd007fa78 R14: 0000000000000000 R15: ffff883fcf5bb738 Aug 22 00:03:49 baal kernel: [ 6994.344235] FS: 0000000000000000(0000) GS:ffff881fffd20000(0000) knlGS:0000000000000000 Aug 22 00:03:49 baal kernel: [ 6994.344236] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 00:03:49 baal kernel: [ 6994.344236] CR2: 00007ffff7ff4000 CR3: 0000000001c16000 CR4: 00000000001407e0 Aug 22 00:03:49 baal kernel: [ 6994.344237] Stack: Aug 22 00:03:49 baal kernel: [ 6994.344238] ffff881fd007faa8 ffffffff817a1665 ffff881fd007fb18 ffffffffc0536ff9 Aug 22 00:03:49 baal kernel: [ 6994.344239] ffff881fd007fab8 ffff8826b8783000 ffff881fd007fc9f ffff8810bf55a090 Aug 22 00:03:49 baal kernel: [ 6994.344240] 0000000000000059 0000000200000007 0000000000000002 ffff8810bf55a090 Aug 22 00:03:49 baal kernel: [ 6994.344242] Call Trace: Aug 22 00:03:49 baal kernel: [ 6994.344244] [] _raw_write_lock+0x25/0x30 Aug 22 00:03:49 baal kernel: [ 6994.344253] [] btrfs_tree_lock+0xc9/0x1d0 [btrfs] Aug 22 00:03:49 baal kernel: [ 6994.344259] [] btrfs_search_slot+0x531/0x880 [btrfs] Aug 22 00:03:49 baal kernel: [ 6994.344265] [] btrfs_insert_empty_items+0x78/0xd0 [btrfs] Aug 22 00:03:49 baal kernel: [ 6994.344273] [] insert_reserved_file_extent.constprop.63+0x145/0x310 [btrfs] Aug 22 00:03:49 baal kernel: [ 6994.344280] [] ? start_transaction.part.35+0x80/0x530 [btrfs] Aug 22 00:03:49 baal kernel: [ 6994.344287] [] btrfs_finish_ordered_io+0x475/0x580 [btrfs] Aug 22 00:03:49 baal kernel: [ 6994.344295] [] ? end_compressed_bio_write+0x31/0xf0 [btrfs] Aug 22 00:03:49 baal kernel: [ 6994.344302] [] finish_ordered_fn+0x15/0x20 [btrfs] Aug 22 00:03:49 baal kernel: [ 6994.344310] [] normal_work_helper+0x79/0x1b0 [btrfs] Aug 22 00:03:49 baal kernel: [ 6994.344312] [] process_one_work+0x17f/0x490 Aug 22 00:03:49 baal kernel: [ 6994.344313] [] worker_thread+0x11b/0x3f0 Aug 22 00:03:49 baal kernel: [ 6994.344315] [] ? create_worker+0x1e0/0x1e0 Aug 22 00:03:49 baal kernel: [ 6994.344316] [] kthread+0xc9/0xe0 Aug 22 00:03:49 baal kernel: [ 6994.344318] [] ? flush_kthread_worker+0x90/0x90 Aug 22 00:03:49 baal kernel: [ 6994.344319] [] ret_from_fork+0x7c/0xb0 Aug 22 00:03:49 baal kernel: [ 6994.344321] [] ? flush_kthread_worker+0x90/0x90 Aug 22 00:03:49 baal kernel: [ 6994.344321] Code: 90 8b 0a 84 c9 66 90 75 f6 89 ce 89 c8 83 ce 01 f0 0f b1 32 39 c8 75 e7 b9 ff 00 00 00 eb 0a 0f 1f 84 00 00 00 00 00 f3 90 8b 02 <83> f8 01 75 f7 f0 0f b1 0a 83 f8 01 75 ee eb b3 0f 1f 40 00 8b Aug 22 00:03:50 baal kernel: [ 6994.364184] NMI watchdog: BUG: soft lockup - CPU#19 stuck for 23s! [kworker/u65:2:10071] Aug 22 00:03:50 baal kernel: [ 6994.372256] Modules linked in: 8021q garp stp mrp llc rfcomm bnep bluetooth joydev x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel kvm crct10dif_pclmul crc32_pclmul ghash_clmulni_intel aesni_intel aes_x86_64 lrw gf128mul glue_helper ablk_helper cryptd nfsd mei_me mei auth_rpcgss lpc_ich nfs_acl sb_edac nfs ioatdma lockd edac_core sunrpc fscache ipmi_si ipmi_msghandler wmi mac_hid parport_pc ppdev lp parport xfs libcrc32c btrfs raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq igb i2c_algo_bit raid1 hid_generic e1000e mpt2sas dca raid0 usbhid raid_class ptp multipath hid scsi_transport_sas pps_core linear Aug 22 00:03:50 baal kernel: [ 6994.372276] CPU: 19 PID: 10071 Comm: kworker/u65:2 Tainted: G L 3.17.0-031700rc1-generic #201408161335 Aug 22 00:03:50 baal kernel: [ 6994.372277] Hardware name: WBS F224A-DE5/X9DRH-iF, BIOS 3.0b 04/28/2014 Aug 22 00:03:50 baal kernel: [ 6994.372287] Workqueue: btrfs-endio-write normal_work_helper [btrfs] Aug 22 00:03:50 baal kernel: [ 6994.372288] task: ffff881fcfa9d000 ti: ffff881567b7c000 task.ti: ffff881567b7c000 Aug 22 00:03:50 baal kernel: [ 6994.372289] RIP: 0010:[] [] queue_read_lock_slowpath+0xb2/0xd0 Aug 22 00:03:50 baal kernel: [ 6994.372291] RSP: 0018:ffff881567b7f978 EFLAGS: 00000206 Aug 22 00:03:50 baal kernel: [ 6994.372292] RAX: 00000000000048ab RBX: 0000000000000000 RCX: 000000000000535c Aug 22 00:03:50 baal kernel: [ 6994.372293] RDX: ffff881be586ed88 RSI: 000000000000535c RDI: ffff881be586ed8c Aug 22 00:03:50 baal kernel: [ 6994.372293] RBP: ffff881567b7f978 R08: 0000000000005356 R09: 0000000000000001 Aug 22 00:03:50 baal kernel: [ 6994.372294] R10: ffff881fd04e2aa0 R11: 0000000000001000 R12: 0000000000000000 Aug 22 00:03:50 baal kernel: [ 6994.372295] R13: ffff881fffd745c0 R14: 0000001300000000 R15: 0000000000000000 Aug 22 00:03:50 baal kernel: [ 6994.372296] FS: 0000000000000000(0000) GS:ffff881fffd60000(0000) knlGS:0000000000000000 Aug 22 00:03:50 baal kernel: [ 6994.372297] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 00:03:50 baal kernel: [ 6994.372298] CR2: 00007ffff7ff4000 CR3: 0000000001c16000 CR4: 00000000001407e0 Aug 22 00:03:50 baal kernel: [ 6994.372298] Stack: Aug 22 00:03:50 baal kernel: [ 6994.372299] ffff881567b7f988 ffffffff817a178d ffff881567b7f9f8 ffffffffc0536c37 Aug 22 00:03:50 baal kernel: [ 6994.372300] 0000000000000013 ffff881fcfa9d530 0000000100000000 ffff881fcfa9d5f0 Aug 22 00:03:50 baal kernel: [ 6994.372302] ffff881567b7f9d8 ffff881fffd745c0 0000000000000000 ffff881e5f74d000 Aug 22 00:03:50 baal kernel: [ 6994.372303] Call Trace: Aug 22 00:03:50 baal kernel: [ 6994.372305] [] _raw_read_lock+0x1d/0x30 Aug 22 00:03:50 baal kernel: [ 6994.372314] [] btrfs_tree_read_lock+0x47/0x120 [btrfs] Aug 22 00:03:50 baal kernel: [ 6994.372320] [] btrfs_read_lock_root_node+0x3b/0x50 [btrfs] Aug 22 00:03:50 baal kernel: [ 6994.372326] [] btrfs_search_slot+0x447/0x880 [btrfs] Aug 22 00:03:50 baal kernel: [ 6994.372333] [] btrfs_lookup_file_extent+0x38/0x40 [btrfs] Aug 22 00:03:50 baal kernel: [ 6994.372341] [] __btrfs_drop_extents+0x151/0xdf0 [btrfs] Aug 22 00:03:50 baal kernel: [ 6994.372346] [] ? btrfs_search_slot+0x747/0x880 [btrfs] Aug 22 00:03:50 baal kernel: [ 6994.372348] [] ? kmem_cache_alloc+0x1b3/0x1f0 Aug 22 00:03:50 baal kernel: [ 6994.372354] [] ? btrfs_alloc_path+0x1a/0x20 [btrfs] Aug 22 00:03:50 baal kernel: [ 6994.372359] [] ? btrfs_alloc_path+0x1a/0x20 [btrfs] Aug 22 00:03:50 baal kernel: [ 6994.372366] [] insert_reserved_file_extent.constprop.63+0xab/0x310 [btrfs] Aug 22 00:03:50 baal kernel: [ 6994.372373] [] ? start_transaction.part.35+0x80/0x530 [btrfs] Aug 22 00:03:50 baal kernel: [ 6994.372380] [] btrfs_finish_ordered_io+0x475/0x580 [btrfs] Aug 22 00:03:50 baal kernel: [ 6994.372388] [] ? end_compressed_bio_write+0x31/0xf0 [btrfs] Aug 22 00:03:50 baal kernel: [ 6994.372395] [] finish_ordered_fn+0x15/0x20 [btrfs] Aug 22 00:03:50 baal kernel: [ 6994.372402] [] normal_work_helper+0x79/0x1b0 [btrfs] Aug 22 00:03:50 baal kernel: [ 6994.372404] [] process_one_work+0x17f/0x490 Aug 22 00:03:50 baal kernel: [ 6994.372406] [] worker_thread+0x11b/0x3f0 Aug 22 00:03:50 baal kernel: [ 6994.372407] [] ? create_worker+0x1e0/0x1e0 Aug 22 00:03:50 baal kernel: [ 6994.372409] [] kthread+0xc9/0xe0 Aug 22 00:03:50 baal kernel: [ 6994.372410] [] ? flush_kthread_worker+0x90/0x90 Aug 22 00:03:50 baal kernel: [ 6994.372412] [] ret_from_fork+0x7c/0xb0 Aug 22 00:03:50 baal kernel: [ 6994.372413] [] ? flush_kthread_worker+0x90/0x90 Aug 22 00:03:50 baal kernel: [ 6994.372414] Code: 5d c3 8b 07 3c ff 0f 1f 00 75 d8 f3 90 8b 02 3c ff 74 f8 5d c3 83 e1 fe 0f b7 f1 b8 00 80 00 00 44 0f b7 42 04 66 44 39 c1 74 88 90 83 e8 01 75 ee 0f 1f 80 00 00 00 00 eb e0 90 90 90 90 90 Aug 22 00:03:50 baal kernel: [ 6994.376172] NMI watchdog: BUG: soft lockup - CPU#20 stuck for 23s! [kworker/u65:11:8296] Aug 22 00:03:50 baal kernel: [ 6994.384248] Modules linked in: 8021q garp stp mrp llc rfcomm bnep bluetooth joydev x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel kvm crct10dif_pclmul crc32_pclmul ghash_clmulni_intel aesni_intel aes_x86_64 lrw gf128mul glue_helper ablk_helper cryptd nfsd mei_me mei auth_rpcgss lpc_ich nfs_acl sb_edac nfs ioatdma lockd edac_core sunrpc fscache ipmi_si ipmi_msghandler wmi mac_hid parport_pc ppdev lp parport xfs libcrc32c btrfs raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq igb i2c_algo_bit raid1 hid_generic e1000e mpt2sas dca raid0 usbhid raid_class ptp multipath hid scsi_transport_sas pps_core linear Aug 22 00:03:50 baal kernel: [ 6994.384277] CPU: 20 PID: 8296 Comm: kworker/u65:11 Tainted: G L 3.17.0-031700rc1-generic #201408161335 Aug 22 00:03:50 baal kernel: [ 6994.384279] Hardware name: WBS F224A-DE5/X9DRH-iF, BIOS 3.0b 04/28/2014 Aug 22 00:03:50 baal kernel: [ 6994.384290] Workqueue: btrfs-endio-write normal_work_helper [btrfs] Aug 22 00:03:50 baal kernel: [ 6994.384292] task: ffff881fcc478a00 ti: ffff881fd005c000 task.ti: ffff881fd005c000 Aug 22 00:03:50 baal kernel: [ 6994.384293] RIP: 0010:[] [] queue_read_lock_slowpath+0xac/0xd0 Aug 22 00:03:50 baal kernel: [ 6994.384296] RSP: 0018:ffff881fd005f958 EFLAGS: 00000202 Aug 22 00:03:50 baal kernel: [ 6994.384297] RAX: 000000000000732c RBX: 0000000000000000 RCX: 00000000000004ee Aug 22 00:03:50 baal kernel: [ 6994.384299] RDX: ffff881be5778198 RSI: 00000000000004ee RDI: ffff881be577819c Aug 22 00:03:50 baal kernel: [ 6994.384300] RBP: ffff881fd005f958 R08: 00000000000004ec R09: 0000000000000000 Aug 22 00:03:50 baal kernel: [ 6994.384301] R10: ffff88380cf01d48 R11: 0000000000000003 R12: 00000000000145c0 Aug 22 00:03:50 baal kernel: [ 6994.384302] R13: ffff883fcb390380 R14: 00000000000145c0 R15: ffff881fd005ffd8 Aug 22 00:03:50 baal kernel: [ 6994.384304] FS: 0000000000000000(0000) GS:ffff881fffd80000(0000) knlGS:0000000000000000 Aug 22 00:03:50 baal kernel: [ 6994.384305] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 00:03:50 baal kernel: [ 6994.384306] CR2: 00007ffff7fe2000 CR3: 0000000001c16000 CR4: 00000000001407e0 Aug 22 00:03:50 baal kernel: [ 6994.384307] Stack: Aug 22 00:03:50 baal kernel: [ 6994.384308] ffff881fd005f968 ffffffff817a178d ffff881fd005f988 ffffffffc0536b44 Aug 22 00:03:50 baal kernel: [ 6994.384310] 0000000000000001 ffffffffffffffe8 ffff881fd005f9a8 ffffffffc04d447a Aug 22 00:03:50 baal kernel: [ 6994.384312] ffff8810bf5411b0 0000000000000000 ffff881fd005fa48 ffffffffc04d9bc2 Aug 22 00:03:50 baal kernel: [ 6994.384315] Call Trace: Aug 22 00:03:50 baal kernel: [ 6994.384317] [] _raw_read_lock+0x1d/0x30 Aug 22 00:03:50 baal kernel: [ 6994.384329] [] btrfs_clear_lock_blocking_rw+0x54/0x100 [btrfs] Aug 22 00:03:50 baal kernel: [ 6994.384338] [] btrfs_clear_path_blocking+0x3a/0x80 [btrfs] Aug 22 00:03:50 baal kernel: [ 6994.384348] [] btrfs_search_slot+0x572/0x880 [btrfs] Aug 22 00:03:50 baal kernel: [ 6994.384360] [] ? release_extent_buffer+0x36/0xe0 [btrfs] Aug 22 00:03:50 baal kernel: [ 6994.384369] [] btrfs_next_old_leaf+0x21f/0x460 [btrfs] Aug 22 00:03:50 baal kernel: [ 6994.384379] [] btrfs_next_leaf+0x10/0x20 [btrfs] Aug 22 00:03:50 baal kernel: [ 6994.384391] [] __btrfs_drop_extents+0x1e2/0xdf0 [btrfs] Aug 22 00:03:50 baal kernel: [ 6994.384403] [] ? merge_state.part.31+0xd2/0x140 [btrfs] Aug 22 00:03:50 baal kernel: [ 6994.384415] [] insert_reserved_file_extent.constprop.63+0xab/0x310 [btrfs] Aug 22 00:03:50 baal kernel: [ 6994.384425] [] ? start_transaction.part.35+0x80/0x530 [btrfs] Aug 22 00:03:50 baal kernel: [ 6994.384436] [] btrfs_finish_ordered_io+0x475/0x580 [btrfs] Aug 22 00:03:50 baal kernel: [ 6994.384447] [] finish_ordered_fn+0x15/0x20 [btrfs] Aug 22 00:03:50 baal kernel: [ 6994.384458] [] normal_work_helper+0x79/0x1b0 [btrfs] Aug 22 00:03:50 baal kernel: [ 6994.384461] [] process_one_work+0x17f/0x490 Aug 22 00:03:50 baal kernel: [ 6994.384463] [] worker_thread+0x11b/0x3f0 Aug 22 00:03:50 baal kernel: [ 6994.384466] [] ? create_worker+0x1e0/0x1e0 Aug 22 00:03:50 baal kernel: [ 6994.384468] [] kthread+0xc9/0xe0 Aug 22 00:03:50 baal kernel: [ 6994.384470] [] ? flush_kthread_worker+0x90/0x90 Aug 22 00:03:50 baal kernel: [ 6994.384472] [] ret_from_fork+0x7c/0xb0 Aug 22 00:03:50 baal kernel: [ 6994.384475] [] ? flush_kthread_worker+0x90/0x90 Aug 22 00:03:50 baal kernel: [ 6994.384476] Code: e8 e8 15 c3 6c 00 5d c3 8b 07 3c ff 0f 1f 00 75 d8 f3 90 8b 02 3c ff 74 f8 5d c3 83 e1 fe 0f b7 f1 b8 00 80 00 00 44 0f b7 42 04 <66> 44 39 c1 74 88 f3 90 83 e8 01 75 ee 0f 1f 80 00 00 00 00 eb Aug 22 00:03:50 baal kernel: [ 6994.536016] NMI watchdog: BUG: soft lockup - CPU#31 stuck for 23s! [doFilebench.sh:8248] Aug 22 00:03:50 baal kernel: [ 6994.544087] Modules linked in: 8021q garp stp mrp llc rfcomm bnep bluetooth joydev x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel kvm crct10dif_pclmul crc32_pclmul ghash_clmulni_intel aesni_intel aes_x86_64 lrw gf128mul glue_helper ablk_helper cryptd nfsd mei_me mei auth_rpcgss lpc_ich nfs_acl sb_edac nfs ioatdma lockd edac_core sunrpc fscache ipmi_si ipmi_msghandler wmi mac_hid parport_pc ppdev lp parport xfs libcrc32c btrfs raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq igb i2c_algo_bit raid1 hid_generic e1000e mpt2sas dca raid0 usbhid raid_class ptp multipath hid scsi_transport_sas pps_core linear Aug 22 00:03:50 baal kernel: [ 6994.544118] CPU: 31 PID: 8248 Comm: doFilebench.sh Tainted: G L 3.17.0-031700rc1-generic #201408161335 Aug 22 00:03:50 baal kernel: [ 6994.544119] Hardware name: WBS F224A-DE5/X9DRH-iF, BIOS 3.0b 04/28/2014 Aug 22 00:03:50 baal kernel: [ 6994.544121] task: ffff881e2f7c3200 ti: ffff881691780000 task.ti: ffff881691780000 Aug 22 00:03:50 baal kernel: [ 6994.544122] RIP: 0010:[] [] queue_read_lock_slowpath+0xb4/0xd0 Aug 22 00:03:50 baal kernel: [ 6994.544125] RSP: 0018:ffff881691783c98 EFLAGS: 00000212 Aug 22 00:03:50 baal kernel: [ 6994.544126] RAX: 0000000000001b99 RBX: 0000000000000000 RCX: 0000000000005370 Aug 22 00:03:50 baal kernel: [ 6994.544128] RDX: ffff881be586ed88 RSI: 0000000000005370 RDI: ffff881be586ed8c Aug 22 00:03:50 baal kernel: [ 6994.544129] RBP: ffff881691783c98 R08: 0000000000005356 R09: 0000000000000000 Aug 22 00:03:50 baal kernel: [ 6994.544130] R10: 0000000000000000 R11: 0000000000000246 R12: ffff882ea8ddcb00 Aug 22 00:03:50 baal kernel: [ 6994.544131] R13: ffff882ea8ddcb10 R14: ffff88169c3af5d8 R15: ffffffff81aff049 Aug 22 00:03:50 baal kernel: [ 6994.544133] FS: 00007ffff7fdf740(0000) GS:ffff88407fde0000(0000) knlGS:0000000000000000 Aug 22 00:03:50 baal kernel: [ 6994.544134] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 00:03:50 baal kernel: [ 6994.544136] CR2: 00007fffffffb398 CR3: 00000030708e5000 CR4: 00000000001407e0 Aug 22 00:03:50 baal kernel: [ 6994.544137] Stack: Aug 22 00:03:50 baal kernel: [ 6994.544137] ffff881691783ca8 ffffffff817a178d ffff881691783d18 ffffffffc0536c37 Aug 22 00:03:50 baal kernel: [ 6994.544140] ffff881691783d68 ffffffff811f8b63 0000000000000002 0000000000000000 Aug 22 00:03:50 baal kernel: [ 6994.544142] ffff881691783d00 ffff882ea8ddcb00 ffff881e2f7c3200 ffff881e5f74d000 Aug 22 00:03:50 baal kernel: [ 6994.544144] Call Trace: Aug 22 00:03:50 baal kernel: [ 6994.544147] [] _raw_read_lock+0x1d/0x30 Aug 22 00:03:50 baal kernel: [ 6994.544161] [] btrfs_tree_read_lock+0x47/0x120 [btrfs] Aug 22 00:03:50 baal kernel: [ 6994.544164] [] ? do_last+0x1e3/0x7b0 Aug 22 00:03:50 baal kernel: [ 6994.544174] [] btrfs_read_lock_root_node+0x3b/0x50 [btrfs] Aug 22 00:03:50 baal kernel: [ 6994.544183] [] btrfs_search_slot+0x447/0x880 [btrfs] Aug 22 00:03:50 baal kernel: [ 6994.544196] [] btrfs_real_readdir+0xfc/0x620 [btrfs] Aug 22 00:03:50 baal kernel: [ 6994.544199] [] iterate_dir+0xb3/0x140 Aug 22 00:03:50 baal kernel: [ 6994.544201] [] ? final_putname+0x26/0x50 Aug 22 00:03:50 baal kernel: [ 6994.544203] [] SyS_getdents+0x8c/0x110 Aug 22 00:03:50 baal kernel: [ 6994.544206] [] ? filldir64+0x110/0x110 Aug 22 00:03:50 baal kernel: [ 6994.544208] [] system_call_fastpath+0x1a/0x1f Aug 22 00:03:50 baal kernel: [ 6994.544209] Code: 8b 07 3c ff 0f 1f 00 75 d8 f3 90 8b 02 3c ff 74 f8 5d c3 83 e1 fe 0f b7 f1 b8 00 80 00 00 44 0f b7 42 04 66 44 39 c1 74 88 f3 90 <83> e8 01 75 ee 0f 1f 80 00 00 00 00 eb e0 90 90 90 90 90 90 90 Aug 22 00:03:55 baal kernel: [ 6999.962711] INFO: rcu_sched self-detected stall on CPU Aug 22 00:03:55 baal kernel: [ 6999.962712] INFO: rcu_sched self-detected stall on CPU Aug 22 00:03:55 baal kernel: [ 6999.962713] INFO: rcu_sched self-detected stall on CPU Aug 22 00:03:55 baal kernel: [ 6999.962713] INFO: rcu_sched self-detected stall on CPU Aug 22 00:03:55 baal kernel: [ 6999.962714] { Aug 22 00:03:55 baal kernel: [ 6999.962714] INFO: rcu_sched self-detected stall on CPU Aug 22 00:03:55 baal kernel: [ 6999.962715] { Aug 22 00:03:55 baal kernel: [ 6999.962716] { Aug 22 00:03:55 baal kernel: [ 6999.962716] 0 Aug 22 00:03:55 baal kernel: [ 6999.962717] { Aug 22 00:03:55 baal kernel: [ 6999.962717] 4 Aug 22 00:03:55 baal kernel: [ 6999.962718] 20 Aug 22 00:03:55 baal kernel: [ 6999.962718] } Aug 22 00:03:55 baal kernel: [ 6999.962719] 17 Aug 22 00:03:55 baal kernel: [ 6999.962719] } Aug 22 00:03:55 baal kernel: [ 6999.962719] } Aug 22 00:03:55 baal kernel: [ 6999.962720] } Aug 22 00:03:55 baal kernel: [ 6999.962720] (t=15000 jiffies g=287767 c=287766 q=0) Aug 22 00:03:55 baal kernel: [ 6999.962721] (t=15000 jiffies g=287767 c=287766 q=0) Aug 22 00:03:55 baal kernel: [ 6999.962722] (t=15000 jiffies g=287767 c=287766 q=0) Aug 22 00:03:55 baal kernel: [ 6999.962723] (t=15000 jiffies g=287767 c=287766 q=0) Aug 22 00:03:55 baal kernel: [ 6999.962723] Task dump for CPU 0: Aug 22 00:03:55 baal kernel: [ 6999.962725] kworker/u65:17 R running task 0 8308 2 0x00000008 Aug 22 00:03:55 baal kernel: [ 6999.962734] Workqueue: btrfs-endio-write normal_work_helper [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.962735] ffffffff81c542c0 ffff881fffc03cf8 ffffffff810a0628 0000000000000000 Aug 22 00:03:55 baal kernel: [ 6999.962736] ffffffff81c542c0 ffff881fffc03d18 ffffffff810a2f4f ffff881fffc03d58 Aug 22 00:03:55 baal kernel: [ 6999.962737] ffffffff81c543c0 ffff881fffc03d48 ffffffff810d31ab ffffffff81c542c0 Aug 22 00:03:55 baal kernel: [ 6999.962737] Call Trace: Aug 22 00:03:55 baal kernel: [ 6999.962741] [] sched_show_task+0xa8/0x110 Aug 22 00:03:55 baal kernel: [ 6999.962742] [] dump_cpu_task+0x3f/0x50 Aug 22 00:03:55 baal kernel: [ 6999.962744] [] rcu_dump_cpu_stacks+0x8b/0xc0 Aug 22 00:03:55 baal kernel: [ 6999.962745] [] print_cpu_stall+0xd7/0x140 Aug 22 00:03:55 baal kernel: [ 6999.962747] [] check_cpu_stall.isra.50+0xa5/0xb0 Aug 22 00:03:55 baal kernel: [ 6999.962748] [] __rcu_pending+0x38/0x1d0 Aug 22 00:03:55 baal kernel: [ 6999.962749] [] rcu_check_callbacks+0xed/0x1a0 Aug 22 00:03:55 baal kernel: [ 6999.962751] [] update_process_times+0x48/0x80 Aug 22 00:03:55 baal kernel: [ 6999.962752] [] tick_sched_handle.isra.14+0x33/0x70 Aug 22 00:03:55 baal kernel: [ 6999.962754] [] tick_sched_timer+0x4c/0x80 Aug 22 00:03:55 baal kernel: [ 6999.962755] [] __run_hrtimer+0x76/0x230 Aug 22 00:03:55 baal kernel: [ 6999.962756] [] ? tick_nohz_handler+0xa0/0xa0 Aug 22 00:03:55 baal kernel: [ 6999.962757] [] hrtimer_interrupt+0xff/0x260 Aug 22 00:03:55 baal kernel: [ 6999.962760] [] local_apic_timer_interrupt+0x3b/0x60 Aug 22 00:03:55 baal kernel: [ 6999.962762] [] smp_apic_timer_interrupt+0x45/0x60 Aug 22 00:03:55 baal kernel: [ 6999.962763] [] apic_timer_interrupt+0x6d/0x80 Aug 22 00:03:55 baal kernel: [ 6999.962765] [] ? queue_read_lock_slowpath+0xb4/0xd0 Aug 22 00:03:55 baal kernel: [ 6999.962767] [] _raw_read_lock+0x1d/0x30 Aug 22 00:03:55 baal kernel: [ 6999.962775] [] btrfs_clear_lock_blocking_rw+0x54/0x100 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.962780] [] btrfs_clear_path_blocking+0x3a/0x80 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.962786] [] btrfs_search_slot+0x572/0x880 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.962794] [] ? release_extent_buffer+0x36/0xe0 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.962800] [] btrfs_next_old_leaf+0x21f/0x460 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.962806] [] btrfs_next_leaf+0x10/0x20 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.962814] [] __btrfs_drop_extents+0x1e2/0xdf0 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.962822] [] ? merge_state.part.31+0xd2/0x140 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.962830] [] insert_reserved_file_extent.constprop.63+0xab/0x310 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.962837] [] ? start_transaction.part.35+0x80/0x530 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.962844] [] btrfs_finish_ordered_io+0x475/0x580 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.962851] [] finish_ordered_fn+0x15/0x20 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.962858] [] normal_work_helper+0x79/0x1b0 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.962860] [] process_one_work+0x17f/0x490 Aug 22 00:03:55 baal kernel: [ 6999.962862] [] worker_thread+0x11b/0x3f0 Aug 22 00:03:55 baal kernel: [ 6999.962863] [] ? create_worker+0x1e0/0x1e0 Aug 22 00:03:55 baal kernel: [ 6999.962864] [] kthread+0xc9/0xe0 Aug 22 00:03:55 baal kernel: [ 6999.962865] [] ? flush_kthread_worker+0x90/0x90 Aug 22 00:03:55 baal kernel: [ 6999.962867] [] ret_from_fork+0x7c/0xb0 Aug 22 00:03:55 baal kernel: [ 6999.962868] [] ? flush_kthread_worker+0x90/0x90 Aug 22 00:03:55 baal kernel: [ 6999.962869] Task dump for CPU 4: Aug 22 00:03:55 baal kernel: [ 6999.962870] kworker/u65:5 R running task 0 8077 2 0x00000008 Aug 22 00:03:55 baal kernel: [ 6999.962877] Workqueue: btrfs-endio-write normal_work_helper [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.962878] 0000000000000000 0000000000000000 0000000000000000 0000000000005356 Aug 22 00:03:55 baal kernel: [ 6999.962879] 0000000000000101 00000000000000ff ffff881be586ed88 0000000000000101 Aug 22 00:03:55 baal kernel: [ 6999.962880] ffff881be586ed8c ffffffffffffff10 ffffffff810bbfb4 0000000000000010 Aug 22 00:03:55 baal kernel: [ 6999.962880] Call Trace: Aug 22 00:03:55 baal kernel: [ 6999.962882] [] ? queue_write_lock_slowpath+0x74/0xd0 Aug 22 00:03:55 baal kernel: [ 6999.962883] [] ? _raw_write_lock+0x25/0x30 Aug 22 00:03:55 baal kernel: [ 6999.962891] [] ? btrfs_tree_lock+0xc9/0x1d0 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.962892] [] ? add_wait_queue+0x60/0x60 Aug 22 00:03:55 baal kernel: [ 6999.962898] [] ? btrfs_lock_root_node+0x3b/0x50 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.962904] [] ? btrfs_search_slot+0x787/0x880 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.962911] [] ? btrfs_lookup_file_extent+0x38/0x40 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.962918] [] ? __btrfs_drop_extents+0x151/0xdf0 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.962924] [] ? btrfs_search_slot+0x747/0x880 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.962926] [] ? kmem_cache_alloc+0x1b3/0x1f0 Aug 22 00:03:55 baal kernel: [ 6999.962931] [] ? btrfs_alloc_path+0x1a/0x20 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.962936] [] ? btrfs_alloc_path+0x1a/0x20 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.962943] [] ? insert_reserved_file_extent.constprop.63+0xab/0x310 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.962950] [] ? start_transaction.part.35+0x80/0x530 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.962957] [] ? btrfs_finish_ordered_io+0x475/0x580 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.962965] [] ? end_compressed_bio_write+0x31/0xf0 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.962972] [] ? finish_ordered_fn+0x15/0x20 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.962979] [] ? normal_work_helper+0x79/0x1b0 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.962981] [] ? process_one_work+0x17f/0x490 Aug 22 00:03:55 baal kernel: [ 6999.962982] [] ? worker_thread+0x11b/0x3f0 Aug 22 00:03:55 baal kernel: [ 6999.962984] [] ? create_worker+0x1e0/0x1e0 Aug 22 00:03:55 baal kernel: [ 6999.962985] [] ? kthread+0xc9/0xe0 Aug 22 00:03:55 baal kernel: [ 6999.962986] [] ? flush_kthread_worker+0x90/0x90 Aug 22 00:03:55 baal kernel: [ 6999.962987] [] ? ret_from_fork+0x7c/0xb0 Aug 22 00:03:55 baal kernel: [ 6999.962988] [] ? flush_kthread_worker+0x90/0x90 Aug 22 00:03:55 baal kernel: [ 6999.962989] Task dump for CPU 16: Aug 22 00:03:55 baal kernel: [ 6999.962989] Task dump for CPU 0: Aug 22 00:03:55 baal kernel: [ 6999.962991] kworker/u65:8 R Aug 22 00:03:55 baal kernel: [ 6999.962991] kworker/u65:17 R Aug 22 00:03:55 baal kernel: [ 6999.962991] running task Aug 22 00:03:55 baal kernel: [ 6999.962992] running task Aug 22 00:03:55 baal kernel: [ 6999.962992] 0 8293 2 0x00000008 Aug 22 00:03:55 baal kernel: [ 6999.962993] 0 8308 2 0x00000008 Aug 22 00:03:55 baal kernel: [ 6999.963009] Workqueue: btrfs-endio-write normal_work_helper [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963009] Workqueue: btrfs-endio-write normal_work_helper [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963009] Aug 22 00:03:55 baal kernel: [ 6999.963010] Aug 22 00:03:55 baal kernel: [ 6999.963010] 0000000000000000 Aug 22 00:03:55 baal kernel: [ 6999.963011] 000000000000362c Aug 22 00:03:55 baal kernel: [ 6999.963011] ffff881be586ed98 Aug 22 00:03:55 baal kernel: [ 6999.963012] 0000000000005358 Aug 22 00:03:55 baal kernel: [ 6999.963012] 0000000000000000 Aug 22 00:03:55 baal kernel: [ 6999.963013] ffff881be586ed88 Aug 22 00:03:55 baal kernel: [ 6999.963013] 0000000000000000 Aug 22 00:03:55 baal kernel: [ 6999.963014] 0000000000005358 Aug 22 00:03:55 baal kernel: [ 6999.963014] Aug 22 00:03:55 baal kernel: [ 6999.963014] Aug 22 00:03:55 baal kernel: [ 6999.963015] ffff881fd0963958 Aug 22 00:03:55 baal kernel: [ 6999.963015] ffff881be586ed8c Aug 22 00:03:55 baal kernel: [ 6999.963016] 0000000000000000 Aug 22 00:03:55 baal kernel: [ 6999.963016] ffffffffffffff10 Aug 22 00:03:55 baal kernel: [ 6999.963017] 0000000000000000 Aug 22 00:03:55 baal kernel: [ 6999.963017] ffffffff810bc0c4 Aug 22 00:03:55 baal kernel: [ 6999.963018] ffff881be5adde70 Aug 22 00:03:55 baal kernel: [ 6999.963018] 0000000000000010 Aug 22 00:03:55 baal kernel: [ 6999.963018] Aug 22 00:03:55 baal kernel: [ 6999.963018] Aug 22 00:03:55 baal kernel: [ 6999.963019] 0000000000000000 Aug 22 00:03:55 baal kernel: [ 6999.963020] 0000000000000202 Aug 22 00:03:55 baal kernel: [ 6999.963020] 0000000000005356 Aug 22 00:03:55 baal kernel: [ 6999.963021] ffff88169fcfb958 Aug 22 00:03:55 baal kernel: [ 6999.963021] 0000000000006b80 Aug 22 00:03:55 baal kernel: [ 6999.963022] 0000000000000018 Aug 22 00:03:55 baal kernel: [ 6999.963022] 000000000000535a Aug 22 00:03:55 baal kernel: [ 6999.963022] ffff8826b8783000 Aug 22 00:03:55 baal kernel: [ 6999.963023] Aug 22 00:03:55 baal kernel: [ 6999.963023] Aug 22 00:03:55 baal kernel: [ 6999.963023] Call Trace: Aug 22 00:03:55 baal kernel: [ 6999.963023] Call Trace: Aug 22 00:03:55 baal kernel: [ 6999.963025] [] ? queue_read_lock_slowpath+0xac/0xd0 Aug 22 00:03:55 baal kernel: [ 6999.963027] [] ? queue_read_lock_slowpath+0xb4/0xd0 Aug 22 00:03:55 baal kernel: [ 6999.963028] [] ? _raw_read_lock+0x1d/0x30 Aug 22 00:03:55 baal kernel: [ 6999.963030] [] ? _raw_read_lock+0x1d/0x30 Aug 22 00:03:55 baal kernel: [ 6999.963037] [] ? btrfs_clear_lock_blocking_rw+0x54/0x100 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963046] [] ? btrfs_clear_lock_blocking_rw+0x54/0x100 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963051] [] ? btrfs_clear_path_blocking+0x3a/0x80 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963057] [] ? btrfs_clear_path_blocking+0x3a/0x80 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963062] [] ? btrfs_search_slot+0x572/0x880 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963068] [] ? btrfs_search_slot+0x572/0x880 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963076] [] ? release_extent_buffer+0x36/0xe0 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963085] [] ? release_extent_buffer+0x36/0xe0 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963090] [] ? btrfs_next_old_leaf+0x21f/0x460 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963097] [] ? btrfs_next_old_leaf+0x21f/0x460 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963102] [] ? btrfs_next_leaf+0x10/0x20 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963109] [] ? btrfs_next_leaf+0x10/0x20 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963116] [] ? __btrfs_drop_extents+0x1e2/0xdf0 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963124] [] ? __btrfs_drop_extents+0x1e2/0xdf0 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963132] [] ? merge_state.part.31+0x135/0x140 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963141] [] ? merge_state.part.31+0xd2/0x140 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963148] [] ? insert_reserved_file_extent.constprop.63+0xab/0x310 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963156] [] ? insert_reserved_file_extent.constprop.63+0xab/0x310 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963162] [] ? start_transaction.part.35+0x80/0x530 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963170] [] ? start_transaction.part.35+0x80/0x530 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963176] [] ? btrfs_finish_ordered_io+0x475/0x580 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963184] [] ? btrfs_finish_ordered_io+0x475/0x580 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963192] [] ? end_compressed_bio_write+0x31/0xf0 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963199] [] ? finish_ordered_fn+0x15/0x20 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963206] [] ? finish_ordered_fn+0x15/0x20 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963214] [] ? normal_work_helper+0x79/0x1b0 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963222] [] ? normal_work_helper+0x79/0x1b0 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963223] [] ? process_one_work+0x17f/0x490 Aug 22 00:03:55 baal kernel: [ 6999.963225] [] ? process_one_work+0x17f/0x490 Aug 22 00:03:55 baal kernel: [ 6999.963226] [] ? worker_thread+0x11b/0x3f0 Aug 22 00:03:55 baal kernel: [ 6999.963228] [] ? worker_thread+0x11b/0x3f0 Aug 22 00:03:55 baal kernel: [ 6999.963229] [] ? create_worker+0x1e0/0x1e0 Aug 22 00:03:55 baal kernel: [ 6999.963231] [] ? create_worker+0x1e0/0x1e0 Aug 22 00:03:55 baal kernel: [ 6999.963232] [] ? kthread+0xc9/0xe0 Aug 22 00:03:55 baal kernel: [ 6999.963233] [] ? kthread+0xc9/0xe0 Aug 22 00:03:55 baal kernel: [ 6999.963235] [] ? flush_kthread_worker+0x90/0x90 Aug 22 00:03:55 baal kernel: [ 6999.963236] [] ? flush_kthread_worker+0x90/0x90 Aug 22 00:03:55 baal kernel: [ 6999.963238] [] ? ret_from_fork+0x7c/0xb0 Aug 22 00:03:55 baal kernel: [ 6999.963239] [] ? ret_from_fork+0x7c/0xb0 Aug 22 00:03:55 baal kernel: [ 6999.963241] [] ? flush_kthread_worker+0x90/0x90 Aug 22 00:03:55 baal kernel: [ 6999.963242] [] ? flush_kthread_worker+0x90/0x90 Aug 22 00:03:55 baal kernel: [ 6999.963242] Task dump for CPU 4: Aug 22 00:03:55 baal kernel: [ 6999.963242] Task dump for CPU 17: Aug 22 00:03:55 baal kernel: [ 6999.963244] kworker/u65:5 R Aug 22 00:03:55 baal kernel: [ 6999.963244] kworker/u65:9 R Aug 22 00:03:55 baal kernel: [ 6999.963244] running task Aug 22 00:03:55 baal kernel: [ 6999.963245] running task Aug 22 00:03:55 baal kernel: [ 6999.963245] 0 8077 2 0x00000008 Aug 22 00:03:55 baal kernel: [ 6999.963246] 0 8294 2 0x00000008 Aug 22 00:03:55 baal kernel: [ 6999.963262] Workqueue: btrfs-endio-write normal_work_helper [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963262] Workqueue: btrfs-endio-write normal_work_helper [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963262] Aug 22 00:03:55 baal kernel: [ 6999.963263] Aug 22 00:03:55 baal kernel: [ 6999.963263] ffffffff81c542c0 Aug 22 00:03:55 baal kernel: [ 6999.963264] ffff881fd007fa78 Aug 22 00:03:55 baal kernel: [ 6999.963264] ffff881fffc83cf8 Aug 22 00:03:55 baal kernel: [ 6999.963265] ffffffff8179d67e Aug 22 00:03:55 baal kernel: [ 6999.963266] ffffffff810a0628 Aug 22 00:03:55 baal kernel: [ 6999.963266] ffff881fd007fa98 Aug 22 00:03:55 baal kernel: [ 6999.963266] 0000000000000004 Aug 22 00:03:55 baal kernel: [ 6999.963267] 0000000000000085 Aug 22 00:03:55 baal kernel: [ 6999.963267] Aug 22 00:03:55 baal kernel: [ 6999.963267] Aug 22 00:03:55 baal kernel: [ 6999.963268] ffffffff81c542c0 Aug 22 00:03:55 baal kernel: [ 6999.963269] 0000000000000000 Aug 22 00:03:55 baal kernel: [ 6999.963269] ffff881fffc83d18 Aug 22 00:03:55 baal kernel: [ 6999.963269] ffff881be5adde70 Aug 22 00:03:55 baal kernel: [ 6999.963270] ffffffff810a2f4f Aug 22 00:03:55 baal kernel: [ 6999.963270] 0000000000000000 Aug 22 00:03:55 baal kernel: [ 6999.963271] ffff881fffc83d58 Aug 22 00:03:55 baal kernel: [ 6999.963271] 00000000000004ec Aug 22 00:03:55 baal kernel: [ 6999.963271] Aug 22 00:03:55 baal kernel: [ 6999.963272] Aug 22 00:03:55 baal kernel: [ 6999.963272] ffffffff81c543c0 Aug 22 00:03:55 baal kernel: [ 6999.963273] 0000000000000201 Aug 22 00:03:55 baal kernel: [ 6999.963273] ffff881fffc83d48 Aug 22 00:03:55 baal kernel: [ 6999.963274] 00000000000000ff Aug 22 00:03:55 baal kernel: [ 6999.963274] ffffffff810d31ab Aug 22 00:03:55 baal kernel: [ 6999.963275] ffff881be5778198 Aug 22 00:03:55 baal kernel: [ 6999.963275] ffffffff81c542c0 Aug 22 00:03:55 baal kernel: [ 6999.963276] 0000000000000301 Aug 22 00:03:55 baal kernel: [ 6999.963276] Aug 22 00:03:55 baal kernel: [ 6999.963276] Aug 22 00:03:55 baal kernel: [ 6999.963276] Call Trace: Aug 22 00:03:55 baal kernel: [ 6999.963277] Call Trace: Aug 22 00:03:55 baal kernel: [ 6999.963277] Aug 22 00:03:55 baal kernel: [ 6999.963279] [] ? __schedule+0x38e/0x770 Aug 22 00:03:55 baal kernel: [ 6999.963281] [] sched_show_task+0xa8/0x110 Aug 22 00:03:55 baal kernel: [ 6999.963282] [] ? queue_write_lock_slowpath+0x72/0xd0 Aug 22 00:03:55 baal kernel: [ 6999.963284] [] dump_cpu_task+0x3f/0x50 Aug 22 00:03:55 baal kernel: [ 6999.963286] [] ? _raw_write_lock+0x25/0x30 Aug 22 00:03:55 baal kernel: [ 6999.963287] [] rcu_dump_cpu_stacks+0x8b/0xc0 Aug 22 00:03:55 baal kernel: [ 6999.963294] [] ? btrfs_tree_lock+0xc9/0x1d0 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963296] [] print_cpu_stall+0xd7/0x140 Aug 22 00:03:55 baal kernel: [ 6999.963302] [] ? btrfs_search_slot+0x531/0x880 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963303] [] check_cpu_stall.isra.50+0xa5/0xb0 Aug 22 00:03:55 baal kernel: [ 6999.963309] [] ? btrfs_insert_empty_items+0x78/0xd0 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963310] [] __rcu_pending+0x38/0x1d0 Aug 22 00:03:55 baal kernel: [ 6999.963317] [] ? insert_reserved_file_extent.constprop.63+0x145/0x310 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963319] [] rcu_check_callbacks+0xed/0x1a0 Aug 22 00:03:55 baal kernel: [ 6999.963325] [] ? start_transaction.part.35+0x80/0x530 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963327] [] update_process_times+0x48/0x80 Aug 22 00:03:55 baal kernel: [ 6999.963334] [] ? btrfs_finish_ordered_io+0x475/0x580 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963335] [] tick_sched_handle.isra.14+0x33/0x70 Aug 22 00:03:55 baal kernel: [ 6999.963343] [] ? end_compressed_bio_write+0x31/0xf0 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963345] [] tick_sched_timer+0x4c/0x80 Aug 22 00:03:55 baal kernel: [ 6999.963351] [] ? finish_ordered_fn+0x15/0x20 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963353] [] __run_hrtimer+0x76/0x230 Aug 22 00:03:55 baal kernel: [ 6999.963360] [] ? normal_work_helper+0x79/0x1b0 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963361] [] ? tick_nohz_handler+0xa0/0xa0 Aug 22 00:03:55 baal kernel: [ 6999.963363] [] ? process_one_work+0x17f/0x490 Aug 22 00:03:55 baal kernel: [ 6999.963364] [] hrtimer_interrupt+0xff/0x260 Aug 22 00:03:55 baal kernel: [ 6999.963366] [] ? worker_thread+0x11b/0x3f0 Aug 22 00:03:55 baal kernel: [ 6999.963368] [] local_apic_timer_interrupt+0x3b/0x60 Aug 22 00:03:55 baal kernel: [ 6999.963369] [] ? create_worker+0x1e0/0x1e0 Aug 22 00:03:55 baal kernel: [ 6999.963371] [] smp_apic_timer_interrupt+0x45/0x60 Aug 22 00:03:55 baal kernel: [ 6999.963372] [] ? kthread+0xc9/0xe0 Aug 22 00:03:55 baal kernel: [ 6999.963374] [] apic_timer_interrupt+0x6d/0x80 Aug 22 00:03:55 baal kernel: [ 6999.963375] [] ? flush_kthread_worker+0x90/0x90 Aug 22 00:03:55 baal kernel: [ 6999.963375] Aug 22 00:03:55 baal kernel: [ 6999.963377] [] ? ret_from_fork+0x7c/0xb0 Aug 22 00:03:55 baal kernel: [ 6999.963378] [] ? queue_write_lock_slowpath+0x74/0xd0 Aug 22 00:03:55 baal kernel: [ 6999.963380] [] ? flush_kthread_worker+0x90/0x90 Aug 22 00:03:55 baal kernel: [ 6999.963381] [] _raw_write_lock+0x25/0x30 Aug 22 00:03:55 baal kernel: [ 6999.963382] Task dump for CPU 19: Aug 22 00:03:55 baal kernel: [ 6999.963382] kworker/u65:2 R Aug 22 00:03:55 baal kernel: [ 6999.963391] running task Aug 22 00:03:55 baal kernel: [ 6999.963391] [] btrfs_tree_lock+0xc9/0x1d0 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963392] 0 10071 2 0x00000008 Aug 22 00:03:55 baal kernel: [ 6999.963400] Workqueue: btrfs-endio-write normal_work_helper [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963400] [] ? add_wait_queue+0x60/0x60 Aug 22 00:03:55 baal kernel: [ 6999.963400] Aug 22 00:03:55 baal kernel: [ 6999.963401] ffff881567b7fa18 Aug 22 00:03:55 baal kernel: [ 6999.963407] ffffffffc04d48db Aug 22 00:03:55 baal kernel: [ 6999.963407] [] btrfs_lock_root_node+0x3b/0x50 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963408] ffff88176b107ea0 0000000000000000 Aug 22 00:03:55 baal kernel: [ 6999.963408] Aug 22 00:03:55 baal kernel: [ 6999.963414] [] btrfs_search_slot+0x787/0x880 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963415] ffff881567b7fab8 ffffffffc04d9a97 0000000000000020 Aug 22 00:03:55 baal kernel: [ 6999.963423] 00000000000000a6 Aug 22 00:03:55 baal kernel: [ 6999.963423] [] btrfs_lookup_file_extent+0x38/0x40 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963423] Aug 22 00:03:55 baal kernel: [ 6999.963424] ffff881567b7faa8 Aug 22 00:03:55 baal kernel: [ 6999.963433] 00000000c04d15d0 Aug 22 00:03:55 baal kernel: [ 6999.963433] [] __btrfs_drop_extents+0x151/0xdf0 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963434] 0000000200000002 00000001014f569e Aug 22 00:03:55 baal kernel: [ 6999.963434] Aug 22 00:03:55 baal kernel: [ 6999.963440] [] ? btrfs_search_slot+0x747/0x880 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963440] Call Trace: Aug 22 00:03:55 baal kernel: [ 6999.963442] [] ? kmem_cache_alloc+0x1b3/0x1f0 Aug 22 00:03:55 baal kernel: [ 6999.963447] [] ? btrfs_read_lock_root_node+0x3b/0x50 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963453] [] ? btrfs_alloc_path+0x1a/0x20 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963458] [] btrfs_search_slot+0x447/0x880 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963464] [] ? btrfs_alloc_path+0x1a/0x20 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963471] [] btrfs_lookup_file_extent+0x38/0x40 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963479] [] insert_reserved_file_extent.constprop.63+0xab/0x310 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963486] [] __btrfs_drop_extents+0x151/0xdf0 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963493] [] ? start_transaction.part.35+0x80/0x530 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963498] [] ? btrfs_search_slot+0x747/0x880 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963506] [] btrfs_finish_ordered_io+0x475/0x580 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963507] [] ? kmem_cache_alloc+0x1b3/0x1f0 Aug 22 00:03:55 baal kernel: [ 6999.963516] [] ? end_compressed_bio_write+0x31/0xf0 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963522] [] ? btrfs_alloc_path+0x1a/0x20 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963529] [] finish_ordered_fn+0x15/0x20 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963534] [] ? btrfs_alloc_path+0x1a/0x20 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963542] [] normal_work_helper+0x79/0x1b0 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963549] [] insert_reserved_file_extent.constprop.63+0xab/0x310 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963551] [] process_one_work+0x17f/0x490 Aug 22 00:03:55 baal kernel: [ 6999.963557] [] ? start_transaction.part.35+0x80/0x530 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963559] [] worker_thread+0x11b/0x3f0 Aug 22 00:03:55 baal kernel: [ 6999.963566] [] btrfs_finish_ordered_io+0x475/0x580 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963567] [] ? create_worker+0x1e0/0x1e0 Aug 22 00:03:55 baal kernel: [ 6999.963575] [] ? end_compressed_bio_write+0x31/0xf0 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963576] [] kthread+0xc9/0xe0 Aug 22 00:03:55 baal kernel: [ 6999.963583] [] finish_ordered_fn+0x15/0x20 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963584] [] ? flush_kthread_worker+0x90/0x90 Aug 22 00:03:55 baal kernel: [ 6999.963592] [] normal_work_helper+0x79/0x1b0 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963593] [] ret_from_fork+0x7c/0xb0 Aug 22 00:03:55 baal kernel: [ 6999.963595] [] process_one_work+0x17f/0x490 Aug 22 00:03:55 baal kernel: [ 6999.963596] [] ? flush_kthread_worker+0x90/0x90 Aug 22 00:03:55 baal kernel: [ 6999.963597] [] worker_thread+0x11b/0x3f0 Aug 22 00:03:55 baal kernel: [ 6999.963598] Task dump for CPU 0: Aug 22 00:03:55 baal kernel: [ 6999.963600] kworker/u65:17 R Aug 22 00:03:55 baal kernel: [ 6999.963600] [] ? create_worker+0x1e0/0x1e0 Aug 22 00:03:55 baal kernel: [ 6999.963601] running task Aug 22 00:03:55 baal kernel: [ 6999.963602] 0 8308 2 0x00000008 Aug 22 00:03:55 baal kernel: [ 6999.963603] [] kthread+0xc9/0xe0 Aug 22 00:03:55 baal kernel: [ 6999.963612] Workqueue: btrfs-endio-write normal_work_helper [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963613] Aug 22 00:03:55 baal kernel: [ 6999.963614] [] ? flush_kthread_worker+0x90/0x90 Aug 22 00:03:55 baal kernel: [ 6999.963614] 000000000000362c Aug 22 00:03:55 baal kernel: [ 6999.963616] 0000000000005358 Aug 22 00:03:55 baal kernel: [ 6999.963616] [] ret_from_fork+0x7c/0xb0 Aug 22 00:03:55 baal kernel: [ 6999.963617] ffff881be586ed88 Aug 22 00:03:55 baal kernel: [ 6999.963619] 0000000000005358 Aug 22 00:03:55 baal kernel: [ 6999.963619] [] ? flush_kthread_worker+0x90/0x90 Aug 22 00:03:55 baal kernel: [ 6999.963619] Aug 22 00:03:55 baal kernel: [ 6999.963619] Task dump for CPU 20: Aug 22 00:03:55 baal kernel: [ 6999.963620] ffff881be586ed8c Aug 22 00:03:55 baal kernel: [ 6999.963621] kworker/u65:11 R Aug 22 00:03:55 baal kernel: [ 6999.963621] ffffffffffffff10 Aug 22 00:03:55 baal kernel: [ 6999.963622] running task Aug 22 00:03:55 baal kernel: [ 6999.963622] ffffffff810bc0c4 Aug 22 00:03:55 baal kernel: [ 6999.963623] 0 8296 2 0x00000008 Aug 22 00:03:55 baal kernel: [ 6999.963630] 0000000000000010 Aug 22 00:03:55 baal kernel: [ 6999.963630] Workqueue: btrfs-endio-write normal_work_helper [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963630] Aug 22 00:03:55 baal kernel: [ 6999.963630] Aug 22 00:03:55 baal kernel: [ 6999.963631] 0000000000000202 Aug 22 00:03:55 baal kernel: [ 6999.963632] ffff881fd005f908 Aug 22 00:03:55 baal kernel: [ 6999.963632] ffff88169fcfb958 Aug 22 00:03:55 baal kernel: [ 6999.963633] ffffffff8179d67e Aug 22 00:03:55 baal kernel: [ 6999.963633] 0000000000000018 Aug 22 00:03:55 baal kernel: [ 6999.963634] 0000000000000004 Aug 22 00:03:55 baal kernel: [ 6999.963634] ffff8826b8783000 Aug 22 00:03:55 baal kernel: [ 6999.963635] ffff881fcc478f30 Aug 22 00:03:55 baal kernel: [ 6999.963635] Aug 22 00:03:55 baal kernel: [ 6999.963635] Aug 22 00:03:55 baal kernel: [ 6999.963635] Call Trace: Aug 22 00:03:55 baal kernel: [ 6999.963636] ffff881fd005ffd8 Aug 22 00:03:55 baal kernel: [ 6999.963638] 00000000000145c0 Aug 22 00:03:55 baal kernel: [ 6999.963638] [] ? queue_read_lock_slowpath+0xb4/0xd0 Aug 22 00:03:55 baal kernel: [ 6999.963639] ffff883fcb390380 Aug 22 00:03:55 baal kernel: [ 6999.963641] 00000000000145c0 Aug 22 00:03:55 baal kernel: [ 6999.963641] [] ? _raw_read_lock+0x1d/0x30 Aug 22 00:03:55 baal kernel: [ 6999.963641] Aug 22 00:03:55 baal kernel: [ 6999.963642] ffff881fd005f958 Aug 22 00:03:55 baal kernel: [ 6999.963652] 0000000000000000 Aug 22 00:03:55 baal kernel: [ 6999.963652] [] ? btrfs_clear_lock_blocking_rw+0x54/0x100 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963653] 0000000000000003 ffff88380cf01d48 Aug 22 00:03:55 baal kernel: [ 6999.963654] Aug 22 00:03:55 baal kernel: [ 6999.963662] [] ? btrfs_clear_path_blocking+0x3a/0x80 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963662] Call Trace: Aug 22 00:03:55 baal kernel: [ 6999.963664] [] ? __schedule+0x38e/0x770 Aug 22 00:03:55 baal kernel: [ 6999.963672] [] ? btrfs_search_slot+0x572/0x880 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963673] [] ? queue_read_lock_slowpath+0xb4/0xd0 Aug 22 00:03:55 baal kernel: [ 6999.963684] [] ? release_extent_buffer+0x36/0xe0 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963685] [] ? _raw_read_lock+0x1d/0x30 Aug 22 00:03:55 baal kernel: [ 6999.963694] [] ? btrfs_next_old_leaf+0x21f/0x460 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963701] [] ? btrfs_clear_lock_blocking_rw+0x54/0x100 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963709] [] ? btrfs_next_leaf+0x10/0x20 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963715] [] ? btrfs_clear_path_blocking+0x3a/0x80 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963725] [] ? __btrfs_drop_extents+0x1e2/0xdf0 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963731] [] ? btrfs_search_slot+0x572/0x880 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963742] [] ? merge_state.part.31+0xd2/0x140 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963749] [] ? release_extent_buffer+0x36/0xe0 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963759] [] ? insert_reserved_file_extent.constprop.63+0xab/0x310 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963765] [] ? btrfs_next_old_leaf+0x21f/0x460 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963774] [] ? start_transaction.part.35+0x80/0x530 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963780] [] ? btrfs_next_leaf+0x10/0x20 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963787] [] ? btrfs_finish_ordered_io+0x475/0x580 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963794] [] ? __btrfs_drop_extents+0x1e2/0xdf0 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963801] [] ? finish_ordered_fn+0x15/0x20 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963809] [] ? merge_state.part.31+0xd2/0x140 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963817] [] ? normal_work_helper+0x79/0x1b0 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963824] [] ? insert_reserved_file_extent.constprop.63+0xab/0x310 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963826] [] ? process_one_work+0x17f/0x490 Aug 22 00:03:55 baal kernel: [ 6999.963833] [] ? start_transaction.part.35+0x80/0x530 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963834] [] ? worker_thread+0x11b/0x3f0 Aug 22 00:03:55 baal kernel: [ 6999.963840] [] ? btrfs_finish_ordered_io+0x475/0x580 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963842] [] ? create_worker+0x1e0/0x1e0 Aug 22 00:03:55 baal kernel: [ 6999.963848] [] ? finish_ordered_fn+0x15/0x20 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963849] [] ? kthread+0xc9/0xe0 Aug 22 00:03:55 baal kernel: [ 6999.963856] [] ? normal_work_helper+0x79/0x1b0 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963858] [] ? flush_kthread_worker+0x90/0x90 Aug 22 00:03:55 baal kernel: [ 6999.963859] [] ? process_one_work+0x17f/0x490 Aug 22 00:03:55 baal kernel: [ 6999.963861] [] ? ret_from_fork+0x7c/0xb0 Aug 22 00:03:55 baal kernel: [ 6999.963862] [] ? worker_thread+0x11b/0x3f0 Aug 22 00:03:55 baal kernel: [ 6999.963863] [] ? flush_kthread_worker+0x90/0x90 Aug 22 00:03:55 baal kernel: [ 6999.963865] [] ? create_worker+0x1e0/0x1e0 Aug 22 00:03:55 baal kernel: [ 6999.963865] Task dump for CPU 4: Aug 22 00:03:55 baal kernel: [ 6999.963867] kworker/u65:5 R Aug 22 00:03:55 baal kernel: [ 6999.963867] [] ? kthread+0xc9/0xe0 Aug 22 00:03:55 baal kernel: [ 6999.963868] running task Aug 22 00:03:55 baal kernel: [ 6999.963869] 0 8077 2 0x00000008 Aug 22 00:03:55 baal kernel: [ 6999.963870] [] ? flush_kthread_worker+0x90/0x90 Aug 22 00:03:55 baal kernel: [ 6999.963879] Workqueue: btrfs-endio-write normal_work_helper [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963880] Aug 22 00:03:55 baal kernel: [ 6999.963881] [] ? ret_from_fork+0x7c/0xb0 Aug 22 00:03:55 baal kernel: [ 6999.963882] 0000000000000000 Aug 22 00:03:55 baal kernel: [ 6999.963883] 0000000000000000 Aug 22 00:03:55 baal kernel: [ 6999.963883] [] ? flush_kthread_worker+0x90/0x90 Aug 22 00:03:55 baal kernel: [ 6999.963884] 0000000000000000 0000000000005356 Aug 22 00:03:55 baal kernel: [ 6999.963884] Task dump for CPU 16: Aug 22 00:03:55 baal kernel: [ 6999.963885] Aug 22 00:03:55 baal kernel: [ 6999.963885] kworker/u65:8 R Aug 22 00:03:55 baal kernel: [ 6999.963885] 0000000000000101 Aug 22 00:03:55 baal kernel: [ 6999.963886] running task Aug 22 00:03:55 baal kernel: [ 6999.963886] 00000000000000ff Aug 22 00:03:55 baal kernel: [ 6999.963886] 0 8293 2 0x00000008 Aug 22 00:03:55 baal kernel: [ 6999.963894] ffff881be586ed88 Aug 22 00:03:55 baal kernel: [ 6999.963894] Workqueue: btrfs-endio-write normal_work_helper [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963894] 0000000000000101 Aug 22 00:03:55 baal kernel: [ 6999.963894] Aug 22 00:03:55 baal kernel: [ 6999.963895] Aug 22 00:03:55 baal kernel: [ 6999.963895] 0000000000000000 Aug 22 00:03:55 baal kernel: [ 6999.963895] ffff881be586ed8c Aug 22 00:03:55 baal kernel: [ 6999.963896] ffff881be586ed98 Aug 22 00:03:55 baal kernel: [ 6999.963896] ffffffffffffff10 Aug 22 00:03:55 baal kernel: [ 6999.963896] 0000000000000000 Aug 22 00:03:55 baal kernel: [ 6999.963897] ffffffff810bbfb4 Aug 22 00:03:55 baal kernel: [ 6999.963897] 0000000000000000 Aug 22 00:03:55 baal kernel: [ 6999.963897] 0000000000000010 Aug 22 00:03:55 baal kernel: [ 6999.963897] Aug 22 00:03:55 baal kernel: [ 6999.963897] Aug 22 00:03:55 baal kernel: [ 6999.963898] ffff881fd0963958 Aug 22 00:03:55 baal kernel: [ 6999.963898] Call Trace: Aug 22 00:03:55 baal kernel: [ 6999.963899] 0000000000000000 0000000000000000 Aug 22 00:03:55 baal kernel: [ 6999.963900] ffff881be5adde70 Aug 22 00:03:55 baal kernel: [ 6999.963900] [] ? queue_write_lock_slowpath+0x74/0xd0 Aug 22 00:03:55 baal kernel: [ 6999.963901] Aug 22 00:03:55 baal kernel: [ 6999.963902] 0000000000000000 Aug 22 00:03:55 baal kernel: [ 6999.963902] [] ? _raw_write_lock+0x25/0x30 Aug 22 00:03:55 baal kernel: [ 6999.963903] 0000000000005356 0000000000006b80 Aug 22 00:03:55 baal kernel: [ 6999.963911] 000000000000535a Aug 22 00:03:55 baal kernel: [ 6999.963911] [] ? btrfs_tree_lock+0xc9/0x1d0 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963911] Aug 22 00:03:55 baal kernel: [ 6999.963912] Call Trace: Aug 22 00:03:55 baal kernel: [ 6999.963913] [] ? add_wait_queue+0x60/0x60 Aug 22 00:03:55 baal kernel: [ 6999.963915] [] ? queue_read_lock_slowpath+0xac/0xd0 Aug 22 00:03:55 baal kernel: [ 6999.963921] [] ? btrfs_lock_root_node+0x3b/0x50 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963922] [] ? _raw_read_lock+0x1d/0x30 Aug 22 00:03:55 baal kernel: [ 6999.963928] [] ? btrfs_search_slot+0x787/0x880 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963936] [] ? btrfs_clear_lock_blocking_rw+0x54/0x100 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963943] [] ? btrfs_lookup_file_extent+0x38/0x40 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963949] [] ? btrfs_clear_path_blocking+0x3a/0x80 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963957] [] ? __btrfs_drop_extents+0x151/0xdf0 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963963] [] ? btrfs_search_slot+0x572/0x880 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963969] [] ? btrfs_search_slot+0x747/0x880 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963978] [] ? release_extent_buffer+0x36/0xe0 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963979] [] ? kmem_cache_alloc+0x1b3/0x1f0 Aug 22 00:03:55 baal kernel: [ 6999.963985] [] ? btrfs_next_old_leaf+0x21f/0x460 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963991] [] ? btrfs_alloc_path+0x1a/0x20 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.963997] [] ? btrfs_next_leaf+0x10/0x20 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964003] [] ? btrfs_alloc_path+0x1a/0x20 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964011] [] ? __btrfs_drop_extents+0x1e2/0xdf0 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964018] [] ? insert_reserved_file_extent.constprop.63+0xab/0x310 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964027] [] ? merge_state.part.31+0x135/0x140 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964034] [] ? start_transaction.part.35+0x80/0x530 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964042] [] ? insert_reserved_file_extent.constprop.63+0xab/0x310 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964049] [] ? btrfs_finish_ordered_io+0x475/0x580 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964056] [] ? start_transaction.part.35+0x80/0x530 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964065] [] ? end_compressed_bio_write+0x31/0xf0 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964073] [] ? btrfs_finish_ordered_io+0x475/0x580 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964080] [] ? finish_ordered_fn+0x15/0x20 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964088] [] ? end_compressed_bio_write+0x31/0xf0 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964096] [] ? normal_work_helper+0x79/0x1b0 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964103] [] ? finish_ordered_fn+0x15/0x20 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964105] [] ? process_one_work+0x17f/0x490 Aug 22 00:03:55 baal kernel: [ 6999.964113] [] ? normal_work_helper+0x79/0x1b0 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964114] [] ? worker_thread+0x11b/0x3f0 Aug 22 00:03:55 baal kernel: [ 6999.964115] [] ? process_one_work+0x17f/0x490 Aug 22 00:03:55 baal kernel: [ 6999.964117] [] ? create_worker+0x1e0/0x1e0 Aug 22 00:03:55 baal kernel: [ 6999.964118] [] ? worker_thread+0x11b/0x3f0 Aug 22 00:03:55 baal kernel: [ 6999.964119] [] ? kthread+0xc9/0xe0 Aug 22 00:03:55 baal kernel: [ 6999.964121] [] ? create_worker+0x1e0/0x1e0 Aug 22 00:03:55 baal kernel: [ 6999.964122] [] ? flush_kthread_worker+0x90/0x90 Aug 22 00:03:55 baal kernel: [ 6999.964123] [] ? kthread+0xc9/0xe0 Aug 22 00:03:55 baal kernel: [ 6999.964124] [] ? ret_from_fork+0x7c/0xb0 Aug 22 00:03:55 baal kernel: [ 6999.964126] [] ? flush_kthread_worker+0x90/0x90 Aug 22 00:03:55 baal kernel: [ 6999.964127] [] ? flush_kthread_worker+0x90/0x90 Aug 22 00:03:55 baal kernel: [ 6999.964128] [] ? ret_from_fork+0x7c/0xb0 Aug 22 00:03:55 baal kernel: [ 6999.964129] Task dump for CPU 0: Aug 22 00:03:55 baal kernel: [ 6999.964130] kworker/u65:17 R Aug 22 00:03:55 baal kernel: [ 6999.964131] [] ? flush_kthread_worker+0x90/0x90 Aug 22 00:03:55 baal kernel: [ 6999.964132] running task 0 8308 2 0x00000008 Aug 22 00:03:55 baal kernel: [ 6999.964132] Task dump for CPU 17: Aug 22 00:03:55 baal kernel: [ 6999.964142] Workqueue: btrfs-endio-write normal_work_helper [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964142] kworker/u65:9 R Aug 22 00:03:55 baal kernel: [ 6999.964142] Aug 22 00:03:55 baal kernel: [ 6999.964143] running task Aug 22 00:03:55 baal kernel: [ 6999.964144] 000000000000362c Aug 22 00:03:55 baal kernel: [ 6999.964144] 0 8294 2 0x00000008 Aug 22 00:03:55 baal kernel: [ 6999.964151] 0000000000005358 Aug 22 00:03:55 baal kernel: [ 6999.964152] Workqueue: btrfs-endio-write normal_work_helper [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964152] ffff881be586ed88 Aug 22 00:03:55 baal kernel: [ 6999.964152] Aug 22 00:03:55 baal kernel: [ 6999.964153] 0000000000005358 Aug 22 00:03:55 baal kernel: [ 6999.964153] ffff881fd007fa78 Aug 22 00:03:55 baal kernel: [ 6999.964153] Aug 22 00:03:55 baal kernel: [ 6999.964154] ffffffff8179d67e Aug 22 00:03:55 baal kernel: [ 6999.964154] ffff881be586ed8c Aug 22 00:03:55 baal kernel: [ 6999.964155] ffff881fd007fa98 Aug 22 00:03:55 baal kernel: [ 6999.964155] ffffffffffffff10 Aug 22 00:03:55 baal kernel: [ 6999.964156] 0000000000000085 Aug 22 00:03:55 baal kernel: [ 6999.964156] ffffffff810bc0c4 Aug 22 00:03:55 baal kernel: [ 6999.964156] Aug 22 00:03:55 baal kernel: [ 6999.964157] 0000000000000010 Aug 22 00:03:55 baal kernel: [ 6999.964157] 0000000000000000 Aug 22 00:03:55 baal kernel: [ 6999.964157] Aug 22 00:03:55 baal kernel: [ 6999.964158] ffff881be5adde70 Aug 22 00:03:55 baal kernel: [ 6999.964159] 0000000000000202 Aug 22 00:03:55 baal kernel: [ 6999.964159] 0000000000000000 Aug 22 00:03:55 baal kernel: [ 6999.964159] ffff88169fcfb958 Aug 22 00:03:55 baal kernel: [ 6999.964160] 00000000000004ec Aug 22 00:03:55 baal kernel: [ 6999.964160] 0000000000000018 Aug 22 00:03:55 baal kernel: [ 6999.964160] Aug 22 00:03:55 baal kernel: [ 6999.964161] ffff8826b8783000 Aug 22 00:03:55 baal kernel: [ 6999.964161] 0000000000000201 Aug 22 00:03:55 baal kernel: [ 6999.964161] Aug 22 00:03:55 baal kernel: [ 6999.964162] 00000000000000ff Aug 22 00:03:55 baal kernel: [ 6999.964162] Call Trace: Aug 22 00:03:55 baal kernel: [ 6999.964163] ffff881be5778198 Aug 22 00:03:55 baal kernel: [ 6999.964165] 0000000000000301 Aug 22 00:03:55 baal kernel: [ 6999.964165] [] ? queue_read_lock_slowpath+0xb4/0xd0 Aug 22 00:03:55 baal kernel: [ 6999.964165] Aug 22 00:03:55 baal kernel: [ 6999.964166] Call Trace: Aug 22 00:03:55 baal kernel: [ 6999.964167] [] ? _raw_read_lock+0x1d/0x30 Aug 22 00:03:55 baal kernel: [ 6999.964169] [] ? __schedule+0x38e/0x770 Aug 22 00:03:55 baal kernel: [ 6999.964176] [] ? btrfs_clear_lock_blocking_rw+0x54/0x100 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964178] [] ? queue_write_lock_slowpath+0x72/0xd0 Aug 22 00:03:55 baal kernel: [ 6999.964183] [] ? btrfs_clear_path_blocking+0x3a/0x80 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964185] [] ? _raw_write_lock+0x25/0x30 Aug 22 00:03:55 baal kernel: [ 6999.964189] [] ? btrfs_search_slot+0x572/0x880 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964199] [] ? btrfs_tree_lock+0xc9/0x1d0 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964206] [] ? release_extent_buffer+0x36/0xe0 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964215] [] ? btrfs_search_slot+0x531/0x880 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964220] [] ? btrfs_next_old_leaf+0x21f/0x460 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964228] [] ? btrfs_insert_empty_items+0x78/0xd0 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964233] [] ? btrfs_next_leaf+0x10/0x20 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964243] [] ? insert_reserved_file_extent.constprop.63+0x145/0x310 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964250] [] ? __btrfs_drop_extents+0x1e2/0xdf0 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964260] [] ? start_transaction.part.35+0x80/0x530 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964267] [] ? merge_state.part.31+0xd2/0x140 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964276] [] ? btrfs_finish_ordered_io+0x475/0x580 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964283] [] ? insert_reserved_file_extent.constprop.63+0xab/0x310 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964294] [] ? end_compressed_bio_write+0x31/0xf0 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964300] [] ? start_transaction.part.35+0x80/0x530 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964309] [] ? finish_ordered_fn+0x15/0x20 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964315] [] ? btrfs_finish_ordered_io+0x475/0x580 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964323] [] ? normal_work_helper+0x79/0x1b0 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964329] [] ? finish_ordered_fn+0x15/0x20 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964330] [] ? process_one_work+0x17f/0x490 Aug 22 00:03:55 baal kernel: [ 6999.964337] [] ? normal_work_helper+0x79/0x1b0 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964339] [] ? worker_thread+0x11b/0x3f0 Aug 22 00:03:55 baal kernel: [ 6999.964340] [] ? process_one_work+0x17f/0x490 Aug 22 00:03:55 baal kernel: [ 6999.964342] [] ? create_worker+0x1e0/0x1e0 Aug 22 00:03:55 baal kernel: [ 6999.964343] [] ? worker_thread+0x11b/0x3f0 Aug 22 00:03:55 baal kernel: [ 6999.964344] [] ? kthread+0xc9/0xe0 Aug 22 00:03:55 baal kernel: [ 6999.964345] [] ? create_worker+0x1e0/0x1e0 Aug 22 00:03:55 baal kernel: [ 6999.964347] [] ? flush_kthread_worker+0x90/0x90 Aug 22 00:03:55 baal kernel: [ 6999.964348] [] ? kthread+0xc9/0xe0 Aug 22 00:03:55 baal kernel: [ 6999.964350] [] ? ret_from_fork+0x7c/0xb0 Aug 22 00:03:55 baal kernel: [ 6999.964351] [] ? flush_kthread_worker+0x90/0x90 Aug 22 00:03:55 baal kernel: [ 6999.964352] [] ? flush_kthread_worker+0x90/0x90 Aug 22 00:03:55 baal kernel: [ 6999.964353] [] ? ret_from_fork+0x7c/0xb0 Aug 22 00:03:55 baal kernel: [ 6999.964354] Task dump for CPU 19: Aug 22 00:03:55 baal kernel: [ 6999.964355] kworker/u65:2 R Aug 22 00:03:55 baal kernel: [ 6999.964355] [] ? flush_kthread_worker+0x90/0x90 Aug 22 00:03:55 baal kernel: [ 6999.964357] running task 0 10071 2 0x00000008 Aug 22 00:03:55 baal kernel: [ 6999.964357] Task dump for CPU 4: Aug 22 00:03:55 baal kernel: [ 6999.964364] Workqueue: btrfs-endio-write normal_work_helper [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964365] kworker/u65:5 R Aug 22 00:03:55 baal kernel: [ 6999.964365] Aug 22 00:03:55 baal kernel: [ 6999.964366] running task Aug 22 00:03:55 baal kernel: [ 6999.964366] ffff881567b7fa18 Aug 22 00:03:55 baal kernel: [ 6999.964366] 0 8077 2 0x00000008 Aug 22 00:03:55 baal kernel: [ 6999.964373] ffffffffc04d48db Aug 22 00:03:55 baal kernel: [ 6999.964373] Workqueue: btrfs-endio-write normal_work_helper [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964374] ffff88176b107ea0 Aug 22 00:03:55 baal kernel: [ 6999.964374] Aug 22 00:03:55 baal kernel: [ 6999.964374] 0000000000000000 Aug 22 00:03:55 baal kernel: [ 6999.964375] 0000000000000000 Aug 22 00:03:55 baal kernel: [ 6999.964375] Aug 22 00:03:55 baal kernel: [ 6999.964376] 0000000000000000 Aug 22 00:03:55 baal kernel: [ 6999.964376] ffff881567b7fab8 Aug 22 00:03:55 baal kernel: [ 6999.964376] 0000000000000000 Aug 22 00:03:55 baal kernel: [ 6999.964377] ffffffffc04d9a97 Aug 22 00:03:55 baal kernel: [ 6999.964377] 0000000000005356 Aug 22 00:03:55 baal kernel: [ 6999.964378] 0000000000000020 Aug 22 00:03:55 baal kernel: [ 6999.964378] Aug 22 00:03:55 baal kernel: [ 6999.964378] 00000000000000a6 Aug 22 00:03:55 baal kernel: [ 6999.964379] 0000000000000101 Aug 22 00:03:55 baal kernel: [ 6999.964379] Aug 22 00:03:55 baal kernel: [ 6999.964380] 00000000000000ff Aug 22 00:03:55 baal kernel: [ 6999.964380] ffff881567b7faa8 Aug 22 00:03:55 baal kernel: [ 6999.964381] ffff881be586ed88 Aug 22 00:03:55 baal kernel: [ 6999.964381] 00000000c04d15d0 Aug 22 00:03:55 baal kernel: [ 6999.964382] 0000000000000101 Aug 22 00:03:55 baal kernel: [ 6999.964382] 0000000200000002 Aug 22 00:03:55 baal kernel: [ 6999.964382] Aug 22 00:03:55 baal kernel: [ 6999.964383] 00000001014f569e Aug 22 00:03:55 baal kernel: [ 6999.964383] ffff881be586ed8c Aug 22 00:03:55 baal kernel: [ 6999.964383] Aug 22 00:03:55 baal kernel: [ 6999.964384] ffffffffffffff10 Aug 22 00:03:55 baal kernel: [ 6999.964384] Call Trace: Aug 22 00:03:55 baal kernel: [ 6999.964385] ffffffff810bbfb4 0000000000000010 Aug 22 00:03:55 baal kernel: [ 6999.964385] Call Trace: Aug 22 00:03:55 baal kernel: [ 6999.964393] [] ? btrfs_read_lock_root_node+0x3b/0x50 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964394] [] ? queue_write_lock_slowpath+0x74/0xd0 Aug 22 00:03:55 baal kernel: [ 6999.964403] [] btrfs_search_slot+0x447/0x880 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964404] [] ? _raw_write_lock+0x25/0x30 Aug 22 00:03:55 baal kernel: [ 6999.964414] [] btrfs_lookup_file_extent+0x38/0x40 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964420] [] ? btrfs_tree_lock+0xc9/0x1d0 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964431] [] __btrfs_drop_extents+0x151/0xdf0 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964432] [] ? add_wait_queue+0x60/0x60 Aug 22 00:03:55 baal kernel: [ 6999.964440] [] ? btrfs_search_slot+0x747/0x880 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964445] [] ? btrfs_lock_root_node+0x3b/0x50 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964447] [] ? kmem_cache_alloc+0x1b3/0x1f0 Aug 22 00:03:55 baal kernel: [ 6999.964451] [] ? btrfs_search_slot+0x787/0x880 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964459] [] ? btrfs_alloc_path+0x1a/0x20 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964465] [] ? btrfs_lookup_file_extent+0x38/0x40 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964473] [] ? btrfs_alloc_path+0x1a/0x20 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964480] [] ? __btrfs_drop_extents+0x151/0xdf0 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964489] [] insert_reserved_file_extent.constprop.63+0xab/0x310 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964494] [] ? btrfs_search_slot+0x747/0x880 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964503] [] ? start_transaction.part.35+0x80/0x530 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964504] [] ? kmem_cache_alloc+0x1b3/0x1f0 Aug 22 00:03:55 baal kernel: [ 6999.964511] [] btrfs_finish_ordered_io+0x475/0x580 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964516] [] ? btrfs_alloc_path+0x1a/0x20 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964525] [] ? end_compressed_bio_write+0x31/0xf0 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964529] [] ? btrfs_alloc_path+0x1a/0x20 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964536] [] finish_ordered_fn+0x15/0x20 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964542] [] ? insert_reserved_file_extent.constprop.63+0xab/0x310 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964550] [] normal_work_helper+0x79/0x1b0 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964556] [] ? start_transaction.part.35+0x80/0x530 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964558] [] process_one_work+0x17f/0x490 Aug 22 00:03:55 baal kernel: [ 6999.964563] [] ? btrfs_finish_ordered_io+0x475/0x580 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964565] [] worker_thread+0x11b/0x3f0 Aug 22 00:03:55 baal kernel: [ 6999.964572] [] ? end_compressed_bio_write+0x31/0xf0 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964574] [] ? create_worker+0x1e0/0x1e0 Aug 22 00:03:55 baal kernel: [ 6999.964580] [] ? finish_ordered_fn+0x15/0x20 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964581] [] kthread+0xc9/0xe0 Aug 22 00:03:55 baal kernel: [ 6999.964587] [] ? normal_work_helper+0x79/0x1b0 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964589] [] ? flush_kthread_worker+0x90/0x90 Aug 22 00:03:55 baal kernel: [ 6999.964590] [] ? process_one_work+0x17f/0x490 Aug 22 00:03:55 baal kernel: [ 6999.964592] [] ret_from_fork+0x7c/0xb0 Aug 22 00:03:55 baal kernel: [ 6999.964593] [] ? worker_thread+0x11b/0x3f0 Aug 22 00:03:55 baal kernel: [ 6999.964595] [] ? flush_kthread_worker+0x90/0x90 Aug 22 00:03:55 baal kernel: [ 6999.964596] [] ? create_worker+0x1e0/0x1e0 Aug 22 00:03:55 baal kernel: [ 6999.964596] Task dump for CPU 20: Aug 22 00:03:55 baal kernel: [ 6999.964598] kworker/u65:11 R Aug 22 00:03:55 baal kernel: [ 6999.964598] [] ? kthread+0xc9/0xe0 Aug 22 00:03:55 baal kernel: [ 6999.964598] running task Aug 22 00:03:55 baal kernel: [ 6999.964599] 0 8296 2 0x00000008 Aug 22 00:03:55 baal kernel: [ 6999.964600] [] ? flush_kthread_worker+0x90/0x90 Aug 22 00:03:55 baal kernel: [ 6999.964609] Workqueue: btrfs-endio-write normal_work_helper [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964609] Aug 22 00:03:55 baal kernel: [ 6999.964611] [] ? ret_from_fork+0x7c/0xb0 Aug 22 00:03:55 baal kernel: [ 6999.964611] ffff881fd005f908 Aug 22 00:03:55 baal kernel: [ 6999.964612] ffffffff8179d67e Aug 22 00:03:55 baal kernel: [ 6999.964613] [] ? flush_kthread_worker+0x90/0x90 Aug 22 00:03:55 baal kernel: [ 6999.964614] 0000000000000004 ffff881fcc478f30 Aug 22 00:03:55 baal kernel: [ 6999.964615] ffff881fd005ffd8 00000000000145c0 ffff883fcb390380 00000000000145c0 Aug 22 00:03:55 baal kernel: [ 6999.964616] ffff881fd005f958 0000000000000000 0000000000000003 ffff88380cf01d48 Aug 22 00:03:55 baal kernel: [ 6999.964617] Call Trace: Aug 22 00:03:55 baal kernel: [ 6999.964618] [] ? __schedule+0x38e/0x770 Aug 22 00:03:55 baal kernel: [ 6999.964620] [] ? queue_read_lock_slowpath+0xb4/0xd0 Aug 22 00:03:55 baal kernel: [ 6999.964622] [] ? _raw_read_lock+0x1d/0x30 Aug 22 00:03:55 baal kernel: [ 6999.964632] [] ? btrfs_clear_lock_blocking_rw+0x54/0x100 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964640] [] ? btrfs_clear_path_blocking+0x3a/0x80 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964649] [] ? btrfs_search_slot+0x572/0x880 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964660] [] ? release_extent_buffer+0x36/0xe0 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964669] [] ? btrfs_next_old_leaf+0x21f/0x460 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964677] [] ? btrfs_next_leaf+0x10/0x20 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964688] [] ? __btrfs_drop_extents+0x1e2/0xdf0 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964698] [] ? merge_state.part.31+0xd2/0x140 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964706] [] ? insert_reserved_file_extent.constprop.63+0xab/0x310 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964714] [] ? start_transaction.part.35+0x80/0x530 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964722] [] ? btrfs_finish_ordered_io+0x475/0x580 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964729] [] ? finish_ordered_fn+0x15/0x20 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964738] [] ? normal_work_helper+0x79/0x1b0 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964739] [] ? process_one_work+0x17f/0x490 Aug 22 00:03:55 baal kernel: [ 6999.964741] [] ? worker_thread+0x11b/0x3f0 Aug 22 00:03:55 baal kernel: [ 6999.964742] [] ? create_worker+0x1e0/0x1e0 Aug 22 00:03:55 baal kernel: [ 6999.964744] [] ? kthread+0xc9/0xe0 Aug 22 00:03:55 baal kernel: [ 6999.964745] [] ? flush_kthread_worker+0x90/0x90 Aug 22 00:03:55 baal kernel: [ 6999.964747] [] ? ret_from_fork+0x7c/0xb0 Aug 22 00:03:55 baal kernel: [ 6999.964748] [] ? flush_kthread_worker+0x90/0x90 Aug 22 00:03:55 baal kernel: [ 6999.964749] Task dump for CPU 16: Aug 22 00:03:55 baal kernel: [ 6999.964750] kworker/u65:8 R running task 0 8293 2 0x00000008 Aug 22 00:03:55 baal kernel: [ 6999.964758] Workqueue: btrfs-endio-write normal_work_helper [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964759] 0000000000000000 ffff881be586ed98 0000000000000000 0000000000000000 Aug 22 00:03:55 baal kernel: [ 6999.964760] ffff881fd0963958 0000000000000000 0000000000000000 ffff881be5adde70 Aug 22 00:03:55 baal kernel: [ 6999.964761] 0000000000000000 0000000000005356 0000000000006b80 000000000000535a Aug 22 00:03:55 baal kernel: [ 6999.964762] Call Trace: Aug 22 00:03:55 baal kernel: [ 6999.964763] [] ? queue_read_lock_slowpath+0xac/0xd0 Aug 22 00:03:55 baal kernel: [ 6999.964765] [] ? _raw_read_lock+0x1d/0x30 Aug 22 00:03:55 baal kernel: [ 6999.964773] [] ? btrfs_clear_lock_blocking_rw+0x54/0x100 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964779] [] ? btrfs_clear_path_blocking+0x3a/0x80 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964786] [] ? btrfs_search_slot+0x572/0x880 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964794] [] ? release_extent_buffer+0x36/0xe0 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964801] [] ? btrfs_next_old_leaf+0x21f/0x460 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964807] [] ? btrfs_next_leaf+0x10/0x20 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964816] [] ? __btrfs_drop_extents+0x1e2/0xdf0 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964824] [] ? merge_state.part.31+0x135/0x140 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964833] [] ? insert_reserved_file_extent.constprop.63+0xab/0x310 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964840] [] ? start_transaction.part.35+0x80/0x530 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964848] [] ? btrfs_finish_ordered_io+0x475/0x580 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964857] [] ? end_compressed_bio_write+0x31/0xf0 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964865] [] ? finish_ordered_fn+0x15/0x20 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964873] [] ? normal_work_helper+0x79/0x1b0 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964875] [] ? process_one_work+0x17f/0x490 Aug 22 00:03:55 baal kernel: [ 6999.964876] [] ? worker_thread+0x11b/0x3f0 Aug 22 00:03:55 baal kernel: [ 6999.964878] [] ? create_worker+0x1e0/0x1e0 Aug 22 00:03:55 baal kernel: [ 6999.964879] [] ? kthread+0xc9/0xe0 Aug 22 00:03:55 baal kernel: [ 6999.964880] [] ? flush_kthread_worker+0x90/0x90 Aug 22 00:03:55 baal kernel: [ 6999.964882] [] ? ret_from_fork+0x7c/0xb0 Aug 22 00:03:55 baal kernel: [ 6999.964883] [] ? flush_kthread_worker+0x90/0x90 Aug 22 00:03:55 baal kernel: [ 6999.964884] Task dump for CPU 17: Aug 22 00:03:55 baal kernel: [ 6999.964885] kworker/u65:9 R running task 0 8294 2 0x00000008 Aug 22 00:03:55 baal kernel: [ 6999.964893] Workqueue: btrfs-endio-write normal_work_helper [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964894] ffff881fd007fa78 ffffffff8179d67e ffff881fd007fa98 0000000000000085 Aug 22 00:03:55 baal kernel: [ 6999.964895] 0000000000000000 ffff881be5adde70 0000000000000000 00000000000004ec Aug 22 00:03:55 baal kernel: [ 6999.964896] 0000000000000201 00000000000000ff ffff881be5778198 0000000000000301 Aug 22 00:03:55 baal kernel: [ 6999.964897] Call Trace: Aug 22 00:03:55 baal kernel: [ 6999.964898] [] ? __schedule+0x38e/0x770 Aug 22 00:03:55 baal kernel: [ 6999.964900] [] ? queue_write_lock_slowpath+0x72/0xd0 Aug 22 00:03:55 baal kernel: [ 6999.964901] [] ? _raw_write_lock+0x25/0x30 Aug 22 00:03:55 baal kernel: [ 6999.964910] [] ? btrfs_tree_lock+0xc9/0x1d0 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964916] [] ? btrfs_search_slot+0x531/0x880 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964923] [] ? btrfs_insert_empty_items+0x78/0xd0 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964930] [] ? insert_reserved_file_extent.constprop.63+0x145/0x310 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964938] [] ? start_transaction.part.35+0x80/0x530 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964945] [] ? btrfs_finish_ordered_io+0x475/0x580 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964955] [] ? end_compressed_bio_write+0x31/0xf0 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964962] [] ? finish_ordered_fn+0x15/0x20 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964970] [] ? normal_work_helper+0x79/0x1b0 [btrfs] Aug 22 00:03:55 baal kernel: [ 6999.964972] [] ? process_one_work+0x17f/0x490 Aug 22 00:03:55 baal kernel: [ 6999.964973] [] ? worker_thread+0x11b/0x3f0 Aug 22 00:03:55 baal kernel: [ 6999.964975] [] ? create_worker+0x1e0/0x1e0 Aug 22 00:03:55 baal kernel: [ 6999.964976] [] ? kthread+0xc9/0xe0 Aug 22 00:03:55 baal kernel: [ 6999.964977] [] ? flush_kthread_worker+0x90/0x90 Aug 22 00:03:55 baal kernel: [ 6999.964979] [] ? ret_from_fork+0x7c/0xb0 Aug 22 00:03:55 baal kernel: [ 6999.964980] [] ? flush_kthread_worker+0x90/0x90 Aug 22 00:03:55 baal kernel: [ 6999.964981] Task dump for CPU 19: ...