当前位置：首页 > news >正文

3par persona设置错误，linux I/O持续报错

news 2025/5/24 8:42:15

概要

OS：Redhat7.8

存储：3par8440

1.dmesg查看

报错间隔不定。信息如下

[Wed May 21 05:58:28 2025] blk_update_request: critical target error, dev sdat, sector 0
[Wed May 21 05:58:28 2025] Buffer I/O error on dev sdat, logical block 0, async page read
[Wed May 21 09:57:54 2025] scsi_io_completion: 2 callbacks suppressed
[Wed May 21 09:57:54 2025] sd 4:0:6:256: [sde] tag#0 FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE cmd_age=0s
[Wed May 21 09:57:54 2025] sd 4:0:6:256: [sde] tag#0 Sense Key : Illegal Request [current]
[Wed May 21 09:57:54 2025] sd 4:0:6:256: [sde] tag#0 Add. Sense: Invalid command operation code
[Wed May 21 09:57:54 2025] sd 4:0:6:256: [sde] tag#0 CDB: Read(6) 08 00 00 00 01 00
[Wed May 21 09:57:54 2025] blk_update_request: 2 callbacks suppressed
[Wed May 21 09:57:54 2025] blk_update_request: critical target error, dev sde, sector 0
[Wed May 21 09:57:54 2025] buffer_io_error: 2 callbacks suppressed
[Wed May 21 09:57:54 2025] Buffer I/O error on dev sde, logical block 0, async page read
[Wed May 21 09:57:54 2025] sd 4:0:6:256: [sde] tag#0 FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE cmd_age=0s
[Wed May 21 09:57:54 2025] sd 4:0:6:256: [sde] tag#0 Sense Key : Illegal Request [current]
[Wed May 21 09:57:54 2025] sd 4:0:6:256: [sde] tag#0 Add. Sense: Invalid command operation code
[Wed May 21 09:57:54 2025] sd 4:0:6:256: [sde] tag#0 CDB: Read(6) 08 00 00 00 01 00
[Wed May 21 09:57:54 2025] blk_update_request: critical target error, dev sde, sector 0
[Wed May 21 09:57:54 2025] Buffer I/O error on dev sde, logical block 0, async page read
[Wed May 21 09:57:54 2025] sd 4:0:6:256: [sde] tag#0 FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE cmd_age=0s
[Wed May 21 09:57:54 2025] sd 4:0:6:256: [sde] tag#0 Sense Key : Illegal Request [current]
[Wed May 21 09:57:54 2025] sd 4:0:6:256: [sde] tag#0 Add. Sense: Invalid command operation code
[Wed May 21 09:57:54 2025] sd 4:0:6:256: [sde] tag#0 CDB: Read(6) 08 00 00 00 01 00
[Wed May 21 09:57:54 2025] blk_update_request: critical target error, dev sde, sector 0
[Wed May 21 09:57:54 2025] Buffer I/O error on dev sde, logical block 0, async page read
[Wed May 21 09:57:54 2025] sd 4:0:8:256: [sdae] tag#1 FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE cmd_age=0s
[Wed May 21 09:57:54 2025] sd 4:0:8:256: [sdae] tag#1 Sense Key : Illegal Request [current]
[Wed May 21 09:57:54 2025] sd 4:0:8:256: [sdae] tag#1 Add. Sense: Invalid command operation code
[Wed May 21 09:57:54 2025] sd 4:0:8:256: [sdae] tag#1 CDB: Read(6) 08 00 00 00 01 00
[Wed May 21 09:57:54 2025] blk_update_request: critical target error, dev sdae, sector 0
[Wed May 21 09:57:54 2025] Buffer I/O error on dev sdae, logical block 0, async page read
[Wed May 21 09:57:54 2025] sd 4:0:8:256: [sdae] tag#1 FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE cmd_age=0s
[Wed May 21 09:57:54 2025] sd 4:0:8:256: [sdae] tag#1 Sense Key : Illegal Request [current]
[Wed May 21 09:57:54 2025] sd 4:0:8:256: [sdae] tag#1 Add. Sense: Invalid command operation code
[Wed May 21 09:57:54 2025] sd 4:0:8:256: [sdae] tag#1 CDB: Read(6) 08 00 00 00 01 00
[Wed May 21 09:57:54 2025] blk_update_request: critical target error, dev sdae, sector 0
[Wed May 21 09:57:54 2025] Buffer I/O error on dev sdae, logical block 0, async page read
[Wed May 21 09:57:54 2025] sd 4:0:8:256: [sdae] tag#0 FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE cmd_age=0s
[Wed May 21 09:57:54 2025] sd 4:0:8:256: [sdae] tag#0 Sense Key : Illegal Request [current]
[Wed May 21 09:57:54 2025] sd 4:0:8:256: [sdae] tag#0 Add. Sense: Invalid command operation code
[Wed May 21 09:57:54 2025] sd 4:0:8:256: [sdae] tag#0 CDB: Read(6) 08 00 00 00 01 00
[Wed May 21 09:57:54 2025] blk_update_request: critical target error, dev sdae, sector 0
[Wed May 21 09:57:54 2025] Buffer I/O error on dev sdae, logical block 0, async page read
[Wed May 21 09:57:54 2025] sd 1:0:7:256: [sdar] tag#1 FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE cmd_age=0s
[Wed May 21 09:57:54 2025] sd 1:0:7:256: [sdar] tag#1 Sense Key : Illegal Request [current]
[Wed May 21 09:57:54 2025] sd 1:0:7:256: [sdar] tag#1 Add. Sense: Invalid command operation code
[Wed May 21 09:57:54 2025] sd 1:0:7:256: [sdar] tag#1 CDB: Read(6) 08 00 00 00 01 00
[Wed May 21 09:57:54 2025] blk_update_request: critical target error, dev sdar, sector 0
[Wed May 21 09:57:54 2025] Buffer I/O error on dev sdar, logical block 0, async page read
[Wed May 21 09:57:54 2025] sd 1:0:7:256: [sdar] tag#1 FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE cmd_age=0s
[Wed May 21 09:57:54 2025] sd 1:0:7:256: [sdar] tag#1 Sense Key : Illegal Request [current]
[Wed May 21 09:57:54 2025] sd 1:0:7:256: [sdar] tag#1 Add. Sense: Invalid command operation code
[Wed May 21 09:57:54 2025] sd 1:0:7:256: [sdar] tag#1 CDB: Read(6) 08 00 00 00 01 00
[Wed May 21 09:57:54 2025] blk_update_request: critical target error, dev sdar, sector 0
[Wed May 21 09:57:54 2025] Buffer I/O error on dev sdar, logical block 0, async page read
[Wed May 21 09:57:54 2025] sd 1:0:7:256: [sdar] tag#1 FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE cmd_age=0s
[Wed May 21 09:57:54 2025] sd 1:0:7:256: [sdar] tag#1 Sense Key : Illegal Request [current]
[Wed May 21 09:57:54 2025] sd 1:0:7:256: [sdar] tag#1 Add. Sense: Invalid command operation code
[Wed May 21 09:57:54 2025] sd 1:0:7:256: [sdar] tag#1 CDB: Read(6) 08 00 00 00 01 00
[Wed May 21 09:57:54 2025] blk_update_request: critical target error, dev sdar, sector 0
[Wed May 21 09:57:54 2025] Buffer I/O error on dev sdar, logical block 0, async page read
[Wed May 21 09:57:54 2025] sd 1:0:8:256: [sdat] tag#0 FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE cmd_age=0s
[Wed May 21 09:57:54 2025] sd 1:0:8:256: [sdat] tag#0 Sense Key : Illegal Request [current]
[Wed May 21 09:57:54 2025] sd 1:0:8:256: [sdat] tag#0 Add. Sense: Invalid command operation code
[Wed May 21 09:57:54 2025] sd 1:0:8:256: [sdat] tag#0 CDB: Read(6) 08 00 00 00 01 00
[Wed May 21 09:57:54 2025] blk_update_request: critical target error, dev sdat, sector 0
[Wed May 21 09:57:54 2025] Buffer I/O error on dev sdat, logical block 0, async page read

2.分析报错内容

2.1 报错对象

四个磁盘符如下：

sde

sdae

sdar

sdat

2.2 lsblk查看

有四块512B大小的磁盘分别是：

sde sdae sdar sdat

和上面IO报错是吻合的磁盘符

[root@redhat log]# lsblk
NAME                MAJ:MIN RM   SIZE RO TYPE  MOUNTPOINT
sdb                   8:16   0 447.1G  0 disk
├─sdb1                8:17   0     1G  0 part  /boot/efi
├─sdb2                8:18   0     1G  0 part  /boot
├─sdb3                8:19   0   232G  0 part
│ ├─rootvg-rootlv   253:0    0    20G  0 lvm   /
│ ├─rootvg-swaplv   253:1    0    32G  0 lvm   [SWAP]
│ ├─rootvg-usrlv    253:2    0    20G  0 lvm   /usr
│ ├─rootvg-gridlv   253:3    0    60G  0 lvm   /grid
│ ├─rootvg-oraclelv 253:4    0    50G  0 lvm   /oracle
│ ├─rootvg-varlv    253:5    0    30G  0 lvm   /var
│ ├─rootvg-tmplv    253:6    0    10G  0 lvm   /tmp
│ ├─rootvg-optlv    253:7    0    10G  0 lvm   /opt
│ └─rootvg-homelv   253:8    0    50G  0 lvm   /home
└─sdb4                8:20   0 213.1G  0 part├─rootvg-rootlv   253:0    0    20G  0 lvm   /├─rootvg-gridlv   253:3    0    60G  0 lvm   /grid├─rootvg-oraclelv 253:4    0    50G  0 lvm   /oracle└─rootvg-varlv    253:5    0    30G  0 lvm   /var
sdc                   8:32   0     2T  0 disk
└─orasas-data1      253:10   0     2T  0 mpath
sdd                   8:48   0     2T  0 disk
└─orassd-data1      253:9    0     2T  0 mpath
sde                   8:64   0   512B  1 disk
sdf                   8:80   0     6G  0 disk
└─ora-ocr1          253:11   0     6G  0 mpath
sdg                   8:96   0     2T  0 disk
└─orasas-data1      253:10   0     2T  0 mpath
sdh                   8:112  0     6G  0 disk
└─ora-ocr2          253:12   0     6G  0 mpath
sdi                   8:128  0     2T  0 disk
└─orassd-data1      253:9    0     2T  0 mpath
sdj                   8:144  0     6G  0 disk
└─ora-ocr3          253:13   0     6G  0 mpath
sdk                   8:160  0     6G  0 disk
└─ora-ocr1          253:11   0     6G  0 mpath
sdl                   8:176  0     6G  0 disk
└─ora-ocr4          253:15   0     6G  0 mpath
sdm                   8:192  0     6G  0 disk
└─ora-ocr2          253:12   0     6G  0 mpath
sdn                   8:208  0     6G  0 disk
└─ora-ocr5          253:14   0     6G  0 mpath
sdo                   8:224  0     6G  0 disk
└─ora-ocr3          253:13   0     6G  0 mpath
sdp                   8:240  0    30G  0 disk
└─ora-mgmt1         253:16   0    30G  0 mpath
sdq                  65:0    0    30G  0 disk
└─ora-mgmt2         253:17   0    30G  0 mpath
sdr                  65:16   0     6G  0 disk
└─ora-ocr4          253:15   0     6G  0 mpath
sds                  65:32   0    30G  0 disk
└─ora-mgmt3         253:18   0    30G  0 mpath
sdt                  65:48   0     6G  0 disk
└─ora-ocr5          253:14   0     6G  0 mpath
sdu                  65:64   0    30G  0 disk
└─ora-mgmt4         253:20   0    30G  0 mpath
sdv                  65:80   0    30G  0 disk
└─ora-mgmt1         253:16   0    30G  0 mpath
sdw                  65:96   0    30G  0 disk
└─ora-mgmt5         253:19   0    30G  0 mpath
sdx                  65:112  0    30G  0 disk
└─ora-mgmt2         253:17   0    30G  0 mpath
sdy                  65:128  0    30G  0 disk
└─ora-mgmt3         253:18   0    30G  0 mpath
sdz                  65:144  0    30G  0 disk
└─ora-mgmt4         253:20   0    30G  0 mpath
sdaa                 65:160  0     2T  0 disk
└─orasas-data1      253:10   0     2T  0 mpath
sdab                 65:176  0    30G  0 disk
└─ora-mgmt5         253:19   0    30G  0 mpath
sdac                 65:192  0     2T  0 disk
└─orassd-data1      253:9    0     2T  0 mpath
sdad                 65:208  0     6G  0 disk
└─ora-ocr1          253:11   0     6G  0 mpath
sdae                 65:224  0   512B  1 disk
sdaf                 65:240  0     6G  0 disk
└─ora-ocr2          253:12   0     6G  0 mpath
sdag                 66:0    0     6G  0 disk
└─ora-ocr3          253:13   0     6G  0 mpath
sdah                 66:16   0     6G  0 disk
└─ora-ocr4          253:15   0     6G  0 mpath
sdai                 66:32   0     6G  0 disk
└─ora-ocr5          253:14   0     6G  0 mpath
sdaj                 66:48   0    30G  0 disk
└─ora-mgmt1         253:16   0    30G  0 mpath
sdak                 66:64   0    30G  0 disk
└─ora-mgmt2         253:17   0    30G  0 mpath
sdal                 66:80   0    30G  0 disk
└─ora-mgmt3         253:18   0    30G  0 mpath
sdba                 67:64   0    30G  0 disk
└─ora-mgmt4         253:20   0    30G  0 mpath
sdam                 66:96   0    30G  0 disk
└─ora-mgmt4         253:20   0    30G  0 mpath
sdbb                 67:80   0    30G  0 disk
└─ora-mgmt5         253:19   0    30G  0 mpath
sdan                 66:112  0     2T  0 disk
└─orasas-data1      253:10   0     2T  0 mpath
sdao                 66:128  0    30G  0 disk
└─ora-mgmt5         253:19   0    30G  0 mpath
sdap                 66:144  0     2T  0 disk
└─orassd-data1      253:9    0     2T  0 mpath
sdaq                 66:160  0     6G  0 disk
└─ora-ocr1          253:11   0     6G  0 mpath
sdar                 66:176  0   512B  1 disk
sdas                 66:192  0     6G  0 disk
└─ora-ocr2          253:12   0     6G  0 mpath
sdat                 66:208  0   512B  1 disk
sdau                 66:224  0     6G  0 disk
└─ora-ocr3          253:13   0     6G  0 mpath
sdav                 66:240  0     6G  0 disk
└─ora-ocr4          253:15   0     6G  0 mpath
sdaw                 67:0    0     6G  0 disk
└─ora-ocr5          253:14   0     6G  0 mpath
sdax                 67:16   0    30G  0 disk
└─ora-mgmt1         253:16   0    30G  0 mpath
sday                 67:32   0    30G  0 disk
└─ora-mgmt2         253:17   0    30G  0 mpath
sdaz                 67:48   0    30G  0 disk
└─ora-mgmt3         253:18   0    30G  0 mpath

2.3 multipath查看

multipath -ll

没有发现上述四个磁盘在用。

2.4 检查盘健康状态

发现该盘是来自于没有在使用的3par，仅仅只是在3par上加了该主机，根本没有映射VV过来。

[root@redhat ~ ]# smartctl -a /dev/sdae
smartctl 7.0 2018-12-30 r4883 [x86_64-linux-3.10.0-1127.el7.x86_64] (local build)
Copyright (C) 2002-18, Bruce Allen, Christian Franke, www.smartmontools.org=== START OF INFORMATION SECTION ===
Vendor:               3PARdata
Product:              VV
Revision:             3315
Compliance:           SPC-4
User Capacity:        512 bytes [512 B]
Logical block size:   512 bytes
LU is fully provisioned [LBPRZ=1]
Logical Unit id:      0x2ff70002ac026bf6
Serial number:        CNXXXQ4N
Device type:          disk
Transport protocol:   Fibre channel (FCP-2)
Local Time is:        Wed May 21 10:27:40 2025 CST
SMART support is:     Available - device has SMART capability.
SMART support is:     Disabled
Temperature Warning:  Disabled or Not Supported=== START OF READ SMART DATA SECTION ===
SMART Health Status: OK
Current Drive Temperature:     0 C
Drive Trip Temperature:        0 CError Counter logging not supportedDevice does not support Self Test logging

2.5 3par查看

发现其主机persona角色设置为VMware而不是redhat对应的Generic-ALUA，所以虽然没有对应大小的磁盘，但是vmware角色默认会产生一些校验类似的盘，这些磁盘符是读不了的，但是redhat内核下会不间断去尝试读一下盘检查状态。所以就产生了dmesg里面的报错信息。

而修改主机的persona需要重启系统，不然只是重新扫描scsi磁盘的话这几个512B的盘仍然存在。

而wwn在线的情况下直接修改不了persona。

如果没有盘在挂载的情况下，可以remove主机+create主机的步骤。

如果有挂载的情况下，则需要关机+修改persona。

gz2pro3par2 cli% showhost redhat
Id Name      Persona      -WWN/iSCSI_Name- Port
30 gz1wmsdb1 VMware       51402EC015535970 0:0:251402EC015535970 1:0:251402EC0155358A8 1:0:151402EC0155358A8 0:0:1