390269071f2dea9d4.png (11.93 KB, 下载次数: 183)
2025-11-2 17:06 上传
架构图如下：
2025169071f201b405.png (106 KB, 下载次数: 183)
2025-11-2 17:06 上传
简易拓扑图如下：
[Client1] [Client2]
│ │
├────── iSCSI over TCP/IP ───────┤
│
[iSCSI Target Server]
├─ /dev/sdb → OCR_VOTE01
├─ /dev/sdc → OCR_VOTE02
├─ /dev/sdd → OCR_VOTE03
├─ /dev/sde → DATA01
└─ /dev/sdf → ARCH01
3.2 服务端安装软件
3.2.1 安装服务器端ISCIS服务
[root@iscsi-server ~]# yum install -y targetcli
Loaded plugins: langpacks, ulninfo
Package targetcli-2.1.51-2.0.1.el7.noarch already installed and latest version
Nothing to do
[root@iscsi-server ~]#
3.2.2 设置target开机自动启动
[root@iscsi-server ~]# systemctl enable target.service
Created symlink from /etc/systemd/system/multi-user.target.wants/target.service to /usr/lib/systemd/system/target.service.
[root@iscsi-server ~]# systemctl restart target
[root@iscsi-server ~]#
3.2.3 关闭防火墙
[root@iscsi-server ~]# systemctl stop firewalld
[root@iscsi-server ~]# systemctl disable firewalld
Removed symlink /etc/systemd/system/multi-user.target.wants/firewalld.service.
Removed symlink /etc/systemd/system/dbus-org.fedoraproject.FirewallD1.service.
[root@iscsi-server ~]#
3.2.4 关闭Selinux
[root@iscsi-server ~]# setenforce 0
[root@iscsi-server ~]# sed -i "/^SELINUX=/s#enforcing#disabled#" /etc/selinux/config
[root@iscsi-server ~]# cat /etc/selinux/config
# This file controls the state of SELinux on the system.
# SELINUX= can take one of these three values:
# enforcing - SELinux security policy is enforced.
# permissive - SELinux prints warnings instead of enforcing.
# disabled - No SELinux policy is loaded.
SELINUX=disabled
# SELINUXTYPE= can take one of three values:
# targeted - Targeted processes are protected,
# minimum - Modification of targeted policy. Only selected processes are protected.
# mls - Multi Level Security protection.
SELINUXTYPE=targeted
[root@iscsi-server ~]#
3.3 配置iSCIS共享存储
如下所示，采用targetcli进入交互模式服务端iscsi命令配置信息
3.3.1 查看磁盘信息
使用lsblk命令确认需要分配的共享存储为3块5G和2块20G磁盘。
# 查看后端块设备列表
[root@iscsi-server ~]# lsblk
NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINT
sdf 8:80 0 20G 0 disk
sdd 8:48 0 5G 0 disk
sdb 8:16 0 5G 0 disk
sr0 11:0 1 1024M 0 rom
sde 8:64 0 20G 0 disk
sdc 8:32 0 5G 0 disk
sda 8:0 0 50G 0 disk
├─sda2 8:2 0 49G 0 part
│ ├─ol-swap 252:1 0 2G 0 lvm [SWAP]
│ └─ol-root 252:0 0 47G 0 lvm /
└─sda1 8:1 0 1G 0 part /boot
[root@iscsi-server ~]#
3.3.2 targetcli获取帮助信息
[root@iscsi-server ~]# targetcli
targetcli shell version 2.1.51
Copyright 2011-2013 by Datera, Inc and others.
For help on commands, type 'help'.
/> help
GENERALITIES
============
This is a shell in which you can create, delete and configure
configuration objects.
The available commands depend on the current path or target
path you want to run a command in: different path have
different sets of available commands, i.e. a path pointing at
an iscsi target will not have the same availaible commands as,
say, a path pointing at a storage object.
The prompt that starts each command line indicates your
current path. Alternatively (useful if the prompt displays
an abbreviated path to save space), you can run the
pwd command to display the complete current path.
Navigating the tree is done using the cd command. Without
any argument, cd will present you with the full objects
tree. Just use arrows to select the destination path, and
enter will get you there. Please try help cd for navigation
tips.
COMMAND SYNTAX
==============
Commands are built using the following syntax:
[TARGET_PATH] COMMAND_NAME [OPTIONS]
The TARGET_PATH indicates the path to run the command from.
If ommited, the command will be run from your current path.
The OPTIONS depend on the command. Please use help
COMMAND to get more information.
AVAILABLE COMMANDS
==================
The following commands are available in the
current path:
- bookmarks action [bookmark]
- cd [path]
- clearconfig [confirm]
- exit
- get [group] [parameter...]
- help [topic]
- ls [path] [depth]
- pwd
- refresh
- restoreconfig [savefile] [clear_existing] [target] [storage_object]
- saveconfig [savefile]
- sessions [action] [sid]
- set [group] [parameter=value...]
- status
- version
/> exit
Global pref auto_save_on_exit=true
Last 10 configs saved in /etc/target/backup/.
Configuration saved to /etc/target/saveconfig.json
[root@iscsi-server ~]#
3.3.3 创建iSCSI磁盘
使用ls命令查看菜单结构
[root@iscsi-server ~]# targetcli
targetcli shell version 2.1.51
Copyright 2011-2013 by Datera, Inc and others.
For help on commands, type 'help'.
/> ls
o- / ......................................................................................................................... [...]
o- backstores .............................................................................................................. [...]
| o- block .................................................................................................. [Storage Objects: 0]
| o- fileio ................................................................................................. [Storage Objects: 0]
| o- pscsi .................................................................................................. [Storage Objects: 0]
| o- ramdisk ................................................................................................ [Storage Objects: 0]
o- iscsi ............................................................................................................ [Targets: 0]
o- loopback ......................................................................................................... [Targets: 0]
o- vhost ............................................................................................................ [Targets: 0]
/>
backstores表示支持的iSCSI存储对象的后端类型，主要由如下：
block：它允许将块设备作为iSCSI后端存储使用，例如硬盘驱动器或逻辑卷。
fileio：它允许使用文件作为iSCSI后端存储使用，即将文件作为虚拟磁盘提供给iSCSI客户端。
pscsi：pscsi代表"pass-through SCSI"，允许将SCSI设备直接公开给iSCSI客户端，以便客户端可以直接访问SCSI命令。
ramdisk：它允许将RAM磁盘作为iSCSI后端存储使用，即将内存中的一部分作为虚拟磁盘提供给iSCSI客户端。
由于我们已经划分了块设备三个5G和两个20G 的磁盘。所以我们直接使用block类型分别创建。创建完毕后再回到/目录，通过ls命令确认。
/> cd /backstores/block
/backstores/block> create ocr_vote01 /dev/sdb
Created block storage object ocr_vote01 using /dev/sdb.
/backstores/block> create ocr_vote02 /dev/sdc
Created block storage object ocr_vote02 using /dev/sdc.
/backstores/block> create ocr_vote03 /dev/sdd
Created block storage object ocr_vote03 using /dev/sdd.
/backstores/block> create data01 /dev/sde
Created block storage object data01 using /dev/sde.
/backstores/block> create arch01 /dev/sdf
Created block storage object arch01 using /dev/sdf.
/backstores/block> cd /
/> ls
o- / ......................................................................................................................... [...]
o- backstores .............................................................................................................. [...]
| o- block .................................................................................................. [Storage Objects: 5]
| | o- arch01 ........................................................................ [/dev/sdf (20.0GiB) write-thru deactivated]
| | | o- alua ................................................................................................... [ALUA Groups: 1]
| | | o- default_tg_pt_gp ....................................................................... [ALUA state: Active/optimized]
| | o- data01 ........................................................................ [/dev/sde (20.0GiB) write-thru deactivated]
| | | o- alua ................................................................................................... [ALUA Groups: 1]
| | | o- default_tg_pt_gp ....................................................................... [ALUA state: Active/optimized]
| | o- ocr_vote01 ..................................................................... [/dev/sdb (5.0GiB) write-thru deactivated]
| | | o- alua ................................................................................................... [ALUA Groups: 1]
| | | o- default_tg_pt_gp ....................................................................... [ALUA state: Active/optimized]
| | o- ocr_vote02 ..................................................................... [/dev/sdc (5.0GiB) write-thru deactivated]
| | | o- alua ................................................................................................... [ALUA Groups: 1]
| | | o- default_tg_pt_gp ....................................................................... [ALUA state: Active/optimized]
| | o- ocr_vote03 ..................................................................... [/dev/sdd (5.0GiB) write-thru deactivated]
| | o- alua ................................................................................................... [ALUA Groups: 1]
| | o- default_tg_pt_gp ....................................................................... [ALUA state: Active/optimized]
| o- fileio ................................................................................................. [Storage Objects: 0]
| o- pscsi .................................................................................................. [Storage Objects: 0]
| o- ramdisk ................................................................................................ [Storage Objects: 0]
o- iscsi ............................................................................................................ [Targets: 0]
o- loopback ......................................................................................................... [Targets: 0]
o- vhost ............................................................................................................ [Targets: 0]
/>
3.3.4 创建iSCSI服务端
进入iscsi目录，创建ISCSI target
/> cd iscsi
/iscsi> create
Created target iqn.2003-01.org.linux-iscsi.iscsi-server.x8664:sn.4dd2641889d2.
Created TPG 1.
Global pref auto_add_default_portal=true
Created default portal listening on all IPs (0.0.0.0), port 3260.
/iscsi> cd /
/> ls
o- / ......................................................................................................................... [...]
o- backstores .............................................................................................................. [...]
| o- block .................................................................................................. [Storage Objects: 5]
| | o- arch01 ........................................................................ [/dev/sdf (20.0GiB) write-thru deactivated]
| | | o- alua ................................................................................................... [ALUA Groups: 1]
| | | o- default_tg_pt_gp ....................................................................... [ALUA state: Active/optimized]
| | o- data01 ........................................................................ [/dev/sde (20.0GiB) write-thru deactivated]
| | | o- alua ................................................................................................... [ALUA Groups: 1]
| | | o- default_tg_pt_gp ....................................................................... [ALUA state: Active/optimized]
| | o- ocr_vote01 ..................................................................... [/dev/sdb (5.0GiB) write-thru deactivated]
| | | o- alua ................................................................................................... [ALUA Groups: 1]
| | | o- default_tg_pt_gp ....................................................................... [ALUA state: Active/optimized]
| | o- ocr_vote02 ..................................................................... [/dev/sdc (5.0GiB) write-thru deactivated]
| | | o- alua ................................................................................................... [ALUA Groups: 1]
| | | o- default_tg_pt_gp ....................................................................... [ALUA state: Active/optimized]
| | o- ocr_vote03 ..................................................................... [/dev/sdd (5.0GiB) write-thru deactivated]
| | o- alua ................................................................................................... [ALUA Groups: 1]
| | o- default_tg_pt_gp ....................................................................... [ALUA state: Active/optimized]
| o- fileio ................................................................................................. [Storage Objects: 0]
| o- pscsi .................................................................................................. [Storage Objects: 0]
| o- ramdisk ................................................................................................ [Storage Objects: 0]
o- iscsi ............................................................................................................ [Targets: 1]
| o- iqn.2003-01.org.linux-iscsi.iscsi-server.x8664:sn.4dd2641889d2 ..................................................... [TPGs: 1]
| o- tpg1 ............................................................................................... [no-gen-acls, no-auth]
| o- acls .......................................................................................................... [ACLs: 0]
| o- luns .......................................................................................................... [LUNs: 0]
| o- portals .................................................................................................... [Portals: 1]
| o- 0.0.0.0:3260 ..................................................................................................... [OK]
o- loopback ......................................................................................................... [Targets: 0]
o- vhost ............................................................................................................ [Targets: 0]
/>
关于为 Target 创建 IQN，有以下几点需要进行说明：
在为 Target 创建 IQN 时会在此 IQN 下面创建一个默认的 TPG。
IQN 即 iSCSI 限定名称，一个全球唯一名称，用于以强制命名格式来识别启动器（initiator）和目标（target）。
通用格式：iqn.YYYY-MM.com.reversed.domain[:optional_string]；
iqn：表示此名称将使用域作为其标识符；
YYYY-MM：拥有域名的第一个月；
com.reversed.domain：此 iSCSI 名称的创建组织的逆向域名；
optional_string：以冒号为前缀的可选字符串。
管理员如果不指定要创建的 IQN，系统会自动生成一个 IQN。
3.3.5 创建LUN（共享卷）
使用后端存储对象创建iSCSI target的luns逻辑单元
/> cd /iscsi/iqn.2003-01.org.linux-iscsi.iscsi-server.x8664:sn.4dd2641889d2/tpg1/luns
/iscsi/iqn.20...9d2/tpg1/luns> create /backstores/block/ocr_vote01
Created LUN 0.
/iscsi/iqn.20...9d2/tpg1/luns> create /backstores/block/ocr_vote02
Created LUN 1.
/iscsi/iqn.20...9d2/tpg1/luns> create /backstores/block/ocr_vote03
Created LUN 2.
/iscsi/iqn.20...9d2/tpg1/luns> create /backstores/block/data01
Created LUN 3.
/iscsi/iqn.20...9d2/tpg1/luns> create /backstores/block/arch01
Created LUN 4.
/iscsi/iqn.20...9d2/tpg1/luns> cd ..
/iscsi/iqn.20...641889d2/tpg1> ls
o- tpg1 ..................................................................................................... [no-gen-acls, no-auth]
o- acls ................................................................................................................ [ACLs: 0]
o- luns ................................................................................................................ [LUNs: 5]
| o- lun0 ....................................................................... [block/ocr_vote01 (/dev/sdb) (default_tg_pt_gp)]
| o- lun1 ....................................................................... [block/ocr_vote02 (/dev/sdc) (default_tg_pt_gp)]
| o- lun2 ....................................................................... [block/ocr_vote03 (/dev/sdd) (default_tg_pt_gp)]
| o- lun3 ........................................................................... [block/data01 (/dev/sde) (default_tg_pt_gp)]
| o- lun4 ........................................................................... [block/arch01 (/dev/sdf) (default_tg_pt_gp)]
o- portals .......................................................................................................... [Portals: 1]
o- 0.0.0.0:3260 ........................................................................................................... [OK]
/iscsi/iqn.20...641889d2/tpg1>
3.3.6 放开客户端所有访问权限
由于是测试环境，设置共享存储组的属性为认证关闭，写保护关闭，生成节点acl ，开启缓存动态acl。这样我们就可以直接通过客户端访问到iSCIS共享存储
/>
/> cd iscsi/iqn.2003-01.org.linux-iscsi.iscsi-server.x8664:sn.4dd2641889d2/tpg1/
/iscsi/iqn.20...641889d2/tpg1> set attribute authentication=0 demo_mode_write_protect=0 generate_node_acls=1 cache_dynamic_acls=1
Parameter demo_mode_write_protect is now '0'.
Parameter authentication is now '0'.
Parameter generate_node_acls is now '1'.
Parameter cache_dynamic_acls is now '1'.
/iscsi/iqn.20...641889d2/tpg1>
如果进行了以上设置就不要在设置客户端认证CHAP，和portal。直接跳到3.3.9步骤
3.3.7 创建客户端认证（CHAP）
先要到客户端查看/etc/iscsi/initiatorname.iscsi配置文件里InitiatorName，通过InitiatorName来创建CHAP
/> cd iscsi/iqn.2003-01.org.linux-iscsi.iscsi-server.x8664:sn.4dd2641889d2/tpg1/acls
/iscsi/iqn.20...9d2/tpg1/acls> create iqn.1988-12.com.oracle:42d4c41739ea
Created Node ACL for iqn.1988-12.com.oracle:42d4c41739ea
Created mapped LUN 0.
Created mapped LUN 1.
Created mapped LUN 2.
Created mapped LUN 3.
Created mapped LUN 4.
/iscsi/iqn.20...9d2/tpg1/acls> cd iqn.1988-12.com.oracle:42d4c41739ea/
/iscsi/iqn.20...:42d4c41739ea> set auth userid=root
Parameter userid is now 'root'.
/iscsi/iqn.20...:42d4c41739ea> set auth password=123456
Parameter password is now '123456'.
/iscsi/iqn.20...:42d4c41739ea> info
chap_password: 123456
chap_userid: root
wwns:
iqn.1988-12.com.oracle:42d4c41739ea
/iscsi/iqn.20...:42d4c41739ea>
3.3.8 创建Portals
管理员需要创建一个门户配置以指定监听 IP 地址和端口；如果未指定 IP 则默认使用 0.0.0.0 地址；如果未指定端口号则默认使用 3260 端口。
/>
/> cd iscsi/iqn.2003-01.org.linux-iscsi.iscsi-server.x8664:sn.4dd2641889d2/tpg1/
/iscsi/iqn.20...641889d2/tpg1> ls
o- tpg1 ........................................................................................................ [gen-acls, no-auth]
o- acls ................................................................................................................ [ACLs: 1]
| o- iqn.1988-12.com.oracle:42d4c41739ea ........................................................................ [Mapped LUNs: 5]
| o- mapped_lun0 .................................................................................. [lun0 block/ocr_vote01 (rw)]
| o- mapped_lun1 .................................................................................. [lun1 block/ocr_vote02 (rw)]
| o- mapped_lun2 .................................................................................. [lun2 block/ocr_vote03 (rw)]
| o- mapped_lun3 ...................................................................................... [lun3 block/data01 (rw)]
| o- mapped_lun4 ...................................................................................... [lun4 block/arch01 (rw)]
o- luns ................................................................................................................ [LUNs: 5]
| o- lun0 ....................................................................... [block/ocr_vote01 (/dev/sdb) (default_tg_pt_gp)]
| o- lun1 ....................................................................... [block/ocr_vote02 (/dev/sdc) (default_tg_pt_gp)]
| o- lun2 ....................................................................... [block/ocr_vote03 (/dev/sdd) (default_tg_pt_gp)]
| o- lun3 ........................................................................... [block/data01 (/dev/sde) (default_tg_pt_gp)]
| o- lun4 ........................................................................... [block/arch01 (/dev/sdf) (default_tg_pt_gp)]
o- portals .......................................................................................................... [Portals: 1]
o- 0.0.0.0:3260 ........................................................................................................... [OK]
/iscsi/iqn.20...641889d2/tpg1> cd portals/
/iscsi/iqn.20.../tpg1/portals> delete 0.0.0.0 3260
Deleted network portal 0.0.0.0:3260
/iscsi/iqn.20.../tpg1/portals> create 192.168.18.128 3260
Using default IP port 3260
Created network portal 192.168.18.128:3260.
/iscsi/iqn.20.../tpg1/portals> ls
o- portals ............................................................................................................ [Portals: 1]
o- 192.168.18.128:3260 ...................................................................................................... [OK]
/iscsi/iqn.20.../tpg1/portals>
3.3.9 查看iSCSI Server配置
/iscsi/iqn.20...641889d2/tpg1> cd /
/> ls
o- / ......................................................................................................................... [...]
o- backstores .............................................................................................................. [...]
| o- block .................................................................................................. [Storage Objects: 5]
| | o- arch01 .......................................................................... [/dev/sdf (20.0GiB) write-thru activated]
| | | o- alua ................................................................................................... [ALUA Groups: 1]
| | | o- default_tg_pt_gp ....................................................................... [ALUA state: Active/optimized]
| | o- data01 .......................................................................... [/dev/sde (20.0GiB) write-thru activated]
| | | o- alua ................................................................................................... [ALUA Groups: 1]
| | | o- default_tg_pt_gp ....................................................................... [ALUA state: Active/optimized]
| | o- ocr_vote01 ....................................................................... [/dev/sdb (5.0GiB) write-thru activated]
| | | o- alua ................................................................................................... [ALUA Groups: 1]
| | | o- default_tg_pt_gp ....................................................................... [ALUA state: Active/optimized]
| | o- ocr_vote02 ....................................................................... [/dev/sdc (5.0GiB) write-thru activated]
| | | o- alua ................................................................................................... [ALUA Groups: 1]
| | | o- default_tg_pt_gp ....................................................................... [ALUA state: Active/optimized]
| | o- ocr_vote03 ....................................................................... [/dev/sdd (5.0GiB) write-thru activated]
| | o- alua ................................................................................................... [ALUA Groups: 1]
| | o- default_tg_pt_gp ....................................................................... [ALUA state: Active/optimized]
| o- fileio ................................................................................................. [Storage Objects: 0]
| o- pscsi .................................................................................................. [Storage Objects: 0]
| o- ramdisk ................................................................................................ [Storage Objects: 0]
o- iscsi ............................................................................................................ [Targets: 1]
| o- iqn.2003-01.org.linux-iscsi.iscsi-server.x8664:sn.4dd2641889d2 ..................................................... [TPGs: 1]
| o- tpg1 .................................................................................................. [gen-acls, no-auth]
| o- acls .......................................................................................................... [ACLs: 0]
| o- luns .......................................................................................................... [LUNs: 5]
| | o- lun0 ................................................................. [block/ocr_vote01 (/dev/sdb) (default_tg_pt_gp)]
| | o- lun1 ................................................................. [block/ocr_vote02 (/dev/sdc) (default_tg_pt_gp)]
| | o- lun2 ................................................................. [block/ocr_vote03 (/dev/sdd) (default_tg_pt_gp)]
| | o- lun3 ..................................................................... [block/data01 (/dev/sde) (default_tg_pt_gp)]
| | o- lun4 ..................................................................... [block/arch01 (/dev/sdf) (default_tg_pt_gp)]
| o- portals .................................................................................................... [Portals: 1]
| o- 0.0.0.0:3260 ..................................................................................................... [OK]
o- loopback ......................................................................................................... [Targets: 0]
o- vhost ............................................................................................................ [Targets: 0]
/> saveconfig
Configuration saved to /etc/target/saveconfig.json
/> exit
Global pref auto_save_on_exit=true
Last 10 configs saved in /etc/target/backup/.
Configuration saved to /etc/target/saveconfig.json
[root@iscsi-server ~]#
3.4 重启target服务
[root@iscsi-server ~]# systemctl restart target
[root@iscsi-server ~]# systemctl status target
● target.service - Restore LIO kernel target configuration
Loaded: loaded (/usr/lib/systemd/system/target.service; enabled; vendor preset: disabled)
Active: active (exited) since Tue 2025-10-21 18:43:55 EDT; 9s ago
Process: 18177 ExecStop=/usr/bin/targetctl clear (code=exited, status=0/SUCCESS)
Process: 18185 ExecStart=/usr/bin/targetctl restore (code=exited, status=0/SUCCESS)
Main PID: 18185 (code=exited, status=0/SUCCESS)
Oct 21 18:43:55 iscsi-server systemd[1]: Stopped Restore LIO kernel target configuration.
Oct 21 18:43:55 iscsi-server systemd[1]: Starting Restore LIO kernel target configuration...
Oct 21 18:43:55 iscsi-server systemd[1]: Started Restore LIO kernel target configuration.
[root@iscsi-server ~]# netstat -lntup | grep 3260
tcp 0 0 0.0.0.0:3260 0.0.0.0:* LISTEN -
[root@iscsi-server ~]#
3.5 配置客户端访问ISCIS共享存储(所有客户端节点)
3.5.1 客户端软件介绍
iscsi-initiator-utils 提供了 iSCSI 客户端的工具和服务，用于管理和配置 iSCSI 连接。它包含了 iscsiadm 命令行工具和其他与 iSCSI 相关的组件。
主要功能和组件包括：
iscsiadm 命令行工具：iscsi-initiator-utils 包含了 iscsiadm 命令行工具，用于管理和配置 iSCSI 连接。您可以使用该工具来发现 iSCSI 目标、建立会话、断开连接、管理目标列表等。
iSCSI 服务：iscsi-initiator-utils 包含了 iSCSI 服务（通常是 iscsid 守护进程），它在后台运行并处理与 iSCSI 存储目标的通信。该服务负责管理 iSCSI 会话和设备，并提供与 iSCSI 目标的交互接口。
iSCSI 配置文件：iscsi-initiator-utils 提供了用于配置 iSCSI 客户端的配置文件。这些配置文件包含了 iSCSI 目标的信息、认证设置、会话选项等。您可以编辑这些配置文件来自定义 iSCSI 连接的行为。
3.5.2 客户端安装软件
[root@node01 ~]# yum install -y iscsi-initiator-utils-iscsiuio
Loaded plugins: langpacks, ulninfo
Package iscsi-initiator-utils-iscsiuio-6.2.0.874-19.0.1.el7.x86_64 already installed and latest version
Nothing to do
[root@node01 ~]# systemctl stop firewalld
[root@node01 ~]# systemctl disable firewalld
Removed symlink /etc/systemd/system/multi-user.target.wants/firewalld.service.
Removed symlink /etc/systemd/system/dbus-org.fedoraproject.FirewallD1.service.
[root@node01 ~]# setenforce 0
[root@node01 ~]# sed -i "/^SELINUX=/s#enforcing#disabled#" /etc/selinux/config
[root@node01 ~]#
3.5.3 启动客户端服务
启动iscsid服务，并查看InitiatorName，为服务器端配置acl做准备
[root@node01 ~]# systemctl restart iscsid
[root@node01 ~]# systemctl enable iscsid
Created symlink from /etc/systemd/system/multi-user.target.wants/iscsid.service to /usr/lib/systemd/system/iscsid.service.
[root@node01 ~]# cat /etc/iscsi/initiatorname.iscsi
InitiatorName=iqn.1988-12.com.oracle:42d4c41739ea
[root@node01 ~]#
如果服务器端配置了CHAP那就要在/etc/iscsi/initiatorname.iscsi配置文件里添加如下配置
InitiatorName=iqn.1988-12.com.oracle:42d4c41739ea
node.session.auth.authmethod = CHAP
node.session.auth.username = root
node.session.auth.password = 123456
3.5.4 发现iSCIS共享存储
发现iSCIS共享存储iscsiadm -m discovery -t sendtargets -p 192.168.18.128:3260
[root@node01 ~]# iscsiadm -m discovery -t sendtargets -p 192.168.18.128:3260
192.168.18.128:3260,1 iqn.2003-01.org.linux-iscsi.iscsi-server.x8664:sn.4dd2641889d2
[root@node01 ~]#
3.5.5 连接iSCIS共享存储
iscsiadm -m node -T iqn.2003-01.org.linux-iscsi.iscsi-server.x8664:sn.4dd2641889d2 -p 192.168.18.128:3260 -l
[root@node01 ~]# iscsiadm -m node -T iqn.2003-01.org.linux-iscsi.iscsi-server.x8664:sn.4dd2641889d2 -p 192.168.18.128:3260 -l
Logging in to [iface: default, target: iqn.2003-01.org.linux-iscsi.iscsi-server.x8664:sn.4dd2641889d2, portal: 192.168.18.128,3260] (multiple)
Login to [iface: default, target: iqn.2003-01.org.linux-iscsi.iscsi-server.x8664:sn.4dd2641889d2, portal: 192.168.18.128,3260] successful.
[root@node01 ~]#
3.5.6 查看共享存储信息
[root@node01 ~]# lsblk
NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINT
sdf 8:80 0 5G 0 disk
sdd 8:48 0 20G 0 disk
sdb 8:16 0 5G 0 disk
sr0 11:0 1 1024M 0 rom
loop0 7:0 0 4.5G 0 loop /mnt
sde 8:64 0 5G 0 disk
sdc 8:32 0 20G 0 disk
sda 8:0 0 50G 0 disk
├─sda2 8:2 0 49G 0 part
│ ├─ol-swap 252:1 0 2G 0 lvm [SWAP]
│ └─ol-root 252:0 0 47G 0 lvm /
└─sda1 8:1 0 1G 0 part /boot
[root@node01 ~]#
至此，iSCIS共享存储配置完成。
3.6 配置UDEV对iSCSI设备绑定
3.6.1 查看磁盘wwid
#可以使用/usr/lib/udev/scsi_id -g -u -d /dev/sdb 命令
[root@node01 ~]# /usr/lib/udev/scsi_id -g -u -d /dev/sdb
3600140583d6edf5efb74012823f81023
[root@node01 ~]# /usr/lib/udev/scsi_id -g -u -d /dev/sdc
36001405dcda565afe02422a990a061d2
[root@node01 ~]# /usr/lib/udev/scsi_id -g -u -d /dev/sdd
36001405996f60e16bad41138a21a46d9
[root@node01 ~]# /usr/lib/udev/scsi_id -g -u -d /dev/sde
36001405b1fe98b9886f4e16bd5104926
[root@node01 ~]# /usr/lib/udev/scsi_id -g -u -d /dev/sdf
3600140544511f4b911441cc8d5a22e46
[root@node01 ~]#
#也可以使用udevadm info --query=all --name=/dev/sdb | grep ID_SERIAL= 命令
[root@node01 ~]# udevadm info --query=all --name=/dev/sdb | grep ID_SERIAL=
E: ID_SERIAL=3600140583d6edf5efb74012823f81023
[root@node01 ~]# udevadm info --query=all --name=/dev/sdc | grep ID_SERIAL=
E: ID_SERIAL=36001405dcda565afe02422a990a061d2
[root@node01 ~]# udevadm info --query=all --name=/dev/sdd | grep ID_SERIAL=
E: ID_SERIAL=36001405996f60e16bad41138a21a46d9
[root@node01 ~]# udevadm info --query=all --name=/dev/sde | grep ID_SERIAL=
E: ID_SERIAL=36001405b1fe98b9886f4e16bd5104926
[root@node01 ~]# udevadm info --query=all --name=/dev/sdf | grep ID_SERIAL=
E: ID_SERIAL=3600140544511f4b911441cc8d5a22e46
[root@node01 ~]#
3.6.2 创建UDEV规则文件99-oracle-asmdevices.rules
[root@node01 ~]# vi /etc/udev/rules.d/99-oracle-asmdevices.rules
[root@node01 ~]# cat /etc/udev/rules.d/99-oracle-asmdevices.rules
##OCR
KERNEL=="sd*", SUBSYSTEM=="block", PROGRAM=="/lib/udev/scsi_id --whitelisted --replace-whitespace --device /dev/$name", RESULT=="3600140583d6edf5efb74012823f81023", SYMLINK+="asmdisks/orcvote01", OWNER="grid", GROUP="asmadmin", MODE="0660"
KERNEL=="sd*", SUBSYSTEM=="block", PROGRAM=="/lib/udev/scsi_id --whitelisted --replace-whitespace --device /dev/$name", RESULT=="36001405b1fe98b9886f4e16bd5104926", SYMLINK+="asmdisks/orcvote02", OWNER="grid", GROUP="asmadmin", MODE="0660"
KERNEL=="sd*", SUBSYSTEM=="block", PROGRAM=="/lib/udev/scsi_id --whitelisted --replace-whitespace --device /dev/$name", RESULT=="3600140544511f4b911441cc8d5a22e46", SYMLINK+="asmdisks/orcvote03", OWNER="grid", GROUP="asmadmin", MODE="0660"
##DATA
KERNEL=="sd*", SUBSYSTEM=="block", PROGRAM=="/lib/udev/scsi_id --whitelisted --replace-whitespace --device /dev/$name", RESULT=="36001405dcda565afe02422a990a061d2", SYMLINK+="asmdisks/data01", OWNER="grid", GROUP="asmadmin", MODE="0660"
##ARCH
KERNEL=="sd*", SUBSYSTEM=="block", PROGRAM=="/lib/udev/scsi_id --whitelisted --replace-whitespace --device /dev/$name", RESULT=="36001405996f60e16bad41138a21a46d9", SYMLINK+="asmdisks/arch01", OWNER="grid", GROUP="asmadmin", MODE="0660"
#重载udev规则并触发udev生效
[root@node01 ~]# udevadm control --reload-rules
[root@node01 ~]# udevadm trigger
[root@node01 ~]# ls -l /dev/asmdisks
total 0
lrwxrwxrwx. 1 root root 6 Oct 22 07:56 arch01 -> ../sdd
lrwxrwxrwx. 1 root root 6 Oct 22 07:56 data01 -> ../sdc
lrwxrwxrwx. 1 root root 6 Oct 22 07:56 orcvote01 -> ../sdb
lrwxrwxrwx. 1 root root 6 Oct 22 07:56 orcvote02 -> ../sde
lrwxrwxrwx. 1 root root 6 Oct 22 07:56 orcvote03 -> ../sdf
[root@node01 ~]# ls -l /dev/sd*
brw-rw----. 1 root disk 8, 0 Oct 22 07:56 /dev/sda
brw-rw----. 1 root disk 8, 1 Oct 22 07:56 /dev/sda1
brw-rw----. 1 root disk 8, 2 Oct 22 07:56 /dev/sda2
brw-rw----. 1 grid asmadmin 8, 16 Oct 22 07:56 /dev/sdb
brw-rw----. 1 grid asmadmin 8, 32 Oct 22 07:56 /dev/sdc
brw-rw----. 1 grid asmadmin 8, 48 Oct 22 07:56 /dev/sdd
brw-rw----. 1 grid asmadmin 8, 64 Oct 22 07:56 /dev/sde
brw-rw----. 1 grid asmadmin 8, 80 Oct 22 07:56 /dev/sdf
[root@node01 ~]# lsblk
NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINT
sdf 8:80 0 5G 0 disk
sdd 8:48 0 20G 0 disk
sdb 8:16 0 5G 0 disk
sr0 11:0 1 1024M 0 rom
loop0 7:0 0 4.5G 0 loop /mnt
sde 8:64 0 5G 0 disk
sdc 8:32 0 20G 0 disk
sda 8:0 0 50G 0 disk
├─sda2 8:2 0 49G 0 part
│ ├─ol-swap 252:1 0 2G 0 lvm [SWAP]
│ └─ol-root 252:0 0 47G 0 lvm /
└─sda1 8:1 0 1G 0 part /boot
[root@node01 ~]#
✨至此，Oracle RAC 测试环境提供共享磁盘（OCR、VOTE、DATA、ARCH）都已经创建完毕。
3.7 iSCSI客户端清理iSCSI挂载信息
3.7这步骤一般在出现iSCSI挂载问题时候操作，一般不会操作。
3.7.1 查看客户端iscsid进程状态
[root@node01 ~]# systemctl status iscsid
● iscsid.service - Open-iSCSI
Loaded: loaded (/usr/lib/systemd/system/iscsid.service; enabled; vendor preset: disabled)
Active: active (running) since Wed 2025-10-22 06:54:44 CST; 1h 20min ago
Docs: man:iscsid(8)
man:iscsiuio(8)
man:iscsiadm(8)
Main PID: 3349 (iscsid)
Status: "Ready to process requests"
Tasks: 1
CGroup: /system.slice/iscsid.service
└─3349 /sbin/iscsid -f -d2
Oct 22 08:11:42 node01 iscsid[3349]: iscsid: Kernel reported iSCSI connection 1:0 error (1020 - ISCSI_ERR_TCP_CONN_CLOSE: TCP connection closed) state (3)
Oct 22 08:11:42 node01 iscsid[3349]: iscsid: re-opening session 1 (reopen_cnt 0)
Oct 22 08:11:42 node01 iscsid[3349]: iscsid: disconnecting conn 0x562f51d25e50, fd 7
Oct 22 08:11:44 node01 iscsid[3349]: iscsid: Poll was woken by an alarm
Oct 22 08:11:44 node01 iscsid[3349]: iscsid: re-opening session 1 (reopen_cnt 0)
Oct 22 08:11:44 node01 iscsid[3349]: iscsid: connecting to 192.168.18.128:3260
Oct 22 08:11:44 node01 iscsid[3349]: iscsid: connected local port 43718 to 192.168.18.128:3260
Oct 22 08:11:44 node01 iscsid[3349]: iscsid: login response status 0000
Oct 22 08:11:44 node01 iscsid[3349]: iscsid: deleting a scheduled/waiting thread!
Oct 22 08:11:44 node01 iscsid[3349]: iscsid: connection1:0 is operational after recovery (1 attempts)
[root@node01 ~]#
3.7.2 查看系统message日志
[root@node01 ~]# tail /var/log/messages
Oct 22 08:11:42 node01 iscsid: iscsid: Kernel reported iSCSI connection 1:0 error (1020 - ISCSI_ERR_TCP_CONN_CLOSE: TCP connection closed) state (3)
Oct 22 08:11:42 node01 iscsid: iscsid: re-opening session 1 (reopen_cnt 0)
Oct 22 08:11:42 node01 iscsid: iscsid: disconnecting conn 0x562f51d25e50, fd 7
Oct 22 08:11:44 node01 iscsid: iscsid: Poll was woken by an alarm
Oct 22 08:11:44 node01 iscsid: iscsid: re-opening session 1 (reopen_cnt 0)
Oct 22 08:11:44 node01 iscsid: iscsid: connecting to 192.168.18.128:3260
Oct 22 08:11:44 node01 iscsid: iscsid: connected local port 43718 to 192.168.18.128:3260
Oct 22 08:11:44 node01 iscsid: iscsid: login response status 0000
Oct 22 08:11:44 node01 iscsid: iscsid: deleting a scheduled/waiting thread!
Oct 22 08:11:44 node01 iscsid: iscsid: connection1:0 is operational after recovery (1 attempts)
[root@node01 ~]#
3.7.3 查看iSCIS Server及客户端磁盘信息
[root@node01 ~]# iscsiadm -m discovery -t st -p 192.168.18.128
192.168.18.128:3260,1 iqn.2003-01.org.linux-iscsi.iscsi-server.x8664:sn.4dd2641889d2
[root@node01 ~]# lsscsi
[1:0:0:0] cd/dvd NECVMWar VMware IDE CDR10 1.00 /dev/sr0
[2:0:0:0] disk VMware, VMware Virtual S 1.0 /dev/sda
[3:0:0:0] disk LIO-ORG ocr_vote01 4.0 /dev/sdb
[3:0:0:1] disk LIO-ORG ocr_vote02 4.0 /dev/sdf
[3:0:0:2] disk LIO-ORG ocr_vote03 4.0 /dev/sde
[3:0:0:3] disk LIO-ORG data01 4.0 /dev/sdd
[3:0:0:4] disk LIO-ORG arch01 4.0 /dev/sdc
[root@node01 ~]#
3.7.4 清理iSCIS客户端login
[root@node01 ~]# iscsiadm -m node --logoutall=all
Logging out of session [sid: 1, target: iqn.2003-01.org.linux-iscsi.iscsi-server.x8664:sn.4dd2641889d2, portal: 192.168.18.128,3260]
Logout of [sid: 1, target: iqn.2003-01.org.linux-iscsi.iscsi-server.x8664:sn.4dd2641889d2, portal: 192.168.18.128,3260] successful.
[root@node01 ~]# lsblk
NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINT
sr0 11:0 1 1024M 0 rom
loop0 7:0 0 4.5G 0 loop /mnt
sda 8:0 0 50G 0 disk
├─sda2 8:2 0 49G 0 part
│ ├─ol-swap 252:1 0 2G 0 lvm [SWAP]
│ └─ol-root 252:0 0 47G 0 lvm /
└─sda1 8:1 0 1G 0 part /boot
[root@node01 ~]# lsscsi
[1:0:0:0] cd/dvd NECVMWar VMware IDE CDR10 1.00 /dev/sr0
[2:0:0:0] disk VMware, VMware Virtual S 1.0 /dev/sda
[root@node01 ~]#
四、总结
本文概述 iSCSI 的原理与应用场景，并以实操示例覆盖从安装、配置、客户端接入到 UDEV 绑定的完整流程，期望对您的共享存储搭建有所助益。
| 欢迎光临 重庆思庄Oracle、KingBase、PostgreSQL、Redhat认证学习论坛 (http://bbs.cqsztech.com/) | Powered by Discuz! X3.2 |