infiniswap安装

环境：ubuntu14.04，内核4.04

uname -a

Linux ubuntu 4.4.0-142-generic #168~14.04.1-Ubuntu SMP Sat Jan 19 11:26:28 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux

克隆项目：

git clone https://github.com/SymbioticLab/Infiniswap.git

1. 客户端守护进程安装

客户端编译安装：
```
cd setup
./install daemon
```
运行客户端守护程序：
```
cd ../infiniswap_daemon
./infiniswap-daemon 192.168.2.221 9400
```
ip地址 192.168.2.221 是客户端所在主机 ib网卡的地址。

2. 服务端块设备（交换分区）安装

进入 setup 目录，修改 install.h
```
cd setup
vim install.h
```
修改内容主要是以下两个：

#have the kernel patch for lookup_bdev()

#(HAVE_LOOKUP_BDEV_PATCH), default is undefined

have_lookup_bdev_patch=1

#name of physical backup disk

#(BACKUP_DISK), default is “/dev/sda4”

backup_disk="/dev/vdb"

如果以上两项未修改正确，无法编译通过。
服务端编译生成内核模块：
```
cd setup
./install bd
```
服务端配置 portal.list
```
vim portal.list
```
1

192.168.2.221:9400

第一行为daemon的数量，后面每行为一个daemon的 ip:port
服务端安装块设备，设置为交换分区：
```
./infiniswap_bd_setup.sh
```
如果执行 ./infiniswap_bd_setup.sh出错，可以一步一步执行，该文件内容如下：
```
   modprobe infiniswap 
   mount -t configfs none /sys/kernel/config
   
   nbdxadm -o create_host -i 0 -p $PWD/portal.list #portal.list
   nbdxadm -o create_device -i 0 -d 0
   
   ls /dev/infiniswap0
   mkswap /dev/infiniswap0
   swapon /dev/infiniswap0
```
成功挂载为交换分区后，打印的内核日志：

[ 94.543854] IS_create_configfs_files

[ 99.157269] IS_session_make_group, name=infiniswaphost0

[ 99.157330] portal_attr_store, buf=1,192.168.2.221:9400,

[ 99.157335] In IS_session_create() with portal: rdma://1,192.168.2.221:9400,

[ 99.157527] rdma://1,192.168.2.221:9400,

[ 99.157879] portal: 192.168.2.221, 9400

[ 99.158040] IS_create_conn with cpu: 0

[ 99.158042] IS_create_conn with cpu: 1

[ 102.866554] IS_device_make_group, name=infiniswap0

[ 102.866612] device_attr_store

[ 102.866616] In IS_create_device(), dev_name:infiniswap0

[ 102.866619] IS: st_size = 12884901888

[ 102.866621] IS_register_block_device

[ 102.867318] IS_init_hctx called index=0 xq=ffff880079327e80

[ 102.867323] IS_init_hctx called index=1 xq=ffff880079327e98

[ 102.867349] IS_register_block_device, dev_name infiniswap0

[ 102.867543] IS: init done

[ 102.868987] stackbd: init done

[ 102.868995] Opened /dev/vdb

[ 102.869010] stackbd: Device real capacity: 29360128

[ 102.869013] stackbd: Max sectors: 8

[ 102.869053] stackbd: done initializing successfully

[ 112.873800] rdma_trigger

[ 211.265717] kernel_cb_init, created cm_id ffff88003633a000

[ 211.265842] cma_event type 0 cma_id ffff88003633a000 (parent)

[ 211.266119] cma_event type 2 cma_id ffff88003633a000 (parent)

[ 211.266161] rdma_resolve_addr - rdma_resolve_route successful

[ 211.266641] created pd ffff880078b8b5c0

[ 211.267343] created cq ffff880036338800

[ 211.269382] created qp ffff880036338c00

[ 211.269388] IS: IS_setup_buffers called on cb ffff88007a9b5000

[ 211.269391] IS: size of IS_rdma_info 392

[ 211.269394] IS: cb->mem=1

[ 211.269396] IS: IS_setup_buffers, in cb->mem==DMA

[ 211.269619] IS: allocated & registered buffers…

[ 211.282962] cma_event type 9 cma_id ffff88003633a000 (parent)

[ 211.282974] ESTABLISHED

[ 211.282990] rdma_connect successful

[ 211.285548] IS_ctx_dma_setup, setup_ctx_dma

[ 211.285734] evict_handler, waiting for STOP msg

[ 211.463865] Received rkey 80709 addr 7fd423fff000 from peer

[ 211.517175] Received rkey 80608 addr 7fd3e3ffd000 from peer

[ 239.423567] Adding 12582908k swap on /dev/infiniswap0. Priority:-1 extents:1 across:12582908k SSFS

在Infiniswap目录编写了服务端启动脚本 r_bd.sh：

#!/bin/bash

pwd=111111
swaps='/dev/vda5'

cd setup
echo $pwd | sudo -S swapon -s

for i in $swaps; do
    echo $pwd | sudo -S swapoff $i
done

./infiniswap_bd_setup.sh
echo $pwd | sudo -S swapon -s