每次启动时,可以看到控制台输出了4条警告信息:
FutureWarning: torch.utils._pytree._register_pytree_node is deprecated. Please use torch.utils._pytree.register_pytree_node instead.
FutureWarning: torch.utils._pytree._register_pytree_node is deprecated. Please use torch.utils._pytree.register_pytree_node instead.
FutureWarning: torch.utils._pytree._register_pytree_node is deprecated. Please use torch.utils._pytree.register_pytree_node instead.
FutureWarning: torch.utils._pytree._register_pytree_node is deprecated. Please use torch.utils._pytree.register_pytree_node instead.
备注:还不能随意降低 transformers 版本,否则加载的 gpt 模型权重可能对不上。 或者在 webui.py 开头添加两句,以消除 FutureWarning 警告。
import warnings
warnings.filterwarnings("ignore", category=FutureWarning)
warnings.filterwarnings("ignore", category=UserWarning)
另外,如果是 fp16 推理,还需要安装 deepspeed,需要在 requirements.txt 里补充上。
pip install deepspeed
但发现这个 deepspeed 会报: test.c LINK : fatal error LNK1181: 无法打开输入文件“aio.lib” test.c LINK : fatal error LNK1181: 无法打开输入文件“cufile.lib”