deepspeed 安装 Windows

目录

目录

Window下安装deepspeed

报错No module named 'torch._six'：

升级安装

解决方法：

Window下安装deepspeed

pip install deepspeed==0.3.16

报错No module named 'torch._six'：

Traceback (most recent call last):
? File "\\tsclient\B\project\motion\DragNUWA-main\aa.py", line 4, in <module>
? ? from deepspeed.runtime.utils import see_memory_usage
? File "D:\ProgramData\miniconda3\envs\py310\lib\site-packages\deepspeed\__init__.py", line 9, in <module>
? ? from .runtime.engine import DeepSpeedEngine
? File "D:\ProgramData\miniconda3\envs\py310\lib\site-packages\deepspeed\runtime\engine.py", line 18, in <module>
? ? from deepspeed.runtime.utils import see_memory_usage
? File "D:\ProgramData\miniconda3\envs\py310\lib\site-packages\deepspeed\runtime\utils.py", line 18, in <module>
? ? from torch._six import inf
ModuleNotFoundError: No module named 'torch._six'

升级安装

pip install deepspeed -U

又报错，

     LINK : fatal error LNK1181: 无法打开输入文件“aio.lib”
      Traceback (most recent call last):
        File "<string>", line 2, in <module>
        File "<pip-setuptools-caller>", line 34, in <module>
        File "C:\Users\Administrator\AppData\Local\Temp\pip-install-sstq3xtg\deepspeed_ec1aceacdee5428b8b8e5a0f883c09d6\setup.py", line 182, in <module>
          abort(f"Unable to pre-compile {op_name}")
        File "C:\Users\Administrator\AppData\Local\Temp\pip-install-sstq3xtg\deepspeed_ec1aceacdee5428b8b8e5a0f883c09d6\setup.py", line 52, in abort
          assert False, msg
      AssertionError: Unable to pre-compile async_io
      DS_BUILD_OPS=1
       [WARNING]  async_io requires the dev libaio .so object and headers but these were not found.
       [WARNING]  If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found.
       [WARNING]  One can disable async_io with DS_BUILD_AIO=0

解决方法：

[REQUEST] Hey, Microsoft...Could you PLEASE Support Your Own OS? · Issue #2427 · microsoft/DeepSpeed · GitHub

其中一个whl，支持python3.9 3.10

https://drive.google.com/drive/folders/117GSNHcJyzvMPTftl0aPBSwQVsU-z4bM