The following useful commands will help you find the root cause of "No left space" in your linux servers
sudo df -h
sudo find . -type f -size +100M -exec ls -lh {} \;
sudo du -h -d 1 -t 1G /home/www/.cache/
Fixing the DeepSpeed Import Error While Fine-Tuning the Qwen Model
While fine-tuning the Qwen model, I encountered an error in the finetune.py script: ImportError : cannot import name 'deepspeed' from 'transformers.deepspeed' After some investigation, I discovered the issue stems from a recent update in the Transformers library. The transformers.deepspeed module has been deprecated and replaced by transformers.integrations . To fix this, you need to update the import statement in your script. The Fix Replace this: from transformers.deepspeed import deepspeed With this: from transformers.integrations import deepspeed This small change resolved the error, allowing the fine-tuning process to proceed smoothly. Additional Resources For more details, refer to the discussion in the official Transformers GitHub repository: Issue #34582 Remember to keep your library versions up-to-date to avoid similar issues in the future!
Comments
Post a Comment