Skip to content

Multi-gpu error with gradio from gpu_infer cast type: 'str' object cannot be interpreted as an integer#95

Open
pftq wants to merge 4 commits into
ali-vilab:mainfrom
pftq:main
Open

Multi-gpu error with gradio from gpu_infer cast type: 'str' object cannot be interpreted as an integer#95
pftq wants to merge 4 commits into
ali-vilab:mainfrom
pftq:main

Conversation

@pftq

@pftq pftq commented Jun 14, 2025

Copy link
Copy Markdown

When running gradio with multi-gpu, it results in an error from gpu_infer being cast as a string because os.environ.get('LOCAL_WORLD_SIZE') returns a string. This PR fixes it by casting to int

After this, gradio works great with multi-gpu support:

gpu_count=2
python vace/gradios/vace_wan_demo.py \
--mp --ulysses_size ${gpu_count} --ring_size 1 \
--model_name "vace-14B" \
--ckpt_dir "models/Wan2.1-VACE-14B/"

@CLAassistant

CLAassistant commented Jun 14, 2025

Copy link
Copy Markdown

CLA assistant check
All committers have signed the CLA.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants