MTP speculative decoding support? #8
Description
The hf config has MTP settings but there is no any MTP weights in the hf repo.
So I am wondering if there is any plan or progress about MTP speculative decoding?
{{ message }}
The hf config has MTP settings but there is no any MTP weights in the hf repo.
So I am wondering if there is any plan or progress about MTP speculative decoding?