Hi!
Thanks for open sourcing the implementation of DeepThink. I was looking into the implementation of simple_majority_vote and weighted_majority_vote here, and one thing I noticed is that the implementation does not group equivalent answers together. So for a given question, if the model answers 0.5 or \frac{1}{2}, these will be counted as two separate answers, when in reality they are the same answer.
Is this intended?
Thanks!
Hi!
Thanks for open sourcing the implementation of DeepThink. I was looking into the implementation of
simple_majority_voteandweighted_majority_votehere, and one thing I noticed is that the implementation does not group equivalent answers together. So for a given question, if the model answers0.5or\frac{1}{2}, these will be counted as two separate answers, when in reality they are the same answer.Is this intended?
Thanks!