What is the difference between Salesforce/GiftEvalPretrain and LOTSA?

[manglu3936-cloud]

They seem to be designed for similar domains.

[cuthalionn]

Hi @manglu3936-cloud,
Salesforce/GiftEvalPretrain is a subset of LOTSA to ensure there is no leakage to test split of GiftEval.

[manglu3936-cloud]

。Since they are subsets, why is the former larger than the latter?

[cuthalionn]

Hi @manglu3936-cloud, good catch! It took me some time to understand the reason.

Apparently some of the folders in Salesforce/GiftEvalPretrain had some cache files uploaded along with the original files (e.g. https://huggingface.co/datasets/Salesforce/GiftEvalPretrain/tree/main/spain) . Since the state.json inside each folder points to the original files it does not affect the data loaded but it is still a waste of space. We will remove those cache files soon.

So practically Salesforce/GiftEvalPretrain is still a subset of the original LOTSA.