Skip to content

Added ability to load pre-computed vectors from Pickle file#134

Open
taylor-brown wants to merge 2 commits into
mlfoundations:mainfrom
taylor-brown:main
Open

Added ability to load pre-computed vectors from Pickle file#134
taylor-brown wants to merge 2 commits into
mlfoundations:mainfrom
taylor-brown:main

Conversation

@taylor-brown

Copy link
Copy Markdown

The "interface" matches the csv one, but with a pickled data frame.
See #99.

The interface matches the csv, but with a pickled data frame.
@Zasder3

Zasder3 commented Jul 27, 2022

Copy link
Copy Markdown
Collaborator

Looks like a very helpful feature! I'll give a deeper pass over this soon. I'm the meantime, could you add an explanation of this to the README.md?

@taylor-brown

Copy link
Copy Markdown
Author

Sure thing. I added a commit.

@rom1504

rom1504 commented Jul 28, 2022

Copy link
Copy Markdown
Collaborator

https://github.com/rom1504/embedding-reader could be another way to get support of this
Would give :

  • reading embeddings from any FS (including S3 and gcs)
  • supporting other formats (npy, parquet)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants