-
Notifications
You must be signed in to change notification settings - Fork 1
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[Feature request] Custom models #1
Comments
Hey @GHuserE Yes, this should be no problem. A custom method for document metadata extraction (excluding keywords) can be implemented by extending the However, I still need to add a method to If you have any specific model in mind, you can also send me a message. If the model provides good performance for the resources it needs, I can add it to the library. |
I want to use Moondream2. It's friggin' good and can run locally and is fast. Thanks! |
Hey there Thank you for the tip. I already have the model on my radar. It is indeed quite remarkable and also steerable enough. There are some other small models that write long elaborations on how they derive the title rather than just returning the answer - no matter how much you ask them not to (they like their flow, don't they) 😆. It may take some time before I add it, though... Please stand by 😃 |
Okay @GHuserE the Moondream2 model is now available since a87135b. You can use it by setting db.set_metadata_method(MOONDREAM2) About adding custom models: I am going to work on reorganizing the code, e.g. by storing all prompts in a single place. This should help it being able to scale better with supporting more models and also remote APIs (ChatGPT, etc.). Please stand by. |
Hello there!
Is it possible to add a feature such that one can add custom models for feature extraction? The donut model is not that accurate and I do not have the hardware for Idefics2. I have 8GB RAM, no GPU.
The text was updated successfully, but these errors were encountered: