Restore BM25 model #63
-
|
Is it possible to restore a BM25 model from the its.modelJSON output so it could vectorize without relearning? |
Beta Was this translation helpful? Give feedback.
Replies: 2 comments 5 replies
-
|
Currently this capability is not available. If there are strong use-cases then we can consider addition of such a feature. |
Beta Was this translation helpful? Give feedback.
-
|
In my case, I'm using docTermMatrix from the BM25 vectorizer as features to a SVM model. I would like to generate BM25 vectors from untrained documents based on the original training set and let the SVM classify the document. Because of the large corpus, I would not want to retrain the vectorizer each time I want to generate a vector for a new document and the shape needs to stay constant for the classifier. |
Beta Was this translation helpful? Give feedback.
-
|
Any thoughts on how would you like to see it working? |
Beta Was this translation helpful? Give feedback.
-
|
Either an option to pass the modelJson output into the config at instantiation or a .load(modelJson) method on the vectorizer. |
Beta Was this translation helpful? Give feedback.
-
|
Sounds great, we decided to provide a separate api — Will take a bit to update the documentation. |
Beta Was this translation helpful? Give feedback.
-
|
I will. Thanks!
…On Thu, Nov 18, 2021 at 1:21 AM Sanjaya Kumar Saxena < ***@***.***> wrote:
Sounds great, we decided to provide a separate api — .loadModel( json )
to enable loading of saved models. It accepts json (i.e. string) as input
and loads it. Once successfully loaded further learning is not possible.
Released v1.10.0 with this feature, please check it out!
Will take a bit to update the documentation.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
<#63 (reply in thread)>,
or unsubscribe
<https://github.com/notifications/unsubscribe-auth/ACVSJAUXDFWNSH7OFWN4BJ3UMTARZANCNFSM5GL5JGNA>
.
Triage notifications on the go with GitHub Mobile for iOS
<https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675>
or Android
<https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub>.
|
Beta Was this translation helpful? Give feedback.
-
|
We have also updated the BM25Vectorizer documentation. |
Beta Was this translation helpful? Give feedback.
Currently this capability is not available. If there are strong use-cases then we can consider addition of such a feature.