How to use gated or private models hosted on Hugging Face
The open source text models on Hugging Face may not be what you always want,
Update embedding_models.yaml
To use a private or custom model with Trieve Vector Inference, you will need to update your embedding_models.yaml
file.
If the model is a private or gated Hugging Face model, you will need to include your Hugging Face API token.
Update your TVI cluster
Update TVI to include your models
Get embeddings endpoint