Reranker
Update embedding_models.yaml
... models: ... my-reranker-model: replicas: 1 revision: main modelName: BAAI/bge-reranker-large ...
Upgrade your TVI cluster
helm upgrade -i vector-inference \ oci://709825985650.dkr.ecr.us-east-1.amazonaws.com/trieve/trieve-embeddings \ -f embedding_models.yaml
Get embeddings endpoint
kubectl get ing
NAME CLASS HOSTS ADDRESS PORTS AGE vector-inference-embedding-bge-reranker-ingress alb * k8s-default-vectorin-b09efe8cf6-890425945.us-west-1.elb.amazonaws.com 80 77m
Was this page helpful?