kingbri 96e8375ec8 Multimodal: Fix memory leak with MMEmbeddings ...

On a basic python class, class attributes are handled by reference,
meaning that every instance of embeddings would attach to that reference
and allocate more memory.

Switch to a Pydantic class and factory methods when instantiating.

Signed-off-by: kingbri <8082010+kingbri1@users.noreply.github.com>

2025-02-02 12:21:19 -05:00

..

actions.py

fix issues with optional dependencies (#204)

2024-09-19 22:24:55 -04:00

args.py

Start: Fix startup with new argparser

2024-09-21 14:36:21 -04:00

auth.py

Tree: Format

2024-09-18 20:36:17 -04:00

concurrency.py

API + Model: Add blocks and checks for various load requests

2024-05-25 21:16:14 -04:00

config_models.py

Merge branch 'main' into vision

2024-11-19 21:19:21 -05:00

downloader.py

config is now backed by pydantic (WIP)

2024-09-05 18:04:56 +01:00

gen_logging.py

Logging: Remove preferences global

2024-09-14 21:49:44 -04:00

health.py

Add health check monitoring for EXL2 errors (#206)

2024-09-22 21:40:36 -04:00

logger.py

API: Add HuggingFace downloader

2024-04-29 01:15:02 -04:00

model.py

Model: Fix load packets

2024-11-21 18:06:47 -05:00

multimodal.py

Multimodal: Fix memory leak with MMEmbeddings

2025-02-02 12:21:19 -05:00

networking.py

remove unused imports

2024-09-11 18:00:29 +01:00

optional_dependencies.py

Dependencies: Remove outlines from optional check

2024-12-18 11:56:40 -05:00

sampling.py

Sampling: Add max_completion_tokens

2024-12-13 01:02:37 -05:00

signals.py

Signals: Split signal handler between sync and async

2024-09-19 23:31:29 -04:00

tabby_config.py

Cleanup config file loader (#208)

2024-09-23 21:42:01 -04:00

templating.py

Tree: Fix classmethod usage

2024-09-10 20:52:29 -04:00

transformers_utils.py

Refactor the sampling class (#199)

2024-10-27 11:43:41 -04:00

utils.py

Cleanup config file loader (#208)

2024-09-23 21:42:01 -04:00