Commit Graph

77 Commits

Author SHA1 Message Date
Thomas
eaf8ad1041 Update chat.py, include multi-line input support and context clearing through input (#738)
* Update chat.py, include multi-line input support and context clearing

- Enable multi-line input (mli) support through the -mli argument. When using mli, end input with the EOF char (return/Ctrl+D on Unix, return/Ctrl+Z/return on Windows)
- Allow context clearing outside of amnesia by inputting "clear"

* Adding qwq chat mode, adding the ability to forget thinking context
2025-03-10 15:28:33 +01:00
turboderp
b400394f06 Update build actions 2025-01-09 11:13:03 +01:00
turboderp
8bb283d319 Cleanup build actions 2024-12-09 20:14:35 +01:00
turboderp
735fa7b4c3 Update build action 2024-11-13 05:56:17 +01:00
turboderp
6f9a697b6a Update build action 2024-11-12 09:32:50 +01:00
turboderp
c708e4fd84 BUild actions 2024-11-12 07:14:23 +01:00
Brian Dashore
84b1f9017d Torch 2.5 (#659)
* Actions: Add helpful comments

Useful for updating dependencies when building.

Signed-off-by: kingbri <bdashore3@proton.me>

* Actions: Add torch 2.5 builds

Signed-off-by: kingbri <bdashore3@proton.me>

---------

Signed-off-by: kingbri <bdashore3@proton.me>
2024-11-02 21:09:23 +01:00
turboderp
8361f3f4a0 Add missing cp310+cu118 torch 2.4 windows wheel 2024-09-23 17:38:53 +02:00
turboderp
b2c7cf280c Add cp310 cu121 torch2.4 Windows wheel 2024-09-14 21:17:52 +02:00
Brian Dashore
c18400fa29 Issues: Add issue templates (#615)
Should help encourage well-formatted issues and make development easier.

Signed-off-by: kingbri <bdashore3@proton.me>
2024-09-04 14:58:58 +02:00
turboderp
3cd1eea53a Remove temp build actions 2024-07-25 06:07:24 +02:00
turboderp
3aabad216b Temp action to update 0.1.8 with Torch 2.4.0 and ROCm 6.1 wheels 2024-07-25 05:21:01 +02:00
Brian Dashore
7e5f0db16e Actions: Add pytorch 2.4.0 to build (#569)
Signed-off-by: kingbri <bdashore3@proton.me>
2024-07-25 05:18:33 +02:00
turboderp
90cc189517 Try MAMBA_NO_LOW_SPEED_LIMIT to prevent dependency download from timing out 2024-07-24 09:13:10 +02:00
turboderp
44dd05b14a Add build action for torch 2.2.2, cp310 2024-07-12 00:41:15 +02:00
turboderp
5996922a0f pin setuptools==69.5.1 2024-06-09 02:27:38 +02:00
turboderp
513c030935 Bump wheels from PyTorch 2.3.0 to 2.3.1 2024-06-08 20:32:01 +02:00
turboderp
713c35b7b4 Merge branch 'refs/heads/master' into dev
# Conflicts:
#	.github/workflows/build-wheels-release.yml
#	.github/workflows/build_wheels_release_python312test.yml
2024-06-08 20:27:29 +02:00
Brian Dashore
b1c9020c2d Update Actions (#497)
* Actions: Python 3.12: Override with VS 2022 17.9

Github Actions updated their runner image with VS 17.10 which is
incompatible with older versions of CUDA. Force a downgrade to 17.9
and build.

Signed-off-by: kingbri <bdashore3@proton.me>

* Actions: Update to VS 2022 17.9

Github Actions updated their Windows runner image with VS 17.10 which is
incompatible with older versions of CUDA. Force a downgrade to 17.9
and build.

Signed-off-by: kingbri <bdashore3@proton.me>

* Actions: Add Python 3.12 to releases

Python 3.12 ExllamaV2 is stable. So, add it into builds.

Signed-off-by: kingbri <bdashore3@proton.me>

---------

Signed-off-by: kingbri <bdashore3@proton.me>
2024-06-08 00:51:57 +02:00
turboderp
34677da2b9 Try vs build tools instead 2024-06-07 16:57:37 +02:00
turboderp
90796477c4 Attempt to uninstall VS2022 2024-06-07 12:11:51 +02:00
turboderp
91681732f4 Downgrade VS2022 enterprise 2024-06-07 11:52:00 +02:00
turboderp
afd0853212 Try to downgrade to VS 17.9 2024-06-07 02:26:22 +02:00
turboderp
9902e446a5 Update build_wheels_release_python312test.yml 2024-06-07 01:38:40 +02:00
turboderp
a9d5831264 Update build_wheels_release_python312test.yml 2024-06-07 01:07:55 +02:00
turboderp
99fa4bbda1 Update build_wheels_release_python312test.yml 2024-06-07 00:41:25 +02:00
turboderp
dad511afb0 Update build_wheels_release_python312test.yml 2024-06-07 00:29:06 +02:00
turboderp
5b5f162395 Test Python 3.12 build 2024-06-07 00:08:26 +02:00
turboderp
b76abc978f Add Python 3.9 ROCm wheels 2024-06-06 03:23:12 +02:00
turboderp
bad89571e4 Update build_wheels_release_rocmtest.yml 2024-06-06 03:01:05 +02:00
turboderp
f144cf43df Python 3.9 ROCm build test 2024-06-06 02:21:17 +02:00
turboderp
009424a6d4 Consolidate and tidy up wheel/release workflow 2024-05-11 23:24:55 +02:00
turboderp
84be945af6 Merge pull request #421 from Orion-zhen/master
Action to build wheels on ROCm 6.0
2024-04-27 04:20:32 +02:00
turboderp
33a508fccc Add ROCm 6.0 to build matrix, remove ROCm for cp38, cp39
Compile wheels against torch==2.3.0
2024-04-27 04:12:01 +02:00
Orion
d3e36361df update: ubuntu 22.04 -> 20.04 2024-04-27 08:17:11 +08:00
Orion
8e5649a071 Merge branch 'turboderp:master' into master 2024-04-27 08:15:17 +08:00
turboderp
8b90117da9 Fix BUILDTAG 2024-04-27 02:00:30 +02:00
turboderp
56437ae500 Stay on torch==2.2.2 for ROCm 5.6 2024-04-27 01:47:45 +02:00
turboderp
1d83e2e35f Fix Torch dependency 2024-04-27 01:29:54 +02:00
turboderp
719dba4769 Add ROCm version to job name 2024-04-27 01:25:01 +02:00
turboderp
5722a01c17 Rename ROCm build actions 2024-04-27 01:23:40 +02:00
turboderp
f7d8349379 Add ROCm 6.0 to build matrix, remove ROCm for cp38, cp39 2024-04-27 01:22:19 +02:00
turboderp
f29ef1c3fc Compile wheels against torch==2.3.0 2024-04-27 00:33:14 +02:00
Orion
c54d44fe2b update: pytorch version 2024-04-24 16:18:59 +08:00
Orion
69903fa278 remove: aio build 2024-04-21 14:48:55 +08:00
Orion
e214989202 fix: no pre arg in test channel 2024-04-21 11:36:43 +08:00
Orion
d9c0a549c1 update: specify pytorch 2024-04-21 11:24:19 +08:00
Orion
2a3765cf03 feat: rocm aio build 2024-04-21 10:48:23 +08:00
Orion
db2980173b update: keep large-packages in disk 2024-04-21 00:10:31 +08:00
Orion
042f50d9c1 update: keep tool-cache in disk 2024-04-21 00:01:07 +08:00