This release is an update to support version 3 of text-generation-webui.

The bind mount paths must be updated in the container. Please review the new example docker-compose.yml file for details. TLDR; *:/app/* must be updated to *:/app/user_data/* for most paths.

Changes:

• Update python to 3.11
• Update torch versions
• Update CUDA to 12.4
• Remap bind mount paths
• Remap application paths
• Add grammars folder to config

Notes:

• ROCM and ARC are not tested
• If CUDA 12.1 is required, please open an issue