NohWai Software
Popular repositories Loading
-
RayTention
RayTention PublicRaytention is a new attention mechanism that solves the bloated k-v cache VRAM problem. Raytention utilizes 7 signals from the context to provide the model with the attention it needs at a much low…
Python 1
Repositories
Showing 1 of 1 repositories
- RayTention Public
Raytention is a new attention mechanism that solves the bloated k-v cache VRAM problem. Raytention utilizes 7 signals from the context to provide the model with the attention it needs at a much lower VRAM cost.
NohWai-Software/RayTention’s past year of commit activity
People
This organization has no public members. You must be a member to see who’s a part of this organization.
Top languages
Loading…
Most used topics
Loading…