Spaces:
Running
Running
Update README.md
Browse files
README.md
CHANGED
@@ -66,4 +66,4 @@ capacity (it will be improved in Preactor). Limits are:
|
|
66 |
We are working on complete Reactive Neural Networks development framework - [RxNN github](https://github.com/RxAI-dev/RxNN)
|
67 |
|
68 |
## Additional Research
|
69 |
-
- **Sparse Query Attention** - the most cost-effective GQA variant,
|
|
|
66 |
We are working on complete Reactive Neural Networks development framework - [RxNN github](https://github.com/RxAI-dev/RxNN)
|
67 |
|
68 |
## Additional Research
|
69 |
+
- **Sparse Query Attention** - the most cost-effective GQA variant, even 2-3x faster for long sequences! Research in progress - [draft](https://github.com/RxAI-dev/RxNN/blob/main/docs/research/sparse_query_attention.md)
|