Support running without FlashAttention?

[Project627]

Great work — this project has really clarified a lot of my previous doubts!
I’m trying to run it on an RTX 2080Ti, where FlashAttention is not supported.
Does this model support running without FlashAttention?

[Dyb3438]

@Project627 Thanks for your interests and suggestions. We will attempt to update a version without FlashAttention required in a few days.

[fallbernana123456]

@Project627 Thanks for your interests and suggestions. We will attempt to update a version without FlashAttention required in a few days.

Looking forward to the update, as there is no flash attn, it cannot run