Search results

Any plan for integrating DPO?

Status: Open.

#104 In RWKV/RWKV-infctx-trainer;

· petergaoshan opened on Oct 14, 2024

Is the state gradient not implemented yet for the CUDA kernel? (hence bptt_truncated_learning still forced to be True?)

Status: Open.

#102 In RWKV/RWKV-infctx-trainer;

· shouldsee opened on Jul 31, 2024

Is the training of the RWKV-6 model not yet applicable?

Status: Open.

#86 In RWKV/RWKV-infctx-trainer;

· wooks186 opened on Feb 19, 2024

[Feature] Support byte wise / character level encoding

Status: Open.

#67 In RWKV/RWKV-infctx-trainer;

· PicoCreator opened on Jan 25, 2024

[Feature] Run OpenAI compatible API server for eval harness

Status: Open.

#30 In RWKV/RWKV-infctx-trainer;

· PicoCreator opened on Sep 14, 2023

Suggestion: trainer should do warning for low disk space

Status: Open.

#27 In RWKV/RWKV-infctx-trainer;

· PicoCreator opened on Aug 26, 2023

[Feature] positive / negative data support (aka RFHL)

Status: Open.

#21 In RWKV/RWKV-infctx-trainer;

· PicoCreator opened on Aug 23, 2023

[Feature] LoRA support

Status: Open.

#20 In RWKV/RWKV-infctx-trainer;

· PicoCreator opened on Aug 23, 2023

[feature] handle multiple dataset seperately, and log loss on them seperately

Status: Open.

#15 In RWKV/RWKV-infctx-trainer;

· PicoCreator opened on Aug 22, 2023