Skip to content

Update llama.cpp vectors to support default length and batch parameters #983

@davidmezzetti

Description

@davidmezzetti

Update llama.cpp vectors to support default length and batch parameters.

  • Default n_ctx to maxlength if available. Otherwise default n_ctx=0, which sets n_ctx=n_ctx_train.
  • Default n_batch to encodebatch

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions