Skip to content

AI Model interface CRUD #504

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
lucksus merged 180 commits into from
Dec 5, 2024
Merged

AI Model interface CRUD #504

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
180 commits
Select commit Hold shift + click to select a range
d02acbb
Add types for AI models and a DB table
lucksus Jul 24, 2024
8d92b39
DB Model crud and change Model enum to a struct with Options for GraphQL
lucksus Jul 25, 2024
0376943
Model CRUD GraphQL definition
lucksus Jul 25, 2024
231bcd1
Remove enum decorator
lucksus Jul 25, 2024
17f2f08
String instead of enum
lucksus Jul 25, 2024
ea31ddb
Model CRUD resolvers
lucksus Jul 25, 2024
4b658fd
Model CRUD integration tests
lucksus Jul 25, 2024
e415666
Refactor model type to use string instead of enum
fayeed Sep 25, 2024
b9e345c
Refactor model type to use string instead of enum
fayeed Sep 25, 2024
52e67c3
Refactor model type to use string instead of enum
fayeed Sep 25, 2024
7833a2b
Merge branch 'dev' into llm-crud-and-interface
fayeed Oct 3, 2024
de5b547
Refactor model type to use string instead of enum
fayeed Oct 3, 2024
723b8bc
Refactor model type to use string instead of enum
fayeed Oct 3, 2024
d90c67c
Fix build issues
fayeed Oct 4, 2024
4911735
Fix format issues
fayeed Oct 4, 2024
45f3d5f
Start on model selection & UI updates for launcher
jhweir Oct 9, 2024
2631afb
Merge branch 'local-ai' into llm-crud-and-interface
lucksus Nov 18, 2024
f898940
Fix cargo.lock after merge
lucksus Nov 18, 2024
969d7cf
Fix merge
lucksus Nov 18, 2024
2903f35
Merge branch 'dev' into llm-crud-and-interface
lucksus Nov 18, 2024
08cb73a
Merge branch 'dev' into llm-crud-and-interface
lucksus Nov 19, 2024
7e8d4c9
Fix merge, add some derives
lucksus Nov 19, 2024
030fb7f
Misc launcher UI clean up
jhweir Nov 20, 2024
1e7aa22
Move model crud functions from "runtime" to "ai" interface scope
lucksus Nov 20, 2024
79d9789
fmt
lucksus Nov 20, 2024
492cfef
Also rename queries to ai scope in client implementation
lucksus Nov 20, 2024
40350e3
Fix syntax error in ai.ts
lucksus Nov 20, 2024
58880f2
Start on external LLM usage & model selection
jhweir Nov 20, 2024
0474684
Fix DB test imports
lucksus Nov 20, 2024
9b7a9e3
fmt
lucksus Nov 20, 2024
d1444e5
Merge commit '58880f227e18d0e9eb10d1bc3fd9791271fc4a67' into llm-crud…
lucksus Nov 20, 2024
309b08b
Deactivate WIP code that doesn't compile
lucksus Nov 21, 2024
9e48e5e
clippy
lucksus Nov 21, 2024
40488d4
fmt
lucksus Nov 21, 2024
b2cd3b0
Update V8 revision, fixing rebuild issue
lucksus Nov 21, 2024
86179c6
WIP: LLM spawning from Model type, using Kalom's Gpt4 type for remote…
lucksus Nov 21, 2024
61a81a5
fmt
lucksus Nov 21, 2024
a5922e3
clippy
lucksus Nov 21, 2024
f4d49e0
Spawn "default" LLM model on startup
lucksus Nov 21, 2024
4763f91
AI models & tasks page updates in launcher
jhweir Nov 22, 2024
a532fb8
dev script & url added for tauri ui
jhweir Nov 22, 2024
4b85cc8
Proper serialise model_type to DB column so it can be deserialised wi…
lucksus Nov 22, 2024
48a77f0
Update rusty_v8 fork to a new rev that works with debug builds
lucksus Nov 22, 2024
8b917b2
Update rusty_v8 fork to a new rev that works with debug builds
lucksus Nov 22, 2024
c9d59a4
Turn on AI tests, but skip transcription test
lucksus Nov 22, 2024
9dcd6d1
Align declaration of ModelType property name and enum with Rust Graph…
lucksus Nov 22, 2024
90cacf1
Rename `type` to `modelType` also in smoke test
lucksus Nov 24, 2024
1689faa
Try activating Tauri shell plugin for opening of links from launcher
lucksus Nov 24, 2024
8a82879
Launcher AI tab UI fixes & error logging
jhweir Nov 24, 2024
23be28e
Login clean up & addModel updates
jhweir Nov 24, 2024
c46c188
Unit test for model_status on DB
lucksus Nov 24, 2024
26caa31
Merge commit '23be28e2e606b2bf34ac420102c6fbc0fb53f60a' into llm-crud…
lucksus Nov 24, 2024
7015ff1
Fix Tauri capabilities to apply to AD4M window and also during debug
lucksus Nov 24, 2024
0882887
ModelTypes capitalised to match AIResolver
jhweir Nov 25, 2024
4c5bf12
Hardcoded names replaced with model names in db when spawing llm & em…
jhweir Nov 25, 2024
464b5a9
Transcriber model name retreived from db & used to publish model stat…
jhweir Nov 25, 2024
c482e50
Initialise model on add
lucksus Nov 25, 2024
94eff14
fmt
lucksus Nov 25, 2024
b197ec5
Cleanup AIService::load()
lucksus Nov 25, 2024
282444d
Default model
lucksus Nov 25, 2024
4cfcf6a
Fix imports of runtime integration test
lucksus Nov 25, 2024
de54541
Align JS and Rust GraphQL interface for new default model queries
lucksus Nov 25, 2024
050fdde
Spawn Bert model if there is now model in the DB, for integration tests
lucksus Nov 25, 2024
6d37531
fmt
lucksus Nov 25, 2024
930f883
Model name inputs, validation, & layout tweaks to AI section of Login…
jhweir Nov 25, 2024
fa6d20e
Launcher styling fixes
jhweir Nov 25, 2024
b3184a2
Close menus on option selection
jhweir Nov 25, 2024
ab6be87
Write default model when adding (so last added model will automatical…
lucksus Nov 25, 2024
f6bb09b
Merge commit 'b3184a255649b03171e803c0eaa12c52bd62b56d' into llm-crud…
lucksus Nov 25, 2024
6b0994d
Font family & styling fixes
jhweir Nov 25, 2024
77f0cd1
Fix "main key not found" / poison error on startup - don't read did f…
lucksus Nov 26, 2024
13dbbf6
Merge commit '6b0994d9bd911a777b817d437fff8c6e8344f64b' into llm-crud…
lucksus Nov 26, 2024
1ecfbd1
Logo css class added to simplify code
jhweir Nov 26, 2024
ce29f39
Set device on llama model
lucksus Nov 26, 2024
d0c5c01
Prevent deadlock on agent-generate
lucksus Nov 26, 2024
b1b8586
fmt
lucksus Nov 26, 2024
2503562
Splashscreen updates
jhweir Nov 26, 2024
be08caf
TrayMessage fix
jhweir Nov 26, 2024
22c38b8
Update Kalosm to latest dev commit which updated candle to 0.7 - and …
lucksus Nov 26, 2024
dfb9c22
Update Kalosm fork and set candle devices to Cpu for Bert and Whisper…
lucksus Nov 27, 2024
295d29d
Login flow updates & styling
jhweir Nov 27, 2024
350f2b6
Fix for radio button not being selected by prop on first load
jhweir Nov 27, 2024
017cd9b
Scroll added to login flow & app window resized for long pages
jhweir Nov 27, 2024
4324d41
AI section set up with new model creation
jhweir Nov 27, 2024
9d42ae6
ModalModel component & editing models set up
jhweir Nov 27, 2024
ec68fcf
API key fix
jhweir Nov 28, 2024
0a890e3
ModelCard set up
jhweir Nov 28, 2024
d4292c2
Color fixes
jhweir Nov 28, 2024
f7ecbaa
Model name & api details added to ModelCard
jhweir Nov 28, 2024
bca9f10
More color & positioning tweaks
jhweir Nov 28, 2024
c14b80c
Card styling updates
jhweir Nov 28, 2024
d63c28f
Merge commit 'c14b80cac9a68a89f3f932e0ee448bba9fb5ca3a' into llm-crud…
lucksus Nov 28, 2024
b7c6a52
Remove accidentally committed metal feature
lucksus Nov 28, 2024
2339740
ModelCard overflow wrap fix for long strings
jhweir Nov 28, 2024
b65424f
Tasks & edit button removed from embedding & transcription models
jhweir Nov 28, 2024
e3e2286
removeModel function hooked up
jhweir Nov 28, 2024
bfc0233
AI mode radio button & text updates
jhweir Nov 28, 2024
07b5d33
API test set up
jhweir Nov 28, 2024
2939aac
API test added to model creation after initialisation
jhweir Nov 28, 2024
b274a3e
WIP: use IDs to refer to models, add db.get_model(id)
lucksus Nov 28, 2024
63789c5
WIP: model id - fix ModelApiType parsing
lucksus Nov 28, 2024
55efc72
WIP: model id - simplify get_default_model resolver
lucksus Nov 28, 2024
6f8153e
model id - adjust tests, removeModel uses ID now
lucksus Nov 28, 2024
320b6e0
Have get_model(id) return Option<Model>
lucksus Nov 28, 2024
8b04414
Don't allow setting of non-existent default model
lucksus Nov 28, 2024
429f3b4
fmt
lucksus Nov 28, 2024
a44ff4b
clippy
lucksus Nov 28, 2024
c3b1637
Align interface parameter names
lucksus Nov 28, 2024
48104f5
Use id in default_model integration test
lucksus Nov 28, 2024
a24fb23
Align interface parameter names
lucksus Nov 28, 2024
4d9dd60
Have add_model return id
lucksus Nov 28, 2024
708d9e0
Have add_model return id
lucksus Nov 28, 2024
1414d61
update_model DB
lucksus Nov 28, 2024
b0992bf
update_model
lucksus Nov 28, 2024
54a3db5
Adjust test assertion
lucksus Nov 28, 2024
bc8b2a1
Merge commit '2939aac11e019f4ac2917268dcb8ae43afcc5df1' into llm-crud…
lucksus Nov 28, 2024
0fd33d8
fmt
lucksus Nov 28, 2024
0d22d36
Adjust test assertions
lucksus Nov 29, 2024
19f6128
Add id field to qraphql query
lucksus Nov 29, 2024
9843744
Add id to getDefaultModel()
lucksus Nov 29, 2024
4288c29
Use model id in spawn_llm_model
lucksus Nov 29, 2024
086338e
Model id used in model CRUD & default model settings added
jhweir Nov 29, 2024
a1dfc2c
Reorder AIService functions to model sections
lucksus Nov 29, 2024
106e25c
Update model bug fix
jhweir Nov 29, 2024
77ad319
Merge commit '106e25cd0492043a7974569cea385c236db6352f' into llm-crud…
lucksus Nov 29, 2024
84653da
Have model status use ids
lucksus Nov 29, 2024
40f6459
Apply "default" model in task description on prompt
lucksus Nov 29, 2024
d99ba79
Fix-up model status integration test
lucksus Nov 29, 2024
e5e3801
Default model button disabled
jhweir Nov 29, 2024
d93d0df
Model id use to check model status
jhweir Nov 29, 2024
1a038ce
Apply "default" model in task description in all relevant functions
lucksus Nov 29, 2024
a0c3907
Test and fix Task CRUD
lucksus Nov 29, 2024
940bea6
Respawn of default tasks when default model gets set
lucksus Nov 29, 2024
d7f8bdf
fmt
lucksus Nov 29, 2024
7ce7aab
Merge commit 'd93d0dff07e774e14e51a8b834bfaba403aaeecb' into llm-crud…
lucksus Nov 29, 2024
9a32e5f
New AI mode cards set up
jhweir Nov 29, 2024
3cb49dd
Fix AgentService unit tests after changing did() implementation earlier
lucksus Nov 29, 2024
1fd9074
More resilient ModelApiType.from_str()
lucksus Nov 29, 2024
a547fb5
fmt
lucksus Nov 29, 2024
77ad0b3
Merge commit '9a32e5f437cc47685e23e1718019f1b0b819e5a3' into llm-crud…
lucksus Nov 29, 2024
db7e49f
Don't automatically set model as default when adding
lucksus Nov 29, 2024
7fa7895
Set default LLM model after created in login process
jhweir Nov 29, 2024
657a020
clean
lucksus Nov 29, 2024
3aba0c6
Padding fix
jhweir Nov 29, 2024
1559c9f
Merge commit '3aba0c6584a1aa27c360668776c753dba690a7f1' into llm-crud…
lucksus Nov 29, 2024
c562bed
Actually use model_id in embed and show which models are available in…
lucksus Nov 29, 2024
f97bbd6
Increase remote LLM response max length
lucksus Nov 29, 2024
8702008
fmt
lucksus Nov 29, 2024
c726cbb
Embedding model renamed to "bert" in login process
jhweir Nov 29, 2024
5a1d15f
Set remote LLM response max length to 10.000
lucksus Nov 29, 2024
cb5d2e2
no message
lucksus Nov 29, 2024
ea23be7
Model task UI fixes
jhweir Dec 2, 2024
075674d
Prevent high CPU load by putting Bert and LLM threads to sleep for so…
lucksus Dec 2, 2024
943d717
Replace tokio::time::timeout with a select! and sleep, to prevent tok…
lucksus Dec 2, 2024
f34fb07
Merge commit 'ea23be781cc48fe1e50a32048fdff6e2d8fff7ea' into llm-crud…
lucksus Dec 2, 2024
77ef499
fmt
lucksus Dec 2, 2024
bd59379
Fix bert test after changing function signature
lucksus Dec 2, 2024
793895b
Tab justification UI tweak
jhweir Dec 2, 2024
af21274
zindex fix on line 66 (+ eslint format)
jhweir Dec 2, 2024
119ea62
fmt
lucksus Dec 3, 2024
99a0551
Replace Kalosm's Gpt3_5 with another crate that can speak Gpt4 chat s…
lucksus Dec 4, 2024
4cb7043
Remove "remote" feature from Kalosm import
lucksus Dec 4, 2024
bf932c6
Remove "/v1" from path if it's already set (chat-gpt-lib-rs adds it i…
lucksus Dec 4, 2024
bda4e85
Actually send the prompt to the API
lucksus Dec 4, 2024
39a09c0
fmt
lucksus Dec 4, 2024
ce7aeb4
cargo.lock
lucksus Dec 4, 2024
131dc05
changelog
lucksus Dec 4, 2024
2bad2bf
Merge branch 'dev' into llm-crud-and-interface
lucksus Dec 4, 2024
2dd5448
Fix notification plugin intialisation after updating to Tauri 2
lucksus Dec 4, 2024
37c13af
Don't block anything while waiting for notification webhook connectio…
lucksus Dec 4, 2024
394d517
Fix type return type of addModel() mutation, and deactivate smoke tes…
lucksus Dec 4, 2024
9456138
Merge branch 'dev' into llm-crud-and-interface
lucksus Dec 4, 2024
3f5693f
WIP: model status with errors
lucksus Dec 5, 2024
692a240
Don't panic if not compiled with metal or cuda but default to CPU
lucksus Dec 5, 2024
8e01b1c
Merge branch 'llm-crud-and-interface' into llm-crud-status-with-errors
lucksus Dec 5, 2024
149131e
Fix ModelCard for tasks undefined
lucksus Dec 5, 2024
bcae6e6
Remove model loading progress println!
lucksus Dec 5, 2024
fa44c75
fmt
lucksus Dec 5, 2024
171ddd6
Revert pnpm.lock to try fixing install problems on CI
lucksus Dec 5, 2024
30a468d
clippy
lucksus Dec 5, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 2 additions & 0 deletions CHANGELOG
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -29,6 +29,8 @@ This project _loosely_ adheres to [Semantic Versioning](https://semver.org/spec/
- App notifications implemented. ADAM apps can register Prolog queries with the executor which will be checked on every perspective change. If the change adds a new match, it will trigger the publishing of a notifications via subscriptions in client interface [PR#475](https://github.com/coasys/ad4m/pull/475), as well as calling a web hook if given [PR#482](https://github.com/coasys/ad4m/pull/482)
- Support ADAM executor hosting service alpha [PR#474](https://github.com/coasys/ad4m/pull/474)
- Complete instructions in README [PR#473](https://github.com/coasys/ad4m/pull/473)
- Local AI inference for LLMs, embedding models and Whisper audio transcription [PR#522](https://github.com/coasys/ad4m/pull/522)
- Full CRUD systems for choosing AI models, remote models through API calls and UI in ADAM Launcher for setup and managing of models [PR#504](https://github.com/coasys/ad4m/pull/504)

### Changed
- Partially migrated the Runtime service to Rust. (DM language installation for agents is pending.) [PR#466](https://github.com/coasys/ad4m/pull/466)
Expand Down
Loading