JSON schema generation for plugins

[akhenakh]

cmd/tools/json_schema_gen is useful to generate a schema definition but it's not designed with plugins in minds:

The only way to generate a json schema including some 3rd party plugin would be to manually patch cmd/tools/json_schema_gen and add import path.

Especially because all those tools are internals:

"github.com/warpstreamlabs/bento/internal/config/schema"
"github.com/warpstreamlabs/bento/internal/docs"

Same problem exist with "github.com/warpstreamlabs/bento/internal/cli/blobl"

blobl.GenerateBloblangSyntax()
blobl.ExecuteBloblangMapping()

One solution could be to create an endpoint that returns the schema definition, for the current Bento, when in streams mode.

Context is I'm working on a visualizer interacting with a bento in stream mode, I would need to gather all inputs/processing/outputs and also registered bloblang funcs.

[gregfurman]

Hey! This is looking great 🤩

The only way to generate a json schema including some 3rd party plugin would be to manually patch cmd/tools/json_schema_gen and add import path.

Would the service.MarshalJSONSchema function suffice for this? You can use it like:

	env := service.GlobalEnvironment()
	schema := env.FullConfigSchema("<version>", "<date>")
	jsonSpec, err := schema.MarshalJSONSchema()
        // do whatever with the json schema for all components in bento environment

Same problem exist with "github.com/warpstreamlabs/bento/internal/cli/blobl"

Seems that the bloblang playground is relevant here 👀

It could be possible to embed it within your visualizer since it's compiled to WASM (see cmd/tools/playground) and used within an iframe on the doc site.