[BUG] Unable to change any cluster setting: all `PUT /_cluster/settings` fail with `unknown setting [archived...]` on an unrelated parameter

[AMoo-Miki]

Describe the bug
Upgrading from OS 2.3.0 to 2.8.0, I am unable to change any cluster setting. All calls result in a 400. For example

PUT /_cluster/settings
{
  "persistent" : {
    "logger.org.opensearch.index.reindex" : "DEBUG"
  }
}

results in

{
  "error": {
    "root_cause": [
      {
        "type": "illegal_argument_exception",
        "reason": "unknown setting [archived.plugins.index_state_management.template_migration.control] did you mean any of [plugins.index_state_management.template_migration.control, opendistro.index_state_management.template_migration.control]?"
      }
    ],
    "type": "illegal_argument_exception",
    "reason": "unknown setting [archived.plugins.index_state_management.template_migration.control] did you mean any of [plugins.index_state_management.template_migration.control, opendistro.index_state_management.template_migration.control]?"
  },
  "status": 400
}

Host/Environment (please complete the following information):

• OS: Windows
• Version: 2.8.0

Additional context
To eliminate the archived, I had to:

PUT /_cluster/settings
{
  "persistent" : {
    "archived.plugins.index_state_management.template_migration.control": null
  }
}

[AMoo-Miki]

PS, the expected behavior would be for archived.* to be ignored and not raise an exception.

[saratvemulapalli]

This is how it works, by design. If there are any unknown settings, OpenSearch doesn't allow changing any other settings without clearing it.
While there are few gotcha's like #2609 chicken and egg problems, since they are archived we could consider them as non-existent. Its an enhancement instead of a bug :)

[AMoo-Miki]

Sarat, this is not a feature request; it is a bug. The user did not add the "archived.*" setting; OpenSearch did. And now, the logs are riddled with errors.