[Feature Request] Change output html file encoding to UTF-8 (No BOM)

[filzrev]

Is your feature request related to a problem? Please describe.
I've created PR #9131 before.
And that PR is reverted because of #9171 issue reported.
(It's not a problem on PR itself. But caused by external scripts that don't properly handle encoding)

Describe the solution you'd like
Merge #9131 PR with breaking change release note.

Additional context
I've created this issues for Reminder purpose.