To be honest – it is a first kind of this report.
I cannot reproduce it on my magic mouse on macOS – I suppose that you have some special “go back” button on your mouse.
Also I cannot reproduce this issue using shortcut used for “Go back” action on Chromium.
(yes, Publii is based on Electron so it is a browser-based desktop app).
Do you appreciate the support you've received today? If so, consider donating to the Publii team by clicking here; we'll be sure to use your donation to make Publii even better!