As of zathura 0.4.0 & girara 0.3.0, calling :set window-title-basename doesn't affect an already open document; the file needs to be reloaded (or reopened) for the option to take effect. It seems it would be nicer if the reload step was not necessary.