Sorry, I just realized that the option is in the "Backup Plans" tab when expanding a plan. It's definitely disabled.

I don't think so, or at least I didn't enable it on purpose, but I can't actually find that option on the backup plans, I only see the checkbox to enable encryption, the algorithm and the password, where is the filename encryption option?