Right click friend -> Manage -> Notifications
All are off, but I still get notifications for every message. Not only do I get them in the steam friends list, but on the client itself as a notification bell.