At this time all addresses that target a single mailbox will use the autoresponder for that mailbox.
I'll make a note of your interest in having autoresponders attached to addresses instead. In the meantime, you could work around it by creating an additional mail user for each unique autoresponder that you need and attach those mail users to their respective addresses.