The best adhesive for a given material is one that is based on that material. Regular latex will work well but I'd use the carpet stuff because it's not just pure latex but a latex based adhesive and is very sticky and gummy. You'll need to give it a lot of dry time cuz that stuff stays tacky for a long time.
Needless to say you'll have to touch up the paint job where the repair was made.
When choosing between two evils, always go with the one you haven't tried yet.