You should as well check the capacity of the front changer but I suspect that those that will handle 36 will also handle 32. However...Do not take my word for this. I have been very wrong in the past and it is never impossible that I will be wrong again. Always try and check with the specification documents if you can. Shimano seem pretty good at providing these and they are not too difficult to find in many cases.
You need to find the item code on the piece of equipment you are investigating, e.g. RD 5001 (I've just made that up so it may not exist) which will be stamped somewher on the body of, in this case, the rear deraillieur. Can take a bit of looking for but not usually too hard to find. Then in some cases all I have done is google searched the code. Sometimes had to add "Shimano" This then gives you the link address to the specification document which will tell you more than you need to know about that particular part.
I find that if you just google the name of the piece "Shimano Alivio rear mech" for instance, it will just give you a huge list of where you can buy said item.
I've probably made this sound a lot more complicated than it actually is but it's fairly easy really. Well it is for Shimano and it is if they do actually provide the document you need.
Good luck.