It is not true that the only way is to try.
For each additional tooth the radius of a bicycle sprocket (whether front or back) increases by 2mm (2.021mm if you want to be precise...
). So if the top jockey wheel is definitely over 4mm away from the 26T sprocket when you are in that gear now, then it will definitely be fine.
Even if it is not, try adjust the B screw until it is. If you can do that, then it will also be fine.
With a 2T increase, if your chain is as short as can be in terms of length currently, then you will need to add a pair of links (since you can't add just one because adjacent links are not the same, otherwise one will do, because every 4T increase in total from front and back requires an additional pair of links - a pretty accurate rule). However there is a good chance you don't need a longer chain because the current chain is probably not at the length limit. If I were you I would check with a chain length calculator.