forget about toe clips, buy some spd pedals and shoes. you can get spd pedals that have a flat side and an spd side. toe clips are only really appropriate these days for track sprinters and people who ride a fixed wheel where spd would be inappropriate (like a commute in work clothing), as clipless pedal systems are safer, counter-intuitive as that sounds.
it's a nice bike, but it's not a classic vintage that needs to be kept as it was on the day it was purchased, so don't feel bad about a bit of customisation here and there…