I dont think you need to worry about any pipes upstairs getting cold enough to freeze . Just open the closet doors on super cold nights and you should be fine.I have heated my home for 30 years with auxillary heat other than my oil eating furnace and never had a problem with freezing upstairs. Actually it sometimes gets too hot upstairs so I keep my door closed because I like it cooler. Just remember heat rises and plenty gets up there .
Just leave your oil boiler on at at a lower setting and if it gets cold in that zone it will just come on once in a while .
I never had a boiler and I have heard pros and cons about using antifreeze in them .Maybe just plumbers looking for extra work or trying to get out of it.
Cant see why antifreeze would bad myself and if power went out etc. you would have one less worry.