You should do some research on Anthracite. Don't just take our word for it. No other fuel can give you the BTU's to your heating dollar like Anthracite does and it burns clean with literally no smoke. Not to mention keeping the money one spends here in the US.
I heat my home for less the $400 a year on Anthracite in New England. My neighbors can and often do spend over $400 a month on oil and I promise you my home is a lot warmer.
There are several members here on this site who are in Rhode Island. One of them "Stove Hospital" restores antique stoves.http://stovehospital.com/
Take a ride out and visit them. A restored Base Burner would fit right in with your "new" Victorian".
Don't be shy about asking questions here either. People on NEPA love to help and will help.