There have been several suggestions from experienced forum members on this subject.
In addition to wiping down with baking soda, it has been suggested to stuff the pipe ends with wads of newspaper to absorb moisture from the humid summer air.
If the pipe is assembled like for a wood chimney, any moisture will drain back into the pipe at the joints. The male end of the pipe faces down, so there shouldn't ever be any moisture in the joint. The silicone is still a very good idea.