I have not made pens for quite a few years, however my wife is still using a fountain pen I made her, and has not had a problem with it drying out.
In the kits I used there was an O ring that sealed between the nib and the back (in hand when writing) section and another that went inside the thread portion of the cap so that should also be mostly airtight.