We recently spent the day at Castle in the Clouds in Moultonborough, and it was beautiful! Of course, a sunny day is better if you're planning to do the horseback riding, or walk the trails, but if it's only sprinkling, walking in the woods is doable. The mansion tour, carriage house, and trolley service make it definitely workable in the rain. I'd bet that crowds would be lessened, too.
