Well my wife and I have raised four skiers (one of 'em boards too), ages 12-20. The things I could tell you. Took wife one time to Aspen when we had an infant, except infant stayed home with Grandma. Infant was fine, but my wife suffered seriously until we found an electric breast pump from local mother support org at Aspen. Make sure you have the feeding aspect scoped out before your trip. Since you plan to bring baby with you, and assuming you and wife want to ski together, best thing would be to bring a nonskiing babysitter (much older sibling/relative/grandparent) with you. Even if they were skiers it would be worth it to have extra hands on rotating baby watch. Probably want to avoid going in dead of winter so as not to expose infant to 0 degree temps. Maybe a spring trip would be in order, child will be a little older too. Make sure accommodations supply cribs or other stuff for infant and that mother, father and child have their own bedroom away from others. Bring one of those automatic infant swing sets to calm baby when all else fails and to save the sanity of all in your group. If the infant is over 4 mos or so, maybe having a heated pool attached to your accoms would be something you could take baby along to enjoy with you. I skied on mild days with one and two year-olds in a back pack about a 12-15 yrs ago, but that may be taboo now at most resorts, especially if passenger is younger than one year.
You don't say where you're from or how far from skiing destination. Obviously a long flight or long road trip will be a challenge. If there is decent skiing close to home I'd look at a visit to a smaller, closer place over the grand, expensive trip across country. Having said that, Smugglers Notch VT might be nice in early spring. Not too crowded, convenient base area. Possible baby sitting help for hire. Good skiing for adults. Many other ski areas would also work, slopeside accoms very much preferred in this situation for easy access to/from baby.