I'm a part-time professional musician.
I love music: When I listen to music, I LISTEN to music. I listen actively; I don't do background music.
I love skiing: When I ski, I want to experience the sights and sounds of skiing; for me, it's part of the kinetic experience.
But that's just me. I don't have a problem with other people listening to music while doing other things, as long as they remain aware of their surroundings.
There you go. When you ski focus on skiing--the sights, the sounds, the smells (marijuana every time you pass a clump of trees). When you listen to music listen. The hip term is mindfulness but I've been thinking that way for a long time. Same reason i don't take a lot of pictures.