Aha! As always the devil is in the details. This last comment you left gave me the hint I needed. I was putting the asterisk in the wrong place and also using parentheses instead of curly braces. The following command works just like I want: 

scp *.{mp3,ogg} 
jonserver:~/destination/dir/

Thanks, Dave!