It might depend on how sensitive a palette you have. I've read where guys refuse to use fruitwood because they say it makes the meat too sweet. If they can taste that, you might be able to taste the boozewood. If you like oak to begin with, it is worth a try.