Illidanerium-KT

Is it just me or do you get an abyss weapon when doing the instance abyssal splinter and as soon as you leave the instance it vanishes out of your inventory. What is up with that ?