Blizzard has confirmed on the forums that quests rewarding only appearances your character can use is intended, and the beta behavior was likely a bug.
I have made a new Dwarf character because I wanted to level through their starting area and beyond also hoping to unlock some missing transmog pieces. I was under the impression that as of 11.0 once you complete a quest you will unlock all available transmog, even the items that your character can not equip.
However I have noticed that this is not the case while questing through the old world. Is this intended, did I maybe misunderstand how unlocking transmog works?
I’m afraid that this is incorrect, and was most likely a bug during the beta. Sorry.
That’s understandable.
I would definitely suggest sending feedback to our developers about this, this sort of thing could always change in the future. Link.
Beta Behavior
During Beta, we observed quests rewarding all appearances when completing, regardless of which rewards you could use or not.
Interview with Morgan Day
In a Interview during beta, Associate Game Director Morgan Day gave an answer that many interpreted as him confirming the observed pattern, but the answer was ambiguous. Below is the manual transcript of the interview and its link.
The question is phrased correctly and asks directly about cross-armor type rewards, but when answering it, it seems like Morgan Day misunderstood the question and only answered as far as regular transmog goes.
Morgan Day
I'm a collector, I love collecting things, transmog Warbands in The War Within is the greatest thing ever, I think with the transmog collection between different armor types and things like that. We noticed in the testing, we would do quests and it would collect all the appearances for all the different armor types but one of the big questions that people are curious about is, is it retroactive to quests that we've already done? Will we need to redo loremaster or is that going to be a massive
Read more on wowhead.com