I just think of it as if I were shopping for a silver GTO: Find one, vin says silver, but the car is red. I'd start asking questions. First thing to come to MY mind is a salvage that was pieced together.
Personally, I'd either look elsewhere or start talking about lowering the asking price.
In my opinion...Yes, it would depreciate the cost. But I guess it all depends on who's looking to buy it.