I suspect as well that this might be a matter of interpretation, as whilst mithral is treated as one category lighter "for purposes of movement and other limitations," there are certain things that this does not affect, such as what proficiency you need.
I'm not sure off-hand what armor master is from, so can't check the wording of that, but it might well be that they don't combine like that.