It's true that an apostrophe can be used when letters are omitted, but this doesn't seem correct.
I agree, it doesn’t look correct but as far as my knowledge of the vernacular goes I believe it is acceptable.
It’s probably down to the fact that ref’ is commonly written without the apostrophe even though it should have it. Maybe its use is so common that ref has become a word itself?