My theory on this is we use the imperial weights when describing the size in relation to the jail time associated with getting caught with it and then switch to metric for personal use.
I guess because no one buys 20 pounds of weed, but 20 grams is just fine...
Gosh, I wonder how many grams there are in a quarter ounce?