This is very exciting. I have tried asking this exact question several different ways, mainly of my husband, who only sort of gets what I’m driving at. It bugs me that I haven’t been able to explain it well.
Unfortunately, VSauce’s conclusion is that there’s no way to know the answer to “Is your red the same as my red?” but it heartens me to know I’m not the only one thinking about this. Yay.