Looking for your thoughts on a few things, such as the theory of infinite universes?
The fact that your experience of consciousness and reality may not be the same as someone elses?
Even that we may not all see colors the same?
These are the things I think about.
There is no such thing as a theory of infinite universes. hypothesis, maybe

Theory = proven hypothesis. Hypothesis = educated guess (in simplest terms). but to answer what I assume you are asking, I often wonder the same. I wonder if time is straight and narrow or a split infinity.
what really makes me wonder about re-incarnation and stuff like that is when I was really young i had a dream several times over a few years. always with me in a classroom of the same kids. Eventually I made it to Junior High in real life and lo and behold; in a class of those same kids from my dream. It is something I well on and wonder about. I can't chalk that up to coincidence and I wonder if / why it is so significant that I had the dream over 3 times several years before meeting them all.
I don't get the color part of your post though. What does colorblindness and similar have to do with the philosophical questions posed before it?
We may all perceive colors differently. What I mean is: the way I perceive red could be how you perceive yellow.
We are all taught the labels of colors, so we can all recognize what one color means; that doesn't necessarily mean that we all see colors in the same way.
Like what if everyone's favorite color is the same they just see it differently, like say mine is blue, and yours is red; we could be seeing the same hue, but were taught different labels for them. If any of that makes sense to you...