If you're unsure with what "window shopping" is, you're essentially just browsing stores for potential purchases. That being said, have you ever found yourself doing it online? I can browse Amazon for hours and not buy anything lol.
I've done that before. Sometimes it's items on the Wish List that we may not be able to afford now, or don't want to afford, can't have, etc, but would be nice in the future.