I like this idea. You're pretty brilliant.

The stats DO come into play, mostly in the form of battling. All monsters will have a fixed amount of health points, attack points, etc, that correlate to our own points. The higher yours get, the more likely you are to survive.