Be honest, does this short story plot sound too weird and stupid?

No, I don't think it sounds weird or stupid :). It actually sounds interesting, but does anything else happen? If you write it right, it'd work, I think. It just seems to end a bit abruptly or quickly reading this summary.