This is correct and you wouldn't be the first to propose this. My own knowledge of astrophysics is very limited but if this topic interests you, you might want to read How You Can Explore Higher Dimensions of Time and Space by T.B. Pawlicki. Early on in this book he seems to be suggesting something very similar to what you are speculating about a curved universe. My memory of his book is vague so I may have some details wrong, but Pawlicki seems to have a bizzare, but for that reason very intrigueing, model of the universe in which it is bent somewhat like a torus with an outer and inner 'surface' which can be traveled between at it's 'poles'. Speculative, but worth contemplating.