Yeah, I figured that's how it should be. The problem in question doesn't seem to be an internet issue as far as I can tell. I'm located in Dallas with a relatively low ping to both east and west servers. That being said, the worlds and everything around load instantly, so do MOST portals.
Only in instances where there are several portals in the near vicinity, do I have moments where I can literally stand on-top of a portal for up to a minute before the game realizes I'm there and loads the correct portal. My chunk cache size is also about as large as it can be.
I have several friends who live in several locations around the US who also experience the same issues. This has been experienced on nearly all planets, specifically, planets on EU, West, and East.
It's certainly nothing major, but frustrating when you're running from a large animal into a group of portals