As of version 1.1; it is possible to teleport with your horse. The player can achieve this by riding on the horse right under the obelisk while they interact with the obelisk.
+
As of version 1.1, the player can ride a horse directly below the obelisk and then interact with the obelisk while still mounted, thus transporting both animal and rider.