Just put some inserts with arch support in them. Mine don't have a fully rigid sole, just the arch part is made of hard plastic, the rest is flexible leather.
What do you mean, your foot will pop out? Just learn to tie your laces, man :)
If you are worried about shoe height/your foot fitting...