Can PHP be moved through folders on Linux/OSX?

As most of you know, on Windows PHP does not require any specific path to
run, and can be places in any path you want. Now, I'm planning to do a
similar thing on Linux, and later OS X, which both will work the same.

Now, my question: because autoconf requires prefixes for installation, will
using the prefix like /home/user/temp/php, and later moving to another
location, work correctly? If not, what problems can I expect?

-- Bas