Mindstorms USB connection and memory

Mindstorms NXT experts,

Okay, so I am working with my NXT and it occurs to me that the brick has a USB
connection. USB connections are bidirectional meaning that information can go
both ways. 

Skip ahead to me wanting to embed a USB memory key into a LEGO brick like so
many others have done and a thought occurs to me. Maybe a USB key could be used
to store more program on the USB key (thumb drive).

Does anyone know if a program could be stored on a USB Key and then connected to
the NXT brick and the program run from the memory on the USB Key.

Or am I crazy?

Todd