An idea I kept in mind for several years. Finally experimented with it: https://github.com/avodonosov/pocl.
I consider the experiment successful. It could be a useful technique of application acceleration.