Possible to not use the registry and store everything to INI files?

Possible to not use the registry and store everything to INI files?

I have a friend who has developed a program but we want to make the program 'portable' so one can install it on a USB flash stick and then move it to another computer and it will still work.

To do that we have to not be using the registry at all, so we could just have all the files zipped up and have the .exe executable which would run once double clicked.

Take for example the popular website (portableapps.com) and how they make it portable. That's what we want. But his code is in Delphi.

Is it possible to make the application not use the registry and just use INI files or something else instead?