How about creating a symbolic link to the library in the /usr/lib/ directory?
It worked for me when I could not link to the glu library.

Or maybe it is enough to run ldconfig?

You could also look at sdl.pas in JEDI_SDL to see how it is done there.