It shouldn't be necessary.
Actually in mine code it's vice versa: then returning back to windowed mode I use (but it's mainly bacause for fullscreen mode I use created by myself window - not VCL form):
[pascal]function TMainForm.XXXXXXX: HResult;
begin
...
SetFocus;
Application.BringToFront;
...
end;
[/pascal]