Ok, I know I can do this, and I know I've done it, but I'll be darned if I can remember how to do it. Basically, I'm building index files for a very large set of raw data, large enough it won't fit into memory very well. So, instead, I'd like to build it out to a file and perform all of my calculations, reads, and writes to disk directly. As eventually this will be running on a SMD SAN data access speeds and read/write block speeds won't be a concern.
Now, I know that I can setup the memory manager for the application to utilize a TFileStream for its allocator and deallocator, but this is a bit overkill. In this case I simply need to have my root records and pointers only go to the file system.
Hopefully this makes sense to someone, but if not ask questions and I'll answer what I can. Due to the nature of the project I can't post source yet. I'm working out a simple version of the problem that isn't related so I can post something to work from.
- Jeremy
Bookmarks