[fitsbits] Fastest way to read a binary table

Thierry Forveille forveill at cfht.hawaii.edu
Wed Jul 10 16:38:21 EDT 2002


William Pence writes:
 > In fact having too many buffers will hurt performance
 > because CFITSIO then spends more time searching to see if the needed FITS
 > block is already loaded in one of the buffers.  Recent tests on a 'typical'
 > program seemed to show a slight improvement in overall I/O speed by
 > increasing the number of buffers to a couple hundred, but increasing it to
 > several thousand caused the program to run slower.
 > 
Is that because CFITSIO performs an O(N) search through the buffer list? That
would certainly make sense for N=50, but for a few thousand it probably
becomes worth using hashing instead.



More information about the fitsbits mailing list