[fitsbits] Fastest way to read a binary table

William Pence pence at tetra.gsfc.nasa.gov
Wed Jul 10 17:06:10 EDT 2002


Thierry Forveille wrote:
> 
> William Pence writes:
>  > In fact having too many buffers will hurt performance
>  > because CFITSIO then spends more time searching to see if the needed FITS
>  > block is already loaded in one of the buffers.  Recent tests on a 'typical'
>  > program seemed to show a slight improvement in overall I/O speed by
>  > increasing the number of buffers to a couple hundred, but increasing it to
>  > several thousand caused the program to run slower.
>  >
> Is that because CFITSIO performs an O(N) search through the buffer list? That
> would certainly make sense for N=50, but for a few thousand it probably
> becomes worth using hashing instead.

Yes, it is just does a simple sequential search through the buffer list.



More information about the fitsbits mailing list