[fitsbits] BINTABLE convention for >999 columns

[Demitri Muna]

Hi,

I agree with Rob here; the simplest solution is to spread the data into two or more extensions. It's not a lot of work for the end user to concatenate the columns into a single data structure if that is preferable for some reason. Creating a new convention that is not part of the FITS standard *does* create a lot of work for many people. While you may be able to create a technically valid FITS file, this proposal is not in the spirit of how FITS files are to be read. This proposal literally redefines the meaning of the mandatory "TFIELDS" header from the "number of columns in the table" to "number of columns in the table, except if there are other keywords, then in that case look elsewhere for this information".

On Jul 7, 2017, at 7:09 AM, Mark Taylor <m.b.taylor at bristol.ac.uk> wrote:

> I'm posting the details here in case people want to comment,
> or point out some major problem with the idea that I might have
> overlooked, or tell me that there's already a convention for
> this out there that I should be using instead.  Otherwise, please
> feel free to ignore this post.  I'm not requesting that any
> other software implements this, though if anyone wants to I
> certainly don't object.

I don't think it's as simple as that. It's one thing to implement this in the software you support, but there are other FITS viewers/readers (Astropy and cfitsio being the main ones, whatever IDL routines there are, not to mention Nightlight). I think it would be wrong for the other programs to implement this without it being part of the standard, and I think it's a bad idea to fork the standard with a custom implementation. Feelings about standards aside, this provides for a bad user experience. It's a legitimate question/frustration for a user to wonder why some columns appear in one program and not many others, especially when the file claims to be a FITS file.

I agree that there are limitations in the FITS format, but I strongly suggest that the only way forward for this idea is to propose it (or something similar) as part of the official FITS format or else use multiple extensions.

Cheers,
Demitri


http://nightlightapp.io

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://listmgr.nrao.edu/pipermail/fitsbits/attachments/20170707/cd9361c6/attachment-0001.html>