Skip to content

ATL08 granule downloads fail with error due to metadata file #30

Description

@trey-stafford

I tired downloading a granule of ATL08 with the DAT's python script today and encountered this error:

$ python nsidc-download_ATL08.007_2026-04-23.py
Querying for data:
         

Found 1 matches.
Downloading 3 files...
1/3: ATL08_20251024195254_06152902_007_01.h5
  [============================================================] 100%  4.4MB/s
2/3: ATL08_20251024195254_06152902_007_01.iso.xml
  [============================================================] 100%  7.9MB/s
3/3: ATL08_20251024195254_06152902_007_01.h5_KOiFgTqo
Traceback (most recent call last):
  File "/tmp/testbad/nsidc-download_ATL08.007_2026-04-23.py", line 613, in <module>
    main()
  File "/tmp/testbad/nsidc-download_ATL08.007_2026-04-23.py", line 607, in main
    cmr_download(url_list, force=force, quiet=quiet)
  File "/tmp/testbad/nsidc-download_ATL08.007_2026-04-23.py", line 341, in cmr_download
    length = int(response.headers["content-length"])
TypeError: int() argument must be a string, a bytes-like object or a real number, not 'NoneType'

This appears to be due to the included ATL08_20251024195254_06152902_007_01.h5_KOiFgTqo, which seems to point to an OpenDAP URL: https://opendap.earthdata.nasa.gov/collections/C3565574177-NSIDC_CPRD/granules/ATL08_20251024195254_06152902_007_01.h5_KOiFgTqo.

The link rel is http://esipfed.org/ns/fedsearch/1.1/metadata#. Our code is setup to filter out metadata files that have this rel and where the filename ends in .dmrpp or the filename is s3credentials. Maybe we need to broaden our filter to exclude any metadata files?

I haven't tested this in EDD, but I suspect it might also run into problems.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Fields

    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions