Data News

Beginning with August 19, 2019 at 13:00 UTC, noise in the form of random horizontal lines over the Eastern Pacific began appearing, with most of the problems appearing each following day in the 12:00, 12:30, and 13:00 half-hours, with at least one instance of 13:30.  This was traced to noise in the GOES-W Tb’s (as the result of the faulty sensor cooling system), which made it past the filtering at CPC, where the Merged Global 4-km IR dataset is assembled.  The Early and Late datasets contain these errors, which will be dealt with in the Final computation.

Keywords:

The combined TRMM and GPM-era (June 2000 – present) IMERG V06B products are now available.  This includes the Final product, as well as the retrospectively reprocessed Early and Late products.  These products are staged in the standard locations.  If you have any questions regarding accessibility please contact us.

As the long-record IMERG products are now available, the TMPA and TMPA-RT products have a planned end date of December 31, 2019.  Users should transition to IMERG during this period.  We are hopeful we can extend the IMERG record back to January 1998 in the near future.  

As always, we are interested in your feedback, especially regarding analysis results. This feedback allows us to improve IMERG and provide answers to any questions you may have. Click here to contact us.
 

Keywords:

IMERG is now available back to June 2000 of the TRMM era.  Both the 'early'
and the 'late' products have been retrospectively processed.  These products are available in the same location on the jsimpson.pps.eosdis.nasa.gov FTP server as the current GPM IMERG products: /NRTPUB/imerg/early/YYYYMM and /NRTPUB/imerg/late/YYYYMM.

We are in the process of retrospectively processing the GIS-friendly versions and accumulations of these IMERG products. This is likely to be completed by the end of September 2019.

               **IMPORTANT**

A very important item is that we have been directed to eliminate ftp to all our servers. We know that many of you have scripts that automatically retrieve data.  PPS is attempting to impact you as little as possible. We are putting up an FTPS server.  This means that as long as you have a client that support FTPS you should be able to use almost extactly the same commands as you currently use.

We will soon announce a public access to this FTPS server. You can then test new FTPS scripts against the FTPS server in parallel with continued retrieval using ftp (thereby not interrupting your operational flow).  We hope to be able to provide this parallel access for six months. After 6 months we will be required to eliminate FTP totally.

Please contact us for any questions.
 

Keywords:

PPS has completed the retrospective processing of IMERG NRT early and late products to version V06B.

All GPM NRT IMERG is available at version V06B from June 2014 through the current IMERG data.

The GPM NRT IMERG from March 2014 through May 2014 will be available once the TRMM era (2000-2014) retrospective processing is completed.

THe V06B data is the default product (early and late) available on the jsimpson.pps.eosdis.nasa.gov NRT file server.

Please contact us for any questions.

 

Keywords:

On 16 June 2019 at 22 UTC several hours of missing IR data and subsequent handling of this outage caused IMERG early and late products to be produced without IR data since that date/time.  To ensure consistent early and late IMERG products it was decided to retroprocess these IMERG early and late products.

All early and late IMERG products from 16 June 2019 at 22:00 UTC through June 19 were retroprocessed. You may wish to download the revised products from 16 June 2019 22:00 UTC  onword.

IMERG early and late are being produced again at their required latency: 
    a. early: approx 4 hours from data collection
    b. late:  approx 14 hours from data collection

We are sorry for the extended unavailability of the products. 
 

Keywords:

Effective around 12:00 UTC 10 June the MHS and ATMS input to real-time IMERG suddenly became unavailable due to an unexpected change in NOAA protocols.  While PPS scrambles to remedy the issue, the data content of the Early and Late Runs may be reduced for the next several days, meaning lower Quality Index due to longer morphing of microwave estimates and greater contributions by IR.

Keywords:

Due to a correction to the GPM IMERG algorithm implemented by the GPM science team, PPS will retract and reprocess all IMERG V06A Final Run GPM and TRMM era data including GIS products as IMERG V06B starting on June 05, 2019.  If you have downloaded IMERG V06A Data previously, please discard this data and use the improved IMERG V06B products as they are produced and archived.

A damaged land/ocean mask file (specifically, a several-gridbox shift to the east and south) was discovered in IMERG V06A,which causes mis-identification of surface type along coasts in theKalman filter computation. While simple to correct, the change in the IMERG results requires shifting to a new sub-version. As of May 22, 2019, the IMERG NRT Early and Late Run files were given the corrected land/ocean mask file and labelled V06B.  The adjustment can be seen in the Early and Late data files starting with June 1, 2019 when the next Kalman statistics were computed.

As was done for V06A, PPS will start the V06B reprocessing with the GPM era, June 2014 - current available data.  This reprocessing will include the GIS products. Once the GPM era is completed, we will start the TRMM-era, June 2000 - May 2014. We will issue necessary update messages as our re-processing effort progresses. The schedule for completing all IMERG V06B processing is not currently known, but will need to reflect balancing the reprocessing with other production computing requirements.

The new V06B TRMM/GPM data products will be made available through PPS's "arthurhou" ftp archive:
ftp://arthurhou.pps.eosdis.nasa.gov/

and STORM (PPS's Online Data Ordering Interface):
https://storm.pps.eosdis.nasa.gov
after the products are produced and archived.

NASA requires that all science data users register in order to access these products.  If you haven't registered, please visit the PPS registration portal at:https://registration.pps.eosdis.nasa.gov/registration/

We apologize for any inconvenience this may have caused and thank you for your attention.  Please inform us if you have any questions or concerns.
 

Keywords:

All IMERG V06A Final products will be retracted later today.  

On Wednesday, June 5, PPS will start the V06B reprocessing beginning with the GPM era, June 2014 - current available data.  Once the GPM era is completed, PPS will start the TRMM-era, June 2000 - May 2014.

Due to capacity loads at PPS, there are no firm estimates as to how long this will take. 

V06A is being retracted due to a corrupt surface coverage file in the Kalman statistics computation.  

Please contact us for any questions.

Keywords:

A damaged land/ocean mask file (specifically, a several-gridbox shift to the east and south) has been discovered in IMERG V06A, which causes mis-identification of surface type along coasts in the Kalman filter computation.  While simple to correct, the change in the IMERG results requires shifting to a new sub-version.  As of May 22, the Early and Late Run files have the corrected land/ocean mask file and are labelled V06B.  The adjustment will be seen in the Early and Late data files starting June 1, when the next Kalman statistics are computed.  Final Run retrospective processing for V06B will begin shortly; more information will be forthcoming.

Keywords:

PPS will be updating GPM 1AGMI data from V05A to V05B today, Thursday May 09, 2019 because there was a minor bug in the algorithm.  Only 1AGMI will change versions.

The L1AGMI executable was previously not filling in a missing scan if there was an error in reading or processing the scan data from the instrument.  Nothing was being generated in the GMI 1A product in this case.  The bug fix was to fill in a missing scan and annotate this in the file header.


+-------+----------------+---------------------+-------+
| AlgId | ProductVersion | StopTime            | SeqNo |
+-------+----------------+---------------------+-------+
| 1AGMI | V05A           | 2019-05-09 12:28:13 | 29508 |
+-------+----------------+---------------------+-------+

Data will be updated to V05B starting with:

+-------+----------------+----------------------+-------+
| AlgId | ProductVersion | StartTime            | SeqNo |
+-------+----------------+----------------------+-------+
| 1AGMI | V05B           | 2019-05-09 12:28:14  | 29509 |
+-------+----------------+----------------------+-------+

PPS replaced one  1AGMI file for orbit 29457 (2019-05-06 04:13:43 ->
2019-05-06 05:46:18)  which was retro-processed as a V05B data product.

1A.GPM.GMI.COUNT2016.20190506-S041343-E054618.029457.V05A.HDF5 - V05A
1A.GPM.GMI.COUNT2016.20190506-S041343-E054618.029457.V05B.HDF5 - V05B
 

Keywords:

Pages