CDIP banner
CDIP banner recent historic documents
sub-menu
Documentation
 
FAQs & Summaries
Glossary
Publications
 
Introduction
  History and Funding
  Program Goals
Wave Measurement
  Wave Generation
  Wave Dynamics
  Irregular Waves
  Spectral Analysis
  Gauging Waves
  Hurricane Events
  Tsunami Events
Instrumentation
  Underwater Sensors
  Surface Buoys
  Meteorological
Data Acquisition
  System Organization
  Hardware
  Software
Data Processing
  System Organization
  Software
  Quality Control
Data Management
  Stations and Sets
  Files and Storage
CDIP Products
  Data Formats
  Web Products
  COOS Integration
  WIS
  QARTOD
  Wave Eval Tool
  Metadata
  Custom Products
  NDBC XML/NWS Format
  NDBC Dial-A-Buoy
  Access Instructions
 
Related Links
 


CDIP Archive Files
------------------

CDIP now maintains two separate archives with two distinct types of information:

   1 - the channel archive, for all single-sensor parameters; and
   2 - the processing archive, with fields describing how a station as a
         whole should be processed. This includes indicating how different
         channels are combined in the processing and data products.



The Channel Archive
-------------------

The channel archive consists of a header and lines of comma-delimited data.
The header includes the fundamental, unchanging attributes of a station: 
the name, the station number, etc. The lines of data following the header,
meanwhile, are composed of all the attributes that are sensor-dependent 
and change through time. (For maximum flexibility, it is assumed that ANY 
channel attribute may change.) Each line of data contains a channel number, 
a frame number, and all of the corresponding field values.

	Name: WHATEVER
	Station: 183
	Funding: USACE/CBDW
	Operator: CDIP
	Decomissioned: --------
	--------------------------------------------------
	1,1,Channel Entrance Surge,1999081900,2000010100,32 51.187,117 21...
	1,2,Southwest Corner,2001020100,----------,30 43.0,81 18.0,2,...
	2,2,Northeast Corner,2001020100,----------,30 43.0,81 18.0,2,...
	etc.

Each line of data - known as a "time frame" - will include the 26 following 
fields:

	1. channel: integer, range 1 to 20

	2. frame: integer, range 1 to 50

	3. description: string, maximum 50 chars. "BUOY", "ARRAY", etc.

	4. installation date: string, 'YYYYMMDDhh'. Note that the frame opens
		at the very beginning of the given hour - if 2002122308, the
		frame is open from 2002-12-23 08:00:00

	5. removal date: string, 'YYYYMMDDhh'. Note that the frame closes
		at the very end of the given hour - if set to 2002122308, the
		frame closes at 2002-12-23 08:59:59. To denote an unknown
		date in the future (for the removal date of a sensor currently
		in use), the date 2100010100 is used.

	6. data type: indexed integer, chosen from the following list.
		1.  'Water column (cm)         '
		2.  'Vertical displacement (cm)'
		3.  'Datawell vectors          '
		4.  'Air temperature (C)       '
		5.  'Sea temperature (C)       '
		6.  'Wind speed (cm/s)         '
		7.  'Wind direction (T)        '
		8.  'Air pressure (mb)         '
		9.  'Sensor orientation (T)    '
		10. 'Current speed x (cm/s)    '
		11. 'Current speed y (cm/s)    '
		12. 'External - directional    '
		13. 'External - non-directional'

	7. gauge type: indexed integer, chosen from the following list.
	        1.  'Paros pressure sensor           '
		2.  'Sensotec pressure sensor        '
		3.  'Kulite pressure sensor          '
		4.  'Gulton pressure sensor          '
		5.  'Datawell Mark 1 directional buoy'
		6.  'Datawell Mark 2 directional buoy'
		7.  'Datawell non-directional buoy   '
		8.  'Wavecrest non-directional buoy  '
		9.  'RM Young anemometer             '
		10. 'Qualmetrics anemometer          '
		11. 'Skyvane anemometer              '
		12. 'Minco resis temp detector (RTD) '
		13. 'Paros temperature sensor        '
		14. 'KVH digital compass             '
		15. 'Marsh-McBirney current meter    '
		16. 'Digital Paros pressure sensor   '
		17. 'RM Young temperature sensor     '
		18. 'RDI Waves ADCP                  '
		19. 'Datawell Mark 3 directional buoy'
		20. 'NDBC buoy                       '

	8. sample rate: real, in Hz

	9. serial number: string, maximum 10 chars

	10. top hat number: string, maximum 10 chars. Applies to directional
		buoys only

	11. latitude: real, in decimal degrees. Negative values represent 
		south latitudes

	12. longitude: real, in decimal degrees. Negative values represent
		west longitudes

	13. water depth: integer, in cm. With respect to MLLW.

	14. sensor elevation: integer, in cm. Does not apply to buoys. Elevation
                from sea floor to sensor. This applies to both underwater 
                and above water sensors.

	15. local magnetic variation: real, in degrees. Applies to directional
		stations - buoys, arrays and wind.

	16. inclination: real, in degrees. Applies only to directional buoys.
		NOTE: FIELD NOT USED IN CURRENT PROCESSING

	17. maximum value: integer, units depend on sensor type. Currently
		this is a maximum value for the calibrated barometer
		time series points and a maximum for the final Hs value 
		calculated for wave sensors. (Currently wind and temperature
		values have hard-wired maximums in the processing; this
		field is not considered.)

	18. field station type: indexed integer, from the following list.
		1. 'memory distributed  '
		2. 'smart               '
		3. 'labview             '
		4. 'sun                 '
		5. 'N/A                 '

	19. field software version: indexed integer, from the following list.
		1.  'N/A                 '
		2.  'tr.exe              '
		3.  'dh136               '
		4.  'dh139               '
		5.  'dh146               '
		6.  'dh147               '
		7.  'dh169 tt            '
		8.  '179pd tt            '
		9.  '180/181pd tt        '
		10. '182pd tt            '
		11. 'datawell_acq v1     '
		12. 'datawell_acq v2     '
		13. 'pressure_acq v1     '
		14. 'sci_acq             '

	20. method of analysis: indexed integer, from the following list.
		1.  'CDIP                '
		2.  'Datawell            '
		3.  'External            '

	21. calibration factor: real. See .far/rd_to_df/calibrate.f for
		details of use. Does not apply to directional buoy or paros
		gauges.

	22. calibration offset: real. See .far/rd_to_df/calibrate.f for
		details of use. Does not apply to directional buoy or paros
		gauges.

	23. Paros cal_a0: real. See .far/rd_to_df/calibrate.f for
		details of use. Applies only to paros gauges.

	24. Paros cal_b0: real. See .far/rd_to_df/calibrate.f for
		details of use. Applies only to paros gauges.

	25. Paros cal_t0: real. See .far/rd_to_df/calibrate.f for
		details of use. Applies only to paros gauges.

	26. gps flag: logical, "T" or "F" in the frame. Applies only to
		directional buoys, T if gps-equipped

	27. surge filter flag: logical. Applies only to wave gauges other
		than directional buoys

	28. energy basin flag: logical. Applies only to wave gauges other
		than directional buoys

	29. radio modem flag: logical. Set for all gauges transmitting data
		via a radio modem.

	30. temperature calibrated flag: logical. For directional buoys, 
		no temperature processing is performed if false. If set true
		for paros gauges, indicates that temperature-dependent
		calibration should be performed. NOTE: THE CURRENT PROCESSING
		IS NOT SET UP TO PERFORM TEMPERATURE-DEPENDENT CALIBRATION;
		SETTING THIS FLAG WILL HAVE NO EFFECT ON PAROS CALIBRATION

	31. public flag: logical. All gauges flagged public produce files and
		products in CDIP's PUBLIC_DATA directories; other data goes
		into the NONPUB_DATA directories



The Processing Archive
----------------------

        
The processing archive holds time frame information for the processing
streams, i.e. the different sorts of processing performed on a 
station's data. Each line of data represents one time frame, is 
comma-delimited, and will include the 9 following fields:

	1. stream: integer, range 1 to 20

	2. frame: integer, range 1 to 50

	3. start date: string, 'YYYYMMDDhh'. (See description above)

	4. end date: string, 'YYYYMMDDhh'. (See description above)

	5. processing type: indexed integer. Chosen from the following.
		1. 'Default             '
		2. 'Parameter           '
		3. 'Waves               '
		4. 'Wind                '
		5. 'Current             '
		6. 'Tidal               '
		7. 'Wind buoy           '
		8. 'Gauge comparison    '
		9. 'Dir buoy, omit temp '

	6. stream list: string, asterisk-delimited: '01*02*04'. List of all
		channels and streams needed for the specified processing type

	7. beach normal: integer, in degrees. Applies only to 'Waves' streams
		(directional array processing)

	8. instrument orientation: integer, in degrees. Applies only to 
		'Waves' streams (directional array processing)

	9. public flag: logical. (See description above)


The labels for streams, like the labels for channels, are two character
strings, but the first character is always 'p'. Thus sp08302200101150825
is the spectral file for channel '02', while sp083p2200101150825 is the
spectral file for stream 'p2', the combined, directional wave processing.

The first two streams in the processing archive, p0 and p1, are reserved 
streams. Stream p0 is for the default, or single-channel, processing; all
channels which are processed alone should be included in this stream.
Stream p1, meanwhile, is the official parameter stream; all channels to be
included in the main parameter file should be listed in this stream.
Official UCSD Web Page