120
146
<h2>NCO Milestones</h2>
123
<li>2012 Apr 01?: Funding for NASA <a href="#prp_access">ACCESS Project</a> begins</li>
149
<li>2014 Mar 25: (TBD) NCO <a href="http://dust.ess.uci.edu/smn/pst_nco_esds_201403.pdf">Poster</a> for NASA ESDSWG, Greenbelt, Maryland</li>
150
<li>2014 Feb ??: NCO 4.4.3 (<i>In progress</i>)
151
<li>2014 Feb 20: NCO 4.4.2 (Stability)
152
<li>2014 Jan 29: NCO 4.4.1 (Stability)
153
<li>2014 Jan 09: NCO 4.4.0 (Stability)
154
<li>2013 Dec 13: NCO <a href="http://dust.ess.uci.edu/smn/smn_nco_agu_201312.pdf">Talk</a> at Fall AGU, San Francisco, California</li>
155
<li>2013 Dec 02: NCO 4.3.9 (new operator, <tt>nces</tt>)
156
<li>2013 Nov 06: NCO 4.3.8 (<tt>ncatted</tt> groups)
157
<li>2013 Oct 17: NCO 4.3.7 (HDF4, XML, <tt>ncrename</tt> groups)
158
<li>2013 Oct 02: NCO <a href="http://dust.ess.uci.edu/smn/pst_nco_esds_201310.pdf">Poster</a> for NASA ESDSWG, Greenbelt, Maryland</li>
159
<li>2013 Sep 27: NCO 4.3.6 (<tt>--dbl</tt> default, <tt>ncdismember</tt>)
160
<li>2013 Sep 20: NCO 4.3.5 (<tt>nces</tt>, <tt>ncra</tt>, <tt>ncrcat</tt> groups)
161
<li>2013 Aug 01: NCO 4.3.4 (<tt>ncpdq</tt> bugfix, HDF unpacking)
162
<li>2013 Jul 24: NCO 4.3.3 (<tt>ncrename</tt>, <tt>ncwa</tt> groups, CDL, XML)
163
<li>2013 Jul 05: NCO 4.3.2 (<tt>ncflint</tt>, <tt>ncpdq</tt> groups)</li>
164
<li>2013 Jun 03: Submitted NASA ACCESS 2013 <a href="http://dust.ess.uci.edu/prp/prp_axs/prp_axs.pdf">proposal</a></li>
165
<li>2013 May 01: NCO 4.3.1 (Group broadcasting)</li>
166
<li>2013 Mar 28: NCO 4.3.0 (<tt>ncbo</tt> groups)</li>
167
<li>2013 Mar 19: NCO 4.2.6</li>
168
<li>2013 Jan 28: NCO 4.2.5</li>
169
<li>2013 Jan 21: NCO 4.2.4</li>
170
<li>2012 Dec 05: NCO <a href="http://dust.ess.uci.edu/smn/smn_nco_agu_201212.pdf">Talk</a> at Fall AGU, San Francisco, California</li>
171
<li>2012 Nov 28: NCO <a href="http://dust.ess.uci.edu/smn/pst_nco_esds_201211.pdf">Poster</a> at NASA ESDSWG, Annapolis, Maryland</li>
172
<li>2012 Nov 13: NCO 4.2.3 (GPE)</li>
173
<li>2012 Oct 29: NCO 4.2.2 (<tt>ncks, ncecat</tt> Groups)</li>
174
<li>2012 Aug 02: NCO 4.2.1 (RAM disks)</li>
175
<li>2012 Jun 12: NCO 4.2.0 (Windows support)</li>
176
<li>2012 Apr 23: Received funding for NASA ACCESS 2011 <a href="#prp_access">project</a></li>
177
<li>2012 Mar 29: NCO 4.1.0 (MD5 support, MM3)</li>
125
178
<li>2012 Feb 13: NCO 4.0.9</li>
127
<li>2011 Jun 03: Submit NASA ACCESS <a href="http://dust.ess.uci.edu/prp/prp_access/prp_access.pdf">proposal</a></li>
179
<li>2011 Jun 03: Submitted NASA ACCESS 2011 <a href="http://dust.ess.uci.edu/prp/prp_access/prp_access.pdf">proposal</a></li>
129
180
<li>2011 Apr 28: NCO 4.0.8 (HPSS support, NOFILL workaround, <i>upgrade recommended</i>)</li>
131
181
<li>2011 Feb 21: NCO 4.0.7 (<i>upgrade recommended</i>)</li>
133
182
<li>2011 Jan 15: NCO 4.0.6</li>
135
183
<li>2010 Oct 13: NCO 4.0.5</li>
137
184
<li>2010 Sep 24: NCO 4.0.4 (chunking everywhere)</li>
139
185
<li>2010 Sep 02: NCO 4.0.3</li>
141
186
<li>2010 Jun 27: NCO 4.0.2</li>
143
187
<li>2010 Apr 05: NCO 4.0.1</li>
145
188
<li>2010 Jan 05: NCO 4.0.0 (bilinear interpolation, calendar attributes)</li>
147
189
<li>2009 Jul 15: NCO 3.9.9 (chunking, re-basing, GSL stats/interp)</li>
149
190
<li>2009 Apr 29: NCO 3.9.8 (GSL RNG/PDF functions)</li>
151
191
<li>2009 Mar 18: NCO 3.9.7</li>
153
192
<li>2009 Jan 22: NCO 3.9.6 (GSL special functions) (<i>upgrade highly recommended</i>)</li>
155
193
<li>2008 Sep 24: <tt>ncap2</tt> <a href="http://nco.sf.net/nco.html#ncap2">documentation</a></li>
157
194
<li>2008 Aug 31: <a href="http://www.nsf.gov">NSF</a> funding ends</a></li>
159
<li>2008 Aug 08: NCO <a href="http://nco.wiki.sourceforge.net">Wiki</a>!</li>
195
<li>2008 Aug 08: NCO <a href="http://nco.wiki.sf.net">Wiki</a>!</li>
161
196
<li>2008 May 22: SWAMP <a href="http://dust.ess.uci.edu/ppr/smn_WZJ08_ccgrid_200805.pdf">Talk</a> at CCGRID08 in Lyon, France</li>
163
197
<li>2008 May 11: NCO 3.9.5</li>
165
198
<li>2008 Apr 28: NCO <a href="http://dust.ess.uci.edu/ppr/ppr_Zen08.pdf">overview</a> paper in EMS</li>
167
199
<li>2008 Mar 04: NCO 3.9.4</li>
169
200
<li>2007 Dec 10: SWAMP <a href="http://dust.ess.uci.edu/ppr/pst_WZJ074.pdf">Poster</a> at Fall AGU, San Francisco, California</li>
171
201
<li>2007 Dec 07: NCO 3.9.3 (SWAMP!)</li>
173
202
<li>2007 Dec 04: NCO <a href="http://dust.ess.uci.edu/ppr/ppr_ZeM07.pdf">scaling paper</a> in IJHPCA</li>
175
203
<li>2007 Aug 29: NCO 3.9.2 (<tt>_FillValue</tt>s)</li>
177
204
<li>2007 Aug 27: <a href="http://swamp.googlecode.com">SWAMP site</a> spins-off from NCO</li>
179
205
<li>2007 Jun 29: NCO 3.9.1 (netCDF4 deflation)</li>
181
206
<li>2007 May 26: NCO 3.9.0 (netCDF4 atomic types)</li>
183
207
<li>2007 May 02: SWAMP <a href="http://dust.ess.uci.edu/smn/smn_WZJ07_gpc_200705.pdf">Talk</a> at GPC, Paris, France</li>
185
208
<li>2007 Apr 20: NCO 3.2.0</li>
187
209
<li>2007 Mar 29: NCO 3.1.9 x86_64 RPMs</li>
189
210
<li>2007 Mar 10: NCO 3.1.9 (i386/x86_64 debs and i386 RPMs)</li>
191
<li>2007 Feb 22: SWAMP
192
<a href="http://dust.ess.uci.edu/smn/smn_WZJ07_opendap_200702.pdf">Talk</a> at OPeNDAP Developer's Workshop, Boulder, Colorado</li>
211
<li>2007 Feb 22: SWAMP <a href="http://dust.ess.uci.edu/smn/smn_WZJ07_opendap_200702.pdf">Talk</a> at OPeNDAP Developer's Workshop, Boulder, Colorado</li>
194
212
<li>2007 Jan 15: <a href="http://dust.ess.uci.edu/smn/smn_nco_ams_200701.pdf">Talk</a> and <a href="http://dust.ess.uci.edu/ppr/abs_xtn_ZeW07.pdf">Extended Abstract</a> on NCO Scaling at AMS IIPS, San Antonio, Texas</li>
196
213
<li>2007 Jan 09: <a href="http://dust.ess.uci.edu/ppr/pst_ZMW06.pdf">Poster</a> on NCO Scaling at Fall AGU, San Francisco, California</li>
198
214
<li>2006 Dec 09: <a href="http://dust.ess.uci.edu/ppr/pst_WZJ06.pdf">Poster</a> on SWAMP at Fall AGU, San Francisco, California</li>
200
215
<li>2006 Dec 06: NCO 3.1.8</li>
202
216
<li>2006 Nov 11: NCO 3.1.7</li>
204
217
<li>2006 Sep 18: NCO 3.1.6</li>
206
218
<li>2006 Aug 29: NCO 3.1.5</li>
208
219
<li>2006 Jun 07: NCO 3.1.4</li>
210
220
<li>2006 May 30: NCO 3.1.3</li>
212
221
<li>2006 Apr 21: NCO 3.1.2</li>
214
222
<li>2006 Jan 30: NCO 3.1.1</li>
216
223
<li>2005 Dec 02: NCO 3.1.0 (MPI!)</li>
218
224
<li>2005 Oct 28: NCO 3.0.3</li>
220
225
<li>2005 Oct 17: <a href="#BM">NCO parallel benchmarks</a></li>
222
226
<li>2005 Aug 22: NCO 3.0.2</li>
224
227
<li>2005 Jun 10: NCO 3.0.1</li>
226
228
<li>2005 Mar 24: NCO 3.0.0</li>
228
229
<li>2004 Sep 07: NCO 2.9.9 (<tt>ncpdq</tt> packs data quietly)</li>
230
230
<li>2004 Sep 01: Funding for NSF <a href="#prp_sei">SEI Project</a> begins</li>
232
231
<li>2004 Aug 07: NCO 2.9.8 (<a href="./nco.html#ncpdq"><tt>ncpdq</tt></a> re-orders dimensions)</li>
234
232
<li>2004 Mar 04: Submit NSF <a href="http://dust.ess.uci.edu/prp/prp_sei/prp_sei.pdf">SEI proposal</a></li>
236
233
<li><a href="./nco_news.shtml">Ancient NCO News & Announcements</a></li>
362
355
By supporting groups in a generic fashion, NCO hopes to remove one of
363
356
the barriers to more widespread adoption of netCDF4 features.</p>
365
<p>We plan to recruit two personnel, a programmer (aka software engineer)
366
and a graduate student (scientific specialist) each for at least two
367
years, to accomplish our ACCESS objectives.
358
<p>We recruited (i.e., these positions have been filled) two
359
personnel, a programmer (aka software engineer)
360
and a graduate student (scientific specialist) both based at UCI for
361
at least two years, to accomplish our ACCESS objectives.
368
362
As described in the proposal, the responsibilities of positions are
369
363
roughly segregated as follows:
371
365
<a href="http://dust.ess.uci.edu/hire/prg_anl_05_adv.pdf">programmer</a>
372
will re-factor the code-base to support groups (50%),
373
improve the NCO build system and user support (25%),
374
and support NASA ESDSWG activities (25%).
366
is re-factoring the code-base to support groups, writing wrappers for
367
NCO, an improving the build system (e.g., now we have native Windows builds!).
376
369
<a href="http://dust.ess.uci.edu/hire/sdn_grd_03_adv.pdf">graduate student researcher</a>
377
analyze and intercompare snow cover and snow albedo datasets from
378
NASA MODIS and MISR datasets (in HDF-EOS format) and NCAR CESM
379
simulations (in netCDF format).
380
The analysis will inform the development of wrappers for NCO
381
commands to analyze HDF-EOS datasets.
382
Contact us if you are seriously interested in these positions on a
383
full-time, part-time, or pay-per-feature basis.</p>
370
is analyzing and intercomparing snow cover and snow albedo datasets
371
from NASA MODIS and MISR datasets (in HDF format) and CMIP5
372
simulations (in netCDF format).
373
Her analysis informs the development of NCO commands and wrappers for
374
HDF atasets so that we solve the most important problems real-world
375
researchers encounter in evaluating GCMs against NASA data.</p>
385
377
<p>We continue to encourage you to e-mail NCO endorsements to
386
378
<a href="mailto:surname@uci.edu">Charlie “my surname is zender” Zender</a>
488
493
<h2>Publications and Presentations</h2>
496
<li><!-- ZVW13 --> <a name="ZVW12"></a> <!--http://www.ess.uci.edu/~zender#ZVW13 -->
497
Zender, C. S., P. Vicente and W. Wang (2012): <i>Use Hierarchical Storage and Analysis to Exploit Intrinsic Parallelism</i>. Presented at the Fall Meeting of the American Geophysical Union, San Francisco, CA, December 9–13, 2013. <i>Eos Trans. AGU</i>, <b>93</b>(53), Fall Meet. Suppl., Abstract IN52A-06.
498
<a href="http://dust.ess.uci.edu/smn/smn_nco_agu_201312.pdf">PDF</a> (© 2013 by me)</a></li>
500
<li><!-- ZVW13 --> <a name="ZVW13"></a> <!--http://www.ess.uci.edu/~zender#ZVW13 -->
501
Zender, C. S., P. Vicente and W. Wang (2013): <i>The Future of Model Evaluation</i>. Presented to the Chapman University Symposium on Big Data and Analytics: 44th Symposium on the Interface of Computing Science and Statistics, Chapman University, Orange, CA, April 4–6, 2013. <a href="http://dust.ess.uci.edu/smn/smn_nco_chapman_201304.pdf">PDF</a> (© 2013 by me)</a></li>
503
<li><!-- ZVW12 --> <a name="ZVW12"></a> <!--http://www.ess.uci.edu/~zender#ZVW12 -->
504
Zender, C. S., P. Vicente and W. Wang (2012): <i>NCO: Simpler and faster model evaluation by NASA satellite data via unified file-level netCDF and HDF-EOS data post-processing tools.</i>. Presented at the Fall Meeting of the American Geophysical Union, San Francisco, CA, December 3–7, 2012. <i>Eos Trans. AGU</i>, <b>93</b>(53), Fall Meet. Suppl., Abstract IN34A-07.
505
<a href="http://dust.ess.uci.edu/smn/smn_nco_agu_201212.pdf">PDF</a> (© 2012 by me)</a></li>
507
<li><!-- ZVW12 --> <a name="ZVW12"></a> <!--http://www.ess.uci.edu/~zender#ZVW12 -->
508
Zender, C. S., P. Vicente and W. Wang (2012): <i>Simplifying and accelerating model evaluation by NASA satellite data.</i>. Presented to the Earth Science Data Systems Working Group (ESDSWG) Meeting, Annapolis MD, November 13–15, 2012.
509
<a href="http://dust.ess.uci.edu/smn/pst_nco_esds_201211.pdf">PDF</a> (© 2012 by me)</a></li>
491
511
<li><!-- WZJ083 --> <a name="WZJ083"></a> <!--http://www.ess.uci.edu/~zender#WZJ083 -->
492
512
Wang, D. L., C. S. Zender, and S. F. Jenks (2008), Compiling the uncompilable: A case for shell script compilation, <i>Submitted to ACM Trans. Softw. Engin. Method.</i>.
493
513
<a href="http://dust.ess.uci.edu/ppr/ppr_WZJ083.bib">BibTeX</a>
600
620
You can also retrieve the source of tagged versions directly
601
621
<a name="#Source">with CVS</a>.
603
<li><b>NCO 4.1.1</b>: (<i>Future</i>)
623
<li><b>NCO 4.4.4</b>: (<i>Future</i>)
604
625
netCDF4 compound types?;
606
<li><b>NCO 4.1.0</b>: (<i>In Progress, features already in beta include the following</i>)
608
Stride works with DAP?;
626
Optimize diskless files?;</li>
627
<li><b>NCO 4.4.3</b>: (<i>In Progress, features completed or being worked on include</i>)
628
<tt>cnk_map=rew</tt>;
629
<a href="http://nco.sf.net/nco.html#cnk">Chunking</a> bytes not elements, caching;</li>
630
<li><b>NCO 4.4.2</b>: (<i>Current Stable Release</i>)
631
Bugfixes for <tt>nces</tt>, LLVM/clang builds, <tt>-X</tt>;</li>
632
<li><b>NCO 4.4.1</b>:
633
Group support for <tt>-X</tt> and <tt>--cnk_dmn</tt>;
634
Chunk and uncompress simultaneously;
635
<tt>ncra/ncea/ncrcat</tt> <a href="#bug_ncra_no_fl_close">bugfix</a></li>
636
<li><b>NCO 4.4.0</b>:
638
<tt>ncdismember</tt> awesomeness;
640
<tt>ncks --fix_rec_dmn=all</tt>;
641
<tt>ncks</tt> <a href="http://nco.sf.net/nco.html#autoconv">autoconversion</a>;
642
<tt>ncrename</tt> output path;
643
<tt>ncra --mro</tt> <a href="#bug_ncra_mro_mss_val">bugfix</a>;
644
<tt>ncra/ncrcat</tt> stride bugfix;
645
Better <a href="http://nco.sf.net/nco.html#cnk">chunking</a>;
646
Group support for <tt>ncwa -w -m</tt>;</li>
647
<li><b>NCO 4.3.9</b>:
648
New operator <tt>nces</tt>;
649
Full XML/NcML compliance;
650
<tt>ncatted</tt> NaN bugfix;</li>
651
<li><b>NCO 4.3.8</b>:
652
<tt>ncatted</tt> group features;</li>
653
<li><b>NCO 4.3.7</b>:
654
HDF4 <a href="http://nco.sf.net/nco.html#hdf4">support</a>;
655
XML/NcML data <a href="http://nco.sf.net/nco.html#xml">support</a>;
656
Multiple record dimension <a href="http://nco.sf.net/nco.html#mrd">support</a> with <tt>ncpdq, ncecat --mrd</a></tt>;
657
<tt>ncrename</tt> group features;
658
<tt>ncap2</tt> file bugfix;
659
<tt>ncecat</tt> ID bugfix;
660
<tt>ncwa -b</tt> bugfix;</li>
661
<li><b>NCO 4.3.6</b>:
662
<tt>--flt</tt> default;
663
<tt>ncpdq/ncecat</tt> leave only one record dimension;
664
<tt>ncwa/nces</tt> bugfixes;
665
<tt>ncdismember</tt></li>
666
<li><b>NCO 4.3.5</b>:
667
<tt>nces/ncra/ncrcat</tt> groups with <tt>-g -G --unn</tt>;</li>
668
<tt>nces/ncra/ncwa</tt> float→double coercion with <tt><a href="http://nco.sf.net/nco.html#dbl">--dbl</a></tt>;</li>
669
<tt>ncwa -d</tt> <a href="#bug_ncwa_lmt">bugfix</a>
670
<li><b>NCO 4.3.4</b>:
671
HDF unpacking <tt>--hdf_upk</tt>;
672
<tt>ncpdq</tt> unpacking <a href="#bug_ncpdq_upk">bugfix</a>;
673
CDL printing legibility;</li>
674
<li><b>NCO 4.3.3</b>:
675
CDL printing <tt>ncks --cdl</tt>;
676
<tt>ncrename -g</tt>;
677
<tt>ncwa</tt> groups with <tt>-g -G --unn</tt>;</li>
678
<li><b>NCO 4.3.2</b>:
679
<tt>ncflint/ncpdq</tt> groups with </tt>-g -G --unn</tt>;
680
<tt>ncks -X</tt> <a href="#bug_ncks_aux">bugfix</a>;</li>
681
<li><b>NCO 4.3.1</b>:
682
<tt>ncbo</tt> symmetry, group broadcasting;
683
<tt>ncbo -G --unn</tt>;
684
<tt>ncecat</tt> <a href="http://nco.sf.net/nco.html#rag">RAG</a>;
685
<tt>ncbo</tt> CF <a href="#bug_ncbo_ccm_ccsm_cf">bugfix</a>;
686
<tt>ncatted</tt> <a href="#bug_ncatted_strcmp">bugfix</a>;
688
<li><b>NCO 4.3.0</b>:
689
<tt>ncbo -g</tt> groups;
690
<tt>ncatted</tt> NULs;
691
<tt>ncap2</tt> rounding;
692
<tt>ncks</tt> metadata <a href="#bug_ncks_mtd">bugfix</a></li>
693
<li><b>NCO 4.2.6</b>:
694
Record appending with <tt>ncra/ncrcat --rec_apn</tt>;
695
<tt>ncflint --fix_rec_crd</tt>;
697
Correct dimension/coordinate scopes;
698
<tt>ncks</tt> MM3 bugfix;</li>
699
<li><b>NCO 4.2.5</b>:
700
<tt>ncks --mk_rec_dmn</tt> <a href="#bug_ncks_mk_rec_dmn">bugfix</a>;
701
<tt>ncks</tt> subsetting <a href="#bug_ncks_sbs">bugfix</a></li>
702
<li><b>NCO 4.2.4</b>:
703
Group <a href="http://nco.sf.net/nco.html#rx">wildcards</a>;
704
Group <a href="http://nco.sf.net/nco.html#anchoring">anchoring and recursion</a>;
705
Intersection/union <a href="http://nco.sf.net/nco.html#unn">modes</a>;
706
<tt>ncrename</tt> global att. handling;
707
<tt>nces</tt> <a href="#bug_nces_rec_var">bugfix</a>;
708
<tt>ncra</tt> <a href="#bug_ncra_flg_bfr_nrm">bugfix</a></li>
709
<li><b>NCO 4.2.3</b>:
710
Group Path Editing (GPE);
711
<tt>ncecat</tt> <a href="#bug_ncecat_nintap">bugfix</a></li>
712
<li><b>NCO 4.2.2</b>:
713
<tt>ncks</tt>, <tt>ncecat</tt> support groups;
714
<tt>--hdr_pad</tt> all operators;
715
<tt>ncks</tt> prints underscores;
716
fixes to <tt>--[mk/fix]_rec_dmn</tt>;
718
<tt>ncwa</tt> on Windows;</li>
719
<li><b>NCO 4.2.1</b>:
720
<tt>--ram_all</tt> for <a href="http://nco.sf.net/nco.html#diskless">diskless files</a>;
721
<tt>--no_tmp_fl</tt> to <a href="http://nco.sf.net/nco.html#no_tmp_fl">bypass</a> temporary files;
722
Negative indices for <a href="http://nco.sf.net/nco.html#hyp">hyperslabs</a>;
723
<tt>ncpdq</tt> unpacks coordinate variables;
724
<tt>ncra/ncrcat</tt> SSC/MRO <a href="http://nco.sf.net/nco.html#ssc">options</a>;
725
<tt>ncra/ncrcat</tt> rebase <a href="http://nco.sf.net/nco.html#rbs">bounds</a>;</li>
726
<li><b>NCO 4.2.0</b>:
727
<tt>ncecat</tt> "fixes" auxiliary coordinates and bounds;
728
<tt>ncks</tt> uses <tt>nc__open</tt>, format <tt>NC_INT</tt> with <tt>%i</tt>;
729
<tt>ncra -y ttl</tt> fix;
730
<tt>ncrcat</tt> UDUnits fix;
731
<tt>ncwa</tt> and <tt>ncap2</tt> limited NaN support;
732
Microsoft Visual Studio support;</li>
733
<li><b>NCO 4.1.0</b>:
735
<tt>ncap2</tt> sorts & maps;
736
<tt>ncks</tt> MM3 <a href="#bug_mm3">workaround</a>;
737
<tt>ncrename/ncatted</tt> chmods;
738
<tt>ncatted</tt> NaN support</li>
609
739
<li><b>NCO 4.0.9</b>:
610
740
Fix over-zealous <tt>ncap2</tt> packing;
611
Fix <tt>ncea -y ttl</tt>;
741
Fix <tt>nces -y ttl</tt>;
612
742
Fix/improve <tt>ncap2 print, array()</tt>;
613
743
Warn when appending variables of suspicious record length;
614
Warn when <tt>NC_MAX_ATTRS</tt> exceeded;
615
<li><b>NCO 4.0.8</b>: (<i>Current Stable Release</i>)
744
Warn when <tt>NC_MAX_ATTRS</tt> exceeded</li>
745
<li><b>NCO 4.0.8</b>:
616
746
Support <a href="http://nco.sf.net/nco.html#hpss">HPSS</a>;
617
747
Workaround netCDF <tt>NOFILL</tt> <a href="#bug_nofill">bug</a> (<i>upgrade recommended</i>);
618
748
Support CF <tt>bounds</tt>;
619
749
CF <tt>noleap</tt> not <tt>no_leap</tt>;
620
750
Fix <tt>ncatted</tt> overwrite-mode;
621
Fix <tt>NC_BYTE</tt> printing;
751
Fix <tt>NC_BYTE</tt> printing</li>
622
752
<li><b>NCO 4.0.7</b>:
623
Fix degenerate hyperslab <a href="#bug_hyp_dgn">bug</a> (<i>upgrade recommended</i>);
753
Fix degenerate hyperslab <a href="#bug_hyp_dgn">bug</a> (<i>upgrade recommended</i>)</li>
624
754
<li><b>NCO 4.0.6</b>:
625
755
<tt>clang</tt>-compliance;
626
756
Fix <tt>ncra</tt> YYYYMMDD-<tt>date</tt> <a href="#bug_ncra_cf_YYYYMMDD_date">bug</a>;
627
757
Extract all associated coordinates;
628
758
Tighten <tt>ncbo</tt> warnings;
629
<tt>ncpdq</tt> warns when _FillValue outside packing range;
759
<tt>ncpdq</tt> warns when _FillValue outside packing range</li>
630
760
<li><b>NCO 4.0.5</b>:
631
761
Fix <tt>ncks</tt> <a href="#bug_ncks_nc4_nc4_hyp_fix">hyperslabbing bug</a>;
632
Fix <tt>ncra</tt> <a href="#bug_ncra_cf_crd_rec_crd">CF "coordinate" bug</a>;
762
Fix <tt>ncra</tt> <a href="#bug_ncra_cf_crd_rec_crd">CF "coordinate" bug</a></li>
633
763
<li><b>NCO 4.0.4</b>:
634
764
Chunking in all operators; preserve deflation; <tt>ncks</tt> print formatting;
635
765
Fix <tt>ncrename</tt> <a href="#bug_ncrename_dot">bug</a>;
636
Do not pack coordinate variables;
766
Do not pack coordinate variables</li>
637
767
<li><b>NCO 4.0.3</b>:
638
768
Fix <tt>configure</tt> for ncap2, netCDF4, UDUnits2, netCDF-DAP;
639
769
Fix <tt>ncbo</tt> <a href="#bug_ncbo_rfr">bug</a> under AIX xlC;
640
Fix <tt>ncra</tt> <a href="#bug_ncra_date">bug</a> for some CF-compliant dates.
641
<li><b>NCO 4.0.2</b>:
770
Fix <tt>ncra</tt> <a href="#bug_ncra_date">bug</a> for some CF-compliant dates.</li>
771
<li><b>NCO 4.0.2</b>:
642
772
Consistent deflation, chunking with <tt>netCDF4_classic</tt>;
643
773
Fix <tt>ncap2</tt> RAM vars, 1-D arrays;
644
Fix <tt>ncatted</tt> appending <tt>NUL</tt>s.
774
Fix <tt>ncatted</tt> appending <tt>NUL</tt>s.</li>
645
775
<li><b>NCO 4.0.1</b>:
646
Easily create/remove record dimensions with <tt>ncks --mk_rec_dmn</tt>, <tt>--fix_rec_dmn</tt>;
776
Easily create/remove record dimensions with <tt>ncks --mk_rec_dmn</tt>, <tt>--fix_rec_dmn</tt>;</li>
647
777
<li><b>NCO 4.0.0</b>:
648
778
Bilinear interpolation, GSL fitting;
649
779
Chunking improvements;
650
Better support CF <tt>calendar</tt> and <tt>coordinate</tt> attributes;
651
<li><b>NCO 3.9.9</b>:
780
Better support CF <tt>calendar</tt> and <tt>coordinate</tt> attributes</li>
781
<li><b>NCO 3.9.9</b>:
652
782
netCDF4 chunking and <tt>NC_STRING</tt> support;
653
783
GSL statistics, interpolation functions;
654
784
UDUnits2 <tt>time-since</tt> support;
655
<tt>ncrcat</tt> re-basing;
785
<tt>ncrcat</tt> re-basing</li>
656
786
<li><b>NCO 3.9.8</b>:
657
787
<tt>ncap2</tt> supports <tt>sort()</tt>, <tt>array()</tt>;
658
788
better DAP/libnetcdf and UDUnits2 builds;
659
GSL distribution/RNG functions;
789
GSL distribution/RNG functions</li>
660
790
<li><b>NCO 3.9.7</b>:
661
791
Improve GSL-build support;
662
792
<tt>ncap2</tt> threading improvements;
663
<tt>ncks --no_dmn_var_nm</tt> printing;
793
<tt>ncks --no_dmn_var_nm</tt> printing</li>
664
794
<li><b>NCO 3.9.6</b>:
665
795
Fix OpenMP MSA <a href="#bug_thr_msa">bug</a> (<i>upgrade highly recommended</i>);
666
796
Memory management to improve threading;
670
800
<tt>ncap2</tt> <a href="http://nco.sf.net/nco.html#ncap2">documentation</a>,
671
801
better missing value propagation,
672
802
<tt>#include</tt> files,
673
<a href="http://nco.sf.net/nco.html#gsl">GSL</a> math functions;
674
<li><b>NCO 3.9.5</b>:
803
<a href="http://nco.sf.net/nco.html#gsl">GSL</a> math functions</li>
804
<li><b>NCO 3.9.5</b>:
675
805
Multi-slabbing (MSA) and <tt>-X</tt> everywhere;
676
806
<tt>ncecat -M</tt>;
677
807
netCDF4-enabled builds on Cygwin;
678
<tt>ncap2</tt> builds on Solaris;
808
<tt>ncap2</tt> builds on Solaris</li>
679
809
<li><b>NCO 3.9.4</b>:
680
810
File consanguinity;
681
811
<tt>ncks</tt>: CF auxiliary coords, LZ stats;
682
<tt>ncap2</tt>: masks, index arrays, print attributes, OpenMP, <tt>atan2()</tt>, <tt>pow()</tt>;
812
<tt>ncap2</tt>: masks, index arrays, print attributes, OpenMP, <tt>atan2()</tt>, <tt>pow()</tt></li>
683
813
<li><b>NCO 3.9.3</b>:
685
815
<tt>ncecat -u</tt>;
686
816
<tt>wget</tt> URLs;
688
<tt>ncap2</tt> OpenMP;
818
<tt>ncap2</tt> OpenMP</li>
689
819
<li><b>NCO 3.9.2</b>:
690
820
<tt>_FillValue</tt> supplants <tt>missing_value</tt>;
691
821
<tt>UDUnits2 support</tt>;
692
822
<tt>ncap2</tt> type-conversion support and printing;
693
823
netCDF4 <tt>configure</tt> fixes;
694
Change licenses to GPL3 and FDL1.2;
824
Change licenses to GPL3 and FDL1.2</li>
695
825
<li><b>NCO 3.9.1</b>:
696
826
<a href="http://nco.sf.net/nco.html#deflate">Support</a> lossless netCDF4/HDF deflation;
697
827
Improve Intel compiler support;
698
828
<tt>ncap2</tt> for/while loops;
699
various and sundry build fixes;
829
various and sundry build fixes</li>
700
830
<li><b>NCO 3.9.0</b>:
701
831
<a href="http://nco.sf.net/nco.html#nco4">Support netCDF4</a> types (<tt>ubyte</tt>, <tt>ushort</tt>, <tt>uint</tt>, <tt>int64</tt>, and <tt>uint64</tt>);
702
832
Control <tt>ncks</tt> metadata <a href="http://nco.sf.net/nco.html#prn">copying</a>;
703
833
Fix <tt>ncbo</tt> packed valued <a href="#bug_ncbo_pck">bug</a> (<i>upgrade recommended</i>);
704
Improve IRIX 6.5 support;
705
<li><b>NCO 3.2.0</b>: More forgiving exclusion list (<tt>-x -v <i>var_nm</i></tt>) <a href="http://nco.sf.net/nco.html#xcl">handling</a>; Fix <tt>rmssdn</tt> normalization; Support Mac OS X on Intel; Documentation bugfixes;
706
<li><b>NCO 3.1.9</b>: <tt>ncap2</tt> in RPM packages; Quieter output; AIX <tt>configure</tt> supports <tt>ncap2</tt>; Update to DAP for netCDF 3.6.2; Fix <tt>nc[erw]a</tt> for coordinate min/max/ttl; <tt>ncecat</tt> allows files to differ in record dimension size;
707
<li><b>NCO 3.1.8</b>: Support <tt>_FillValue</tt> with compile-time switch; Debian package synchronized, includes <tt>ncap2</tt>
708
<li><b>NCO 3.1.7</b>: <tt>ncap2</tt> “double-parsing”, array initialization, supercedes <tt>ncap</tt>
709
<li><b>NCO 3.1.6</b>: Support <a href="http://nco.sf.net/nco.html#srd">stride</a> in all hyperslabbing operators; change more WARNINGs to INFOs
710
<li><b>NCO 3.1.5</b>: New <tt>ncap2</tt> array and hyperslab features; change some WARNINGs to INFOs, add Pathscale and update PGI and Intel compiler support
711
<li><b>NCO 3.1.4</b>: Fix <tt>ncbo</tt> memory problem; report timer results
712
<li><b>NCO 3.1.3</b>: <tt>ncap2</tt> automatically <a href="http://nco.sf.net/nco.html#att_prp">propagates</a> attributes to new/derived variables; NCO handles record variables with zero records; <a href="http://nco.sf.net/nco.html#cnv_CF_crd">support</a> CF <tt>coordinates</tt> convention; <tt>ncwa -b</tt> <a href="http://nco.sf.net/nco.html#ncwa">retains</a> degenerate dimensions; build fixes for Cray T3E, Solaris, Cygwin.
713
<li><b>NCO 3.1.2</b>: <tt>ncap2</tt> control structures (conditionals, loops, etc.); keep non-processed data <a href="bug_pack_fix">packed</a> in output file; binary operators <tt>ncbo</tt> and <tt>ncflint</tt> work when only one variable has <tt>missing_value</tt> attribute; change <tt>ncra</tt> and <tt>ncea</tt> to always average coordinate variables
714
<li><b>NCO 3.1.1</b>: NCO builds (again) with C++ compilers; ncap2 development code; server-side extensions
715
<li><b>NCO 3.1.0</b>: MPI operators are bug-free; fix <t>./configure</t> for MPI and netCDF4; MRV algorithm speeds up <tt>ncwa</tt> 5—10 times; <tt>ncap</tt> random number generator <tt>rnd_nbr()</tt>
716
<li><b>NCO 3.0.3</b>: Eliminate all critical read regions (accelerates all SMP operators); builds with netCDF4 alpha; read <t>NETCDF4_CLASSIC</t> (i.e., HDF) files automatically; write <t>NETCDF4</t> files <a href="http://nco.sf.net/nco.html#netcdf4">on request</a>; <a href="http://nco.sf.net#BM">benchmark results</a> quantify parallelism.
717
<li><b>NCO 3.0.2</b>: Fewer critical read regions; all known memory leaks plugged; better Intel compiler support; <tt>SFTP</tt> protocol support; FTP protocol supports <tt>.netrc</tt>-based passwords; better model grid-property-awareness (e.g., <tt>lat_bnds</tt>); <tt>ncatted</tt> <tt>ncks</tt>, <tt>ncrename</tt> support metadata header padding with <tt>--hdr</tt>; <tt>ncbo</tt> supports heterogeneous variable ordering; <tt>ncatted</tt> bugfix
718
<li><b>NCO 3.0.1</b>: benchmarks; <tt>ncks</tt> printing tweaks; memory cleanup; <tt>ncap</tt> double-parse speedup and <a href="bug_ncap_cmt">exponentiation bugfix</a>; thread operators by default
719
<li><b>NCO 3.0.0</b>: New <tt>ncks -P</tt> print switch; <tt>ncap</tt> optimizations; <tt>-Z</tt> option supports 64-bit offsets (requires netCDF 3.6); NEC SX build improvements; support GCC 3.4.X; <tt>nco_put_vara()</tt> overloads in <tt>libnco_c++</tt>
720
<li><b>NCO 2.9.9</b>: <tt>ncpdq</tt> packs/unpacks entire files; <tt>ncbo</tt> is threaded
721
<li><b>NCO 2.9.8</b>: <a href="./nco.html#ncpdq"><tt>ncpdq</tt></a> released; <tt>ncwa --msk_sng</tt> consolidated mask switch; C99 compiler required
722
<li><b>NCO 2.9.7</b>: Read input file lists from <tt>stdin</tt>; write <tt>nco_input_file_list</tt> attributes; add <tt>nco_put_att<int,short,long></tt> functions to libnco_c++; large file support (LFS); write <tt>nco_openmp_thread_number</tt> attribute
723
<li><b>NCO 2.9.6</b>: Support <tt>-o fl_out</tt> syntax; 64-bit ABI for x86_64; <a href="http://www.debian.org">Debian</a> builds libnco_c++
724
<li><b>NCO 2.9.5</b>: <tt>ncflint</tt> handles <tt>missing_value</tt> data better, is commutative when weights are equal
725
<li><b>NCO 2.9.4</b>: <tt>ncecat</tt> works on pure scalar files; change to <tt>cvs.sf.net</tt>; AIX GCC builds
726
<li><b>NCO 2.9.3</b>: <tt>ncra</tt> and <tt>ncea</tt> now <a name="bug_mss_val_zro_ncra">work correctly</a> when <tt>missing_value</tt> equals zero or any intermediate sums
727
<li><b>NCO 2.9.2</b>: <tt>ncap</tt> <tt>S/V</tt>, <tt>S%V</tt>, and <tt>S^V</tt> <a href="#bug_ncap_cmt">operations fixed</a> (<tt>S</tt> = scalar, <tt>V</tt> = variable)
728
<li><b>NCO 2.9.1</b>: <tt>ncwa</tt> works again on packed <tt>NC_FLOAT</tt> data (<a href="#bug_pck_ncwa">broke when?</a>)
729
<li><b>NCO 2.9.0</b>: Complete <tt>ncap</tt> modulo operator (<tt>V%S</tt>) and generic exponentiation (<tt>V^S</tt>), scalar divided by variable (<tt>S/V</tt>); workaround stack memory problem with GCC extensions; fix <tt>make check</tt>
730
<li><b>NCO 2.8.8</b>: <tt>--enable-[optimize/debug]-custom</tt> options for GCC work again (broke in 2.8.6)
731
<li><b>NCO 2.8.7</b>: <tt>ncap</tt> packing works again (<a href="#bug_pck">broke in 2.8.4</a>); Cygwin builds work again
732
<li><b>NCO 2.8.6</b>: AIX and IRIX builds work again; custom GCC builds with <tt>-Werror</tt>
733
<li><b>NCO 2.8.5</b>: Solaris <tt>make install</tt> works; <tt>ncap</tt> changes attribute values correctly; <a href="#bld_DODS">Support DODS 3.4+, deprecate 3.3-</a>; add <tt>--enable-[optimize/debug]-custom</tt> options to <tt>./configure</tt>
734
<li><b>NCO 2.8.4</b>: Index-based hyperslabs work again (<a href="#bug_idx_hyp">broke in 2.7.3</a>, <i>upgrade highly recommended</i>); <tt>ncap</tt> peak memory usage reduced still more; support for AMD Opteron x86_64 architecture
834
Improve IRIX 6.5 support</li>
835
<li><b>NCO 3.2.0</b>: More forgiving exclusion list (<tt>-x -v <i>var_nm</i></tt>) <a href="http://nco.sf.net/nco.html#xcl">handling</a>; Fix <tt>rmssdn</tt> normalization; Support Mac OS X on Intel; Documentation bugfixes</li>
836
<li><b>NCO 3.1.9</b>: <tt>ncap2</tt> in RPM packages; Quieter output; AIX <tt>configure</tt> supports <tt>ncap2</tt>; Update to DAP for netCDF 3.6.2; Fix <tt>nc[erw]a</tt> for coordinate min/max/ttl; <tt>ncecat</tt> allows files to differ in record dimension size</li>
837
<li><b>NCO 3.1.8</b>: Support <tt>_FillValue</tt> with compile-time switch; Debian package synchronized, includes <tt>ncap2</tt></li>
838
<li><b>NCO 3.1.7</b>: <tt>ncap2</tt> “double-parsing”, array initialization, supercedes <tt>ncap</tt></li>
839
<li><b>NCO 3.1.6</b>: Support <a href="http://nco.sf.net/nco.html#srd">stride</a> in all hyperslabbing operators; change more WARNINGs to INFOs</li>
840
<li><b>NCO 3.1.5</b>: New <tt>ncap2</tt> array and hyperslab features; change some WARNINGs to INFOs, add Pathscale and update PGI and Intel compiler support</li>
841
<li><b>NCO 3.1.4</b>: Fix <tt>ncbo</tt> memory problem; report timer results</li>
842
<li><b>NCO 3.1.3</b>: <tt>ncap2</tt> automatically <a href="http://nco.sf.net/nco.html#att_prp">propagates</a> attributes to new/derived variables; NCO handles record variables with zero records; <a href="http://nco.sf.net/nco.html#cnv_CF_crd">support</a> CF <tt>coordinates</tt> convention; <tt>ncwa -b</tt> <a href="http://nco.sf.net/nco.html#ncwa">retains</a> degenerate dimensions; build fixes for Cray T3E, Solaris, Cygwin.</li>
843
<li><b>NCO 3.1.2</b>: <tt>ncap2</tt> control structures (conditionals, loops, etc.); keep non-processed data <a href="bug_pack_fix">packed</a> in output file; binary operators <tt>ncbo</tt> and <tt>ncflint</tt> work when only one variable has <tt>missing_value</tt> attribute; change <tt>ncra</tt> and <tt>nces</tt> to always average coordinate variables</li>
844
<li><b>NCO 3.1.1</b>: NCO builds (again) with C++ compilers; ncap2 development code; server-side extensions</li>
845
<li><b>NCO 3.1.0</b>: MPI operators are bug-free; fix <t>./configure</t> for MPI and netCDF4; MRV algorithm speeds up <tt>ncwa</tt> 5—10 times; <tt>ncap</tt> random number generator <tt>rnd_nbr()</tt></li>
846
<li><b>NCO 3.0.3</b>: Eliminate all critical read regions (accelerates all SMP operators); builds with netCDF4 alpha; read <t>NETCDF4_CLASSIC</t> (i.e., HDF) files automatically; write <t>NETCDF4</t> files <a href="http://nco.sf.net/nco.html#netcdf4">on request</a>; <a href="http://nco.sf.net#BM">benchmark results</a> quantify parallelism.</li>
847
<li><b>NCO 3.0.2</b>: Fewer critical read regions; all known memory leaks plugged; better Intel compiler support; <tt>SFTP</tt> protocol support; FTP protocol supports <tt>.netrc</tt>-based passwords; better model grid-property-awareness (e.g., <tt>lat_bnds</tt>); <tt>ncatted</tt> <tt>ncks</tt>, <tt>ncrename</tt> support metadata header padding with <tt>--hdr</tt>; <tt>ncbo</tt> supports heterogeneous variable ordering; <tt>ncatted</tt> bugfix</li>
848
<li><b>NCO 3.0.1</b>: benchmarks; <tt>ncks</tt> printing tweaks; memory cleanup; <tt>ncap</tt> double-parse speedup and <a href="bug_ncap_cmt">exponentiation bugfix</a>; thread operators by default</li>
849
<li><b>NCO 3.0.0</b>: New <tt>ncks -P</tt> print switch; <tt>ncap</tt> optimizations; <tt>-Z</tt> option supports 64-bit offsets (requires netCDF 3.6); NEC SX build improvements; support GCC 3.4.X; <tt>nco_put_vara()</tt> overloads in <tt>libnco_c++</tt></li>
850
<li><b>NCO 2.9.9</b>: <tt>ncpdq</tt> packs/unpacks entire files; <tt>ncbo</tt> is threaded</li>
851
<li><b>NCO 2.9.8</b>: <a href="./nco.html#ncpdq"><tt>ncpdq</tt></a> released; <tt>ncwa --msk_sng</tt> consolidated mask switch; C99 compiler required</li>
852
<li><b>NCO 2.9.7</b>: Read input file lists from <tt>stdin</tt>; write <tt>nco_input_file_list</tt> attributes; add <tt>nco_put_att<int,short,long></tt> functions to libnco_c++; large file support (LFS); write <tt>nco_openmp_thread_number</tt> attribute</li>
853
<li><b>NCO 2.9.6</b>: Support <tt>-o fl_out</tt> syntax; 64-bit ABI for x86_64; <a href="http://www.debian.org">Debian</a> builds libnco_c++</li>
854
<li><b>NCO 2.9.5</b>: <tt>ncflint</tt> handles <tt>missing_value</tt> data better, is commutative when weights are equal</li>
855
<li><b>NCO 2.9.4</b>: <tt>ncecat</tt> works on pure scalar files; change to <tt>cvs.sf.net</tt>; AIX GCC builds</li>
856
<li><b>NCO 2.9.3</b>: <tt>ncra</tt> and <tt>nces</tt> now <a name="bug_mss_val_zro_ncra">work correctly</a> when <tt>missing_value</tt> equals zero or any intermediate sums</li>
857
<li><b>NCO 2.9.2</b>: <tt>ncap</tt> <tt>S/V</tt>, <tt>S%V</tt>, and <tt>S^V</tt> <a href="#bug_ncap_cmt">operations fixed</a> (<tt>S</tt> = scalar, <tt>V</tt> = variable)</li>
858
<li><b>NCO 2.9.1</b>: <tt>ncwa</tt> works again on packed <tt>NC_FLOAT</tt> data (<a href="#bug_pck_ncwa">broke when?</a>)</li>
859
<li><b>NCO 2.9.0</b>: Complete <tt>ncap</tt> modulo operator (<tt>V%S</tt>) and generic exponentiation (<tt>V^S</tt>), scalar divided by variable (<tt>S/V</tt>); workaround stack memory problem with GCC extensions; fix <tt>make check</tt></li>
860
<li><b>NCO 2.8.8</b>: <tt>--enable-[optimize/debug]-custom</tt> options for GCC work again (broke in 2.8.6)</li>
861
<li><b>NCO 2.8.7</b>: <tt>ncap</tt> packing works again (<a href="#bug_pck">broke in 2.8.4</a>); Cygwin builds work again</li>
862
<li><b>NCO 2.8.6</b>: AIX and IRIX builds work again; custom GCC builds with <tt>-Werror</tt></li>
863
<li><b>NCO 2.8.5</b>: Solaris <tt>make install</tt> works; <tt>ncap</tt> changes attribute values correctly; <a href="#bld_DODS">Support DODS 3.4+, deprecate 3.3-</a>; add <tt>--enable-[optimize/debug]-custom</tt> options to <tt>./configure</tt></li>
864
<li><b>NCO 2.8.4</b>: Index-based hyperslabs work again (<a href="#bug_idx_hyp">broke in 2.7.3</a>, <i>upgrade highly recommended</i>); <tt>ncap</tt> peak memory usage reduced still more; support for AMD Opteron x86_64 architecture</li>
735
865
<li><b>NCO 2.8.3</b>: Fix big <tt>ncap</tt> memory leak; fix regressions; remove scary packing warnings</li>
736
866
<li><b>NCO 2.8.2</b>: <tt>ncbo</tt> handles distinct <tt>missing_value</tt>s correctly; improve error diagnostics</li>
737
867
<li><b>NCO 2.8.1</b>: <a href="./nco.html#rx">“Variable wildcarding”</a>—extended regular expressions in <tt>-v var,...</tt> lists—support in all operators</li>
773
903
<li><b>NCO 2.1.0</b>: <tt>ncap</tt> full lexer/parser operational</li>
774
904
<li><b>NCO 2.0.3</b>: small fixes to 2.0.0 (e.g., <tt>ncks</tt> printing)</li>
775
905
<li><b>NCO 2.0.2</b>: Add packing/unpacking capabilities based on <tt>scale_factor</tt> and <tt>add_offset</tt> convention</li>
776
<li><b>NCO 2.0.1</b>: Add user-configurable multi-threaded capability to arithmetic-intensive operators <tt>ncwa</tt>, <tt>ncea</tt>, and <tt>ncra</tt></li>
777
<li><b>NCO 2.0.0</b>: (RPM available) <a href="./nco_news.shtml#20010507">20010507</a>: Switched all internal calls to netCDF 3.x API</li>
906
<li><b>NCO 2.0.1</b>: Add user-configurable multi-threaded capability to arithmetic-intensive operators <tt>ncwa</tt>, <tt>nces</tt>, and <tt>ncra</tt></li>
907
<li><b>NCO 2.0.0</b>: (RPM available) <a href="./nco_news.shtml#20010507">20010507</a>: Switched all internal calls to netCDF 3.x API</li>
778
908
<li><b>NCO 1.2.2</b>: <a href="./nco_news.shtml#20010211">20010211</a>: Allow weights with
779
909
<tt>ncwa</tt> in min/max/ttl operations; easier building with HDF4.
780
910
<tt>ncrename</tt> can now work on specific variables rather than whole file.
781
911
<tt>ncks</tt> has <tt>-q</tt> option for cleaner printing</li>
782
912
<li><b>NCO 1.2.1</b>: <a href="./nco_news.shtml#20000828">20000828</a>: Added type-conversion of integers to floating point before arithmetic; fixed broken <tt>-v</tt> option</li>
783
<li><b>NCO 1.2</b>: <a href="./nco_news.shtml#20000730">20000730</a>: Added non-linear operations to <tt>ncra/ncea</tt> and <tt>ncwa</tt>: min,max,total,rms,rmssdn,sqrt. Added <a href="http://opendap.org">DODS</a> compliance.</li>
913
<li><b>NCO 1.2</b>: <a href="./nco_news.shtml#20000730">20000730</a>: Added non-linear operations to <tt>ncra/nces</tt> and <tt>ncwa</tt>: min,max,total,rms,rmssdn,sqrt. Added <a href="http://opendap.org">DODS</a> compliance.</li>
784
914
<li><b>NCO 1.1.48</b>: <a href="./nco_news.shtml#20000515">20000515</a>: Potentially serious bugfix to <tt>ncdiff</tt>, recommend upgrade</li>
785
915
<li><b>NCO 1.1.47</b>: <a href="./nco_news.shtml#20000510">20000510</a>: Improved <tt>ncra</tt> and <tt>ncrcat</tt> to allow lazier specifications of input files</li>
821
952
<h3><a href="http://www.debian.org">Debian</a> and <a href="http://www.ubuntu.com">Ubuntu</a> GNU/Linux</a></h3>
824
<li><a href="http://www.debian.org">Debian</a> and <a href="http://www.ubuntu.com">Ubuntu</a> GNU/Linux-compatible Intel systems, prebuilt binary executable <a href="http://www.debian.org">deb</a>: <a href="http://packages.debian.org/testing/math/nco.html">nco-4.0.9</a></li>
955
<li><a href="http://www.debian.org">Debian</a> and <a href="http://www.ubuntu.com">Ubuntu</a> GNU/Linux-compatible Intel systems, prebuilt binary executable <a href="http://www.debian.org">deb</a>: <a href="http://packages.debian.org/testing/math/nco.html">nco-4.4.2</a></li>
826
957
<a href="http://packages.debian.org/unstable/science/nco">Debian NCO</a> and
827
958
<a href="http://packages.ubuntu.com/natty/nco">Ubuntu NCO</a> homepages.
828
959
‘<tt>aptitude install nco</tt>’ installs the standard NCO for your Debian-compatible OS.
829
NCO packages in the Debian/Ubuntu repositories (i.e., Sid and Natty) generally lag the packages distributed here by 6–12 months.
960
NCO packages in the Debian/Ubuntu repositories (i.e., Sid and Raring) generally lag the packages distributed here by 6–12 months.
830
961
<a name="beta"></a><a name="prerelease"> <!-- http://nco.sf.net#beta -->
831
962
Newer (beta- or pre-release) packages are often available for intrepid Debian/Ubuntu users as described <a href="http://nco.cvs.sf.net/nco/nco/doc/beta.txt">here</a>.
832
<dt>Debian package for most recent NCO release (install with, e.g., ‘<tt>dpkg --install nco_4.0.9-1_i386.deb</tt>’):</dt>
833
<li><a href="src/nco_4.0.9-1_amd64.deb">nco_4.0.9-1_amd64.deb</a> (<!--#fsize file="src/nco_4.0.9-1_amd64.deb"-->): Executables AMD64-compatible (last updated <!--#flastmod file="src/nco_4.0.9-1_amd64.deb"-->)</li>
834
<li><a href="src/nco_4.0.9-1.dsc">nco_4.0.9-1.dsc</a> (<!--#fsize file="src/nco_4.0.9-1.dsc"-->): Description (last updated <!--#flastmod file="src/nco_4.0.9-1.dsc"-->)</li>
835
<li><a href="src/nco_4.0.9-1_amd64.changes">nco_4.0.9-1_amd64.changes</a> (<!--#fsize file="src/nco_4.0.9-1_amd64.changes"-->): Changes since last deb package (last updated <!--#flastmod file="src/nco_4.0.9-1_amd64.changes"-->)</li>
836
<li><a href="src/nco_4.0.9.orig.tar.gz">nco_4.0.9.orig.tar.gz</a> (<!--#fsize file="src/nco_4.0.9.orig.tar.gz"-->): Upstream Source (last updated <!--#flastmod file="src/nco_4.0.9.orig.tar.gz"-->)</li>
837
<li><a href="src/nco_4.0.9-1.diff.gz">nco_4.0.9-1.diff.gz</a> (<!--#fsize file="src/nco_4.0.9-1_amd64.changes"-->): Debian patch to upstream source (last updated <!--#flastmod file="src/nco_4.0.9-1_amd64.changes"-->)</li>
963
<dt>Debian package for most recent NCO release (install with, e.g., ‘<tt>dpkg --install nco_4.4.2-1_i386.deb</tt>’):</dt>
964
<li><a href="src/nco_4.4.2-1_amd64.deb">nco_4.4.2-1_amd64.deb</a> (<!--#fsize file="src/nco_4.4.2-1_amd64.deb"-->): Executables AMD64-compatible (last updated <!--#flastmod file="src/nco_4.4.2-1_amd64.deb"-->)</li>
965
<li><a href="src/nco_4.4.2-1.dsc">nco_4.4.2-1.dsc</a> (<!--#fsize file="src/nco_4.4.2-1.dsc"-->): Description (last updated <!--#flastmod file="src/nco_4.4.2-1.dsc"-->)</li>
966
<li><a href="src/nco_4.4.2-1_amd64.changes">nco_4.4.2-1_amd64.changes</a> (<!--#fsize file="src/nco_4.4.2-1_amd64.changes"-->): Changes since last deb package (last updated <!--#flastmod file="src/nco_4.4.2-1_amd64.changes"-->)</li>
967
<li><a href="src/nco_4.4.2.orig.tar.gz">nco_4.4.2.orig.tar.gz</a> (<!--#fsize file="src/nco_4.4.2.orig.tar.gz"-->): Upstream Source (last updated <!--#flastmod file="src/nco_4.4.2.orig.tar.gz"-->)</li>
968
<li><a href="src/nco_4.4.2-1.diff.gz">nco_4.4.2-1.diff.gz</a> (<!--#fsize file="src/nco_4.4.2-1_amd64.changes"-->): Debian patch to upstream source (last updated <!--#flastmod file="src/nco_4.4.2-1_amd64.changes"-->)</li>
838
969
Thanks to Daniel Baumann, Barry deFreese, Francesco Lovergine,
839
970
Brian Mays, Rorik Peterson, and Matej Vela for their help packaging
840
971
NCO for Debian over the years.
845
976
<a name="centos"></a><a name="cnt"></a><a name="rhel"></a> <!-- http://nco.sf.net#centos --> <!-- http://nco.sf.net#cnt --> <!-- http://nco.sf.net#rhel -->
846
977
<h3><a href="http://fedora.redhat.com">Fedora</a>, RedHat Enterprise Linux (<a href="http://www.redhat.com/rhel">RHEL</a>), and Community ENTerprise Operating System (<a href="http://www.centos.org">CentOS</a>) GNU/Linux</h3>
848
<dt>The <a href="https://admin.fedoraproject.org/pkgdb/packages/name/nco">Fedora NCO</a> RPMs are usually up-to-date so that ‘<tt>yum install nco</tt>’ might install, e.g.,
849
<li><a href="http://rpmfind.net/linux/RPM/fedora/devel/x86_64/nco-3.9.8-1.fc11.x86_64.html">nco-3.9.8-1.fc11.x86_64.rpm</a>: Executables for x86_64/Fedora Core 11-compatible environments</li></dt>
850
<dt>If not, try our own most recent self-built NCO RPMs (install with, e.g., ‘<tt>yum install nco-3.9.5-1.fc7.i386.rpm</tt>’):
979
<dt>The <a href="https://admin.fedoraproject.org/pkgdb/packages/name/nco">Fedora NCO</a> RPMs are usually up-to-date so that ‘<tt>yum install nco</tt>’ will install a recent version.
980
A comprehensive list of pre-built RPMs for many OS's is <a href="http://rpmfind.net/linux/rpm2html/search.php?query=nco">here</a>.
981
<li><a href="ftp://rpmfind.net/linux/fedora/linux/development/rawhide/x86_64/os/Packages/n/nco-4.3.2-1.fc20.x86_64.rpm">nco-4.3.2-1.fc20.x86_64.rpm</a>: Executables for x86_64/Fedora Core 20-compatible environments</li></dt>
982
<dt>If not, try our own most recent (we stopped building RPMs many years ago and are looking for a volunteer to do this instead) self-built NCO RPMs (install with, e.g., ‘<tt>yum install nco-3.9.5-1.fc7.i386.rpm</tt>’):
851
983
<li><a href="src/nco-3.9.5-1.fc7.i386.rpm">nco-3.9.5-1.fc7.i386.rpm</a> (<!--#fsize file="src/nco-3.9.5-1.fc7.i386.rpm"-->): Executables for i386/Fedora Core 7-compatible environments (last updated <!--#flastmod file="src/nco-3.9.5-1.fc7.i386.rpm"-->)</li>
852
984
<li><a href="src/nco-3.9.5-1.fc7.src.rpm">nco-3.9.5-1.fc7.src.rpm</a> (<!--#fsize file="src/nco-3.9.5-1.fc7.src.rpm"-->): Source (last updated <!--#flastmod file="src/nco-3.9.5-1.fc7.src.rpm"-->)</li>
853
985
<li><a href="src/nco-3.9.5-1.x86_64.rpm">nco-3.9.5-1.x86_64.rpm</a> (<!--#fsize file="src/nco-3.9.5-1.x86_64.rpm"-->): Executables for x86_64/CentOS 5-compatible environments (last updated <!--#flastmod file="src/nco-3.9.5-1.x86_64.rpm"-->)</li>
854
<li>Scripts for generating executables for recent (4.0.x, ~2011) versions of NCO for RedHat Enterprise Linux 5 (RHEL5) and CentOS5 platforms are described <a href="http://sourceforge.net/projects/nco/forums/forum/9830/topic/4089501">here</a>.</li>
855
<li>Older information on building x86_64 RPMs is available <a href="http://dust.ess.uci.edu/wangd/s9y">here</a>.</li>
856
986
Volunteers have updated and maintained fairly up-to-date NCO packages in Fedora since it was added by Ed Hill in about 2004.
857
987
Thanks to Patrice Dumas, Ed Hill, and Orion Poplawski for packaging NCO RPMs over the years.
858
988
Thanks to Gavin Burris and Kyle Wilcox for documenting build procedures for RHEL and CentOS.
878
1008
<a name="fink"></a> <!-- http://nco.sf.net#fink -->
879
1009
<h3><a href="http://www.apple.com/macosx/">Mac OS X/Darwin</a></h3>
881
<!-- Copy DMG files from http://ps.uci.edu/~pscsg/nco
882
wget http://ps.uci.edu/~pscsg/nco/nco-4.0.7_x86_10.6.dmg -O /tmp/nco-4.0.7_x86_10.6.dmg
883
/usr/bin/scp /tmp/nco-4.0.7_x86_10.6.dmg zender,nco@web.sf.net:/home/project-web/nco/htdocs/src
884
scp /tmp/nco-4.0.7_x86_10.6.dmg dust.ess.uci.edu:/var/www/html/nco/src
1012
/usr/bin/scp /home/pvicente/nco/doc/index.shtml pvicente,nco@web.sf.net:/home/project-web/nco/htdocs
1013
/usr/bin/scp /home/pvicente/windows_setup/nco-4.4.1.macosx.10.9.tar.gz pvicente,nco@web.sf.net:/home/project-web/nco/htdocs/src
886
Use the <a href="http://en.wikipedia.org/wiki/Apple_Disk_Image">DMG</a> files if you do not have MacPorts installed. You may need to add <tt>/opt/local/bin</tt> to your executable path to access the operators.
1015
The most up-to-date binaries are probably those in the tarball below. Those unfamiliar with installing executables from tarballs may try the (older) <a href="http://en.wikipedia.org/wiki/Apple_Disk_Image">DMG</a> files (you may need to add <tt>/opt/local/bin</tt> to your executable path to access those operators).
1016
<li><a href="src/nco-4.4.1.macosx.10.9.tar.gz">nco-4.4.1.macosx.10.9.tar.gz</a> (<!--#fsize file="src/nco-4.4.1.macosx.10.9.tar.gz"-->): Executables MacOSX 10.9-compatible (last updated <!--#flastmod file="src/nco-4.4.1.macosx.10.9.tar.gz"-->).
1017
(NB: These executables require the <a href="http://trac.macosforge.org/projects/macports/wiki">MacPorts</a> dependencies for <a href="http://svn.macports.org/repository/macports/trunk/dports/science/nco">NCO</a>). Maintained by NCO Project.</li>
887
1018
<li><a href="src/nco-4.0.3_x86_10.6.dmg">nco-4.0.3_x86_10.6.dmg</a> (<!--#fsize file="src/nco-4.0.3_x86_10.6.dmg"-->): For Mac OS 10.6 (last updated <!--#flastmod file="src/nco-4.0.3_x86_10.6.dmg"-->). Maintained by Chad Cantwell.</li>
888
1019
<li><a href="src/nco-4.0.7_x86_10.6.dmg">nco-4.0.7_x86_10.6.dmg</a> (<!--#fsize file="src/nco-4.0.7_x86_10.6.dmg"-->): For Mac OS 10.6 (last updated <!--#flastmod file="src/nco-4.0.7_x86_10.6.dmg"-->). Maintained by Chad Cantwell.</li>
889
1020
<li><a href="http://fink.sf.net">Fink</a> packages for <a href="http://fink.sf.net/pdb/package.php/nco">NCO</a>: Currently NCO 3.9.5. Maintained by Alexander Hansen.</li>
890
<li><a href="http://trac.macosforge.org/projects/macports/wiki">MacPorts</a> infrastructure for <a href="http://svn.macports.org/repository/macports/trunk/dports/science/nco">NCO</a>:
891
<a href="http://svn.macports.org/repository/macports/trunk/dports/science/nco">Portfile</a>
892
for NCO 3.9.9. Maintained by Takeshi Enomoto.</li>
895
<a name="cygwin"></a><a name="dbn"></a> <!-- http://nco.sf.net#cygwin -->
896
<a name="windows"></a><a name="ubn"></a> <!-- http://nco.sf.net#windows -->
897
<h3><a href="http://www.microsoft.com">Microsoft</a> Windows</a> running <a href="http://www.cygwin.org">Cygwin</a></h3>
899
<li><a href="src/nco-4.0.6.win32.cygwin.tar.gz">nco-4.0.6.win32.cygwin.tar.gz</a> (<!--#fsize file="src/nco-4.0.6.win32.cygwin.tar.gz"-->): Executables Win32-compatible (last updated <!--#flastmod file="src/nco-4.0.6.win32.cygwin.tar.gz"-->).</li>
1021
<li><a href="http://trac.macosforge.org/projects/macports/wiki">MacPorts</a> infrastructure for <a href="http://svn.macports.org/repository/macports/trunk/dports/science/nco">NCO</a>: <a href="http://svn.macports.org/repository/macports/trunk/dports/science/nco">Portfile</a> for NCO 3.9.9. Maintained by Takeshi Enomoto.</li>
1024
<a name="visual"></a> <!-- http://nco.sf.net#visual -->
1025
<a name="mvs"></a> <!-- http://nco.sf.net#mvs -->
1026
<a name="windows"></a> <!-- http://nco.sf.net#windows -->
1027
<h3><a href="http://www.microsoft.com">Microsoft</a> Windows</a>
1028
(native build, compiled with <a href="http://www.microsoft.com/visualstudio/en-us/products/2010-editions/express">Visual Studio 2010</a>, use this if unsure)</h3>
1029
These native Windows executables should be stand-alone, i.e., not
1030
require users to have any additional software.
1031
This is a new feature as of 20120615, please send us feedback.
1032
To build NCO from source yourself using MSVC or Qt, please see the <a href="nco_qt_msvc.shtml">NCO Qt/MSVC build</a> page.
1034
<!-- Copy files from http://glace.ess.uci.edu
1035
/usr/bin/scp /home/pvicente/nco/doc/index.shtml pvicente,nco@web.sf.net:/home/project-web/nco/htdocs
1036
/usr/bin/scp /home/pvicente/windows_setup/nco-4.4.1.windows.mvs.exe pvicente,nco@web.sf.net:/home/project-web/nco/htdocs/src
1037
/usr/bin/scp /home/pvicente/windows_setup/nco-4.4.1.win32.cygwin.tar.gz pvicente,nco@web.sf.net:/home/project-web/nco/htdocs/src
1038
/usr/bin/scp /home/pvicente/windows_setup/nco-4.4.1.macosx.10.9.tar.gz pvicente,nco@web.sf.net:/home/project-web/nco/htdocs/src
1040
<li><a href="src/nco-4.4.1.windows.mvs.exe">nco-4.4.1.windows.mvs.exe</a> (<!--#fsize file="src/nco-4.4.1.windows.mvs.exe"-->) : Windows Self-Extracting Installer (last updated <!--#flastmod file="src/nco-4.4.1.windows.mvs.exe"-->). Maintained by NCO Project.</li>
1043
<a name="cygwin"></a> <!-- http://nco.sf.net#cygwin -->
1044
<h3><a href="http://www.microsoft.com">Microsoft</a> Windows</a> (running <a href="http://www.cygwin.org">Cygwin</a> environment, compiled with GNU-toolchain)</h3>
1046
<li><a href="src/nco-4.4.1.win32.cygwin.tar.gz">nco-4.4.1.win32.cygwin.tar.gz</a> (<!--#fsize file="src/nco-4.4.1.win32.cygwin.tar.gz"-->): Executables Cygwin-compatible (last updated <!--#flastmod file="src/nco-4.4.1.win32.cygwin.tar.gz"-->). Maintained by NCO Project.</li>
900
1047
First install <tt>curl</tt> (in the "Web" category of Cygwin setup),
901
1048
and point the environment variable <tt>UDUNITS2_XML_PATH</tt> to the
902
1049
<tt>udunits2.xml</tt> file, e.g., with
903
1050
<tt>export UDUNITS2_XML_PATH='/usr/local/share/udunits/udunits2.xml'</tt>.
1051
Thanks to Mark Hadfield for creating Cygwin tarballs.
904
1052
Thanks to Cygnus Solutions and RedHat Inc. for developing and supporting Cygwin over the years.
924
1073
<tt>nco.texi</tt> is the most up-to-date.
925
1074
Files <tt>nco.dvi</tt>, <tt>nco.ps</tt>, and <tt>nco.pdf</tt> are
926
the most complete and contain all the mathematical formulae (typeset
927
with TeX) missing from the screen-oriented formats.
1075
contain all the mathematical formulae (typeset with TeX) missing from
1076
the screen-oriented formats.
928
1077
The screen-oriented formats—<tt>nco.html</tt>,
929
1078
<tt>nco.info</tt>, <tt>nco.txt</tt>, and <tt>nco.xml</tt>—contain
930
1079
all the documentation except the highly mathematical sections.
934
<li>As of August, 2008, NCO has a <a href="http://nco.wiki.sourceforge.net">Wiki</a>.
935
The Wiki contains a <a href="http://nco.wiki.sourceforge.net/Cookbook">Cookbook</a>
936
of NCO examples not found in the manual.
937
Volunteers are encourage to add their own “NCO Hacks” to this cookbook!
1084
<li>NCO had a <a href="http://nco.wiki.sf.net">Wiki</a> for a few
1085
years beginning in August, 2008.
1086
The Wiki contained a <a href="http://nco.wiki.sf.net/Cookbook">Cookbook</a>
1087
of NCO examples not found in the manual.
1088
Volunteers are encouraged to add their own “NCO Hacks” to this cookbook!</li>
940
1092
<h3>Other documentation:</h3>
942
1094
<li>This <a href="http://dust.ess.uci.edu/doc/abb/abb.pdf">abbreviation key</a> unlocks the mysteries of the source code abbreviations and acronyms.</li>
1096
<!-- This documentation went MIA sometime in 2010:
944
1097
<li>Unidata netCDF for Developers Workshop <a href="http://www.unidata.ucar.edu/software/netcdf/docs/workshop/utilities/Nco.html">NCO examples</a></li>
947
1101
<!-- This documentation went MIA sometime in 2004:
1102
<a href="http://www.ncl.ucar.edu/Training/Workshops/PPTS/nco.ppt">Slideshow</a> and
948
1103
<a href="http://www.cgd.ucar.edu/csm/support/Document/pdf/nco.pdf">pamphlet</a> and
949
1104
<a href="http://www.cgd.ucar.edu/csm/support/Document/shows/nco/nco_files/v3_document.htm">slide presentation</a>
950
1105
introduce and summarize the NCO operators.
1081
1236
<!-- http://nco.sf.net#bld -->
1082
1237
<dt><a name="Rqr"></a><a name="rqr"></a></dt> <!-- http://nco.sf.net#rqr -->
1083
1238
<dt><a name="bld"></a></dt> <!-- http://nco.sf.net#bld -->
1084
<dt><a name="apt"></a></dt> <!-- http://nco.sf.net#apt -->
1085
<dt><a name="yum"></a></dt> <!-- http://nco.sf.net#yum -->
1086
1239
<dt><a name="cmp"></a></dt> <!-- http://nco.sf.net#cmp -->
1087
1240
<h2>Compilation Requirements</h2>
1089
1242
<ul><b>Best Practices:</b>
1091
1244
<a name="bld_rqr"></a> <!-- http://nco.sf.net#bld_rqr -->
1092
Building NCO yourself can be painful, so we recommend you first try the pre-built binaries for your system, e.g.,
1245
<li>Although building NCO yourself can be easy, sexy, and lucrative,
1246
we recommend that you first try the pre-built binaries for your
1094
<dt>sudo aptitude install nco # Debian-based systems like Ubuntu</dt>
1095
<dt>sudo yum-install nco # RPM-based systems like Fedora</dt>
1249
<dt>sudo aptitude install nco # Debian-based systems like Debian, Mint, Ubuntu</dt>
1250
<dt>sudo yum-install nco # RPM-based systems like CentOS, Fedora, RHEL</dt>
1097
If the pre-built executables do not satisfy you, then the recommended first steps to build (i.e., compile, for the most part) NCO from source code are to install
1098
<a href="http://www.antlr.org">ANTLR 2.7.x (not version 3.x!)</a> (required for <tt>ncap2</tt>),
1252
If the pre-built executables do not satisfy you, or are out-of-date
1253
and you want the latest, greatest NCO features, then the recommended
1254
first steps to build (i.e., compile, for the most part) NCO from
1255
source code are to install
1256
<a href="http://www.antlr.org">ANTLR 2.7.x</a> (not version 3.x or 4.x!) (required for <tt>ncap2</tt>),
1099
1257
<a href="http://www.gnu.org/software/gsl">GSL</a> (desirable for <tt>ncap2</tt>),
1100
1258
<a href="http://www.unidata.ucar.edu/packages/netcdf">netCDF</a> (absolutely required),
1101
1259
<a href="http://opendap.org">OPeNDAP</a> (enables network transparency), and
1102
1260
<a href="http://www.unidata.ucar.edu/packages/udunits">UDUnits</a> (allows dimensional unit transformations)
1103
1261
before building NCO.
1104
If possible build these all with the same compiler (and switches).
1262
If possible, install this software stack from pre-built binaries
1263
(commands to do so on Debian and RPM systems are given just below).
1264
Failing that (e.g., you lack root access or are on a non-package
1265
system such as AIX), build these all with the same compiler (and switches).
1266
Recent versions of netCDF automatically build OPeNDAP and UDUnits.
1105
1267
NCO is mostly written in C99, and although you <i>may</i> mix and
1106
1268
match compilers, this is often difficult in practice and is not recommended.
1107
1269
The exception is <tt>ncap2</tt> which is written in C++.
1108
1270
ANTLR, OPeNDAP, and NCO must be built with the same C++ compiler
1109
1271
to properly resolve the C++ name-mangling.
1110
1272
NCO does not yet support newer ANTLR versions because the
1111
ANTLR 3.x C++ interface is incomplete.
1273
ANTLR 3.x and 4.x C++ interfaces are incomplete.
1113
It is possible and often preferable to install most of the
1114
pre-requisite and optional software from pre-compiled packages on
1115
modern Debian-based systems with
1275
<dt><a name="apt"></a></dt> <!-- http://nco.sf.net#apt -->
1276
<dt><a name="aptitude"></a></dt> <!-- http://nco.sf.net#aptitude -->
1277
<dt><a name="bld_apt"></a></dt> <!-- http://nco.sf.net#bld_apt -->
1278
For the reasons explained above (compiler compatibility) install as
1279
much pre-requisite and optional software as possible from pre-compiled
1281
This is easy on modern package-oriented OSs.
1282
For Debian-based systems:
1117
1284
<dt>sudo aptitude install antlr libantlr-dev # ANTLR</dt>
1118
<dt>sudo aptitude install libcurl4-gnutls-dev libexpat1-dev libxml2-dev # DAP-prereqs</dt>
1285
<dt>sudo aptitude install libcurl4-gnutls-dev libexpat1-dev libxml2-dev # DAP-prereqs (curl, expat XML parser) </dt>
1119
1286
<dt>sudo aptitude install bison flex gcc g++ # GNU toolchain</dt>
1120
1287
<dt>sudo aptitude install gsl-bin libgsl0-dev # GSL</dt>
1121
1288
<dt>sudo aptitude install libnetcdf6 libnetcdf-dev netcdf-bin # netCDF and DAP</dt>
1289
<dt>sudo aptitude install libhdf5-serial-dev # HDF5</dt>
1122
1290
<dt>sudo aptitude install udunits-bin libudunits2-0 libudunits2-dev # UDUnits</dt>
1124
</tt>or, on RPM-based systems, with
1126
<dt>sudo yum install antlr antlr-c++-devel # ANTLR</dt>
1127
<dt>sudo yum install curl-devel libxml2-devel # DAP-prereqs</dt>
1128
<dt>sudo yum install libdap libdap-devel libnc-dap libnc-dap-devel # DAP</dt>
1129
<dt>sudo yum install bison flex gcc g++ # GNU toolchain</dt>
1130
<dt>sudo yum install gsl gsl-devel # GSL</dt>
1131
<dt>sudo yum install netcdf netcdf-devel # netCDF</dt>
1132
<dt>sudo yum install librx librx-devel # RX</dt>
1133
<dt>sudo yum install udunits udunits-devel # UDUnits</dt>
1293
<dt><a name="yum"></a></dt> <!-- http://nco.sf.net#yum -->
1294
<dt><a name="bld_yum"></a></dt> <!-- http://nco.sf.net#bld_yum -->
1295
For RPM-based systems:
1297
<dt>sudo yum install antlr antlr-C++ -y # ANTLR</dt>
1298
<dt>sudo yum install curl-devel libxml2-devel -y # DAP-prereqs</dt>
1299
<dt>sudo yum install expat expat-devel -y # expat XML parser, a UDUnits-prereq (RHEL only?)</dt>
1300
<dt>sudo yum install libdap libdap-devel -y # DAP</dt>
1301
<dt>sudo yum install bison flex gcc gcc-c++ -y # GNU toolchain</dt>
1302
<dt>sudo yum install gsl gsl-devel -y # GSL</dt>
1303
<dt>sudo yum install netcdf netcdf-devel -y # netCDF</dt>
1304
<dt>sudo yum install librx librx-devel -y # RX</dt>
1305
<dt>sudo yum install udunits2 udunits2-devel -y # UDUnits</dt>
1308
<dt><a name="port"></a></dt> <!-- http://nco.sf.net#port -->
1309
<dt><a name="bld_macports"></a></dt> <!-- http://nco.sf.net#bld_macports -->
1310
For Mac OS X with MacPorts:
1312
<dt>sudo port install libdap # DAP</dt>
1313
<dt>sudo port install gsl # GSL</dt>
1314
<dt>sudo port install netcdf # netCDF</dt>
1315
<dt>sudo port install udunits2 # UDUnits</dt>
1318
<li>Once you have installed the pre-requisites as shown above, you may
1319
then build the latest stable NCO and install it in,
1320
e.g., <tt>/usr/local</tt> with:
1322
<dt>wget http://dust.ess.uci.edu/nco/nco.tar.gz</dt>
1323
<dt>tar xvzf nco.tar.gz</dt>
1324
<dt>cd nco-4.4.2</dt>
1325
<dt>./configure --prefix=/usr/local</dt>
1327
<dt>sudo make install</dt>
1328
<dt>export PATH=/usr/local/bin\:${PATH}</dt>
1329
<dt>export LD_LIBRARY_PATH=/usr/local/lib\:${LD_LIBRARY_PATH}</dt>
1331
<dt><a name="bonobo"></a></dt> <!-- http://nco.sf.net#bonobo -->
1332
<dt><a name="bnb"></a></dt> <!-- http://nco.sf.net#bnb -->
1333
Please post questions about building or installing NCO to the
1334
<a href="http://sf.net/projects/nco/forums/forum/9830">list</a>
1335
only after reading and attempting to follow these instructions.
1336
To indicate you have done this, include the word “bonobo”
1337
in the first sentence of your post.
1338
Yes, “bonobo”.
1339
Otherwise we will likely redirect you here.
1340
For more sophisticated build/install options, see the next section.
1139
1343
<dt><a name="Makefile"></a></dt> <!-- http://nco.sf.net#Makefile -->
1418
1635
<h2>Using NCO at UCI, NCAR, and other High Performance Computing Centers (HPCCs)</h2>
1419
1636
<p>UC Irvine and NCAR users <i>may</i> find pre-built,
1420
1637
<i>almost</i> up-to-date NCO executables in the following locations.
1421
These executables are <i>unsupported</i> and are almost
1422
<i>guaranteed</i> to hail from different NCO versions and thus to
1423
behave slightly differently.
1424
(They are built from the main trunk, not a tagged version).
1425
Users at NCAR should try the <i>supported</i> executables in
1426
<tt>/usr/local/bin</tt> first.
1638
Users at NCAR/NWSC should first try the CISL-<i>supported</i>
1639
executables with <tt>module load nco</tt>.
1640
The unsatisfied or adventurous may try my personal executables which
1641
are built from the “main trunk” of NCO, not a tagged
1642
version, and therefore may behave slightly differently.
1428
<li>CGD network (Solaris 2.x): <tt>/home/zender/bin/SUNMP</tt></li>
1429
<li>ESS <tt>greenplanet.ps.uci.edu</tt> (Linux 2.6.x): <tt>/home/zender/bin/LINUX</tt></li>
1430
<li>ESS <tt>dust.ess.uci.edu</tt> (Linux 2.6.x): <tt>/home/zender/bin/LINUXAMD64</tt></li>
1431
<li>CISL <tt>bluefire.ucar.edu</tt> (AIX 5.3): <tt>~zender/bin/AIX</tt></li>
1432
<li>CISL <tt>mirage0.ucar.edu</tt> (Linux 2.6.x): <tt>~zender/bin/LINUXAMD64</tt></li>
1644
<li>UCI ESS <tt>greenplanet.ps.uci.edu</tt> (Linux 2.6.x): <tt>~zender/bin/LINUX</tt></li>
1645
<li>UCI ESS <tt>dust.ess.uci.edu</tt> (Linux 3.2.x): <tt>~zender/bin/LINUXAMD64</tt></li>
1646
<li>NCAR CISL <tt>yellowstone.ucar.edu</tt> (Linux 2.6.x): <tt>~zender/bin/LINUXAMD64</tt></li>
1647
<li>NCAR CISL <tt>mirage0.ucar.edu</tt> (Linux 2.6.x): <tt>~zender/bin/LINUXAMD64</tt></li>
1435
1650
<!-- End http://nco.sf.net#NCAR -->
1475
1690
Problems with recent releases:
1477
1692
<ul><b>Recent Generic Run-time Problems:</b>
1693
<!-- http://nco.sf.net#bug_mm3 -->
1694
<a name="bug_mm3"></a>
1695
<li><i><tt>MM3</tt> slowdown:</i>
1696
A longstanding “feature” of netCDF3 was identified in
1697
March, 2012, and is now known by the tag MM3.
1698
The MM3 issue can lead to unusually slow performance.
1699
The problem is triggered by an aggregate pattern of file access so the
1700
workaround must be implemented in the application software (e.g., NCO)
1701
rather than in the netCDF library itself.
1702
The name MM3 fits because the problem is normally encountered on
1703
Multi-record Multi-variable netCDF3 files.
1704
And we call our “solution” the MM3-workaround.
1705
If you encounter unusually slow NCO performance while using NCO to
1706
analyze MM3 files on a large blocksize filesystem,
1707
chances are you are encountering an MM3-induced slowdown.
1708
NCO release 4.1.0 implements the MM3-workaround for <tt>ncks</tt>.
1709
It speeds-up common ncks sub-setting on NCAR's GLADE by 10-50x.
1710
MM3-induced slowdowns are present in other NCO operators and we are
1711
prioritizing our MM3-patches to those encountered most often.
1712
Thanks to Gary Strand for reporting this problem, and to Russ Rew for
1713
creating the workaround algorithm, which is also now in <tt>nccopy</tt>.
1478
1716
<!-- http://nco.sf.net#bug_nofill -->
1479
1717
<a name="bug_nofill"></a>
1480
1718
<li><i><tt>NOFILL</tt> bug:</i>
1506
1744
<ul><b>Recent Operator-specific Run-time Problems:</b>
1507
No known operator-specific problems with recent releases.
1746
<!-- http://nco.sf.net#bug_ncra_no_fl_close -->
1747
<a name="bug_ncra_no_fl_close"></a>
1748
<li><i><tt>ncra</tt>, <tt>ncea</tt>, and <tt>ncrcat</tt> file close bug:</i>
1749
Versions 4.3.9—4.4.0 of <tt>ncra</tt>, <tt>ncea</tt>,
1750
and <tt>ncrcat</tt> failed to correctly close and optionally remove
1752
This could cause NCO to exceed system limits on the maximum number of
1753
open files when hundreds-to-thousands of input files were specified
1755
The exact failure point is OS-dependent (NCO commands on Mac OS X 10.9
1756
would fail when processing more than 256 files at a time).
1757
This is embarassing because NCO has always been designed to work with
1758
arbitrary numbers of input files and we want power users to be
1759
comfortable running it on hundreds of thousands of input files.
1760
The solution is to avoid versions 4.3.9—4.4.0 or to upgrade to
1765
<!-- http://nco.sf.net#bug_ncra_mro_mss_val -->
1766
<a name="bug_ncra_mro_mss_val"></a>
1767
<li><i><tt>ncra</tt> MRO missing value bug:</i>
1768
Versions 4.3.6—4.3.9 of <tt>ncra</tt> could treat missing values
1769
incorrectly during double-precision arithmetic.
1770
A symptom was that missing values could be replaced by strange numbers
1771
like, well, infinity or zero.
1772
This mainly affects <tt>ncra</tt> in MRO (multi-record output) mode,
1773
and the symptoms should be noticeable.
1774
The workaround is to run the affected versions of ncra using the
1775
<tt>--flt</tt> switch, so that single-precision floating point numbers
1776
are not promoted prior to arithmetic.
1777
The solution is to upgrade to NCO 4.4.0.
1781
<!-- http://nco.sf.net#bug_ncwa_lmt -->
1782
<a name="bug_ncwa_lmt"></a>
1783
<li><i><tt>ncwa</tt> hyperslabbing while averaging bug:</i>
1784
Versions 4.3.3—4.3.5 of <tt>ncwa</tt> could return incorrect
1785
answers when user-specified hyperslabs were simultaneously extracted.
1786
In such cases, hyperslab limits were not consistently applied.
1787
This could produce incorrect answers that look correct.
1788
This bug only affected hyperslabbed statistics (those produced
1789
by simultaneously invoking <tt>-a</tt> and <tt>-d</tt> switches);
1790
“global averages” were unaffected.
1791
We urge all <tt>ncwa</tt> users to upgrade to NCO 4.3.6.
1795
<!-- http://nco.sf.net#bug_ncpdq_upk -->
1796
<a name="bug_ncpdq_upk"></a>
1797
<li><i><tt>ncpdq</tt> unpacking bug with auxiliary coordinates:</i>
1798
Versions 4.3.2–4.3.3 of <tt>ncpdq</tt> did not correctly
1799
store unpacked variables.
1800
These versions unpacked (when specified with <tt>-U</tt> or <tt>-P
1801
upk</tt>) the values, but inadvertently stored their original packing
1802
attributes with the unpacked values.
1803
This would lead further operators to assume that the values were still
1805
Hence consecutive operations could lead to incorrect values.
1806
Fixed in version 4.3.4.
1807
All <tt>ncpdq</tt> users are encouraged to upgrade.
1808
NB: this bug did not affect the other arithmetic operators which
1809
unpack data prior to arithmetic.
1510
1812
<ul><b>Recent Platform-specific Run-time Problems:</b>
1511
1813
No known platform-specific problems with recent releases.
1574
1877
<ul><b>Older Operator-specific Run-time Problems:</b>
1879
<!-- http://nco.sf.net#bug_ncks_aux -->
1880
<a name="bug_ncks_aux"></a>
1881
<li><i><tt>ncks</tt> bug with auxiliary coordinates:</i>
1882
Versions 4.2.x–4.3.1 of <tt>ncks</tt> did not correctly
1883
support auxiliary coordinates (specified with <tt>-X</tt>).
1884
Auxiliary coordinates continued to work with the other hyperslabbing
1885
NCO operators. Auxiliary coordinates once again work in all
1886
hyperslabbing operators, including on netCDF4 group files in operators
1888
Fixed in version 4.3.2.
1891
<!-- http://nco.sf.net#bug_ncatted_strcmp -->
1892
<a name="bug_ncatted_strcmp"></a>
1893
<li><i><tt>ncatted</tt> bug on implicit attribute names:</i>
1894
Versions 4.2.x–4.3.0 of <tt>ncatted</tt> could segfault when
1895
processing attributes specified implicitly (i.e., by leaving the
1896
attribute field blank in the <tt>-a</tt> specification.
1897
Fixed in version 4.3.1.
1900
<!-- http://nco.sf.net#bug_ncbo_ccm_ccsm_cf -->
1901
<a name="bug_ncbo_ccm_ccsm_cf"></a>
1902
<li><i><tt>ncbo</tt> bug handling certain special variables:</i>
1903
Version 4.3.0 of <tt>ncbo</tt> inadvertently always turns off
1904
certain <a href="http://nco.sf.net/nco.html#prc_xcp">exceptions</a>
1905
to variable list processing.
1906
This may cause some grid-related variables (e.g., <tt>ntrm</tt> and <tt>nbdate</tt>)
1907
and some non-grid variables (e.g., <tt>ORO</tt> and <tt>gw</tt>) to be
1908
arithmetically processed (e.g., subtracted) even when that makes no
1909
sense in most climate model datasets.
1910
Fixed in version 4.3.1.
1913
<!-- http://nco.sf.net#bug_ncks_mtd -->
1914
<a name="bug_ncks_mtd"></a>
1915
<li><i><tt>ncks</tt> bug copying metadata:</i>
1916
Version 4.2.6 of <tt>ncks</tt> does not copy variable metadata by default.
1917
Thus output files appear stripped of metadata.
1918
One can work around this problem in 4.2.6 by specifying the <tt>-m</tt> option.
1919
Otherwise an upgrade is recommended.
1920
Fixed in version 4.3.0.
1923
<!-- http://nco.sf.net#bug_ncks_sbs -->
1924
<a name="bug_ncks_sbs"></a>
1925
<li><i><tt>ncks</tt> bug subsetting variables:</i>
1926
Version 4.2.4 of <tt>ncks</tt> sometimes dumps core
1927
when subsetting variables with <tt>-v var</tt>.
1928
Fixed in version 4.2.5.
1931
<!-- http://nco.sf.net#bug_ncks_mk_rec_dmn -->
1932
<a name="bug_ncks_mk_rec_dmn"></a>
1933
<li><i><tt>ncks</tt> bug with altering record dimensions:</i>
1934
Version 4.2.4 of <tt>ncks</tt> ignored both the
1935
<tt>--mk_rec_dmn</tt> and the <tt>--fix_rec_dmn</tt> switches.
1936
It exited successfully without altering the record variable.
1937
Fixed in version 4.2.5.
1940
<!-- http://nco.sf.net#bug_nces_rec_var -->
1941
<a name="bug_nces_rec_var"></a>
1942
<li><i><tt>nces</tt> bug with non-record files:</i>
1943
Versions 4.2.1—4.2.3 of <tt>nces</tt> incorrectly referenced
1944
the record variable on files which do not contain it.
1945
This caused a segmentation violation and core dump.
1948
<!-- http://nco.sf.net#bug_ncra_flg_bfr_nrm -->
1949
<a name="bug_ncra_flg_bfr_nrm"></a>
1950
<li><i><tt>ncra</tt> bug when last file(s) is/are superfluous:</i>
1951
Versions 4.2.1—4.2.3 of <tt>ncra</tt> incorrectly skipped
1952
writing the results of the final normalization when trailing files
1953
were superfluous (not used).
1954
In the most common case, all values are zeros in the output file.
1955
Upgrade if you call <tt>ncra</tt> with trailing superfluous files.
1958
<!-- http://nco.sf.net#bug_ncecat_nintap -->
1959
<a name="bug_ncecat_nintap"></a>
1960
<li><i><tt>ncecat</tt> bug when files generated with <tt>-n</tt>:</i>
1961
Version 4.2.2 of <tt>ncecat</tt> could incorrectly skip the first
1962
input file in the default mode (RECORD_AGGREGATE) when
1963
the <tt>-n NINTAP</tt> switch is used to automate filename generation.
1964
Upgrade if you use <tt>ncecat -n</tt>.
1575
1967
<!-- http://nco.sf.net#bug_ncra_cf_crd_rec_crd -->
1576
1968
<a name="bug_ncra_cf_crd_rec_crd"></a>
1577
1969
<li><i><tt>ncra</tt> bug handling CF <tt>coordinates</tt> attributes
1811
2206
<i>Other Interests</i>: Atmospheric Physics, Climate Change.
2210
<a name="butowsky"></a><a name="Butowsky"></a> <!-- http://nco.sf.net#butowsky -->
2211
<a href="http://dust.ess.uci.edu/hbutowsk">Henry Butowsky</a>,
2213
<i>Roles</i>: Scientific programmer
2214
<i>Current Research</i>:
2215
1. Efficient complex data analysis with storage-layer constraints.
2216
2. Develop and thread the <tt>ncap2</tt> interpreter.
2217
<i>Other Interests</i>: Compilers and interpreters.
2221
<a name="vicente"></a><a name="Vicente"></a> <!-- http://nco.sf.net#vicente -->
2222
<a href="http://dust.ess.uci.edu/pvicente">Pedro Vicente</a>,
2224
<i>Roles</i>: Scientific programmer
2225
<i>Current Research</i>:
2226
1. Support for hierarchical datasets.
2227
2. Optimization of hierarchical access.
2228
<i>Other Interests</i>: HDF and netCDF data visualization.
2232
<a name="wenshan"></a><a name="Wenshan"></a> <!-- http://nco.sf.net#wenshan -->
2233
<a href="http://dust.ess.uci.edu/wenshanw">Wenshan Wang</a>,
2235
<i>Roles</i>: Graduate Student
2236
<i>Current Research</i>:
2237
1. Causes and implications of snowpack darkening.
2238
2. Rapid evaluation and exploitation of multi-model datasets.
2239
<i>Other Interests</i>: Passing Comps.
2244
<p>Alumni Developers:
1815
2248
<a name="jenks"></a><a name="Jenks"></a> <!-- http://nco.sf.net#jenks -->
1816
2249
<a href="http://spds.ece.uci.edu/~sjenks">Stephen Jenks</a>,
1817
Former Assistant Professor of Electrical Engineering and Computer Science
1818
(<a href="http://www.eecs.uci.edu">EECS</a>) and
1819
Director, Scalable Parallel and Distributed Systems
1820
(<a href="http://spds.ece.uci.edu">SPDS</a>) lab.
2250
former Assistant Professor of Electrical Engineering and Computer Science
2251
(<a href="http://www.eecs.uci.edu">EECS</a>).
1821
2253
<i>Roles</i>: Collaborator. Thesis advisor.
1822
2254
<i>Related Research</i>:
1823
2255
1. Consulting on SWAMP design and implementation.
1824
2256
<i>Other Interests</i>: Cache memory usage
2261
<a name="capps"></a><a name="Capps"></a> <!-- http://nco.sf.net#capps -->
2262
<a href="http://dust.ess.uci.edu/scapps/web">Dr. Scott Capps</a>,
2263
earned Earth System Science Ph.D. (2009) with Zender at UCI, now at UCLA.
2265
<i>Related Research</i>:
2266
1. Test NCO on real tera-scale geoscience analysis problems and
2267
identify necessary improvements in <tt>ncap2</tt> and in SWAMP.
2268
2. Role of satellite-observed sub-gridscale wind variability
2269
on air-surface exchange.
2270
<i>Other Interests</i>: Weather, climate
1828
2275
<a name="wang"></a><a name="Wang"></a> <!-- http://nco.sf.net#wang -->
1829
2276
<a href="http://dust.ess.uci.edu/~wangd">Dr. Daniel Wang</a>:
1830
Earned EECS Ph.D. (2008) with Jenks and Zender at UCI, now at SLAC.
2277
earned EECS Ph.D. (2008) with Jenks and Zender at UCI, now at SLAC.
1831
2279
<i>Role</i>: Architect distributed data reduction and analysis
1832
2280
solutions for geoscience workflows
1833
2281
<i>Related Research</i>:
1888
2314
<a href="./nco.html#help">Help Requests and Bug Reports</a>.
1890
2316
<li><i>Where should I ask my questions on how to use NCO?</i>
1891
On the <a href="http://sourceforge.net/projects/nco/forums/forum/9830">Help</a> site.
2317
On the <a href="http://sf.net/projects/nco/forums/forum/9830">Help</a> site.
1893
2319
<li><i>Where should I post suggestions/comments on NCO features and usage?</i>
1894
On the <a href="http://sourceforge.net/projects/nco/forums/forum/9829">Discussion</a> site.
2320
On the <a href="http://sf.net/projects/nco/forums/forum/9829">Discussion</a> site.
1896
2322
<li><i>Where are NCO development and bug-squashing discussed?</i>
1897
At the <a href="http://sourceforge.net/projects/nco/forums/forum/9831">Developer</a>
2323
At the <a href="http://sf.net/projects/nco/forums/forum/9831">Developer</a>
1901
2327
<!-- End Contacts -->
1903
<a href="http://sourceforge.net/projects/nco"><img src="http://sflogo.sourceforge.net/sflogo.php?group_id=3331&type=12" width="120" height="30" alt="Get NCO netCDF Operators at SourceForge.net. Fast, secure and Free Open Source software downloads" /></a>
2329
<a href="http://sf.net/projects/nco"><img src="http://sflogo.sf.net/sflogo.php?group_id=3331&type=12" width="120" height="30" alt="Get NCO netCDF Operators at SourceForge.net. Fast, secure and Free Open Source software downloads" /></a>
1905
2331
<table width="100%"><tr><td align="left" valign="top">/
1906
2332
<a href="http://lists.sf.net/mailman/listinfo/nco-announce">Announce</a> /
1907
<a href="http://sourceforge.net/projects/nco/forums/forum/9831">Developer</a> /
1908
<a href="http://sourceforge.net/projects/nco/forums/forum/9829">Discussion</a> /
1909
<a href="http://sourceforge.net/projects/nco/forums/forum/9830">Help</a> /
2333
<a href="http://sf.net/projects/nco/forums/forum/9831">Developer</a> /
2334
<a href="http://sf.net/projects/nco/forums/forum/9829">Discussion</a> /
2335
<a href="http://sf.net/projects/nco/forums/forum/9830">Help</a> /
1910
2336
<a href="http://nco.sf.net">Homepage</a> /
1911
2337
<a href="#RTFM">Manual</a> /
1912
2338
<a href="http://sf.net/projects/nco">Project</a> /
1913
2339
<a href="http://nco.cvs.sf.net/nco/nco/src/nco/">Source</a> /
1914
<a href="http://nco.wiki.sourceforge.net">Wiki</a> /
1917
2342
<td align="right" valign="top">
1918
2343
[<a href="http://www.antlr.org">ANTLR</a>]
1919
2344
[<a href="http://cf-pcmdi.llnl.gov/documents/cf-conventions/latest-cf-conventions-document-1">CF</a>]
2345
[<a href="https://wiki.earthdata.nasa.gov/display/ESDSWG/Dataset+Interoperability+Working+Group">DIWG</a>]
1920
2346
[<a href="http://www.gnu.org/software/gsl">GSL</a>]
1921
2347
[<a href="http://www.unidata.ucar.edu/packages/netcdf">netCDF</a>]
1922
2348
[<a href="http://opendap.org">OPeNDAP</a>]