http://gfi.wiki.uib.no/api.php?action=feedcontributions&user=Csp001&feedformat=atomgfi - User contributions [en]2024-03-19T04:05:50ZUser contributionsMediaWiki 1.39.6http://gfi.wiki.uib.no/index.php?title=ERA5_reanalysis_data&diff=1731ERA5 reanalysis data2023-09-22T10:46:35Z<p>Csp001: Adding detected_features folder and a little clean-up.</p>
<hr />
<div>GFI is building up an archive of ERA5 reanalysis data on the local linux system cyclone.hpc.uib.no. ERA5 supersedes the ERA-Interim reanalysis data, which ended in August 2019. More information about the ERA5 reanalysis data set is available [https://www.ecmwf.int/en/forecasts/datasets/reanalysis-datasets/era5 at ECMWF's ERA5 websites].<br />
<br />
The ERA5 data files are available in two different CF-compatible netCDF formats (ETH Zurich format and Bergen format) at<br />
<br />
/Data/gfi/share/era5<br />
<br />
<br />
== Data in ETH Zurich format ==<br />
<br />
Data in the ETH Zurich format is collected in one subfolder:<br />
<br />
ml/ 3-hourly data on a regular 0.5 deg lat-lon grid, with model-level and pressure level files (see below)<br />
<br />
<br />
Data in the '''ml'''-folder are contained in subdirectories for each year and month:<br />
<br />
ml/yyyy/mm/[B|H|P|Z]yyyymmdd_hh<br />
<br />
where yyyy is the year, mm the two-digit month, dd the two-digit day, and hh the two-digit hours, and Bxxx, Hxxx, Pxxx, Zxxx are different file types, as described in the table below. This format is the same used at the [https://iac.ethz.ch/group/atmospheric-dynamics.html Atmospheric Dynamics group at IAC, ETH Zürich, Switzerland]; the [https://www.imk-tro.kit.edu/7425.php LSDP group at Karlsruhe Institute of Technology, Germany]; and the [https://www.weizmann.ac.il/EPS/raveh-rubin/ Dynamical Meteorology Group, Weizmann Institute of Science, Rehovot, Israel].<br />
<br />
Until now, the years 1999-2018 have been retrieved. The period will successively be extended back to 1979, and forward in time.<br />
<br />
The data files contain the following variables:<br />
<br />
{| class="wikitable"<br />
|+ '''ERA5 data files in ETH Zurich format format'''<br />
|-<br />
|File name<br />
|colspan="2"|Pyyyymmdd_hh<br />
|colspan="1"|Zyyyymmdd_hh<br />
|colspan="1"|Hyyyymmdd_hh<br />
|colspan="1"|Byyyymmdd_hh<br />
|-<br />
|Leveltype<br />
|Model level<br />
|Surface<br />
|Pressure<br />
|Pressure<br />
|Surface<br />
|-<br />
|Variables<br />
|T, Q, U, V, OMEGA, LWC, IWC, RWC, SWC<br />
|LSP, CP, SF, SSHF, SLHF, BLH, TCC, U10M, V10M, MSL, PS, SSTK<br />
|Z, T, Q, U, V<br />
|Z<br />
|PS, MSL, TCC, U10M, V10M, SSTK, CI, D2M, T2M, TCW, TCWV, VIWVD, E, MN2T, MX2T, SI, TTR, TTRC, WG10, LSP, CP, SF, SSHF, SLHF, BLH<br />
|-<br />
|Levels<br />
|40-137<br />
| -<br />
|900, 850, 800, 700, 600, 500, 400, 300, 250, 200, 100 hPa<br />
|1000, 975, 950, 925, 900, 875, 850, 825, 800, 775, 750, 700, 650, 600, 550, 500, 450, 400, 350, 300, 250, 225, 200, 175, 150, 125, 100, 70, 50, 30, 20, 10, 70, 5, 3, 2, 1 hPa<br />
| -<br />
|-<br />
|Times available<br />
|colspan="5"|00, 03, 06, 09, 12, 15, 18, 21 UTC<br />
|}<br />
<br />
Note that the variables LSP, CP, SF, SSHF, SLHF, and BLH are derived as prognostic variables from the short-range forecast. Data valid at 00, 03, 06, 09 UTC are 06, 09, 12, 15 h forecast of the 18 UTC forecast of the previous day. Accordingly, data valid at 12, 15, 18, 21 UTC are 06, 09, 12, 15 h forecast of the 06 UTC forecast. The prognostic variables are accumulated over the previous 1 h.<br />
<br />
Please see [https://confluence.ecmwf.int/display/CKB/ERA5%3A+data+documentation ECMWF ERA5 data documentation] for parameter abbreviations.<br />
<br />
'''Conditions of use:''' When using the ERA5 data from this archive please make sure to reference "[https://cds.climate.copernicus.eu/cdsapp#!/home Copernicus Climate Change Service (C3S) (2017): ERA5: Fifth generation of ECMWF atmospheric reanalyses of the global climate. Copernicus Climate Change Service Climate Data Store (CDS)], date of citation" and acknowledge "ECMWF for providing ERA-5 data“. Also, please acknowledge "Michael Sprenger (ETH Zurich)“ for the support in providing the data.<br />
<br />
<br />
== Data in Bergen format ==<br />
<br />
Data in the Bergen format is in the following subfolders:<br />
<br />
pl/ Pressure level data.<br />
pl_tendencies/ Diabatic temperature tendencies on pressure levels.<br />
pv2/ Data on the PV2-surface.<br />
sfc/ Single-level data.<br />
detected_features/ Weather events identified by various detection algorithms.<br />
slope/ Isentropic slope data and its tendencies.<br />
<br />
Data in these folders is organised in one file per month, variable and level, for example:<br />
<br />
pl/ea.[ans|for].yyyymm.plev.var<br />
<br />
This data is completely available for 1979-2022. Specifically, we have the following data available<br />
<br />
{| class="wikitable"<br />
|+ '''ERA5 data files in Bergen format'''<br />
|-<br />
!colspan="1"|Folder<br />
!colspan="1"|Data available (see [https://confluence.ecmwf.int/display/CKB/ERA5%3A+data+documentation] for parameter abbreviations)<br />
!colspan="1"|Details<br />
|-<br />
| rowspan=2 | '''sfc/'''<br />
|blh, msl, siconc, sp, sst, t2m, tcwv, u10, v10, viewvf, vinwf<br />
|Instantaneous (ans)<br />
|-<br />
|cp, lsp, slhf, sshf, ssrd, ssr, strd, str, tsr, ttr<br />
|Accumulated over previous 3 hours (for)<br />
|-<br />
|'''pl/'''<br />
|t, q, z, u, v, w<br />
|Instantaneous (ans)<br />
|-<br />
|'''pl_tendencies/'''<br />
|mttlwrcs, mttlwr, mttpm, mttswrcs, mttswr<br />
|Accumulated over previous 3 hours (for)<br />
|-<br />
|'''pv2/'''<br />
|u, v, pt, pres<br />
|Instantaneous (ans)<br />
|}<br />
<br />
The folder '''detected_features/''' contains detected cyclones, anticyclones, fronts, jet axes, moisture transport axes, cold-air outbreaks, frontal volumes, Rossby wave breaking, and blocking events. For details on the different weather features refer to the '''README''' in the folder.<br />
<br />
The folder '''slope/''' contains data deriving from the isentropic slope framework (see [https://doi.org/10.1002/qj.2605 Papritz and Spengler, 2015], for more details):<br />
<br />
{| class="wikitable"<br />
!colspan="1"|Variable name<br />
!colspan="1"|Description<br />
!colspan="1"|Equation<br />
!colspan="1"|Units<br />
!colspan="1"|Notes<br />
|-<br />
|slope<br />
|Slope of isentropic surface<br />
| S = abs(grad<sub>θ</sub>z)<br />
|m m<sup>-1</sup><br />
|Instantaneous<br />
|-<br />
|tilt<br />
|Tendency in slope due to tilting<br />
| grad<sub>θ</sub>z /S · grad<sub>θ</sub> w<sub>id</sub><br />
|m m<sup>-1</sup> s<sup>-1</sup><br />
|Instantaneous<br />
|-<br />
|diab<br />
|Tendency in slope due to diabatic heating<br />
| -dz/dθ grad<sub>θ</sub>z /S · grad<sub>θ</sub> (dθ/dt)<br />
|m m<sup>-1</sup> s<sup>-1</sup><br />
|Accumulated over 6-hour period centred on instantaneous time step (stored as instantaneous, ans)<br />
|-<br />
|iadv<br />
|Tendency in slope due to isentropic advection<br />
| '''u''' · grad<sub>θ</sub>S<br />
|m m<sup>-1</sup> s<sup>-1</sup><br />
|Instantaneous<br />
|-<br />
|w_ci<br />
|Cross isentropic vertical velocity<br />
| w - w<sub>iu<sub><br />
|m s<sup>-1</sup><br />
|Instantaneous<br />
|-<br />
|mask_slope<br />
|Combination of masks from slope, diab and tilt<br />
| -<br />
|0-1<br />
|Instantaneous<br />
|}</div>Csp001http://gfi.wiki.uib.no/index.php?title=ERA5_reanalysis_data&diff=1728ERA5 reanalysis data2023-09-14T10:56:48Z<p>Csp001: Separating more cleanly which folders contain which format.</p>
<hr />
<div>GFI is building up an archive of ERA5 reanalysis data on the local linux system cyclone.hpc.uib.no. ERA5 supersedes the ERA-Interim reanalysis data, which ended in August 2019. More information about the ERA5 reanalysis data set is available [https://www.ecmwf.int/en/forecasts/datasets/reanalysis-datasets/era5 at ECMWF's ERA5 websites].<br />
<br />
The ERA5 data files are available in two different CF-compatible netCDF formats at<br />
<br />
/Data/gfi/share/era5<br />
<br />
<br />
== Data in ETH Zurich format ==<br />
<br />
Data in the ETH Zurich format is collected in one subfolder:<br />
<br />
ml/ 3-hourly data on a regular 0.5 deg lat-lon grid, with model-level and pressure level files (see below)<br />
<br />
<br />
Data in the '''ml'''-folder are contained in subdirectories for each year and month:<br />
<br />
ml/yyyy/mm/[B|H|P|Z]yyyymmdd_hh<br />
<br />
where yyyy is the year, mm the two-digit month, dd the two-digit day, and hh the two-digit hours, and Bxxx, Hxxx, Pxxx, Zxxx are different file types, as described in the table below. This format is the same used at the [https://iac.ethz.ch/group/atmospheric-dynamics.html Atmospheric Dynamics group at IAC, ETH Zürich, Switzerland]; the [https://www.imk-tro.kit.edu/7425.php LSDP group at Karlsruhe Institute of Technology, Germany]; and the [https://www.weizmann.ac.il/EPS/raveh-rubin/ Dynamical Meteorology Group, Weizmann Institute of Science, Rehovot, Israel].<br />
<br />
Until now, the years 1999-2018 have been retrieved. The period will successively be extended back to 1979, and forward in time.<br />
<br />
The data files contain the following variables:<br />
<br />
{| class="wikitable"<br />
|+ '''ERA5 data files in ETH Zurich format format'''<br />
|-<br />
|File name<br />
|colspan="2"|Pyyyymmdd_hh<br />
|colspan="1"|Zyyyymmdd_hh<br />
|colspan="1"|Hyyyymmdd_hh<br />
|colspan="1"|Byyyymmdd_hh<br />
|-<br />
|Leveltype<br />
|Model level<br />
|Surface<br />
|Pressure<br />
|Pressure<br />
|Surface<br />
|-<br />
|Variables<br />
|T, Q, U, V, OMEGA, LWC, IWC, RWC, SWC<br />
|LSP, CP, SF, SSHF, SLHF, BLH, TCC, U10M, V10M, MSL, PS, SSTK<br />
|Z, T, Q, U, V<br />
|Z<br />
|PS, MSL, TCC, U10M, V10M, SSTK, CI, D2M, T2M, TCW, TCWV, VIWVD, E, MN2T, MX2T, SI, TTR, TTRC, WG10, LSP, CP, SF, SSHF, SLHF, BLH<br />
|-<br />
|Levels<br />
|40-137<br />
| -<br />
|900, 850, 800, 700, 600, 500, 400, 300, 250, 200, 100 hPa<br />
|1000, 975, 950, 925, 900, 875, 850, 825, 800, 775, 750, 700, 650, 600, 550, 500, 450, 400, 350, 300, 250, 225, 200, 175, 150, 125, 100, 70, 50, 30, 20, 10, 70, 5, 3, 2, 1 hPa<br />
| -<br />
|-<br />
|Times available<br />
|colspan="5"|00, 03, 06, 09, 12, 15, 18, 21 UTC<br />
|}<br />
<br />
Note that the variables LSP, CP, SF, SSHF, SLHF, and BLH are derived as prognostic variables from the short-range forecast. Data valid at 00, 03, 06, 09 UTC are 06, 09, 12, 15 h forecast of the 18 UTC forecast of the previous day. Accordingly, data valid at 12, 15, 18, 21 UTC are 06, 09, 12, 15 h forecast of the 06 UTC forecast. The prognostic variables are accumulated over the previous 1 h.<br />
<br />
Please see [https://confluence.ecmwf.int/display/CKB/ERA5%3A+data+documentation ECMWF ERA5 data documentation] for parameter abbreviations.<br />
<br />
'''Conditions of use:''' When using the ERA5 data from this archive please make sure to reference "[https://cds.climate.copernicus.eu/cdsapp#!/home Copernicus Climate Change Service (C3S) (2017): ERA5: Fifth generation of ECMWF atmospheric reanalyses of the global climate. Copernicus Climate Change Service Climate Data Store (CDS)], date of citation" and acknowledge "ECMWF for providing ERA-5 data“. Also, please acknowledge "Michael Sprenger (ETH Zurich)“ for the support in providing the data.<br />
<br />
<br />
== Data in Bergen format ==<br />
<br />
Data in the Bergen format is in the following subfolders:<br />
<br />
pl/ pressure level data following the format of ERA-interim.<br />
pl_tendencies/ diabatic temperature tendencies on pressure levels, following the format of ERA-interim.<br />
pv2/ Data on the PV2-surface following the format of ERA-interim.<br />
sfc/ Single-level data following the format of ERA-interim.<br />
slope/ Isentropic slope data and its tendencies following the format of ERA-interim<br />
<br />
Data in these folders is organised in one file per month, variable and level, for example:<br />
<br />
pl/ea.[ans|for].yyyymm.plev.var<br />
<br />
This data is completely available for 1979-2022. Specifically, we have the following data available<br />
<br />
{| class="wikitable"<br />
|+ '''ERA5 data files in Bergen format'''<br />
|-<br />
!colspan="1"|Folder<br />
!colspan="1"|Data available (see [https://confluence.ecmwf.int/display/CKB/ERA5%3A+data+documentation] for parameter abbreviations)<br />
!colspan="1"|Details<br />
|-<br />
| rowspan=2 | '''sfc/'''<br />
|blh, msl, siconc, sp, sst, t2m, tcwv, u10, v10, viewvf, vinwf<br />
|Instantaneous (ans)<br />
|-<br />
|cp, lsp, slhf, sshf, ssrd, ssr, strd, str, tsr, ttr<br />
|Accumulated over previous 3 hours (for)<br />
|-<br />
|'''pl/'''<br />
|t, q, z, u, v, w<br />
|Instantaneous (ans)<br />
|-<br />
|'''pl_tendencies/'''<br />
|mttlwrcs, mttlwr, mttpm, mttswrcs, mttswr<br />
|Accumulated over previous 3 hours (for)<br />
|-<br />
|'''pv2/'''<br />
|u, v, pt, pres<br />
|Instantaneous (ans)<br />
|}<br />
<br />
The folder '''slope/''' contains data deriving from the isentropic slope framework (see [https://doi.org/10.1002/qj.2605 Papritz and Spengler, 2015], for more details):<br />
<br />
{| class="wikitable"<br />
!colspan="1"|Variable name<br />
!colspan="1"|Description<br />
!colspan="1"|Equation<br />
!colspan="1"|Units<br />
!colspan="1"|Notes<br />
|-<br />
|slope<br />
|Slope of isentropic surface<br />
| S = abs(grad<sub>θ</sub>z)<br />
|m m<sup>-1</sup><br />
|Instantaneous<br />
|-<br />
|tilt<br />
|Tendency in slope due to tilting<br />
| grad<sub>θ</sub>z /S · grad<sub>θ</sub> w<sub>id</sub><br />
|m m<sup>-1</sup> s<sup>-1</sup><br />
|Instantaneous<br />
|-<br />
|diab<br />
|Tendency in slope due to diabatic heating<br />
| -dz/dθ grad<sub>θ</sub>z /S · grad<sub>θ</sub> (dθ/dt)<br />
|m m<sup>-1</sup> s<sup>-1</sup><br />
|Accumulated over 6-hour period centred on instantaneous time step (stored as instantaneous, ans)<br />
|-<br />
|iadv<br />
|Tendency in slope due to isentropic advection<br />
| '''u''' · grad<sub>θ</sub>S<br />
|m m<sup>-1</sup> s<sup>-1</sup><br />
|Instantaneous<br />
|-<br />
|w_ci<br />
|Cross isentropic vertical velocity<br />
| w - w<sub>iu<sub><br />
|m s<sup>-1</sup><br />
|Instantaneous<br />
|-<br />
|mask_slope<br />
|Combination of masks from slope, diab and tilt<br />
| -<br />
|0-1<br />
|Instantaneous<br />
|}</div>Csp001http://gfi.wiki.uib.no/index.php?title=ERA5_reanalysis_data&diff=1681ERA5 reanalysis data2023-03-20T13:31:10Z<p>Csp001: Adding file name pattern for pl, sfc, and pv2-data.</p>
<hr />
<div>Documentation of the ERA5 archive at GFI<br />
<br />
GFI is building up an archive of ERA5 reanalysis data on the local linux system cyclone.hpc.uib.no. ERA5 supersedes the ERA-Interim reanalysis data, which ended in August 2019. More information about the ERA5 reanalysis data set is available [https://www.ecmwf.int/en/forecasts/datasets/reanalysis-datasets/era5 at ECMWF's ERA5 websites].<br />
<br />
The ERA5 data files are available in a CF-compatible netCDF format on cyclone.hpc.uib.no and other computers that mount the UiB linux system at<br />
<br />
/Data/gfi/share/era5<br />
<br />
At GFI, we share the data format with the [https://iac.ethz.ch/group/atmospheric-dynamics.html Atmospheric Dynamics group at IAC, ETH Zürich, Switzerland]; the [https://www.imk-tro.kit.edu/7425.php LSDP group at Karlsruhe Institute of Technology, Germany]; and the [https://www.weizmann.ac.il/EPS/raveh-rubin/ Dynamical Meteorology Group, Weizmann Institute of Science, Rehovot, Israel]. The data are organised as follows<br />
<br />
ml/ 3-hourly data on a regular 0.5 deg lat-lon grid, with model-level and pressure level files (see below)<br />
pl/ pressure level data following the format of ERA-interim.<br />
pl_tendencies/ diabatic temperature tendencies on pressure levels, following the format of ERA-interim.<br />
pv2/ Data on the PV2-surface following the format of ERA-interim.<br />
sfc/ Single-level data following the format of ERA-interim.<br />
<br />
Data in the '''ml'''-folder are contained in subdirectories for each year and month:<br />
<br />
ml/yyyy/mm/[B|H|P|Z]yyyymmdd_hh<br />
<br />
where yyyy is the year, mm the two-digit month, dd the two-digit day, and hh the two-digit hours, and Bxxx, Hxxx, Pxxx, Zxxx are different file types, as described in the table below.<br />
<br />
Until now, the years 1999-2018 have been retrieved, the period will successively be extended back to 1979, and forward in time.<br />
<br />
Data in the '''pl_*''', '''sfc''' and '''pv2'''-folders is organised in one file per month, variable and level, for example:<br />
<br />
pl/ea.[ans|for].YYYYMM.PLEV.VAR<br />
<br />
This data is completely available for 1979-2020.<br />
<br />
The data files contain the following variables:<br />
<br />
{| class="wikitable"<br />
!colspan="6"|ERA5 data files<br />
|-<br />
|File name<br />
|colspan="2"|Pyyyymmdd_hh<br />
|colspan="1"|Zyyyymmdd_hh<br />
|colspan="1"|Hyyyymmdd_hh<br />
|colspan="1"|Byyyymmdd_hh<br />
|-<br />
|Leveltype<br />
|Model level<br />
|Surface<br />
|Pressure<br />
|Pressure<br />
|Surface<br />
|-<br />
|Variables<br />
|T, Q, U, V, OMEGA, LWC, IWC, RWC, SWC<br />
|LSP, CP, SF, SSHF, SLHF, BLH, TCC, U10M, V10M, MSL, PS, SSTK<br />
|Z, T, Q, U, V<br />
|Z<br />
|PS, MSL, TCC, U10M, V10M, SSTK, CI, D2M, T2M, TCW, TCWV, VIWVD, E, MN2T, MX2T, SI, TTR, TTRC, WG10, LSP, CP, SF, SSHF, SLHF, BLH<br />
|-<br />
|Levels<br />
|40-137<br />
| -<br />
|900, 850, 800, 700, 600, 500, 400, 300, 250, 200, 100 hPa<br />
|1000, 975, 950, 925, 900, 875, 850, 825, 800, 775, 750, 700, 650, 600, 550, 500, 450, 400, 350, 300, 250, 225, 200, 175, 150, 125, 100, 70, 50, 30, 20, 10, 70, 5, 3, 2, 1 hPa<br />
| -<br />
|-<br />
|Times available<br />
|colspan="5"|00, 03, 06, 09, 12, 15, 18, 21 UTC<br />
|}<br />
<br />
Note that the variables LSP, CP, SF, SSHF, SLHF, and BLH are derived as prognostic variables from the short-range forecast. Data valid at 00, 03, 06, 09 UTC are 06, 09, 12, 15 h forecast of the 18 UTC forecast of the previous day. Accordingly, data valid at 12, 15, 18, 21 UTC are 06, 09, 12, 15 h forecast of the 06 UTC forecast. The prognostic variables are accumulated over the previous 1 h.<br />
<br />
Please see [https://confluence.ecmwf.int//display/CKB/ERA5+data+documentation#ERA5datadocumentation-Parameterlistings ECMWF ERA5 data documentation] for parameter abbreviations.<br />
<br />
'''Conditions of use:''' When using the ERA5 data from this archive please make sure to reference "[https://cds.climate.copernicus.eu/cdsapp#!/home Copernicus Climate Change Service (C3S) (2017): ERA5: Fifth generation of ECMWF atmospheric reanalyses of the global climate. Copernicus Climate Change Service Climate Data Store (CDS)], date of citation" and acknowledge "ECMWF for providing ERA-5 data“. Also, please acknowledge "Michael Sprenger (ETH Zurich)“ for the support in providing the data.</div>Csp001http://gfi.wiki.uib.no/index.php?title=ERA5_reanalysis_data&diff=1680ERA5 reanalysis data2023-03-20T13:25:01Z<p>Csp001: Updating info on the pl and pl_tendency data.</p>
<hr />
<div>Documentation of the ERA5 archive at GFI<br />
<br />
GFI is building up an archive of ERA5 reanalysis data on the local linux system cyclone.hpc.uib.no. ERA5 supersedes the ERA-Interim reanalysis data, which ended in August 2019. More information about the ERA5 reanalysis data set is available [https://www.ecmwf.int/en/forecasts/datasets/reanalysis-datasets/era5 at ECMWF's ERA5 websites].<br />
<br />
The ERA5 data files are available in a CF-compatible netCDF format on cyclone.hpc.uib.no and other computers that mount the UiB linux system at<br />
<br />
/Data/gfi/share/era5<br />
<br />
At GFI, we share the data format with the [https://iac.ethz.ch/group/atmospheric-dynamics.html Atmospheric Dynamics group at IAC, ETH Zürich, Switzerland]; the [https://www.imk-tro.kit.edu/7425.php LSDP group at Karlsruhe Institute of Technology, Germany]; and the [https://www.weizmann.ac.il/EPS/raveh-rubin/ Dynamical Meteorology Group, Weizmann Institute of Science, Rehovot, Israel]. The data are organised as follows<br />
<br />
ml/ 3-hourly data on a regular 0.5 deg lat-lon grid, with model-level and pressure level files (see below)<br />
pl/ pressure level data following the format of ERA-interim.<br />
pl_tendencies/ diabatic temperature tendencies on pressure levels, following the format of ERA-interim.<br />
<br />
Data files are contained in subdirectories for each year and month:<br />
<br />
ml/yyyy/mm/[B|H|P|Z]yyyymmdd_hh<br />
<br />
where yyyy is the year, mm the two-digit month, dd the two-digit day, and hh the two-digit hours, and Bxxx, Hxxx, Pxxx, Zxxx are different file types, as described in the table below.<br />
<br />
Until now, the years 1999-2018 have been retrieved, the period will successively be extended back to 1979, and forward in time.<br />
<br />
The data files contain the following variables:<br />
<br />
{| class="wikitable"<br />
!colspan="6"|ERA5 data files<br />
|-<br />
|File name<br />
|colspan="2"|Pyyyymmdd_hh<br />
|colspan="1"|Zyyyymmdd_hh<br />
|colspan="1"|Hyyyymmdd_hh<br />
|colspan="1"|Byyyymmdd_hh<br />
|-<br />
|Leveltype<br />
|Model level<br />
|Surface<br />
|Pressure<br />
|Pressure<br />
|Surface<br />
|-<br />
|Variables<br />
|T, Q, U, V, OMEGA, LWC, IWC, RWC, SWC<br />
|LSP, CP, SF, SSHF, SLHF, BLH, TCC, U10M, V10M, MSL, PS, SSTK<br />
|Z, T, Q, U, V<br />
|Z<br />
|PS, MSL, TCC, U10M, V10M, SSTK, CI, D2M, T2M, TCW, TCWV, VIWVD, E, MN2T, MX2T, SI, TTR, TTRC, WG10, LSP, CP, SF, SSHF, SLHF, BLH<br />
|-<br />
|Levels<br />
|40-137<br />
| -<br />
|900, 850, 800, 700, 600, 500, 400, 300, 250, 200, 100 hPa<br />
|1000, 975, 950, 925, 900, 875, 850, 825, 800, 775, 750, 700, 650, 600, 550, 500, 450, 400, 350, 300, 250, 225, 200, 175, 150, 125, 100, 70, 50, 30, 20, 10, 70, 5, 3, 2, 1 hPa<br />
| -<br />
|-<br />
|Times available<br />
|colspan="5"|00, 03, 06, 09, 12, 15, 18, 21 UTC<br />
|}<br />
<br />
Note that the variables LSP, CP, SF, SSHF, SLHF, and BLH are derived as prognostic variables from the short-range forecast. Data valid at 00, 03, 06, 09 UTC are 06, 09, 12, 15 h forecast of the 18 UTC forecast of the previous day. Accordingly, data valid at 12, 15, 18, 21 UTC are 06, 09, 12, 15 h forecast of the 06 UTC forecast. The prognostic variables are accumulated over the previous 1 h.<br />
<br />
Please see [https://confluence.ecmwf.int//display/CKB/ERA5+data+documentation#ERA5datadocumentation-Parameterlistings ECMWF ERA5 data documentation] for parameter abbreviations.<br />
<br />
'''Conditions of use:''' When using the ERA5 data from this archive please make sure to reference "[https://cds.climate.copernicus.eu/cdsapp#!/home Copernicus Climate Change Service (C3S) (2017): ERA5: Fifth generation of ECMWF atmospheric reanalyses of the global climate. Copernicus Climate Change Service Climate Data Store (CDS)], date of citation" and acknowledge "ECMWF for providing ERA-5 data“. Also, please acknowledge "Michael Sprenger (ETH Zurich)“ for the support in providing the data.</div>Csp001http://gfi.wiki.uib.no/index.php?title=File:Get_started_cyclone.pdf&diff=1639File:Get started cyclone.pdf2022-12-05T14:05:48Z<p>Csp001: Csp001 uploaded a new version of File:Get started cyclone.pdf</p>
<hr />
<div>Step by step guide for Jupyter on cyclone.</div>Csp001http://gfi.wiki.uib.no/index.php?title=Using_cyclone&diff=1618Using cyclone2022-09-21T09:53:11Z<p>Csp001: /* Accessing the data from your own machines */</p>
<hr />
<div>== Connection and first steps ==<br />
<br />
Use ssh to connect<br />
<pre>ssh -Y <username>@cyclone.hpc.uib.no</pre><br />
or just simply:<br />
<pre>ssh -Y cyclone.hpc.uib.no</pre><br />
if you're connecting from a computer where you are logged in under the same name. When you are connecting for the first time, you will be asked to verify a signature. Reply "yes" to this question.<br />
<br />
=== Home directories ===<br />
<br />
<code>cyclone.hpc.uib.no</code> shares home directories with the new hexagon cluster. These home directories are separate from your standard UiB home directory. The contents of your home directories will not be synced, so you will manually need to transfer your scripts to the new system.<br />
<br />
=== How to access software ===<br />
<br />
In contrast to the old skd-cyclone, most scientific software is only available through software modules. Modules need to be loaded manually before the respective software can be used. We use software modules, because they provide are a clean and handy way to offer conflicting software or software versions: Instead of updating software and potentially breaking user scripts and programs new software is then made available in parallel to those that require it.<br />
<br />
=== Start-up scripts ===<br />
<br />
It might be handy to automatically load modules for software that you use frequently every time you login to cyclone. To accomplish that for bash, there are two relevant files, <code>$HOME/.bashrc</code> and <code>$HOME/.bash_profile</code> . <code>.bash_profile</code> should contain things that need to be defined at login time only, like <code>PATH</code> and other environment variables, startup programs, etc. You just need things once, not in every shell you open. In most cases, you also need the things from <code>.bashrc</code> in your login shell. That's why <code>.bash_profile</code> sources <code>.bashrc</code> as well, but .bashrc doesn't usually source <code>.bash_profile</code>. In contrast, <code>.bashrc</code> should typically contain things you want to set in every shell you open, like aliases, functions, etc. These are per shell session items that are not inherited from environment ([https://unix.stackexchange.com/questions/346336/why-have-both-bash-profile-and-bashrc source and detailed explanation]).<br />
<br />
==== An example <code>.bash_profile</code> for inspiration ====<br />
<br />
<pre>module load cdo/1.6.9<br />
module load ncarg/6.3.0-login<br />
<br />
alias rm="rm -i"<br />
alias cp="cp -i"<br />
alias erai="cd /Data/skd/share/Reanalysis/ERA_INTERIM/6HOURLY/"<br />
<br />
if [ -f ~/.bashrc ]; then<br />
. ~/.bashrc<br />
fi</pre><br />
<br />
==== An example <code>.bash_profile</code> for inspiration ====<br />
<br />
<pre>alias rm="rm -i"<br />
alias cp="cp -i"<br />
alias erai="cd /Data/skd/share/Reanalysis/ERA_INTERIM/6HOURLY/"</pre><br />
<br />
<br />
== Available software ==<br />
<br />
Below is a list of frequently used software and which module to load on the new cyclone. Relevant module names are printed like for <code>matlab/2015b</code>. Modules can be loaded by <code>module load <module name></code>, and unloaded <code>module unload <module name></code>. [[Using modules on cyclone|More details on the module system]].<br />
<br />
To list all available modules, use the command<br />
<pre>module avail</pre><br />
<br />
Hexagon-specific modules are now no longer listed and available on cyclone. All packages listed with this command should work, so please report to <code>support@hpc.uib.no</code> if they do not.<br />
<br />
=== Data analysis and plotting ===<br />
<br />
* CDO<br />
*: <code>CDO</code>, <code>CDO/1.9.5-foss-2018b</code><br />
* Dynlib<br />
*: See temporary solution for python. Requires in addition <code>OpenBLAS/0.3.1-GCC-7.3.0-2.30</code> and <code>ScaLAPACK/2.0.2-gompi-2018b-OpenBLAS-0.3.1</code>.<br />
* ghostview<br />
*: ''<no module required>''<br />
* grads<br />
*: ''<no module required>''<br />
* Matlab<br />
*: <code>Matlab</code>, <code>Matlab/2018a</code>, <code>Matlab/2012a</code><br />
* ncdump and other netCDF utilities<br />
*: <code>netCDF</code>, <code>netCDF/4.6.1-foss-2018b</code><br />
* NCL<br />
*: <code>NCL</code>, <code>NCL/6.5.0</code><br />
* nco<br />
*: <code>NCO</code>, <code>NCO/4.7.4-foss-2018b</code><br />
* ncview<br />
*: <code>ncview</code>, <code>ncview/2.1.7-foss-2018b</code>. Load only when needed! The package is currently known to break some GUI programs like gedit and gvim. <br />
* python, plus selection of scientific packages<br />
*: ''First'' choose and load the python module for the python version that you want to use, either <code>Python/2.7.15-foss-2018b</code> for python 2.7.15, or <code>Python/3.7.0-foss-2018b</code> for python 3.7.0.<br />
*: ''Then'', as a temporary solution, many scientific python packages are installed in the following virtual environments:<br />
*: <code>source /Data/gfi/users/local/share/virtualenv/dynpie2/bin/activate</code> for python 2.7.15. <br />
*: <code>source /Data/gfi/users/local/share/virtualenv/dynpie3-2021a/bin/activate</code> for python 3.7.0.<br />
*: For the pygrib module, <code>ecCodes/2.7.3-foss-2018b</code> is required in addition.<br />
* R<br />
*: ''<no module required>''<br />
<br />
=== Text editors ===<br />
<br />
* emacs<br />
*: Is installed globally, but requires <code>util-linux/2.32-GCCcore-7.3.0</code> to work.<br />
* gedit<br />
*: ''<no module required>''<br />
* gvim<br />
*: ''<no module required>''<br />
* vi(m)<br />
*: ''<no module required>''<br />
<br />
=== Compilers and libraries ===<br />
<br />
* blas<br />
*: <code>OpenBLAS/0.3.1-GCC-7.3.0-2.30</code>. '''Note''': The library is called <code>libopenblas</code>, so you'll need to compile with <code>-lopenblas</code>. <br />
* eccodes (replacement for grib_api)<br />
*: <code>ecCodes/2.7.3-foss-2018b</code><br />
* gcc, gfortran<br />
*: <code>GCC</code>, <code>GCC/7.3.0-2.30</code><br />
* grib_api<br />
*: <code>grib_api/1.24.0-foss-2018b</code><br />
* HDF5 libraries<br />
*: <code>HDF5/1.10.2-foss-2018b</code><br />
* lapack<br />
*: <code>ScaLAPACK/2.0.2-gompi-2018b-OpenBLAS-0.3.1</code>. '''Note''': The library is called <code>libscalapack</code>, so you'll need to compile with <code>-lscalapack</code>. <br />
* MPI<br />
*: <code>OpenMPI/3.1.1-GCC-7.3.0-2.30</code><br />
* netcdf<br />
*: For C-libaries: <code>netCDF/4.6.1-foss-2018b</code>, <br />
*: For Fortran-libraries <code>netCDF-Fortran/4.4.4-foss-2018b</code>, compile with option <code>-I/shared/apps/netCDF-Fortran/4.4.4-foss-2018b/include</code><br />
* proj<br />
*: <code>PROJ/5.0.0-foss-2018b</code><br />
<br />
=== Jupyter & Jupyterhub ===<br />
<br />
Here is a step by step guide to setup and use Jupyter based on the <code>dynpie3</code> environment.<br />
<br />
[[File:Get started cyclone.pdf|thumb|Step by step guide for Jupyter on cyclone]]<br />
<br />
<br />
== Accessing the data from your own machines ==<br />
<br />
Note: From your personal machines you will need to be connected to the UiB VPN to be able to mount the following network drives. <br />
<br />
On MacOS you can mount folders through <code>Finder > Go > Connect to Server ...</code>. In the dialogue window that pops up, enter<br />
<pre>smb://uib.no;<user name>@leo.hpc.uib.no/gfi</pre><br />
as the '''Server Address'''. You might want to replace <code>gfi</code> by <code>skd</code> to access the skd disks if that is your primary affiliation.<br />
On Ubuntu this is very similar: <code>Files > Go > Enter Location ...</code>. Enter the address: <pre>smb://uib.no;<user name>@leo.hpc.uib.no/gfi</pre> and enter your password in the next pop-up window, while keeping "UiB" in the "Domain" field.<br />
Alternatively you can mount the network drive with sshfs to a dedicated directory using <code>sshfs</code> (install with <code>sudo apt install sshfs</code>):<br />
<pre>mkdir ~/cyclone_gfi<br />
From UiB network: sshfs -o follow_symlinks <user name>@cyclone.hpc.uib.no:/gfi/ ~/cyclone_gfi/<br />
From ext. networks: sshfs -o follow_symlinks <user name>@sync.uib.no:/gfi/ ~/cyclone_gfi/<br />
Unmount with: fusermount -u ~/cyclone_gfi</pre><br />
On Windows you can mount by navigating to <code>File Explorer > Map network drive</code> and enter <code>\\leo.hpc.uib.no\gfi</code>. Make sure to enable <code>Connect using different credentials</code> and fill in <code><user name>@uib.no</code> and your PW.<br />
<br />
== Displaying GUIs on your screen ==<br />
<br />
The ssh-login command at the top of this wiki enables trusted X11 forwarding (the <code>-Y</code> option), which allows you to display Graphical User Interfaces (GUIs) on your screen. This way you may be able to run software on a high performance system in a more userfriendly way than by just operating via the terminal. To make this work properly you may have to edit the ssh configuration file (<code>/etc/ssh/ssh_config</code> on linux systems) by adding or uncommenting the following two lines: <br />
<br />
<pre>X11Forwarding yes<br />
ForwardX11Trusted yes</pre><br />
<br />
Editing this file requires superuser priviliges so you may have to ask the IT department for support. For Mac the solution should be pretty similar, windows requires additional software like PuTTY (for establishing an ssh-connection) and an XServer (e.g. VcXsrv).</div>Csp001http://gfi.wiki.uib.no/index.php?title=Using_cyclone&diff=1568Using cyclone2022-02-07T12:46:47Z<p>Csp001: Add instructions for jupyter</p>
<hr />
<div>== Connection and first steps ==<br />
<br />
Use ssh to connect<br />
<pre>ssh -Y <username>@cyclone.hpc.uib.no</pre><br />
or just simply:<br />
<pre>ssh -Y cyclone.hpc.uib.no</pre><br />
if you're connecting from a computer where you are logged in under the same name. When you are connecting for the first time, you will be asked to verify a signature. Reply "yes" to this question.<br />
<br />
=== Home directories ===<br />
<br />
<code>cyclone.hpc.uib.no</code> shares home directories with the new hexagon cluster. These home directories are separate from your standard UiB home directory. The contents of your home directories will not be synced, so you will manually need to transfer your scripts to the new system.<br />
<br />
=== How to access software ===<br />
<br />
In contrast to the old skd-cyclone, most scientific software is only available through software modules. Modules need to be loaded manually before the respective software can be used. We use software modules, because they provide are a clean and handy way to offer conflicting software or software versions: Instead of updating software and potentially breaking user scripts and programs new software is then made available in parallel to those that require it.<br />
<br />
=== Start-up scripts ===<br />
<br />
It might be handy to automatically load modules for software that you use frequently every time you login to cyclone. To accomplish that for bash, there are two relevant files, <code>$HOME/.bashrc</code> and <code>$HOME/.bash_profile</code> . <code>.bash_profile</code> should contain things that need to be defined at login time only, like <code>PATH</code> and other environment variables, startup programs, etc. You just need things once, not in every shell you open. In most cases, you also need the things from <code>.bashrc</code> in your login shell. That's why <code>.bash_profile</code> sources <code>.bashrc</code> as well, but .bashrc doesn't usually source <code>.bash_profile</code>. In contrast, <code>.bashrc</code> should typically contain things you want to set in every shell you open, like aliases, functions, etc. These are per shell session items that are not inherited from environment ([https://unix.stackexchange.com/questions/346336/why-have-both-bash-profile-and-bashrc source and detailed explanation]).<br />
<br />
==== An example <code>.bash_profile</code> for inspiration ====<br />
<br />
<pre>module load cdo/1.6.9<br />
module load ncarg/6.3.0-login<br />
<br />
alias rm="rm -i"<br />
alias cp="cp -i"<br />
alias erai="cd /Data/skd/share/Reanalysis/ERA_INTERIM/6HOURLY/"<br />
<br />
if [ -f ~/.bashrc ]; then<br />
. ~/.bashrc<br />
fi</pre><br />
<br />
==== An example <code>.bash_profile</code> for inspiration ====<br />
<br />
<pre>alias rm="rm -i"<br />
alias cp="cp -i"<br />
alias erai="cd /Data/skd/share/Reanalysis/ERA_INTERIM/6HOURLY/"</pre><br />
<br />
<br />
== Available software ==<br />
<br />
Below is a list of frequently used software and which module to load on the new cyclone. Relevant module names are printed like for <code>matlab/2015b</code>. Modules can be loaded by <code>module load <module name></code>, and unloaded <code>module unload <module name></code>. [[Using modules on cyclone|More details on the module system]].<br />
<br />
To list all available modules, use the command<br />
<pre>module avail</pre><br />
<br />
Hexagon-specific modules are now no longer listed and available on cyclone. All packages listed with this command should work, so please report to <code>support@hpc.uib.no</code> if they do not.<br />
<br />
=== Data analysis and plotting ===<br />
<br />
* CDO<br />
*: <code>CDO</code>, <code>CDO/1.9.5-foss-2018b</code><br />
* Dynlib<br />
*: See temporary solution for python. Requires in addition <code>OpenBLAS/0.3.1-GCC-7.3.0-2.30</code> and <code>ScaLAPACK/2.0.2-gompi-2018b-OpenBLAS-0.3.1</code>.<br />
* ghostview<br />
*: ''<no module required>''<br />
* grads<br />
*: ''<no module required>''<br />
* Matlab<br />
*: <code>Matlab</code>, <code>Matlab/2018a</code>, <code>Matlab/2012a</code><br />
* ncdump and other netCDF utilities<br />
*: <code>netCDF</code>, <code>netCDF/4.6.1-foss-2018b</code><br />
* NCL<br />
*: <code>NCL</code>, <code>NCL/6.5.0</code><br />
* nco<br />
*: <code>NCO</code>, <code>NCO/4.7.4-foss-2018b</code><br />
* ncview<br />
*: <code>ncview</code>, <code>ncview/2.1.7-foss-2018b</code>. Load only when needed! The package is currently known to break some GUI programs like gedit and gvim. <br />
* python, plus selection of scientific packages<br />
*: ''First'' choose and load the python module for the python version that you want to use, either <code>Python/2.7.15-foss-2018b</code> for python 2.7.15, or <code>Python/3.7.0-foss-2018b</code> for python 3.7.0.<br />
*: ''Then'', as a temporary solution, many scientific python packages are installed in the following virtual environments:<br />
*: <code>source /Data/gfi/users/local/share/virtualenv/dynpie2/bin/activate</code> for python 2.7.15. <br />
*: <code>source /Data/gfi/users/local/share/virtualenv/dynpie3-2021a/bin/activate</code> for python 3.7.0.<br />
*: For the pygrib module, <code>ecCodes/2.7.3-foss-2018b</code> is required in addition.<br />
* R<br />
*: ''<no module required>''<br />
<br />
=== Text editors ===<br />
<br />
* emacs<br />
*: Is installed globally, but requires <code>util-linux/2.32-GCCcore-7.3.0</code> to work.<br />
* gedit<br />
*: ''<no module required>''<br />
* gvim<br />
*: ''<no module required>''<br />
* vi(m)<br />
*: ''<no module required>''<br />
<br />
=== Compilers and libraries ===<br />
<br />
* blas<br />
*: <code>OpenBLAS/0.3.1-GCC-7.3.0-2.30</code>. '''Note''': The library is called <code>libopenblas</code>, so you'll need to compile with <code>-lopenblas</code>. <br />
* eccodes (replacement for grib_api)<br />
*: <code>ecCodes/2.7.3-foss-2018b</code><br />
* gcc, gfortran<br />
*: <code>GCC</code>, <code>GCC/7.3.0-2.30</code><br />
* grib_api<br />
*: <code>grib_api/1.24.0-foss-2018b</code><br />
* HDF5 libraries<br />
*: <code>HDF5/1.10.2-foss-2018b</code><br />
* lapack<br />
*: <code>ScaLAPACK/2.0.2-gompi-2018b-OpenBLAS-0.3.1</code>. '''Note''': The library is called <code>libscalapack</code>, so you'll need to compile with <code>-lscalapack</code>. <br />
* MPI<br />
*: <code>OpenMPI/3.1.1-GCC-7.3.0-2.30</code><br />
* netcdf<br />
*: For C-libaries: <code>netCDF/4.6.1-foss-2018b</code>, <br />
*: For Fortran-libraries <code>netCDF-Fortran/4.4.4-foss-2018b</code>, compile with option <code>-I/shared/apps/netCDF-Fortran/4.4.4-foss-2018b/include</code><br />
* proj<br />
*: <code>PROJ/5.0.0-foss-2018b</code><br />
<br />
=== Jupyter & Jupyterhub ===<br />
<br />
Here is a step by step guide to setup and use Jupyter based on the <code>dynpie3</code> environment.<br />
<br />
[[File:Get started cyclone.pdf|thumb|Step by step guide for Jupyter on cyclone]]<br />
<br />
<br />
== Accessing the data from your own machines ==<br />
<br />
Note: From your personal machines you will need to be connected to the UiB VPN to be able to mount the following network drives. <br />
<br />
On MacOS you can mount folders through <code>Finder > Go > Connect to Server ...</code>. In the dialogue window that pops up, enter<br />
<pre>smb://<user name>@leo.hpc.uib.no/gfi</pre><br />
as the '''Server Address'''. You might want to replace <code>gfi</code> by <code>skd</code> to access the skd disks if that is your primary affiliation.<br />
On Ubuntu this is very similar: <code>Files > Go > Enter Location ...</code>. Enter the address: <pre>smb://<user name>@leo.hpc.uib.no/gfi</pre> and enter your password in the next pop-up window, while keeping "UiB" in the "Domain" field.<br />
Alternatively you can mount the network drive with sshfs to a dedicated directory using <code>sshfs</code> (install with <code>sudo apt install sshfs</code>):<br />
<pre>mkdir ~/cyclone_gfi<br />
From UiB network: sshfs -o follow_symlinks <user name>@cyclone.hpc.uib.no:/gfi/ ~/cyclone_gfi/<br />
From ext. networks: sshfs -o follow_symlinks <user name>@sync.uib.no:/gfi/ ~/cyclone_gfi/<br />
Unmount with: fusermount -u ~/cyclone_gfi</pre><br />
On Windows you can mount by navigating to <code>File Explorer > Map network drive</code> and enter <code>\\leo.hpc.uib.no\gfi</code>. Make sure to enable <code>Connect using different credentials</code> and fill in <code><user name>@uib.no</code> and your PW. <br />
<br />
<br />
== Displaying GUIs on your screen ==<br />
<br />
The ssh-login command at the top of this wiki enables trusted X11 forwarding (the <code>-Y</code> option), which allows you to display Graphical User Interfaces (GUIs) on your screen. This way you may be able to run software on a high performance system in a more userfriendly way than by just operating via the terminal. To make this work properly you may have to edit the ssh configuration file (<code>/etc/ssh/ssh_config</code> on linux systems) by adding or uncommenting the following two lines: <br />
<br />
<pre>X11Forwarding yes<br />
ForwardX11Trusted yes</pre><br />
<br />
Editing this file requires superuser priviliges so you may have to ask the IT department for support. For Mac the solution should be pretty similar, windows requires additional software like PuTTY (for establishing an ssh-connection) and an XServer (e.g. VcXsrv).</div>Csp001http://gfi.wiki.uib.no/index.php?title=File:Get_started_cyclone.pdf&diff=1567File:Get started cyclone.pdf2022-02-07T12:44:17Z<p>Csp001: </p>
<hr />
<div>Step by step guide for Jupyter on cyclone.</div>Csp001http://gfi.wiki.uib.no/index.php?title=Using_cyclone&diff=1423Using cyclone2021-01-07T09:56:23Z<p>Csp001: New virtualenv.</p>
<hr />
<div>== Connection and first steps ==<br />
<br />
Use ssh to connect<br />
<pre>ssh -Y <username>@cyclone.hpc.uib.no</pre><br />
or just simply:<br />
<pre>ssh -Y cyclone.hpc.uib.no</pre><br />
if you're connecting from a computer where you are logged in under the same name. When you are connecting for the first time, you will be asked to verify a signature. Reply "yes" to this question.<br />
<br />
=== Home directories ===<br />
<br />
<code>cyclone.hpc.uib.no</code> shares home directories with the new hexagon cluster. These home directories are separate from your standard UiB home directory. The contents of your home directories will not be synced, so you will manually need to transfer your scripts to the new system.<br />
<br />
=== How to access software ===<br />
<br />
In contrast to the old skd-cyclone, most scientific software is only available through software modules. Modules need to be loaded manually before the respective software can be used. We use software modules, because they provide are a clean and handy way to offer conflicting software or software versions: Instead of updating software and potentially breaking user scripts and programs new software is then made available in parallel to those that require it.<br />
<br />
=== Start-up scripts ===<br />
<br />
It might be handy to automatically load modules for software that you use frequently every time you login to cyclone. To accomplish that for bash, there are two relevant files, <code>$HOME/.bashrc</code> and <code>$HOME/.bash_profile</code> . <code>.bash_profile</code> should contain things that need to be defined at login time only, like <code>PATH</code> and other environment variables, startup programs, etc. You just need things once, not in every shell you open. In most cases, you also need the things from <code>.bashrc</code> in your login shell. That's why <code>.bash_profile</code> sources <code>.bashrc</code> as well, but .bashrc doesn't usually source <code>.bash_profile</code>. In contrast, <code>.bashrc</code> should typically contain things you want to set in every shell you open, like aliases, functions, etc. These are per shell session items that are not inherited from environment ([https://unix.stackexchange.com/questions/346336/why-have-both-bash-profile-and-bashrc source and detailed explanation]).<br />
<br />
==== An example <code>.bash_profile</code> for inspiration ====<br />
<br />
<pre>module load cdo/1.6.9<br />
module load ncarg/6.3.0-login<br />
<br />
alias rm="rm -i"<br />
alias cp="cp -i"<br />
alias erai="cd /Data/skd/share/Reanalysis/ERA_INTERIM/6HOURLY/"<br />
<br />
if [ -f ~/.bashrc ]; then<br />
. ~/.bashrc<br />
fi</pre><br />
<br />
==== An example <code>.bash_profile</code> for inspiration ====<br />
<br />
<pre>alias rm="rm -i"<br />
alias cp="cp -i"<br />
alias erai="cd /Data/skd/share/Reanalysis/ERA_INTERIM/6HOURLY/"</pre><br />
<br />
<br />
== Available software ==<br />
<br />
Below is a list of frequently used software and which module to load on the new cyclone. Relevant module names are printed like for <code>matlab/2015b</code>. Modules can be loaded by <code>module load <module name></code>, and unloaded <code>module unload <module name></code>. [[Using modules on cyclone|More details on the module system]].<br />
<br />
To list all available modules, use the command<br />
<pre>module avail</pre><br />
<br />
Hexagon-specific modules are now no longer listed and available on cyclone. All packages listed with this command should work, so please report to <code>support@hpc.uib.no</code> if they do not.<br />
<br />
=== Data analysis and plotting ===<br />
<br />
* CDO<br />
*: <code>CDO</code>, <code>CDO/1.9.5-foss-2018b</code><br />
* Dynlib<br />
*: See temporary solution for python. Requires in addition <code>OpenBLAS/0.3.1-GCC-7.3.0-2.30</code> and <code>ScaLAPACK/2.0.2-gompi-2018b-OpenBLAS-0.3.1</code>.<br />
* ghostview<br />
*: ''<no module required>''<br />
* grads<br />
*: ''<no module required>''<br />
* Matlab<br />
*: <code>Matlab</code>, <code>Matlab/2018a</code>, <code>Matlab/2012a</code><br />
* ncdump and other netCDF utilities<br />
*: <code>netCDF</code>, <code>netCDF/4.6.1-foss-2018b</code><br />
* NCL<br />
*: <code>NCL</code>, <code>NCL/6.5.0</code><br />
* nco<br />
*: <code>NCO</code>, <code>NCO/4.7.4-foss-2018b</code><br />
* ncview<br />
*: <code>ncview</code>, <code>ncview/2.1.7-foss-2018b</code>. Load only when needed! The package is currently known to break some GUI programs like gedit and gvim. <br />
* python, plus selection of scientific packages<br />
*: ''First'' choose and load the python module for the python version that you want to use, either <code>Python/2.7.15-foss-2018b</code> for python 2.7.15, or <code>Python/3.7.0-foss-2018b</code> for python 3.7.0.<br />
*: ''Then'', as a temporary solution, many scientific python packages are installed in the following virtual environments:<br />
*: <code>source /Data/gfi/users/local/share/virtualenv/dynpie2/bin/activate</code> for python 2.7.15. <br />
*: <code>source /Data/gfi/users/local/share/virtualenv/dynpie3-2021a/bin/activate</code> for python 3.7.0.<br />
*: For the pygrib module, <code>ecCodes/2.7.3-foss-2018b</code> is required in addition.<br />
* R<br />
*: ''<no module required>''<br />
<br />
=== Text editors ===<br />
<br />
* emacs<br />
*: Is installed globally, but requires <code>util-linux/2.32-GCCcore-7.3.0</code> to work.<br />
* gedit<br />
*: ''<no module required>''<br />
* gvim<br />
*: ''<no module required>''<br />
* vi(m)<br />
*: ''<no module required>''<br />
<br />
=== Compilers and libraries ===<br />
<br />
* blas<br />
*: <code>OpenBLAS/0.3.1-GCC-7.3.0-2.30</code>. '''Note''': The library is called <code>libopenblas</code>, so you'll need to compile with <code>-lopenblas</code>. <br />
* eccodes (replacement for grib_api)<br />
*: <code>ecCodes/2.7.3-foss-2018b</code><br />
* gcc, gfortran<br />
*: <code>GCC</code>, <code>GCC/7.3.0-2.30</code><br />
* grib_api<br />
*: <code>grib_api/1.24.0-foss-2018b</code><br />
* HDF5 libraries<br />
*: <code>HDF5/1.10.2-foss-2018b</code><br />
* lapack<br />
*: <code>ScaLAPACK/2.0.2-gompi-2018b-OpenBLAS-0.3.1</code>. '''Note''': The library is called <code>libscalapack</code>, so you'll need to compile with <code>-lscalapack</code>. <br />
* MPI<br />
*: <code>OpenMPI/3.1.1-GCC-7.3.0-2.30</code><br />
* netcdf<br />
*: For C-libaries: <code>netCDF/4.6.1-foss-2018b</code>, <br />
*: For Fortran-libraries <code>netCDF-Fortran/4.4.4-foss-2018b</code>, compile with option <code>-I/shared/apps/netCDF-Fortran/4.4.4-foss-2018b/include</code><br />
* proj<br />
*: <code>PROJ/5.0.0-foss-2018b</code><br />
<br />
== Accessing the data from your own machines ==<br />
<br />
Note: From your personal machines you will need to be connected to the UiB VPN to be able to mount the following network drives. <br />
<br />
On MacOS you can mount folders through <code>Finder > Go > Connect to Server ...</code>. In the dialogue window that pops up, enter<br />
<pre>smb://<user name>@leo.hpc.uib.no/gfi</pre><br />
as the '''Server Address'''. You might want to replace <code>gfi</code> by <code>skd</code> to access the skd disks if that is your primary affiliation.<br />
On Ubuntu this is very similar: <code>Files > Go > Enter Location ...</code>. Enter the address: <pre>smb://<user name>@leo.hpc.uib.no/gfi</pre> and enter your password in the next pop-up window, while keeping "UiB" in the "Domain" field.</div>Csp001http://gfi.wiki.uib.no/index.php?title=Using_cyclone&diff=1410Using cyclone2020-11-16T10:00:36Z<p>Csp001: Update virtualenv for python3</p>
<hr />
<div>== Connection and first steps ==<br />
<br />
Use ssh to connect<br />
<pre>ssh -Y <username>@cyclone.hpc.uib.no</pre><br />
or just simply:<br />
<pre>ssh -Y cyclone.hpc.uib.no</pre><br />
if you're connecting from a computer where you are logged in under the same name. When you are connecting for the first time, you will be asked to verify a signature. Reply "yes" to this question.<br />
<br />
=== Home directories ===<br />
<br />
<code>cyclone.hpc.uib.no</code> shares home directories with the new hexagon cluster. These home directories are separate from your standard UiB home directory. The contents of your home directories will not be synced, so you will manually need to transfer your scripts to the new system.<br />
<br />
=== How to access software ===<br />
<br />
In contrast to the old skd-cyclone, most scientific software is only available through software modules. Modules need to be loaded manually before the respective software can be used. We use software modules, because they provide are a clean and handy way to offer conflicting software or software versions: Instead of updating software and potentially breaking user scripts and programs new software is then made available in parallel to those that require it.<br />
<br />
=== Start-up scripts ===<br />
<br />
It might be handy to automatically load modules for software that you use frequently every time you login to cyclone. To accomplish that for bash, there are two relevant files, <code>$HOME/.bashrc</code> and <code>$HOME/.bash_profile</code> . <code>.bash_profile</code> should contain things that need to be defined at login time only, like <code>PATH</code> and other environment variables, startup programs, etc. You just need things once, not in every shell you open. In most cases, you also need the things from <code>.bashrc</code> in your login shell. That's why <code>.bash_profile</code> sources <code>.bashrc</code> as well, but .bashrc doesn't usually source <code>.bash_profile</code>. In contrast, <code>.bashrc</code> should typically contain things you want to set in every shell you open, like aliases, functions, etc. These are per shell session items that are not inherited from environment ([https://unix.stackexchange.com/questions/346336/why-have-both-bash-profile-and-bashrc source and detailed explanation]).<br />
<br />
==== An example <code>.bash_profile</code> for inspiration ====<br />
<br />
<pre>module load cdo/1.6.9<br />
module load ncarg/6.3.0-login<br />
<br />
alias rm="rm -i"<br />
alias cp="cp -i"<br />
alias erai="cd /Data/skd/share/Reanalysis/ERA_INTERIM/6HOURLY/"<br />
<br />
if [ -f ~/.bashrc ]; then<br />
. ~/.bashrc<br />
fi</pre><br />
<br />
==== An example <code>.bash_profile</code> for inspiration ====<br />
<br />
<pre>alias rm="rm -i"<br />
alias cp="cp -i"<br />
alias erai="cd /Data/skd/share/Reanalysis/ERA_INTERIM/6HOURLY/"</pre><br />
<br />
<br />
== Available software ==<br />
<br />
Below is a list of frequently used software and which module to load on the new cyclone. Relevant module names are printed like for <code>matlab/2015b</code>. Modules can be loaded by <code>module load <module name></code>, and unloaded <code>module unload <module name></code>. [[Using modules on cyclone|More details on the module system]].<br />
<br />
To list all available modules, use the command<br />
<pre>module avail</pre><br />
<br />
Hexagon-specific modules are now no longer listed and available on cyclone. All packages listed with this command should work, so please report to <code>support@hpc.uib.no</code> if they do not.<br />
<br />
=== Data analysis and plotting ===<br />
<br />
* CDO<br />
*: <code>CDO</code>, <code>CDO/1.9.5-foss-2018b</code><br />
* Dynlib<br />
*: See temporary solution for python. Requires in addition <code>OpenBLAS/0.3.1-GCC-7.3.0-2.30</code> and <code>ScaLAPACK/2.0.2-gompi-2018b-OpenBLAS-0.3.1</code>.<br />
* ghostview<br />
*: ''<no module required>''<br />
* grads<br />
*: ''<no module required>''<br />
* Matlab<br />
*: <code>Matlab</code>, <code>Matlab/2018a</code>, <code>Matlab/2012a</code><br />
* ncdump and other netCDF utilities<br />
*: <code>netCDF</code>, <code>netCDF/4.6.1-foss-2018b</code><br />
* NCL<br />
*: <code>NCL</code>, <code>NCL/6.5.0</code><br />
* nco<br />
*: <code>NCO</code>, <code>NCO/4.7.4-foss-2018b</code><br />
* ncview<br />
*: <code>ncview</code>, <code>ncview/2.1.7-foss-2018b</code>. Load only when needed! The package is currently known to break some GUI programs like gedit and gvim. <br />
* python, plus selection of scientific packages<br />
*: ''First'' choose and load the python module for the python version that you want to use, either <code>Python/2.7.15-foss-2018b</code> for python 2.7.15, or <code>Python/3.7.0-foss-2018b</code> for python 3.7.0.<br />
*: ''Then'', as a temporary solution, many scientific python packages are installed in the following virtual environments:<br />
*: <code>source /Data/gfi/users/local/share/virtualenv/dynpie2/bin/activate</code> for python 2.7.15. <br />
*: <code>source /Data/gfi/users/local/share/virtualenv/dynpie3-2020a/bin/activate</code> for python 3.7.0.<br />
*: For the pygrib module, <code>ecCodes/2.7.3-foss-2018b</code> is required in addition.<br />
* R<br />
*: ''<no module required>''<br />
<br />
=== Text editors ===<br />
<br />
* emacs<br />
*: Is installed globally, but requires <code>util-linux/2.32-GCCcore-7.3.0</code> to work.<br />
* gedit<br />
*: ''<no module required>''<br />
* gvim<br />
*: ''<no module required>''<br />
* vi(m)<br />
*: ''<no module required>''<br />
<br />
=== Compilers and libraries ===<br />
<br />
* blas<br />
*: <code>OpenBLAS/0.3.1-GCC-7.3.0-2.30</code>. '''Note''': The library is called <code>libopenblas</code>, so you'll need to compile with <code>-lopenblas</code>. <br />
* eccodes (replacement for grib_api)<br />
*: <code>ecCodes/2.7.3-foss-2018b</code><br />
* gcc, gfortran<br />
*: <code>GCC</code>, <code>GCC/7.3.0-2.30</code><br />
* grib_api<br />
*: <code>grib_api/1.24.0-foss-2018b</code><br />
* HDF5 libraries<br />
*: <code>HDF5/1.10.2-foss-2018b</code><br />
* lapack<br />
*: <code>ScaLAPACK/2.0.2-gompi-2018b-OpenBLAS-0.3.1</code>. '''Note''': The library is called <code>libscalapack</code>, so you'll need to compile with <code>-lscalapack</code>. <br />
* MPI<br />
*: <code>OpenMPI/3.1.1-GCC-7.3.0-2.30</code><br />
* netcdf<br />
*: For C-libaries: <code>netCDF/4.6.1-foss-2018b</code>, <br />
*: For Fortran-libraries <code>netCDF-Fortran/4.4.4-foss-2018b</code>, compile with option <code>-I/shared/apps/netCDF-Fortran/4.4.4-foss-2018b/include</code><br />
* proj<br />
*: <code>PROJ/5.0.0-foss-2018b</code><br />
<br />
== Accessing the data from your own machines ==<br />
<br />
Note: From your personal machines you will need to be connected to the UiB VPN to be able to mount the following network drives. <br />
<br />
On MacOS you can mount folders through <code>Finder > Go > Connect to Server ...</code>. In the dialogue window that pops up, enter<br />
<pre>smb://<user name>@leo.hpc.uib.no/gfi</pre><br />
as the '''Server Address'''. You might want to replace <code>gfi</code> by <code>skd</code> to access the skd disks if that is your primary affiliation.<br />
On Ubuntu this is very similar: <code>Files > Go > Enter Location ...</code>. Enter the address: <pre>smb://<user name>@leo.hpc.uib.no/gfi</pre> and enter your password in the next pop-up window, while keeping "UiB" in the "Domain" field.</div>Csp001http://gfi.wiki.uib.no/index.php?title=Using_cyclone&diff=1095Using cyclone2019-04-10T09:57:18Z<p>Csp001: /* Data analysis and plotting */ Clarify that python need to be loaded before being able to use the virtualenvs.</p>
<hr />
<div>== Connection and first steps ==<br />
<br />
Use ssh to connect<br />
<pre>ssh -Y <username>@cyclone.hpc.uib.no</pre><br />
or just simply:<br />
<pre>ssh -Y cyclone.hpc.uib.no</pre><br />
if you're connecting from a computer where you are logged in under the same name. When you are connecting for the first time, you will be asked to verify a signature. Reply "yes" to this question.<br />
<br />
=== Home directories ===<br />
<br />
<code>cyclone.hpc.uib.no</code> shares home directories with the new hexagon cluster. These home directories are separate from your standard UiB home directory. The contents of your home directories will not be synced, so you will manually need to transfer your scripts to the new system.<br />
<br />
=== How to access software ===<br />
<br />
In contrast to the old skd-cyclone, most scientific software is only available through software modules. Modules need to be loaded manually before the respective software can be used. We use software modules, because they provide are a clean and handy way to offer conflicting software or software versions: Instead of updating software and potentially breaking user scripts and programs new software is then made available in parallel to those that require it.<br />
<br />
=== Start-up scripts ===<br />
<br />
It might be handy to automatically load modules for software that you use frequently every time you login to cyclone. To accomplish that for bash, there are two relevant files, <code>$HOME/.bashrc</code> and <code>$HOME/.bash_profile</code> . <code>.bash_profile</code> should contain things that need to be defined at login time only, like <code>PATH</code> and other environment variables, startup programs, etc. You just need things once, not in every shell you open. In most cases, you also need the things from <code>.bashrc</code> in your login shell. That's why <code>.bash_profile</code> sources <code>.bashrc</code> as well, but .bashrc doesn't usually source <code>.bash_profile</code>. In contrast, <code>.bashrc</code> should typically contain things you want to set in every shell you open, like aliases, functions, etc. These are per shell session items that are not inherited from environment ([https://unix.stackexchange.com/questions/346336/why-have-both-bash-profile-and-bashrc source and detailed explanation]).<br />
<br />
==== An example <code>.bash_profile</code> for inspiration ====<br />
<br />
<pre>module load cdo/1.6.9<br />
module load ncarg/6.3.0-login<br />
<br />
alias rm="rm -i"<br />
alias cp="cp -i"<br />
alias erai="cd /Data/skd/share/Reanalysis/ERA_INTERIM/6HOURLY/"<br />
<br />
if [ -f ~/.bashrc ]; then<br />
. ~/.bashrc<br />
fi</pre><br />
<br />
==== An example <code>.bash_profile</code> for inspiration ====<br />
<br />
<pre>alias rm="rm -i"<br />
alias cp="cp -i"<br />
alias erai="cd /Data/skd/share/Reanalysis/ERA_INTERIM/6HOURLY/"</pre><br />
<br />
<br />
== Available software ==<br />
<br />
Below is a list of frequently used software and which module to load on the new cyclone. Relevant module names are printed like for <code>matlab/2015b</code>. Modules can be loaded by <code>module load <module name></code>, and unloaded <code>module unload <module name></code>. [[Using modules on cyclone|More details on the module system]].<br />
<br />
To list all available modules, use the command<br />
<pre>module avail</pre><br />
<br />
Hexagon-specific modules are now no longer listed and available on cyclone. All packages listed with this command should work, so please report to <code>support@hpc.uib.no</code> if they do not.<br />
<br />
=== Data analysis and plotting ===<br />
<br />
* CDO<br />
*: <code>CDO</code>, <code>CDO/1.9.5-foss-2018b</code><br />
* Dynlib<br />
*: See temporary solution for python. Requires in addition <code>OpenBLAS/0.3.1-GCC-7.3.0-2.30</code> and <code>ScaLAPACK/2.0.2-gompi-2018b-OpenBLAS-0.3.1</code>.<br />
* ghostview<br />
*: ''<no module required>''<br />
* grads<br />
*: ''<no module required>''<br />
* Matlab<br />
*: <code>Matlab</code>, <code>Matlab/2018a</code>, <code>Matlab/2012a</code><br />
* ncdump and other netCDF utilities<br />
*: <code>netCDF</code>, <code>netCDF/4.6.1-foss-2018b</code><br />
* NCL<br />
*: <code>NCL</code>, <code>NCL/6.5.0</code><br />
* nco<br />
*: <code>NCO</code>, <code>NCO/4.7.4-foss-2018b</code><br />
* ncview<br />
*: <code>ncview</code>, <code>ncview/2.1.7-foss-2018b</code>. Load only when needed! The package is currently known to break some GUI programs like gedit and gvim. <br />
* python, plus selection of scientific packages<br />
*: ''First'' choose and load the python module for the python version that you want to use, either <code>Python/2.7.15-foss-2018b</code> for python 2.7.15, or <code>Python/3.7.0-foss-2018b</code> for python 3.7.0.<br />
*: ''Then'', as a temporary solution, many scientific python packages are installed in the following virtual environments:<br />
*: <code>source /Data/gfi/users/local/share/virtualenv/dynpie2/bin/activate</code> for python 2.7.15. <br />
*: <code>source /Data/gfi/users/local/share/virtualenv/dynpie3/bin/activate</code> for python 3.7.0.<br />
*: For the pygrib module, <code>ecCodes/2.7.3-foss-2018b</code> is required in addition.<br />
* R<br />
*: ''<no module required>''<br />
<br />
=== Text editors ===<br />
<br />
* emacs<br />
*: Is installed globally, but requires <code>util-linux/2.32-GCCcore-7.3.0</code> to work.<br />
* gedit<br />
*: ''<no module required>''<br />
* gvim<br />
*: ''<no module required>''<br />
* vi(m)<br />
*: ''<no module required>''<br />
<br />
=== Compilers and libraries ===<br />
<br />
* blas<br />
*: <code>OpenBLAS/0.3.1-GCC-7.3.0-2.30</code>. '''Note''': The library is called <code>libopenblas</code>, so you'll need to compile with <code>-lopenblas</code>. <br />
* eccodes (replacement for grib_api)<br />
*: <code>ecCodes/2.7.3-foss-2018b</code><br />
* gcc, gfortran<br />
*: <code>GCC</code>, <code>GCC/7.3.0-2.30</code><br />
* grib_api<br />
*: <code>grib_api/1.24.0-foss-2018b</code><br />
* HDF5 libraries<br />
*: <code>HDF5/1.10.2-foss-2018b</code><br />
* lapack<br />
*: <code>ScaLAPACK/2.0.2-gompi-2018b-OpenBLAS-0.3.1</code>. '''Note''': The library is called <code>libscalapack</code>, so you'll need to compile with <code>-lscalapack</code>. <br />
* MPI<br />
*: <code>OpenMPI/3.1.1-GCC-7.3.0-2.30</code><br />
* netcdf<br />
*: For C-libaries: <code>netCDF/4.6.1-foss-2018b</code>, <br />
*: For Fortran-libraries <code>netCDF-Fortran/4.4.4-foss-2018b</code>, compile with option <code>-I/shared/apps/netCDF-Fortran/4.4.4-foss-2018b/include</code><br />
* proj<br />
*: <code>PROJ/5.0.0-foss-2018b</code><br />
<br />
== Accessing the data from your own machines ==<br />
<br />
Note: From your personal machines you will need to be connected to the UiB VPN to be able to mount the following network drives. <br />
<br />
On MacOS you can mount folders through <code>Finder > Go > Connect to Server ...</code>. In the dialogue window that pops up, enter<br />
<pre>smb://<user name>@leo.hpc.uib.no/gfi</pre><br />
as the '''Server Address'''. You might want to replace <code>gfi</code> by <code>skd</code> to access the skd disks if that is your primary affiliation.<br />
On Ubuntu this is very similar: <code>Files > Go > Enter Location ...</code>. Enter the address: <pre>smb://<user name>@leo.hpc.uib.no/gfi</pre> and enter your password in the next pop-up window, while keeping "UiB" in the "Domain" field.</div>Csp001http://gfi.wiki.uib.no/index.php?title=Using_cyclone&diff=1027Using cyclone2018-11-26T13:34:06Z<p>Csp001: /* Compilers and libraries */</p>
<hr />
<div>== Connection and first steps ==<br />
<br />
Use ssh to connect<br />
<pre>ssh -Y <username>@cyclone.hpc.uib.no</pre><br />
or just simply:<br />
<pre>ssh -Y cyclone.hpc.uib.no</pre><br />
if you're connecting from a computer where you are logged in under the same name. When you are connecting for the first time, you will be asked to verify a signature. Reply "yes" to this question.<br />
<br />
=== Home directories ===<br />
<br />
<code>cyclone.hpc.uib.no</code> shares home directories with the new hexagon cluster. These home directories are separate from your standard UiB home directory. The contents of your home directories will not be synced, so you will manually need to transfer your scripts to the new system.<br />
<br />
=== How to access software ===<br />
<br />
In contrast to the old skd-cyclone, most scientific software is only available through software modules. Modules need to be loaded manually before the respective software can be used. We use software modules, because they provide are a clean and handy way to offer conflicting software or software versions: Instead of updating software and potentially breaking user scripts and programs new software is then made available in parallel to those that require it.<br />
<br />
=== Start-up scripts ===<br />
<br />
It might be handy to automatically load modules for software that you use frequently every time you login to cyclone. To accomplish that for bash, there are two relevant files, <code>$HOME/.bashrc</code> and <code>$HOME/.bash_profile</code> . <code>.bash_profile</code> should contain things that need to be defined at login time only, like <code>PATH</code> and other environment variables, startup programs, etc. You just need things once, not in every shell you open. In most cases, you also need the things from <code>.bashrc</code> in your login shell. That's why <code>.bash_profile</code> sources <code>.bashrc</code> as well, but .bashrc doesn't usually source <code>.bash_profile</code>. In contrast, <code>.bashrc</code> should typically contain things you want to set in every shell you open, like aliases, functions, etc. These are per shell session items that are not inherited from environment ([https://unix.stackexchange.com/questions/346336/why-have-both-bash-profile-and-bashrc source and detailed explanation]).<br />
<br />
==== An example <code>.bash_profile</code> for inspiration ====<br />
<br />
<pre>module load cdo/1.6.9<br />
module load ncarg/6.3.0-login<br />
<br />
alias rm="rm -i"<br />
alias cp="cp -i"<br />
alias erai="cd /Data/skd/share/Reanalysis/ERA_INTERIM/6HOURLY/"<br />
<br />
if [ -f ~/.bashrc ]; then<br />
. ~/.bashrc<br />
fi</pre><br />
<br />
==== An example <code>.bash_profile</code> for inspiration ====<br />
<br />
<pre>alias rm="rm -i"<br />
alias cp="cp -i"<br />
alias erai="cd /Data/skd/share/Reanalysis/ERA_INTERIM/6HOURLY/"</pre><br />
<br />
<br />
== Available software ==<br />
<br />
Below is a list of frequently used software and which module to load on the new cyclone. Relevant module names are printed like for <code>matlab/2015b</code>. Modules can be loaded by <code>module load <module name></code>, and unloaded <code>module unload <module name></code>. [[Using modules on cyclone|More details on the module system]].<br />
<br />
To list all available modules, use the command<br />
<pre>module avail</pre><br />
<br />
Hexagon-specific modules are now no longer listed and available on cyclone. All packages listed with this command should work, so please report to <code>support@hpc.uib.no</code> if they do not.<br />
<br />
=== Data analysis and plotting ===<br />
<br />
* CDO<br />
*: <code>CDO</code>, <code>CDO/1.9.5-foss-2018b</code><br />
* Dynlib<br />
*: See temporary solution for python. Requires in addition <code>OpenBLAS/0.3.1-GCC-7.3.0-2.30</code> and <code>ScaLAPACK/2.0.2-gompi-2018b-OpenBLAS-0.3.1</code>.<br />
* ghostview<br />
*: ''<no module required>''<br />
* grads<br />
*: ''<no module required>''<br />
* Matlab<br />
*: <code>Matlab</code>, <code>Matlab/2018a</code>, <code>Matlab/2012a</code><br />
* ncdump and other netCDF utilities<br />
*: <code>netCDF</code>, <code>netCDF/4.6.1-foss-2018b</code><br />
* NCL<br />
*: <code>NCL</code>, <code>NCL/6.5.0</code><br />
* nco<br />
*: <code>NCO</code>, <code>NCO/4.7.4-foss-2018b</code><br />
* ncview<br />
*: <code>ncview</code>, <code>ncview/2.1.7-foss-2018b</code>. Load only when needed! The package is currently known to break some GUI programs like gedit and gvim. <br />
* python, plus selection of scientific packages<br />
*: Temporary solution, use one of the two below commands to enable the virtual environment:<br />
*: <code>source /Data/gfi/users/local/share/virtualenv/dynpie2/bin/activate</code> for python 2.7.15, based on <code>Python/2.7.15-foss-2018b</code><br />
*: <code>source /Data/gfi/users/local/share/virtualenv/dynpie3/bin/activate</code> for python 3.7.0, based on <code>Python/3.7.0-foss-2018b</code>.<br />
*: For the pygrib module, <code>ecCodes/2.7.3-foss-2018b</code> is required in addition.<br />
* R<br />
*: ''<no module required>''<br />
<br />
=== Text editors ===<br />
<br />
* emacs<br />
*: Is installed globally, but requires <code>util-linux/2.32-GCCcore-7.3.0</code> to work.<br />
* gedit<br />
*: ''<no module required>''<br />
* gvim<br />
*: ''<no module required>''<br />
* vi(m)<br />
*: ''<no module required>''<br />
<br />
=== Compilers and libraries ===<br />
<br />
* blas<br />
*: <code>OpenBLAS/0.3.1-GCC-7.3.0-2.30</code>. '''Note''': The library is called <code>libopenblas</code>, so you'll need to compile with <code>-lopenblas</code>. <br />
* eccodes (replacement for grib_api)<br />
*: <code>ecCodes/2.7.3-foss-2018b</code><br />
* gcc, gfortran<br />
*: <code>GCC</code>, <code>GCC/7.3.0-2.30</code><br />
* grib_api<br />
*: <code>grib_api/1.24.0-foss-2018b</code><br />
* HDF5 libraries<br />
*: <code>HDF5/1.10.2-foss-2018b</code><br />
* lapack<br />
*: <code>ScaLAPACK/2.0.2-gompi-2018b-OpenBLAS-0.3.1</code>. '''Note''': The library is called <code>libscalapack</code>, so you'll need to compile with <code>-lscalapack</code>. <br />
* MPI<br />
*: <code>OpenMPI/3.1.1-GCC-7.3.0-2.30</code><br />
* netcdf<br />
*: For C-libaries: <code>netCDF/4.6.1-foss-2018b</code>, <br />
*: For Fortran-libraries <code>netCDF-Fortran/4.4.4-foss-2018b</code>, compile with option <code>-I/shared/apps/netCDF-Fortran/4.4.4-foss-2018b/include</code><br />
* proj<br />
*: <code>PROJ/5.0.0-foss-2018b</code><br />
<br />
== Accessing the data from your own machines ==<br />
<br />
Note: From your personal machines you will need to be connected to the UiB VPN to be able to mount the following network drives. <br />
<br />
On MacOS you can mount folders through <code>Finder > Go > Connect to Server ...</code>. In the dialogue window that pops up, enter<br />
<pre>smb://<user name>@leo.hpc.uib.no/gfi</pre><br />
as the '''Server Address'''. You might want to replace <code>gfi</code> by <code>skd</code> to access the skd disks if that is your primary affiliation.<br />
On Ubuntu this is very similar: <code>Files > Go > Enter Location ...</code>. Enter the address: <pre>smb://<user name>@leo.hpc.uib.no/gfi</pre> and enter your password in the next pop-up window, while keeping "UiB" in the "Domain" field.</div>Csp001http://gfi.wiki.uib.no/index.php?title=Using_cyclone&diff=1026Using cyclone2018-11-26T10:03:57Z<p>Csp001: /* Text editors */</p>
<hr />
<div>== Connection and first steps ==<br />
<br />
Use ssh to connect<br />
<pre>ssh -Y <username>@cyclone.hpc.uib.no</pre><br />
or just simply:<br />
<pre>ssh -Y cyclone.hpc.uib.no</pre><br />
if you're connecting from a computer where you are logged in under the same name. When you are connecting for the first time, you will be asked to verify a signature. Reply "yes" to this question.<br />
<br />
=== Home directories ===<br />
<br />
<code>cyclone.hpc.uib.no</code> shares home directories with the new hexagon cluster. These home directories are separate from your standard UiB home directory. The contents of your home directories will not be synced, so you will manually need to transfer your scripts to the new system.<br />
<br />
=== How to access software ===<br />
<br />
In contrast to the old skd-cyclone, most scientific software is only available through software modules. Modules need to be loaded manually before the respective software can be used. We use software modules, because they provide are a clean and handy way to offer conflicting software or software versions: Instead of updating software and potentially breaking user scripts and programs new software is then made available in parallel to those that require it.<br />
<br />
=== Start-up scripts ===<br />
<br />
It might be handy to automatically load modules for software that you use frequently every time you login to cyclone. To accomplish that for bash, there are two relevant files, <code>$HOME/.bashrc</code> and <code>$HOME/.bash_profile</code> . <code>.bash_profile</code> should contain things that need to be defined at login time only, like <code>PATH</code> and other environment variables, startup programs, etc. You just need things once, not in every shell you open. In most cases, you also need the things from <code>.bashrc</code> in your login shell. That's why <code>.bash_profile</code> sources <code>.bashrc</code> as well, but .bashrc doesn't usually source <code>.bash_profile</code>. In contrast, <code>.bashrc</code> should typically contain things you want to set in every shell you open, like aliases, functions, etc. These are per shell session items that are not inherited from environment ([https://unix.stackexchange.com/questions/346336/why-have-both-bash-profile-and-bashrc source and detailed explanation]).<br />
<br />
==== An example <code>.bash_profile</code> for inspiration ====<br />
<br />
<pre>module load cdo/1.6.9<br />
module load ncarg/6.3.0-login<br />
<br />
alias rm="rm -i"<br />
alias cp="cp -i"<br />
alias erai="cd /Data/skd/share/Reanalysis/ERA_INTERIM/6HOURLY/"<br />
<br />
if [ -f ~/.bashrc ]; then<br />
. ~/.bashrc<br />
fi</pre><br />
<br />
==== An example <code>.bash_profile</code> for inspiration ====<br />
<br />
<pre>alias rm="rm -i"<br />
alias cp="cp -i"<br />
alias erai="cd /Data/skd/share/Reanalysis/ERA_INTERIM/6HOURLY/"</pre><br />
<br />
<br />
== Available software ==<br />
<br />
Below is a list of frequently used software and which module to load on the new cyclone. Relevant module names are printed like for <code>matlab/2015b</code>. Modules can be loaded by <code>module load <module name></code>, and unloaded <code>module unload <module name></code>. [[Using modules on cyclone|More details on the module system]].<br />
<br />
To list all available modules, use the command<br />
<pre>module avail</pre><br />
<br />
Hexagon-specific modules are now no longer listed and available on cyclone. All packages listed with this command should work, so please report to <code>support@hpc.uib.no</code> if they do not.<br />
<br />
=== Data analysis and plotting ===<br />
<br />
* CDO<br />
*: <code>CDO</code>, <code>CDO/1.9.5-foss-2018b</code><br />
* Dynlib<br />
*: See temporary solution for python. Requires in addition <code>OpenBLAS/0.3.1-GCC-7.3.0-2.30</code> and <code>ScaLAPACK/2.0.2-gompi-2018b-OpenBLAS-0.3.1</code>.<br />
* ghostview<br />
*: ''<no module required>''<br />
* grads<br />
*: ''<no module required>''<br />
* Matlab<br />
*: <code>Matlab</code>, <code>Matlab/2018a</code>, <code>Matlab/2012a</code><br />
* ncdump and other netCDF utilities<br />
*: <code>netCDF</code>, <code>netCDF/4.6.1-foss-2018b</code><br />
* NCL<br />
*: <code>NCL</code>, <code>NCL/6.5.0</code><br />
* nco<br />
*: <code>NCO</code>, <code>NCO/4.7.4-foss-2018b</code><br />
* ncview<br />
*: <code>ncview</code>, <code>ncview/2.1.7-foss-2018b</code>. Load only when needed! The package is currently known to break some GUI programs like gedit and gvim. <br />
* python, plus selection of scientific packages<br />
*: Temporary solution, use one of the two below commands to enable the virtual environment:<br />
*: <code>source /Data/gfi/users/local/share/virtualenv/dynpie2/bin/activate</code> for python 2.7.15, based on <code>Python/2.7.15-foss-2018b</code><br />
*: <code>source /Data/gfi/users/local/share/virtualenv/dynpie3/bin/activate</code> for python 3.7.0, based on <code>Python/3.7.0-foss-2018b</code>.<br />
*: For the pygrib module, <code>ecCodes/2.7.3-foss-2018b</code> is required in addition.<br />
* R<br />
*: ''<no module required>''<br />
<br />
=== Text editors ===<br />
<br />
* emacs<br />
*: Is installed globally, but requires <code>util-linux/2.32-GCCcore-7.3.0</code> to work.<br />
* gedit<br />
*: ''<no module required>''<br />
* gvim<br />
*: ''<no module required>''<br />
* vi(m)<br />
*: ''<no module required>''<br />
<br />
=== Compilers and libraries ===<br />
<br />
* blas<br />
*: <code>OpenBLAS/0.3.1-GCC-7.3.0-2.30</code><br />
* eccodes (replacement for grib_api)<br />
*: <code>ecCodes/2.7.3-foss-2018b</code><br />
* gcc, gfortran<br />
*: <code>GCC</code>, <code>GCC/7.3.0-2.30</code><br />
* grib_api<br />
*: <code>grib_api/1.24.0-foss-2018b</code><br />
* HDF5 libraries<br />
*: <code>HDF5/1.10.2-foss-2018b</code><br />
* lapack<br />
*: <code>ScaLAPACK/2.0.2-gompi-2018b-OpenBLAS-0.3.1</code><br />
* MPI<br />
*: <code>OpenMPI/3.1.1-GCC-7.3.0-2.30</code><br />
* netcdf<br />
*: For C-libaries: <code>netCDF/4.6.1-foss-2018b</code>, <br />
*: For Fortran-libraries <code>netCDF-Fortran/4.4.4-foss-2018b</code>, compile with option <code>-I/shared/apps/netCDF-Fortran/4.4.4-foss-2018b/include</code><br />
* proj<br />
*: <code>PROJ/5.0.0-foss-2018b</code><br />
<br />
== Accessing the data from your own machines ==<br />
<br />
Note: From your personal machines you will need to be connected to the UiB VPN to be able to mount the following network drives. <br />
<br />
On MacOS you can mount folders through <code>Finder > Go > Connect to Server ...</code>. In the dialogue window that pops up, enter<br />
<pre>smb://<user name>@leo.hpc.uib.no/gfi</pre><br />
as the '''Server Address'''. You might want to replace <code>gfi</code> by <code>skd</code> to access the skd disks if that is your primary affiliation.<br />
On Ubuntu this is very similar: <code>Files > Go > Enter Location ...</code>. Enter the address: <pre>smb://<user name>@leo.hpc.uib.no/gfi</pre> and enter your password in the next pop-up window, while keeping "UiB" in the "Domain" field.</div>Csp001http://gfi.wiki.uib.no/index.php?title=Using_cyclone&diff=1025Using cyclone2018-11-26T10:03:30Z<p>Csp001: /* Available software */</p>
<hr />
<div>== Connection and first steps ==<br />
<br />
Use ssh to connect<br />
<pre>ssh -Y <username>@cyclone.hpc.uib.no</pre><br />
or just simply:<br />
<pre>ssh -Y cyclone.hpc.uib.no</pre><br />
if you're connecting from a computer where you are logged in under the same name. When you are connecting for the first time, you will be asked to verify a signature. Reply "yes" to this question.<br />
<br />
=== Home directories ===<br />
<br />
<code>cyclone.hpc.uib.no</code> shares home directories with the new hexagon cluster. These home directories are separate from your standard UiB home directory. The contents of your home directories will not be synced, so you will manually need to transfer your scripts to the new system.<br />
<br />
=== How to access software ===<br />
<br />
In contrast to the old skd-cyclone, most scientific software is only available through software modules. Modules need to be loaded manually before the respective software can be used. We use software modules, because they provide are a clean and handy way to offer conflicting software or software versions: Instead of updating software and potentially breaking user scripts and programs new software is then made available in parallel to those that require it.<br />
<br />
=== Start-up scripts ===<br />
<br />
It might be handy to automatically load modules for software that you use frequently every time you login to cyclone. To accomplish that for bash, there are two relevant files, <code>$HOME/.bashrc</code> and <code>$HOME/.bash_profile</code> . <code>.bash_profile</code> should contain things that need to be defined at login time only, like <code>PATH</code> and other environment variables, startup programs, etc. You just need things once, not in every shell you open. In most cases, you also need the things from <code>.bashrc</code> in your login shell. That's why <code>.bash_profile</code> sources <code>.bashrc</code> as well, but .bashrc doesn't usually source <code>.bash_profile</code>. In contrast, <code>.bashrc</code> should typically contain things you want to set in every shell you open, like aliases, functions, etc. These are per shell session items that are not inherited from environment ([https://unix.stackexchange.com/questions/346336/why-have-both-bash-profile-and-bashrc source and detailed explanation]).<br />
<br />
==== An example <code>.bash_profile</code> for inspiration ====<br />
<br />
<pre>module load cdo/1.6.9<br />
module load ncarg/6.3.0-login<br />
<br />
alias rm="rm -i"<br />
alias cp="cp -i"<br />
alias erai="cd /Data/skd/share/Reanalysis/ERA_INTERIM/6HOURLY/"<br />
<br />
if [ -f ~/.bashrc ]; then<br />
. ~/.bashrc<br />
fi</pre><br />
<br />
==== An example <code>.bash_profile</code> for inspiration ====<br />
<br />
<pre>alias rm="rm -i"<br />
alias cp="cp -i"<br />
alias erai="cd /Data/skd/share/Reanalysis/ERA_INTERIM/6HOURLY/"</pre><br />
<br />
<br />
== Available software ==<br />
<br />
Below is a list of frequently used software and which module to load on the new cyclone. Relevant module names are printed like for <code>matlab/2015b</code>. Modules can be loaded by <code>module load <module name></code>, and unloaded <code>module unload <module name></code>. [[Using modules on cyclone|More details on the module system]].<br />
<br />
To list all available modules, use the command<br />
<pre>module avail</pre><br />
<br />
Hexagon-specific modules are now no longer listed and available on cyclone. All packages listed with this command should work, so please report to <code>support@hpc.uib.no</code> if they do not.<br />
<br />
=== Data analysis and plotting ===<br />
<br />
* CDO<br />
*: <code>CDO</code>, <code>CDO/1.9.5-foss-2018b</code><br />
* Dynlib<br />
*: See temporary solution for python. Requires in addition <code>OpenBLAS/0.3.1-GCC-7.3.0-2.30</code> and <code>ScaLAPACK/2.0.2-gompi-2018b-OpenBLAS-0.3.1</code>.<br />
* ghostview<br />
*: ''<no module required>''<br />
* grads<br />
*: ''<no module required>''<br />
* Matlab<br />
*: <code>Matlab</code>, <code>Matlab/2018a</code>, <code>Matlab/2012a</code><br />
* ncdump and other netCDF utilities<br />
*: <code>netCDF</code>, <code>netCDF/4.6.1-foss-2018b</code><br />
* NCL<br />
*: <code>NCL</code>, <code>NCL/6.5.0</code><br />
* nco<br />
*: <code>NCO</code>, <code>NCO/4.7.4-foss-2018b</code><br />
* ncview<br />
*: <code>ncview</code>, <code>ncview/2.1.7-foss-2018b</code>. Load only when needed! The package is currently known to break some GUI programs like gedit and gvim. <br />
* python, plus selection of scientific packages<br />
*: Temporary solution, use one of the two below commands to enable the virtual environment:<br />
*: <code>source /Data/gfi/users/local/share/virtualenv/dynpie2/bin/activate</code> for python 2.7.15, based on <code>Python/2.7.15-foss-2018b</code><br />
*: <code>source /Data/gfi/users/local/share/virtualenv/dynpie3/bin/activate</code> for python 3.7.0, based on <code>Python/3.7.0-foss-2018b</code>.<br />
*: For the pygrib module, <code>ecCodes/2.7.3-foss-2018b</code> is required in addition.<br />
* R<br />
*: ''<no module required>''<br />
<br />
=== Text editors ===<br />
<br />
* emacs<br />
*: <code>util-linux/2.32-GCCcore-7.3.0</code><br />
* gedit<br />
*: ''<no module required>''<br />
* gvim<br />
*: ''<no module required>''<br />
* vi(m)<br />
*: ''<no module required>''<br />
<br />
=== Compilers and libraries ===<br />
<br />
* blas<br />
*: <code>OpenBLAS/0.3.1-GCC-7.3.0-2.30</code><br />
* eccodes (replacement for grib_api)<br />
*: <code>ecCodes/2.7.3-foss-2018b</code><br />
* gcc, gfortran<br />
*: <code>GCC</code>, <code>GCC/7.3.0-2.30</code><br />
* grib_api<br />
*: <code>grib_api/1.24.0-foss-2018b</code><br />
* HDF5 libraries<br />
*: <code>HDF5/1.10.2-foss-2018b</code><br />
* lapack<br />
*: <code>ScaLAPACK/2.0.2-gompi-2018b-OpenBLAS-0.3.1</code><br />
* MPI<br />
*: <code>OpenMPI/3.1.1-GCC-7.3.0-2.30</code><br />
* netcdf<br />
*: For C-libaries: <code>netCDF/4.6.1-foss-2018b</code>, <br />
*: For Fortran-libraries <code>netCDF-Fortran/4.4.4-foss-2018b</code>, compile with option <code>-I/shared/apps/netCDF-Fortran/4.4.4-foss-2018b/include</code><br />
* proj<br />
*: <code>PROJ/5.0.0-foss-2018b</code><br />
<br />
== Accessing the data from your own machines ==<br />
<br />
Note: From your personal machines you will need to be connected to the UiB VPN to be able to mount the following network drives. <br />
<br />
On MacOS you can mount folders through <code>Finder > Go > Connect to Server ...</code>. In the dialogue window that pops up, enter<br />
<pre>smb://<user name>@leo.hpc.uib.no/gfi</pre><br />
as the '''Server Address'''. You might want to replace <code>gfi</code> by <code>skd</code> to access the skd disks if that is your primary affiliation.<br />
On Ubuntu this is very similar: <code>Files > Go > Enter Location ...</code>. Enter the address: <pre>smb://<user name>@leo.hpc.uib.no/gfi</pre> and enter your password in the next pop-up window, while keeping "UiB" in the "Domain" field.</div>Csp001http://gfi.wiki.uib.no/index.php?title=Using_cyclone&diff=1018Using cyclone2018-11-05T14:09:18Z<p>Csp001: /* Data analysis and plotting */</p>
<hr />
<div>== Connection and first steps ==<br />
<br />
Use ssh to connect<br />
<pre>ssh -Y <username>@cyclone.hpc.uib.no</pre><br />
or just simply:<br />
<pre>ssh -Y cyclone.hpc.uib.no</pre><br />
if you're connecting from a computer where you are logged in under the same name. When you are connecting for the first time, you will be asked to verify a signature. Reply "yes" to this question.<br />
<br />
=== Home directories ===<br />
<br />
<code>cyclone.hpc.uib.no</code> shares home directories with the new hexagon cluster. These home directories are separate from your standard UiB home directory. The contents of your home directories will not be synced, so you will manually need to transfer your scripts to the new system.<br />
<br />
=== How to access software ===<br />
<br />
In contrast to the old skd-cyclone, most scientific software is only available through software modules. Modules need to be loaded manually before the respective software can be used. We use software modules, because they provide are a clean and handy way to offer conflicting software or software versions: Instead of updating software and potentially breaking user scripts and programs new software is then made available in parallel to those that require it.<br />
<br />
=== Start-up scripts ===<br />
<br />
It might be handy to automatically load modules for software that you use frequently every time you login to cyclone. To accomplish that for bash, there are two relevant files, <code>$HOME/.bashrc</code> and <code>$HOME/.bash_profile</code> . <code>.bash_profile</code> should contain things that need to be defined at login time only, like <code>PATH</code> and other environment variables, startup programs, etc. You just need things once, not in every shell you open. In most cases, you also need the things from <code>.bashrc</code> in your login shell. That's why <code>.bash_profile</code> sources <code>.bashrc</code> as well, but .bashrc doesn't usually source <code>.bash_profile</code>. In contrast, <code>.bashrc</code> should typically contain things you want to set in every shell you open, like aliases, functions, etc. These are per shell session items that are not inherited from environment ([https://unix.stackexchange.com/questions/346336/why-have-both-bash-profile-and-bashrc source and detailed explanation]).<br />
<br />
==== An example <code>.bash_profile</code> for inspiration ====<br />
<br />
<pre>module load cdo/1.6.9<br />
module load ncarg/6.3.0-login<br />
<br />
alias rm="rm -i"<br />
alias cp="cp -i"<br />
alias erai="cd /Data/skd/share/Reanalysis/ERA_INTERIM/6HOURLY/"<br />
<br />
if [ -f ~/.bashrc ]; then<br />
. ~/.bashrc<br />
fi</pre><br />
<br />
==== An example <code>.bash_profile</code> for inspiration ====<br />
<br />
<pre>alias rm="rm -i"<br />
alias cp="cp -i"<br />
alias erai="cd /Data/skd/share/Reanalysis/ERA_INTERIM/6HOURLY/"</pre><br />
<br />
<br />
== Available software ==<br />
<br />
Below is a list of frequently used software and which module to load on the new cyclone. Relevant module names are printed like for <code>matlab/2015b</code>. Modules can be loaded by <code>module load <module name></code>, and unloaded <code>module unload <module name></code>. [[Using modules on cyclone|More details on the module system]].<br />
<br />
To list all available modules, use the command<br />
<pre>module avail</pre><br />
<br />
Hexagon-specific modules are now no longer listed and available on cyclone. All packages listed with this command should work, so please report to <code>support@hpc.uib.no</code> if they do not.<br />
<br />
=== Data analysis and plotting ===<br />
<br />
* CDO<br />
*: <code>CDO</code>, <code>CDO/1.9.5-foss-2018b</code><br />
* Dynlib<br />
*: See temporary solution for python. Requires in addition <code>OpenBLAS/0.3.1-GCC-7.3.0-2.30</code> and <code>ScaLAPACK/2.0.2-gompi-2018b-OpenBLAS-0.3.1</code>.<br />
* ghostview<br />
*: ''<no module required>''<br />
* grads<br />
*: ''<no module required>''<br />
* Matlab<br />
*: <code>Matlab</code>, <code>Matlab/2018a</code>, <code>Matlab/2012a</code><br />
* ncdump and other netCDF utilities<br />
*: <code>netCDF</code>, <code>netCDF/4.6.1-foss-2018b</code><br />
* NCL<br />
*: <code>NCL</code>, <code>NCL/6.5.0</code><br />
* nco<br />
*: <code>NCO</code>, <code>NCO/4.7.4-foss-2018b</code><br />
* ncview<br />
*: <code>ncview</code>, <code>ncview/2.1.7-foss-2018b</code>. Load only when needed! The package is currently known to break some GUI programs like gedit and gvim. <br />
* python, plus selection of scientific packages<br />
*: Temporary solution, use one of the two below commands to enable the virtual environment:<br />
*: <code>source /Data/gfi/users/local/share/virtualenv/dynpie2/bin/activate</code> for python 2.7.15, based on <code>Python/2.7.15-foss-2018b</code><br />
*: <code>source /Data/gfi/users/local/share/virtualenv/dynpie3/bin/activate</code> for python 3.7.0, based on <code>Python/3.7.0-foss-2018b</code>.<br />
*: For the pygrib module, <code>ecCodes/2.7.3-foss-2018b</code> is required in addition.<br />
* R<br />
*: ''<no module required>''<br />
<br />
=== Text editors ===<br />
<br />
* emacs<br />
*: ''<no module required>''<br />
* gedit<br />
*: ''<no module required>''<br />
* gvim<br />
*: ''<no module required>''<br />
* vi(m)<br />
*: ''<no module required>''<br />
<br />
=== Compilers and libraries ===<br />
<br />
* blas<br />
*: <code>OpenBLAS/0.3.1-GCC-7.3.0-2.30</code><br />
* eccodes (replacement for grib_api)<br />
*: <code>ecCodes/2.7.3-foss-2018b</code><br />
* gcc, gfortran<br />
*: <code>GCC</code>, <code>GCC/7.3.0-2.30</code><br />
* grib_api<br />
*: <code>grib_api/1.24.0-foss-2018b</code><br />
* HDF5 libraries<br />
*: <code>HDF5/1.10.2-foss-2018b</code><br />
* lapack<br />
*: <code>ScaLAPACK/2.0.2-gompi-2018b-OpenBLAS-0.3.1</code><br />
* MPI<br />
*: <code>OpenMPI/3.1.1-GCC-7.3.0-2.30</code><br />
* netcdf<br />
*: For C-libaries: <code>netCDF/4.6.1-foss-2018b</code>, <br />
*: For Fortran-libraries <code>netCDF-Fortran/4.4.4-foss-2018b</code>, compile with option <code>-I/shared/apps/netCDF-Fortran/4.4.4-foss-2018b/include</code><br />
* proj<br />
*: <code>PROJ/5.0.0-foss-2018b</code><br />
<br />
== Accessing the data from your own machines ==<br />
<br />
Note: From your personal machines you will need to be connected to the UiB VPN to be able to mount the following network drives. <br />
<br />
On MacOS you can mount folders through <code>Finder > Go > Connect to Server ...</code>. In the dialogue window that pops up, enter<br />
<pre>smb://<user name>@leo.hpc.uib.no/gfi</pre><br />
as the '''Server Address'''. You might want to replace <code>gfi</code> by <code>skd</code> to access the skd disks if that is your primary affiliation.<br />
On Ubuntu this is very similar: <code>Files > Go > Enter Location ...</code>. Enter the address: <pre>smb://<user name>@leo.hpc.uib.no/gfi</pre> and enter your password in the next pop-up window, while keeping "UiB" in the "Domain" field.</div>Csp001http://gfi.wiki.uib.no/index.php?title=Using_cyclone&diff=1010Using cyclone2018-10-10T14:25:51Z<p>Csp001: /* Data analysis and plotting */</p>
<hr />
<div>== Connection and first steps ==<br />
<br />
Use ssh to connect<br />
<pre>ssh -Y <username>@cyclone.hpc.uib.no</pre><br />
or just simply:<br />
<pre>ssh -Y cyclone.hpc.uib.no</pre><br />
if you're connecting from a computer where you are logged in under the same name. When you are connecting for the first time, you will be asked to verify a signature. Reply "yes" to this question.<br />
<br />
=== Home directories ===<br />
<br />
<code>cyclone.hpc.uib.no</code> shares home directories with the new hexagon cluster. These home directories are separate from your standard UiB home directory. The contents of your home directories will not be synced, so you will manually need to transfer your scripts to the new system.<br />
<br />
=== How to access software ===<br />
<br />
In contrast to the old skd-cyclone, most scientific software is only available through software modules. Modules need to be loaded manually before the respective software can be used. We use software modules, because they provide are a clean and handy way to offer conflicting software or software versions: Instead of updating software and potentially breaking user scripts and programs new software is then made available in parallel to those that require it.<br />
<br />
=== Start-up scripts ===<br />
<br />
It might be handy to automatically load modules for software that you use frequently every time you login to cyclone. To accomplish that for bash, there are two relevant files, <code>$HOME/.bashrc</code> and <code>$HOME/.bash_profile</code> . <code>.bash_profile</code> should contain things that need to be defined at login time only, like <code>PATH</code> and other environment variables, startup programs, etc. You just need things once, not in every shell you open. In most cases, you also need the things from <code>.bashrc</code> in your login shell. That's why <code>.bash_profile</code> sources <code>.bashrc</code> as well, but .bashrc doesn't usually source <code>.bash_profile</code>. In contrast, <code>.bashrc</code> should typically contain things you want to set in every shell you open, like aliases, functions, etc. These are per shell session items that are not inherited from environment ([https://unix.stackexchange.com/questions/346336/why-have-both-bash-profile-and-bashrc source and detailed explanation]).<br />
<br />
==== An example <code>.bash_profile</code> for inspiration ====<br />
<br />
<pre>module load cdo/1.6.9<br />
module load ncarg/6.3.0-login<br />
<br />
alias rm="rm -i"<br />
alias cp="cp -i"<br />
alias erai="cd /Data/skd/share/Reanalysis/ERA_INTERIM/6HOURLY/"<br />
<br />
if [ -f ~/.bashrc ]; then<br />
. ~/.bashrc<br />
fi</pre><br />
<br />
==== An example <code>.bash_profile</code> for inspiration ====<br />
<br />
<pre>alias rm="rm -i"<br />
alias cp="cp -i"<br />
alias erai="cd /Data/skd/share/Reanalysis/ERA_INTERIM/6HOURLY/"</pre><br />
<br />
<br />
== Available software ==<br />
<br />
Below is a list of frequently used software and which module to load on the new cyclone. Relevant module names are printed like for <code>matlab/2015b</code>. Modules can be loaded by <code>module load <module name></code>, and unloaded <code>module unload <module name></code>. [[Using modules on cyclone|More details on the module system]].<br />
<br />
To list all available modules, use the command<br />
<pre>module avail</pre><br />
<br />
Hexagon-specific modules are now no longer listed and available on cyclone. All packages listed with this command should work, so please report to <code>support@hpc.uib.no</code> if they do not.<br />
<br />
=== Data analysis and plotting ===<br />
<br />
* CDO<br />
*: <code>CDO</code>, <code>CDO/1.9.5-foss-2018b</code><br />
* Dynlib<br />
*: See temporary solution for python. Requires in addition <code>OpenBLAS/0.3.1-GCC-7.3.0-2.30</code> and <code>ScaLAPACK/2.0.2-gompi-2018b-OpenBLAS-0.3.1</code>.<br />
* ghostview<br />
*: ''<no module required>''<br />
* grads<br />
*: ''<no module required>''<br />
* Matlab<br />
*: <code>Matlab</code>, <code>Matlab/2018a</code>, <code>Matlab/2012a</code><br />
* NCL<br />
*: <code>NCL</code>, <code>NCL/6.5.0</code><br />
* nco<br />
*: ''<no module required>''<br />
* ncview<br />
*: <code>ncview</code>, <code>ncview/2.1.7-foss-2018b</code>. Load only when needed! The package is currently known to break some GUI programs like gedit and gvim. <br />
* python, plus selection of scientific packages<br />
*: Temporary solution, use one of the two below commands to enable the virtual environment:<br />
*: <code>source /Data/gfi/users/local/share/virtualenv/dynpie2/bin/activate</code> for python 2.7.15, based on <code>Python/2.7.15-foss-2018b</code><br />
*: <code>source /Data/gfi/users/local/share/virtualenv/dynpie3/bin/activate</code> for python 3.7.0, based on <code>Python/3.7.0-foss-2018b</code>.<br />
*: For the pygrib module, <code>ecCodes/2.7.3-foss-2018b</code> is required in addition.<br />
* R<br />
*: ''<no module required>''<br />
<br />
=== Text editors ===<br />
<br />
* emacs<br />
*: ''<no module required>''<br />
* gedit<br />
*: ''<no module required>''<br />
* gvim<br />
*: ''<no module required>''<br />
* vi(m)<br />
*: ''<no module required>''<br />
<br />
=== Compilers and libraries ===<br />
<br />
* blas<br />
*: <code>OpenBLAS/0.3.1-GCC-7.3.0-2.30</code><br />
* eccodes (replacement for grib_api)<br />
*: <code>ecCodes/2.7.3-foss-2018b</code><br />
* gcc, gfortran<br />
*: <code>GCC</code>, <code>GCC/7.3.0-2.30</code><br />
* grib_api<br />
*: <code>grib_api/1.24.0-foss-2018b</code><br />
* HDF5 libraries<br />
*: <code>HDF5/1.10.2-foss-2018b</code><br />
* lapack<br />
*: <code>ScaLAPACK/2.0.2-gompi-2018b-OpenBLAS-0.3.1</code><br />
* MPI<br />
*: <code>OpenMPI/3.1.1-GCC-7.3.0-2.30</code><br />
* netcdf<br />
*: For C-libaries: <code>netCDF/4.6.1-foss-2018b</code>, <br />
*: For Fortran-libraries <code>netCDF-Fortran/4.4.4-foss-2018b</code>, compile with option <code>-I/shared/apps/netCDF-Fortran/4.4.4-foss-2018b/include</code><br />
* proj<br />
*: <code>PROJ/5.0.0-foss-2018b</code><br />
<br />
== Accessing the data from your own machines ==<br />
<br />
Note: From your personal machines you will need to be connected to the UiB VPN to be able to mount the following network drives. <br />
<br />
On MacOS you can mount folders through <code>Finder > Go > Connect to Server ...</code>. In the dialogue window that pops up, enter<br />
<pre>smb://<user name>@leo.hpc.uib.no/gfi</pre><br />
as the '''Server Address'''. You might want to replace <code>gfi</code> by <code>skd</code> to access the skd disks if that is your primary affiliation.<br />
On Ubuntu this is very similar: <code>Files > Go > Enter Location ...</code>. Enter the address: <pre>smb://<user name>@leo.hpc.uib.no/gfi</pre> and enter your password in the next pop-up window, while keeping "UiB" in the "Domain" field.</div>Csp001http://gfi.wiki.uib.no/index.php?title=Using_cyclone&diff=1009Using cyclone2018-10-10T14:07:46Z<p>Csp001: /* Data analysis and plotting */</p>
<hr />
<div>== Connection and first steps ==<br />
<br />
Use ssh to connect<br />
<pre>ssh -Y <username>@cyclone.hpc.uib.no</pre><br />
or just simply:<br />
<pre>ssh -Y cyclone.hpc.uib.no</pre><br />
if you're connecting from a computer where you are logged in under the same name. When you are connecting for the first time, you will be asked to verify a signature. Reply "yes" to this question.<br />
<br />
=== Home directories ===<br />
<br />
<code>cyclone.hpc.uib.no</code> shares home directories with the new hexagon cluster. These home directories are separate from your standard UiB home directory. The contents of your home directories will not be synced, so you will manually need to transfer your scripts to the new system.<br />
<br />
=== How to access software ===<br />
<br />
In contrast to the old skd-cyclone, most scientific software is only available through software modules. Modules need to be loaded manually before the respective software can be used. We use software modules, because they provide are a clean and handy way to offer conflicting software or software versions: Instead of updating software and potentially breaking user scripts and programs new software is then made available in parallel to those that require it.<br />
<br />
=== Start-up scripts ===<br />
<br />
It might be handy to automatically load modules for software that you use frequently every time you login to cyclone. To accomplish that for bash, there are two relevant files, <code>$HOME/.bashrc</code> and <code>$HOME/.bash_profile</code> . <code>.bash_profile</code> should contain things that need to be defined at login time only, like <code>PATH</code> and other environment variables, startup programs, etc. You just need things once, not in every shell you open. In most cases, you also need the things from <code>.bashrc</code> in your login shell. That's why <code>.bash_profile</code> sources <code>.bashrc</code> as well, but .bashrc doesn't usually source <code>.bash_profile</code>. In contrast, <code>.bashrc</code> should typically contain things you want to set in every shell you open, like aliases, functions, etc. These are per shell session items that are not inherited from environment ([https://unix.stackexchange.com/questions/346336/why-have-both-bash-profile-and-bashrc source and detailed explanation]).<br />
<br />
==== An example <code>.bash_profile</code> for inspiration ====<br />
<br />
<pre>module load cdo/1.6.9<br />
module load ncarg/6.3.0-login<br />
<br />
alias rm="rm -i"<br />
alias cp="cp -i"<br />
alias erai="cd /Data/skd/share/Reanalysis/ERA_INTERIM/6HOURLY/"<br />
<br />
if [ -f ~/.bashrc ]; then<br />
. ~/.bashrc<br />
fi</pre><br />
<br />
==== An example <code>.bash_profile</code> for inspiration ====<br />
<br />
<pre>alias rm="rm -i"<br />
alias cp="cp -i"<br />
alias erai="cd /Data/skd/share/Reanalysis/ERA_INTERIM/6HOURLY/"</pre><br />
<br />
<br />
== Available software ==<br />
<br />
Below is a list of frequently used software and which module to load on the new cyclone. Relevant module names are printed like for <code>matlab/2015b</code>. Modules can be loaded by <code>module load <module name></code>, and unloaded <code>module unload <module name></code>. [[Using modules on cyclone|More details on the module system]].<br />
<br />
To list all available modules, use the command<br />
<pre>module avail</pre><br />
<br />
Hexagon-specific modules are now no longer listed and available on cyclone. All packages listed with this command should work, so please report to <code>support@hpc.uib.no</code> if they do not.<br />
<br />
=== Data analysis and plotting ===<br />
<br />
* CDO<br />
*: <code>CDO</code>, <code>CDO/1.9.5-foss-2018b</code><br />
* Dynlib<br />
*: See temporary solution for python. Requires in addition <code>OpenBLAS/0.3.1-GCC-7.3.0-2.30</code> and <code>ScaLAPACK/2.0.2-gompi-2018b-OpenBLAS-0.3.1</code>.<br />
* ghostview<br />
*: ''<no module required>''<br />
* grads<br />
*: ''<no module required>''<br />
* Matlab<br />
*: <code>Matlab</code>, <code>Matlab/2018a</code>, <code>Matlab/2012a</code><br />
* NCL<br />
*: <code>NCL</code>, <code>NCL/6.5.0</code><br />
* nco<br />
*: ''<no module required>''<br />
* ncview<br />
*: <code>ncview</code>, <code>ncview/2.1.7-foss-2018b</code>. Load only when needed! The package is currently known to break some GUI programs like gedit and gvim. <br />
* python, plus selection of scientific packages<br />
*: Temporary solution, use one of the two below commands to enable the virtual environment:<br />
*: <code>source /Data/gfi/users/local/share/virtualenv/dynpie2/bin/activate</code> for python 2.7.15, based on <code>Python/2.7.15-foss-2018b</code><br />
*: <code>source /Data/gfi/users/local/share/virtualenv/dynpie3/bin/activate</code> for python 3.7.0, based on <code>Python/3.7.0-foss-2018b</code>.<br />
*: For the pygrib module, <code>grib_api/1.24.0-foss-2018b</code> is required in addition.<br />
* R<br />
*: ''<no module required>''<br />
<br />
=== Text editors ===<br />
<br />
* emacs<br />
*: ''<no module required>''<br />
* gedit<br />
*: ''<no module required>''<br />
* gvim<br />
*: ''<no module required>''<br />
* vi(m)<br />
*: ''<no module required>''<br />
<br />
=== Compilers and libraries ===<br />
<br />
* blas<br />
*: <code>OpenBLAS/0.3.1-GCC-7.3.0-2.30</code><br />
* eccodes (replacement for grib_api)<br />
*: <code>ecCodes/2.7.3-foss-2018b</code><br />
* gcc, gfortran<br />
*: <code>GCC</code>, <code>GCC/7.3.0-2.30</code><br />
* grib_api<br />
*: <code>grib_api/1.24.0-foss-2018b</code><br />
* HDF5 libraries<br />
*: <code>HDF5/1.10.2-foss-2018b</code><br />
* lapack<br />
*: <code>ScaLAPACK/2.0.2-gompi-2018b-OpenBLAS-0.3.1</code><br />
* MPI<br />
*: <code>OpenMPI/3.1.1-GCC-7.3.0-2.30</code><br />
* netcdf<br />
*: For C-libaries: <code>netCDF/4.6.1-foss-2018b</code>, <br />
*: For Fortran-libraries <code>netCDF-Fortran/4.4.4-foss-2018b</code>, compile with option <code>-I/shared/apps/netCDF-Fortran/4.4.4-foss-2018b/include</code><br />
* proj<br />
*: <code>PROJ/5.0.0-foss-2018b</code><br />
<br />
== Accessing the data from your own machines ==<br />
<br />
Note: From your personal machines you will need to be connected to the UiB VPN to be able to mount the following network drives. <br />
<br />
On MacOS you can mount folders through <code>Finder > Go > Connect to Server ...</code>. In the dialogue window that pops up, enter<br />
<pre>smb://<user name>@leo.hpc.uib.no/gfi</pre><br />
as the '''Server Address'''. You might want to replace <code>gfi</code> by <code>skd</code> to access the skd disks if that is your primary affiliation.<br />
On Ubuntu this is very similar: <code>Files > Go > Enter Location ...</code>. Enter the address: <pre>smb://<user name>@leo.hpc.uib.no/gfi</pre> and enter your password in the next pop-up window, while keeping "UiB" in the "Domain" field.</div>Csp001http://gfi.wiki.uib.no/index.php?title=Using_cyclone&diff=1007Using cyclone2018-10-08T11:23:27Z<p>Csp001: /* Compilers and libraries */</p>
<hr />
<div>== Connection and first steps ==<br />
<br />
Use ssh to connect<br />
<pre>ssh -Y <username>@cyclone.hpc.uib.no</pre><br />
or just simply:<br />
<pre>ssh -Y cyclone.hpc.uib.no</pre><br />
if you're connecting from a computer where you are logged in under the same name. When you are connecting for the first time, you will be asked to verify a signature. Reply "yes" to this question.<br />
<br />
=== Home directories ===<br />
<br />
<code>cyclone.hpc.uib.no</code> shares home directories with the new hexagon cluster. These home directories are separate from your standard UiB home directory. The contents of your home directories will not be synced, so you will manually need to transfer your scripts to the new system.<br />
<br />
=== How to access software ===<br />
<br />
In contrast to the old skd-cyclone, most scientific software is only available through software modules. Modules need to be loaded manually before the respective software can be used. We use software modules, because they provide are a clean and handy way to offer conflicting software or software versions: Instead of updating software and potentially breaking user scripts and programs new software is then made available in parallel to those that require it.<br />
<br />
=== Start-up scripts ===<br />
<br />
It might be handy to automatically load modules for software that you use frequently every time you login to cyclone. To accomplish that for bash, there are two relevant files, <code>$HOME/.bashrc</code> and <code>$HOME/.bash_profile</code> . <code>.bash_profile</code> should contain things that need to be defined at login time only, like <code>PATH</code> and other environment variables, startup programs, etc. You just need things once, not in every shell you open. In most cases, you also need the things from <code>.bashrc</code> in your login shell. That's why <code>.bash_profile</code> sources <code>.bashrc</code> as well, but .bashrc doesn't usually source <code>.bash_profile</code>. In contrast, <code>.bashrc</code> should typically contain things you want to set in every shell you open, like aliases, functions, etc. These are per shell session items that are not inherited from environment ([https://unix.stackexchange.com/questions/346336/why-have-both-bash-profile-and-bashrc source and detailed explanation]).<br />
<br />
==== An example <code>.bash_profile</code> for inspiration ====<br />
<br />
<pre>module load cdo/1.6.9<br />
module load ncarg/6.3.0-login<br />
<br />
alias rm="rm -i"<br />
alias cp="cp -i"<br />
alias erai="cd /Data/skd/share/Reanalysis/ERA_INTERIM/6HOURLY/"<br />
<br />
if [ -f ~/.bashrc ]; then<br />
. ~/.bashrc<br />
fi</pre><br />
<br />
==== An example <code>.bash_profile</code> for inspiration ====<br />
<br />
<pre>alias rm="rm -i"<br />
alias cp="cp -i"<br />
alias erai="cd /Data/skd/share/Reanalysis/ERA_INTERIM/6HOURLY/"</pre><br />
<br />
<br />
== Available software ==<br />
<br />
Below is a list of frequently used software and which module to load on the new cyclone. Relevant module names are printed like for <code>matlab/2015b</code>. Modules can be loaded by <code>module load <module name></code>, and unloaded <code>module unload <module name></code>. [[Using modules on cyclone|More details on the module system]].<br />
<br />
To list all available modules, use the command<br />
<pre>module avail</pre><br />
<br />
Hexagon-specific modules are now no longer listed and available on cyclone. All packages listed with this command should work, so please report to <code>support@hpc.uib.no</code> if they do not.<br />
<br />
=== Data analysis and plotting ===<br />
<br />
* CDO<br />
*: <code>CDO</code>, <code>CDO/1.9.5-foss-2018b</code><br />
* Dynlib<br />
*: See temporary solution for python. Requires in addition <code>OpenBLAS/0.3.1-GCC-7.3.0-2.30</code> and <code>ScaLAPACK/2.0.2-gompi-2018b-OpenBLAS-0.3.1</code>.<br />
* ghostview<br />
*: ''<no module required>''<br />
* grads<br />
*: ''<no module required>''<br />
* Matlab<br />
*: <code>Matlab</code>, <code>Matlab/2018a</code>, <code>Matlab/2012a</code><br />
* NCL<br />
*: <code>NCL</code>, <code>NCL/6.5.0</code><br />
* nco<br />
*: ''<no module required>''<br />
* ncview<br />
*: <code>ncview</code>, <code>ncview/2.1.7-foss-2018b</code>. Load only when needed! The package is currently known to break some GUI programs like gedit and gvim. <br />
* python, plus selection of scientific packages<br />
*: Temporary solution, use one of the two below commands to enable the virtual environment:<br />
*: <code>source /Data/gfi/users/local/share/virtualenv/dynpie2/bin/activate</code> for python 2.7.5.<br />
*: <code>source /Data/gfi/users/local/share/virtualenv/dynpie3/bin/activate</code> for python 3.4.9.<br />
*: For the pygrib module, <code>grib_api/1.24.0-foss-2018b</code> is required in addition. '''Note''': These virtual environments will at some point be replaced by ones based on the new python versions 2.7.15 and 3.7.0 that are now available on cyclone. This change will be announced on dynlib-users@gfi.uib.no, please contact Clemens Spensberger if you are not on this list and like to be informed.<br />
* R<br />
*: ''<no module required>''<br />
<br />
=== Text editors ===<br />
<br />
* emacs<br />
*: ''<no module required>''<br />
* gedit<br />
*: ''<no module required>''<br />
* gvim<br />
*: ''<no module required>''<br />
* vi(m)<br />
*: ''<no module required>''<br />
<br />
=== Compilers and libraries ===<br />
<br />
* blas<br />
*: <code>OpenBLAS/0.3.1-GCC-7.3.0-2.30</code><br />
* eccodes (replacement for grib_api)<br />
*: <code>ecCodes/2.7.3-foss-2018b</code><br />
* gcc, gfortran<br />
*: <code>GCC</code>, <code>GCC/7.3.0-2.30</code><br />
* grib_api<br />
*: <code>grib_api/1.24.0-foss-2018b</code><br />
* HDF5 libraries<br />
*: <code>HDF5/1.10.2-foss-2018b</code><br />
* lapack<br />
*: <code>ScaLAPACK/2.0.2-gompi-2018b-OpenBLAS-0.3.1</code><br />
* MPI<br />
*: <code>OpenMPI/3.1.1-GCC-7.3.0-2.30</code><br />
* netcdf<br />
*: For C-libaries: <code>netCDF/4.6.1-foss-2018b</code>, <br />
*: For Fortran-libraries <code>netCDF-Fortran/4.4.4-foss-2018b</code>, compile with option <code>-I/shared/apps/netCDF-Fortran/4.4.4-foss-2018b/include</code><br />
* proj<br />
*: <code>PROJ/5.0.0-foss-2018b</code><br />
<br />
== Accessing the data from your own machines ==<br />
<br />
Note: From your personal machines you will need to be connected to the UiB VPN to be able to mount the following network drives. <br />
<br />
On MacOS you can mount folders through <code>Finder > Go > Connect to Server ...</code>. In the dialogue window that pops up, enter<br />
<pre>smb://<user name>@leo.hpc.uib.no/gfi</pre><br />
as the '''Server Address'''. You might want to replace <code>gfi</code> by <code>skd</code> to access the skd disks if that is your primary affiliation.<br />
On Ubuntu this is very similar: <code>Files > Go > Enter Location ...</code>. Enter the address: <pre>smb://<user name>@leo.hpc.uib.no/gfi</pre> and enter your password in the next pop-up window, while keeping "UiB" in the "Domain" field.</div>Csp001http://gfi.wiki.uib.no/index.php?title=Using_cyclone&diff=1006Using cyclone2018-10-08T09:44:18Z<p>Csp001: /* Data analysis and plotting */</p>
<hr />
<div>== Connection and first steps ==<br />
<br />
Use ssh to connect<br />
<pre>ssh -Y <username>@cyclone.hpc.uib.no</pre><br />
or just simply:<br />
<pre>ssh -Y cyclone.hpc.uib.no</pre><br />
if you're connecting from a computer where you are logged in under the same name. When you are connecting for the first time, you will be asked to verify a signature. Reply "yes" to this question.<br />
<br />
=== Home directories ===<br />
<br />
<code>cyclone.hpc.uib.no</code> shares home directories with the new hexagon cluster. These home directories are separate from your standard UiB home directory. The contents of your home directories will not be synced, so you will manually need to transfer your scripts to the new system.<br />
<br />
=== How to access software ===<br />
<br />
In contrast to the old skd-cyclone, most scientific software is only available through software modules. Modules need to be loaded manually before the respective software can be used. We use software modules, because they provide are a clean and handy way to offer conflicting software or software versions: Instead of updating software and potentially breaking user scripts and programs new software is then made available in parallel to those that require it.<br />
<br />
=== Start-up scripts ===<br />
<br />
It might be handy to automatically load modules for software that you use frequently every time you login to cyclone. To accomplish that for bash, there are two relevant files, <code>$HOME/.bashrc</code> and <code>$HOME/.bash_profile</code> . <code>.bash_profile</code> should contain things that need to be defined at login time only, like <code>PATH</code> and other environment variables, startup programs, etc. You just need things once, not in every shell you open. In most cases, you also need the things from <code>.bashrc</code> in your login shell. That's why <code>.bash_profile</code> sources <code>.bashrc</code> as well, but .bashrc doesn't usually source <code>.bash_profile</code>. In contrast, <code>.bashrc</code> should typically contain things you want to set in every shell you open, like aliases, functions, etc. These are per shell session items that are not inherited from environment ([https://unix.stackexchange.com/questions/346336/why-have-both-bash-profile-and-bashrc source and detailed explanation]).<br />
<br />
==== An example <code>.bash_profile</code> for inspiration ====<br />
<br />
<pre>module load cdo/1.6.9<br />
module load ncarg/6.3.0-login<br />
<br />
alias rm="rm -i"<br />
alias cp="cp -i"<br />
alias erai="cd /Data/skd/share/Reanalysis/ERA_INTERIM/6HOURLY/"<br />
<br />
if [ -f ~/.bashrc ]; then<br />
. ~/.bashrc<br />
fi</pre><br />
<br />
==== An example <code>.bash_profile</code> for inspiration ====<br />
<br />
<pre>alias rm="rm -i"<br />
alias cp="cp -i"<br />
alias erai="cd /Data/skd/share/Reanalysis/ERA_INTERIM/6HOURLY/"</pre><br />
<br />
<br />
== Available software ==<br />
<br />
Below is a list of frequently used software and which module to load on the new cyclone. Relevant module names are printed like for <code>matlab/2015b</code>. Modules can be loaded by <code>module load <module name></code>, and unloaded <code>module unload <module name></code>. [[Using modules on cyclone|More details on the module system]].<br />
<br />
To list all available modules, use the command<br />
<pre>module avail</pre><br />
<br />
Hexagon-specific modules are now no longer listed and available on cyclone. All packages listed with this command should work, so please report to <code>support@hpc.uib.no</code> if they do not.<br />
<br />
=== Data analysis and plotting ===<br />
<br />
* CDO<br />
*: <code>CDO</code>, <code>CDO/1.9.5-foss-2018b</code><br />
* Dynlib<br />
*: See temporary solution for python. Requires in addition <code>OpenBLAS/0.3.1-GCC-7.3.0-2.30</code> and <code>ScaLAPACK/2.0.2-gompi-2018b-OpenBLAS-0.3.1</code>.<br />
* ghostview<br />
*: ''<no module required>''<br />
* grads<br />
*: ''<no module required>''<br />
* Matlab<br />
*: <code>Matlab</code>, <code>Matlab/2018a</code>, <code>Matlab/2012a</code><br />
* NCL<br />
*: <code>NCL</code>, <code>NCL/6.5.0</code><br />
* nco<br />
*: ''<no module required>''<br />
* ncview<br />
*: <code>ncview</code>, <code>ncview/2.1.7-foss-2018b</code>. Load only when needed! The package is currently known to break some GUI programs like gedit and gvim. <br />
* python, plus selection of scientific packages<br />
*: Temporary solution, use one of the two below commands to enable the virtual environment:<br />
*: <code>source /Data/gfi/users/local/share/virtualenv/dynpie2/bin/activate</code> for python 2.7.5.<br />
*: <code>source /Data/gfi/users/local/share/virtualenv/dynpie3/bin/activate</code> for python 3.4.9.<br />
*: For the pygrib module, <code>grib_api/1.24.0-foss-2018b</code> is required in addition. '''Note''': These virtual environments will at some point be replaced by ones based on the new python versions 2.7.15 and 3.7.0 that are now available on cyclone. This change will be announced on dynlib-users@gfi.uib.no, please contact Clemens Spensberger if you are not on this list and like to be informed.<br />
* R<br />
*: ''<no module required>''<br />
<br />
=== Text editors ===<br />
<br />
* emacs<br />
*: ''<no module required>''<br />
* gedit<br />
*: ''<no module required>''<br />
* gvim<br />
*: ''<no module required>''<br />
* vi(m)<br />
*: ''<no module required>''<br />
<br />
=== Compilers and libraries ===<br />
<br />
* blas<br />
*: <code>OpenBLAS/0.3.1-GCC-7.3.0-2.30</code><br />
* gcc, gfortran<br />
*: <code>GCC</code>, <code>GCC/7.3.0-2.30</code><br />
* grib_api<br />
*: <code>grib_api/1.24.0-foss-2018b</code><br />
* HDF5 libraries<br />
*: <code>HDF5/1.10.2-foss-2018b</code><br />
* lapack<br />
*: <code>ScaLAPACK/2.0.2-gompi-2018b-OpenBLAS-0.3.1</code><br />
* MPI<br />
*: <code>OpenMPI/3.1.1-GCC-7.3.0-2.30</code><br />
* netcdf<br />
*: For C-libaries: <code>netCDF/4.6.1-foss-2018b</code>, <br />
*: For Fortran-libraries <code>netCDF-Fortran/4.4.4-foss-2018b</code>, compile with option <code>-I/shared/apps/netCDF-Fortran/4.4.4-foss-2018b/include</code><br />
* proj<br />
*: <code>PROJ/5.0.0-foss-2018b</code><br />
<br />
== Accessing the data from your own machines ==<br />
<br />
Note: From your personal machines you will need to be connected to the UiB VPN to be able to mount the following network drives. <br />
<br />
On MacOS you can mount folders through <code>Finder > Go > Connect to Server ...</code>. In the dialogue window that pops up, enter<br />
<pre>smb://<user name>@leo.hpc.uib.no/gfi</pre><br />
as the '''Server Address'''. You might want to replace <code>gfi</code> by <code>skd</code> to access the skd disks if that is your primary affiliation.<br />
On Ubuntu this is very similar: <code>Files > Go > Enter Location ...</code>. Enter the address: <pre>smb://<user name>@leo.hpc.uib.no/gfi</pre> and enter your password in the next pop-up window, while keeping "UiB" in the "Domain" field.</div>Csp001http://gfi.wiki.uib.no/index.php?title=Using_cyclone&diff=1005Using cyclone2018-10-06T09:48:18Z<p>Csp001: /* Compilers and libraries */</p>
<hr />
<div>== Connection and first steps ==<br />
<br />
Use ssh to connect<br />
<pre>ssh -Y <username>@cyclone.hpc.uib.no</pre><br />
or just simply:<br />
<pre>ssh -Y cyclone.hpc.uib.no</pre><br />
if you're connecting from a computer where you are logged in under the same name. When you are connecting for the first time, you will be asked to verify a signature. Reply "yes" to this question.<br />
<br />
=== Home directories ===<br />
<br />
<code>cyclone.hpc.uib.no</code> shares home directories with the new hexagon cluster. These home directories are separate from your standard UiB home directory. The contents of your home directories will not be synced, so you will manually need to transfer your scripts to the new system.<br />
<br />
=== How to access software ===<br />
<br />
In contrast to the old skd-cyclone, most scientific software is only available through software modules. Modules need to be loaded manually before the respective software can be used. We use software modules, because they provide are a clean and handy way to offer conflicting software or software versions: Instead of updating software and potentially breaking user scripts and programs new software is then made available in parallel to those that require it.<br />
<br />
=== Start-up scripts ===<br />
<br />
It might be handy to automatically load modules for software that you use frequently every time you login to cyclone. To accomplish that for bash, there are two relevant files, <code>$HOME/.bashrc</code> and <code>$HOME/.bash_profile</code> . <code>.bash_profile</code> should contain things that need to be defined at login time only, like <code>PATH</code> and other environment variables, startup programs, etc. You just need things once, not in every shell you open. In most cases, you also need the things from <code>.bashrc</code> in your login shell. That's why <code>.bash_profile</code> sources <code>.bashrc</code> as well, but .bashrc doesn't usually source <code>.bash_profile</code>. In contrast, <code>.bashrc</code> should typically contain things you want to set in every shell you open, like aliases, functions, etc. These are per shell session items that are not inherited from environment ([https://unix.stackexchange.com/questions/346336/why-have-both-bash-profile-and-bashrc source and detailed explanation]).<br />
<br />
==== An example <code>.bash_profile</code> for inspiration ====<br />
<br />
<pre>module load cdo/1.6.9<br />
module load ncarg/6.3.0-login<br />
<br />
alias rm="rm -i"<br />
alias cp="cp -i"<br />
alias erai="cd /Data/skd/share/Reanalysis/ERA_INTERIM/6HOURLY/"<br />
<br />
if [ -f ~/.bashrc ]; then<br />
. ~/.bashrc<br />
fi</pre><br />
<br />
==== An example <code>.bash_profile</code> for inspiration ====<br />
<br />
<pre>alias rm="rm -i"<br />
alias cp="cp -i"<br />
alias erai="cd /Data/skd/share/Reanalysis/ERA_INTERIM/6HOURLY/"</pre><br />
<br />
<br />
== Available software ==<br />
<br />
Below is a list of frequently used software and which module to load on the new cyclone. Relevant module names are printed like for <code>matlab/2015b</code>. Modules can be loaded by <code>module load <module name></code>, and unloaded <code>module unload <module name></code>. [[Using modules on cyclone|More details on the module system]].<br />
<br />
To list all available modules, use the command<br />
<pre>module avail</pre><br />
<br />
Hexagon-specific modules are now no longer listed and available on cyclone. All packages listed with this command should work, so please report to <code>support@hpc.uib.no</code> if they do not.<br />
<br />
=== Data analysis and plotting ===<br />
<br />
* CDO<br />
*: <code>CDO</code>, <code>CDO/1.9.5-foss-2018b</code><br />
* Dynlib<br />
*: See temporary solution for python. Requires in addition <code>OpenBLAS/0.3.1-GCC-7.3.0-2.30</code> and <code>ScaLAPACK/2.0.2-gompi-2018b-OpenBLAS-0.3.1</code>.<br />
* ghostview<br />
*: ''<no module required>''<br />
* grads<br />
*: ''<no module required>''<br />
* Matlab<br />
*: <code>Matlab</code>, <code>Matlab/2018a</code>, <code>Matlab/2012a</code><br />
* NCL<br />
*: ''Currently unavailable''<br />
* nco<br />
*: ''<no module required>''<br />
* ncview<br />
*: <code>ncview</code>, <code>ncview/2.1.7-foss-2018b</code>. Load only when needed! The package is currently known to break some GUI programs like gedit and gvim. <br />
* python, plus selection of scientific packages<br />
*: Temporary solution, use one of the two below commands to enable the virtual environment:<br />
*: <code>source /Data/gfi/users/local/share/virtualenv/dynpie2/bin/activate</code> for python 2.7.5.<br />
*: <code>source /Data/gfi/users/local/share/virtualenv/dynpie3/bin/activate</code> for python 3.4.9.<br />
*: For the pygrib module, <code>grib_api/1.24.0-foss-2018b</code> is required in addition. '''Note''': These virtual environments will at some point be replaced by ones based on the new python versions 2.7.15 and 3.7.0 that are now available on cyclone. This change will be announced on dynlib-users@gfi.uib.no, please contact Clemens Spensberger if you are not on this list and like to be informed.<br />
* R<br />
*: ''<no module required>''<br />
<br />
=== Text editors ===<br />
<br />
* emacs<br />
*: ''<no module required>''<br />
* gedit<br />
*: ''<no module required>''<br />
* gvim<br />
*: ''<no module required>''<br />
* vi(m)<br />
*: ''<no module required>''<br />
<br />
=== Compilers and libraries ===<br />
<br />
* blas<br />
*: <code>OpenBLAS/0.3.1-GCC-7.3.0-2.30</code><br />
* gcc, gfortran<br />
*: <code>GCC</code>, <code>GCC/7.3.0-2.30</code><br />
* grib_api<br />
*: <code>grib_api/1.24.0-foss-2018b</code><br />
* HDF5 libraries<br />
*: <code>HDF5/1.10.2-foss-2018b</code><br />
* lapack<br />
*: <code>ScaLAPACK/2.0.2-gompi-2018b-OpenBLAS-0.3.1</code><br />
* MPI<br />
*: <code>OpenMPI/3.1.1-GCC-7.3.0-2.30</code><br />
* netcdf<br />
*: For C-libaries: <code>netCDF/4.6.1-foss-2018b</code>, <br />
*: For Fortran-libraries <code>netCDF-Fortran/4.4.4-foss-2018b</code>, compile with option <code>-I/shared/apps/netCDF-Fortran/4.4.4-foss-2018b/include</code><br />
* proj<br />
*: <code>PROJ/5.0.0-foss-2018b</code><br />
<br />
== Accessing the data from your own machines ==<br />
<br />
Note: From your personal machines you will need to be connected to the UiB VPN to be able to mount the following network drives. <br />
<br />
On MacOS you can mount folders through <code>Finder > Go > Connect to Server ...</code>. In the dialogue window that pops up, enter<br />
<pre>smb://<user name>@leo.hpc.uib.no/gfi</pre><br />
as the '''Server Address'''. You might want to replace <code>gfi</code> by <code>skd</code> to access the skd disks if that is your primary affiliation.<br />
On Ubuntu this is very similar: <code>Files > Go > Enter Location ...</code>. Enter the address: <pre>smb://<user name>@leo.hpc.uib.no/gfi</pre> and enter your password in the next pop-up window, while keeping "UiB" in the "Domain" field.</div>Csp001http://gfi.wiki.uib.no/index.php?title=Using_cyclone&diff=1004Using cyclone2018-10-06T09:43:31Z<p>Csp001: /* Available software */</p>
<hr />
<div>== Connection and first steps ==<br />
<br />
Use ssh to connect<br />
<pre>ssh -Y <username>@cyclone.hpc.uib.no</pre><br />
or just simply:<br />
<pre>ssh -Y cyclone.hpc.uib.no</pre><br />
if you're connecting from a computer where you are logged in under the same name. When you are connecting for the first time, you will be asked to verify a signature. Reply "yes" to this question.<br />
<br />
=== Home directories ===<br />
<br />
<code>cyclone.hpc.uib.no</code> shares home directories with the new hexagon cluster. These home directories are separate from your standard UiB home directory. The contents of your home directories will not be synced, so you will manually need to transfer your scripts to the new system.<br />
<br />
=== How to access software ===<br />
<br />
In contrast to the old skd-cyclone, most scientific software is only available through software modules. Modules need to be loaded manually before the respective software can be used. We use software modules, because they provide are a clean and handy way to offer conflicting software or software versions: Instead of updating software and potentially breaking user scripts and programs new software is then made available in parallel to those that require it.<br />
<br />
=== Start-up scripts ===<br />
<br />
It might be handy to automatically load modules for software that you use frequently every time you login to cyclone. To accomplish that for bash, there are two relevant files, <code>$HOME/.bashrc</code> and <code>$HOME/.bash_profile</code> . <code>.bash_profile</code> should contain things that need to be defined at login time only, like <code>PATH</code> and other environment variables, startup programs, etc. You just need things once, not in every shell you open. In most cases, you also need the things from <code>.bashrc</code> in your login shell. That's why <code>.bash_profile</code> sources <code>.bashrc</code> as well, but .bashrc doesn't usually source <code>.bash_profile</code>. In contrast, <code>.bashrc</code> should typically contain things you want to set in every shell you open, like aliases, functions, etc. These are per shell session items that are not inherited from environment ([https://unix.stackexchange.com/questions/346336/why-have-both-bash-profile-and-bashrc source and detailed explanation]).<br />
<br />
==== An example <code>.bash_profile</code> for inspiration ====<br />
<br />
<pre>module load cdo/1.6.9<br />
module load ncarg/6.3.0-login<br />
<br />
alias rm="rm -i"<br />
alias cp="cp -i"<br />
alias erai="cd /Data/skd/share/Reanalysis/ERA_INTERIM/6HOURLY/"<br />
<br />
if [ -f ~/.bashrc ]; then<br />
. ~/.bashrc<br />
fi</pre><br />
<br />
==== An example <code>.bash_profile</code> for inspiration ====<br />
<br />
<pre>alias rm="rm -i"<br />
alias cp="cp -i"<br />
alias erai="cd /Data/skd/share/Reanalysis/ERA_INTERIM/6HOURLY/"</pre><br />
<br />
<br />
== Available software ==<br />
<br />
Below is a list of frequently used software and which module to load on the new cyclone. Relevant module names are printed like for <code>matlab/2015b</code>. Modules can be loaded by <code>module load <module name></code>, and unloaded <code>module unload <module name></code>. [[Using modules on cyclone|More details on the module system]].<br />
<br />
To list all available modules, use the command<br />
<pre>module avail</pre><br />
<br />
Hexagon-specific modules are now no longer listed and available on cyclone. All packages listed with this command should work, so please report to <code>support@hpc.uib.no</code> if they do not.<br />
<br />
=== Data analysis and plotting ===<br />
<br />
* CDO<br />
*: <code>CDO</code>, <code>CDO/1.9.5-foss-2018b</code><br />
* Dynlib<br />
*: See temporary solution for python. Requires in addition <code>OpenBLAS/0.3.1-GCC-7.3.0-2.30</code> and <code>ScaLAPACK/2.0.2-gompi-2018b-OpenBLAS-0.3.1</code>.<br />
* ghostview<br />
*: ''<no module required>''<br />
* grads<br />
*: ''<no module required>''<br />
* Matlab<br />
*: <code>Matlab</code>, <code>Matlab/2018a</code>, <code>Matlab/2012a</code><br />
* NCL<br />
*: ''Currently unavailable''<br />
* nco<br />
*: ''<no module required>''<br />
* ncview<br />
*: <code>ncview</code>, <code>ncview/2.1.7-foss-2018b</code>. Load only when needed! The package is currently known to break some GUI programs like gedit and gvim. <br />
* python, plus selection of scientific packages<br />
*: Temporary solution, use one of the two below commands to enable the virtual environment:<br />
*: <code>source /Data/gfi/users/local/share/virtualenv/dynpie2/bin/activate</code> for python 2.7.5.<br />
*: <code>source /Data/gfi/users/local/share/virtualenv/dynpie3/bin/activate</code> for python 3.4.9.<br />
*: For the pygrib module, <code>grib_api/1.24.0-foss-2018b</code> is required in addition. '''Note''': These virtual environments will at some point be replaced by ones based on the new python versions 2.7.15 and 3.7.0 that are now available on cyclone. This change will be announced on dynlib-users@gfi.uib.no, please contact Clemens Spensberger if you are not on this list and like to be informed.<br />
* R<br />
*: ''<no module required>''<br />
<br />
=== Text editors ===<br />
<br />
* emacs<br />
*: ''<no module required>''<br />
* gedit<br />
*: ''<no module required>''<br />
* gvim<br />
*: ''<no module required>''<br />
* vi(m)<br />
*: ''<no module required>''<br />
<br />
=== Compilers and libraries ===<br />
<br />
* blas<br />
*: <code>OpenBLAS/0.3.1-GCC-7.3.0-2.30</code><br />
* gcc, gfortran<br />
*: <code>GCC</code>, <code>GCC/7.3.0-2.30</code><br />
* grib_api<br />
*: <code>grib_api/1.24.0-foss-2018b</code><br />
* HDF5 libraries<br />
*: <code>HDF5/1.10.2-foss-2018b</code><br />
* lapack<br />
*: <code>ScaLAPACK/2.0.2-gompi-2018b-OpenBLAS-0.3.1</code><br />
* netcdf<br />
*: For C-libaries: <code>netCDF/4.6.1-foss-2018b</code>, <br />
*: For Fortran-libraries <code>netCDF-Fortran/4.4.4-foss-2018b</code>, compile with option <code>-I/shared/apps/netCDF-Fortran/4.4.4-foss-2018b/include</code><br />
<br />
== Accessing the data from your own machines ==<br />
<br />
Note: From your personal machines you will need to be connected to the UiB VPN to be able to mount the following network drives. <br />
<br />
On MacOS you can mount folders through <code>Finder > Go > Connect to Server ...</code>. In the dialogue window that pops up, enter<br />
<pre>smb://<user name>@leo.hpc.uib.no/gfi</pre><br />
as the '''Server Address'''. You might want to replace <code>gfi</code> by <code>skd</code> to access the skd disks if that is your primary affiliation.<br />
On Ubuntu this is very similar: <code>Files > Go > Enter Location ...</code>. Enter the address: <pre>smb://<user name>@leo.hpc.uib.no/gfi</pre> and enter your password in the next pop-up window, while keeping "UiB" in the "Domain" field.</div>Csp001http://gfi.wiki.uib.no/index.php?title=Using_cyclone&diff=1003Using cyclone2018-10-05T13:36:01Z<p>Csp001: /* Data analysis and plotting */</p>
<hr />
<div>== Connection and first steps ==<br />
<br />
Use ssh to connect<br />
<pre>ssh -Y <username>@cyclone.hpc.uib.no</pre><br />
or just simply:<br />
<pre>ssh -Y cyclone.hpc.uib.no</pre><br />
if you're connecting from a computer where you are logged in under the same name. When you are connecting for the first time, you will be asked to verify a signature. Reply "yes" to this question.<br />
<br />
=== Home directories ===<br />
<br />
<code>cyclone.hpc.uib.no</code> shares home directories with the new hexagon cluster. These home directories are separate from your standard UiB home directory. The contents of your home directories will not be synced, so you will manually need to transfer your scripts to the new system.<br />
<br />
=== How to access software ===<br />
<br />
In contrast to the old skd-cyclone, most scientific software is only available through software modules. Modules need to be loaded manually before the respective software can be used. We use software modules, because they provide are a clean and handy way to offer conflicting software or software versions: Instead of updating software and potentially breaking user scripts and programs new software is then made available in parallel to those that require it.<br />
<br />
=== Start-up scripts ===<br />
<br />
It might be handy to automatically load modules for software that you use frequently every time you login to cyclone. To accomplish that for bash, there are two relevant files, <code>$HOME/.bashrc</code> and <code>$HOME/.bash_profile</code> . <code>.bash_profile</code> should contain things that need to be defined at login time only, like <code>PATH</code> and other environment variables, startup programs, etc. You just need things once, not in every shell you open. In most cases, you also need the things from <code>.bashrc</code> in your login shell. That's why <code>.bash_profile</code> sources <code>.bashrc</code> as well, but .bashrc doesn't usually source <code>.bash_profile</code>. In contrast, <code>.bashrc</code> should typically contain things you want to set in every shell you open, like aliases, functions, etc. These are per shell session items that are not inherited from environment ([https://unix.stackexchange.com/questions/346336/why-have-both-bash-profile-and-bashrc source and detailed explanation]).<br />
<br />
==== An example <code>.bash_profile</code> for inspiration ====<br />
<br />
<pre>module load cdo/1.6.9<br />
module load ncarg/6.3.0-login<br />
<br />
alias rm="rm -i"<br />
alias cp="cp -i"<br />
alias erai="cd /Data/skd/share/Reanalysis/ERA_INTERIM/6HOURLY/"<br />
<br />
if [ -f ~/.bashrc ]; then<br />
. ~/.bashrc<br />
fi</pre><br />
<br />
==== An example <code>.bash_profile</code> for inspiration ====<br />
<br />
<pre>alias rm="rm -i"<br />
alias cp="cp -i"<br />
alias erai="cd /Data/skd/share/Reanalysis/ERA_INTERIM/6HOURLY/"</pre><br />
<br />
<br />
== Available software ==<br />
<br />
Below is a list of frequently used software and which module to load on the new cyclone. Relevant module names are printed like for <code>matlab/2015b</code>. Modules can be loaded by <code>module load <module name></code>, and unloaded <code>module unload <module name></code>. [[Using modules on cyclone|More details on the module system]].<br />
<br />
To list all available modules, use the command<br />
<pre>module avail</pre><br />
<br />
Hexagon-specific modules are now no longer listed and available on cyclone. All packages listed with this command should work, so please report to <code>support@hpc.uib.no</code> if they do not.<br />
<br />
=== Data analysis and plotting ===<br />
<br />
* CDO<br />
*: <code>CDO</code>, <code>CDO/1.9.5-foss-2018b</code><br />
* Dynlib<br />
*: See temporary solution for python. Requires in addition <code>OpenBLAS/0.3.1-GCC-7.3.0-2.30</code> and <code>ScaLAPACK/2.0.2-gompi-2018b-OpenBLAS-0.3.1</code>.<br />
* Matlab<br />
*: <code>Matlab</code>, <code>Matlab/2018a</code><br />
* NCL<br />
*: ''Currently unavailable''<br />
* nco<br />
*: ''Currently unavailable''<br />
* ncview<br />
*: <code>ncview</code>, <code>ncview/2.1.7-foss-2018b</code>. Load only when needed! The package is currently known to break some GUI programs like gedit and gvim. <br />
* python, plus selection of scientific packages<br />
*: Temporary solution, use one of the two below commands to enable the virtual environment:<br />
*: <code>source /Data/gfi/users/local/share/virtualenv/dynpie2/bin/activate</code> for python 2.7.5.<br />
*: <code>source /Data/gfi/users/local/share/virtualenv/dynpie3/bin/activate</code> for python 3.4.9.<br />
*: For the pygrib module, <code>grib_api/1.24.0-foss-2018b</code> is required in addition. '''Note''': These virtual environments will at some point be replaced by ones based on the new python versions 2.7.15 and 3.7.0 that are now available on cyclone. This change will be announced on dynlib-users@gfi.uib.no, please contact Clemens Spensberger if you are not on this list and like to be informed.<br />
* R<br />
*: ''Currently unavailable''<br />
<br />
=== Text editors ===<br />
<br />
* emacs<br />
*: ''<no module required>''<br />
* gedit<br />
*: ''<no module required>''<br />
* gvim<br />
*: ''<no module required>''<br />
* vi(m)<br />
*: ''<no module required>''<br />
<br />
=== Compilers and libraries ===<br />
<br />
* blas<br />
*: <code>OpenBLAS/0.3.1-GCC-7.3.0-2.30</code><br />
* gcc, gfortran<br />
*: <code>GCC</code>, <code>GCC/7.3.0-2.30</code><br />
* grib_api<br />
*: <code>grib_api/1.24.0-foss-2018b</code><br />
* HDF5 libraries<br />
*: <code>HDF5/1.10.2-foss-2018b</code><br />
* lapack<br />
*: <code>ScaLAPACK/2.0.2-gompi-2018b-OpenBLAS-0.3.1</code><br />
* netcdf<br />
*: For C-libaries: <code>netCDF/4.6.1-foss-2018b</code>, <br />
*: For Fortran-libraries <code>netCDF-Fortran/4.4.4-foss-2018b</code>, compile with option <code>-I/shared/apps/netCDF-Fortran/4.4.4-foss-2018b/include</code><br />
<br />
== Accessing the data from your own machines ==<br />
<br />
Note: From your personal machines you will need to be connected to the UiB VPN to be able to mount the following network drives. <br />
<br />
On MacOS you can mount folders through <code>Finder > Go > Connect to Server ...</code>. In the dialogue window that pops up, enter<br />
<pre>smb://<user name>@leo.hpc.uib.no/gfi</pre><br />
as the '''Server Address'''. You might want to replace <code>gfi</code> by <code>skd</code> to access the skd disks if that is your primary affiliation.<br />
On Ubuntu this is very similar: <code>Files > Go > Enter Location ...</code>. Enter the address: <pre>smb://<user name>@leo.hpc.uib.no/gfi</pre> and enter your password in the next pop-up window, while keeping "UiB" in the "Domain" field.</div>Csp001http://gfi.wiki.uib.no/index.php?title=Using_cyclone&diff=1002Using cyclone2018-10-05T11:43:35Z<p>Csp001: /* Data analysis and plotting */</p>
<hr />
<div>== Connection and first steps ==<br />
<br />
Use ssh to connect<br />
<pre>ssh -Y <username>@cyclone.hpc.uib.no</pre><br />
or just simply:<br />
<pre>ssh -Y cyclone.hpc.uib.no</pre><br />
if you're connecting from a computer where you are logged in under the same name. When you are connecting for the first time, you will be asked to verify a signature. Reply "yes" to this question.<br />
<br />
=== Home directories ===<br />
<br />
<code>cyclone.hpc.uib.no</code> shares home directories with the new hexagon cluster. These home directories are separate from your standard UiB home directory. The contents of your home directories will not be synced, so you will manually need to transfer your scripts to the new system.<br />
<br />
=== How to access software ===<br />
<br />
In contrast to the old skd-cyclone, most scientific software is only available through software modules. Modules need to be loaded manually before the respective software can be used. We use software modules, because they provide are a clean and handy way to offer conflicting software or software versions: Instead of updating software and potentially breaking user scripts and programs new software is then made available in parallel to those that require it.<br />
<br />
=== Start-up scripts ===<br />
<br />
It might be handy to automatically load modules for software that you use frequently every time you login to cyclone. To accomplish that for bash, there are two relevant files, <code>$HOME/.bashrc</code> and <code>$HOME/.bash_profile</code> . <code>.bash_profile</code> should contain things that need to be defined at login time only, like <code>PATH</code> and other environment variables, startup programs, etc. You just need things once, not in every shell you open. In most cases, you also need the things from <code>.bashrc</code> in your login shell. That's why <code>.bash_profile</code> sources <code>.bashrc</code> as well, but .bashrc doesn't usually source <code>.bash_profile</code>. In contrast, <code>.bashrc</code> should typically contain things you want to set in every shell you open, like aliases, functions, etc. These are per shell session items that are not inherited from environment ([https://unix.stackexchange.com/questions/346336/why-have-both-bash-profile-and-bashrc source and detailed explanation]).<br />
<br />
==== An example <code>.bash_profile</code> for inspiration ====<br />
<br />
<pre>module load cdo/1.6.9<br />
module load ncarg/6.3.0-login<br />
<br />
alias rm="rm -i"<br />
alias cp="cp -i"<br />
alias erai="cd /Data/skd/share/Reanalysis/ERA_INTERIM/6HOURLY/"<br />
<br />
if [ -f ~/.bashrc ]; then<br />
. ~/.bashrc<br />
fi</pre><br />
<br />
==== An example <code>.bash_profile</code> for inspiration ====<br />
<br />
<pre>alias rm="rm -i"<br />
alias cp="cp -i"<br />
alias erai="cd /Data/skd/share/Reanalysis/ERA_INTERIM/6HOURLY/"</pre><br />
<br />
<br />
== Available software ==<br />
<br />
Below is a list of frequently used software and which module to load on the new cyclone. Relevant module names are printed like for <code>matlab/2015b</code>. Modules can be loaded by <code>module load <module name></code>, and unloaded <code>module unload <module name></code>. [[Using modules on cyclone|More details on the module system]].<br />
<br />
To list all available modules, use the command<br />
<pre>module avail</pre><br />
<br />
Hexagon-specific modules are now no longer listed and available on cyclone. All packages listed with this command should work, so please report to <code>support@hpc.uib.no</code> if they do not.<br />
<br />
=== Data analysis and plotting ===<br />
<br />
* CDO<br />
*: <code>CDO</code>, <code>CDO/1.9.5-foss-2018b</code><br />
* Dynlib<br />
*: See temporary solution for python. Requires in addition <code>OpenBLAS/0.3.1-GCC-7.3.0-2.30</code> and <code>ScaLAPACK/2.0.2-gompi-2018b-OpenBLAS-0.3.1</code>.<br />
* Matlab<br />
*: ''Currently unavailable''<br />
* NCL<br />
*: ''Currently unavailable''<br />
* nco<br />
*: ''Currently unavailable''<br />
* ncview<br />
*: <code>ncview</code>, <code>ncview/2.1.7-foss-2018b</code>. Load only when needed! The package is currently known to break some GUI programs like gedit and gvim. <br />
* python, plus selection of scientific packages<br />
*: Temporary solution, use one of the two below commands to enable the virtual environment:<br />
*: <code>source /Data/gfi/users/local/share/virtualenv/dynpie2/bin/activate</code> for python 2.7.5.<br />
*: <code>source /Data/gfi/users/local/share/virtualenv/dynpie3/bin/activate</code> for python 3.4.9.<br />
*: For the pygrib module, <code>grib_api/1.24.0-foss-2018b</code> is required in addition. '''Note''': These virtual environments will at some point be replaced by ones based on the new python versions 2.7.15 and 3.7.0 that are now available on cyclone. This change will be announced on dynlib-users@gfi.uib.no, please contact Clemens Spensberger if you are not on this list and like to be informed.<br />
* R<br />
*: ''Currently unavailable''<br />
<br />
=== Text editors ===<br />
<br />
* emacs<br />
*: ''<no module required>''<br />
* gedit<br />
*: ''<no module required>''<br />
* gvim<br />
*: ''<no module required>''<br />
* vi(m)<br />
*: ''<no module required>''<br />
<br />
=== Compilers and libraries ===<br />
<br />
* blas<br />
*: <code>OpenBLAS/0.3.1-GCC-7.3.0-2.30</code><br />
* gcc, gfortran<br />
*: <code>GCC</code>, <code>GCC/7.3.0-2.30</code><br />
* grib_api<br />
*: <code>grib_api/1.24.0-foss-2018b</code><br />
* HDF5 libraries<br />
*: <code>HDF5/1.10.2-foss-2018b</code><br />
* lapack<br />
*: <code>ScaLAPACK/2.0.2-gompi-2018b-OpenBLAS-0.3.1</code><br />
* netcdf<br />
*: For C-libaries: <code>netCDF/4.6.1-foss-2018b</code>, <br />
*: For Fortran-libraries <code>netCDF-Fortran/4.4.4-foss-2018b</code>, compile with option <code>-I/shared/apps/netCDF-Fortran/4.4.4-foss-2018b/include</code><br />
<br />
== Accessing the data from your own machines ==<br />
<br />
Note: From your personal machines you will need to be connected to the UiB VPN to be able to mount the following network drives. <br />
<br />
On MacOS you can mount folders through <code>Finder > Go > Connect to Server ...</code>. In the dialogue window that pops up, enter<br />
<pre>smb://<user name>@leo.hpc.uib.no/gfi</pre><br />
as the '''Server Address'''. You might want to replace <code>gfi</code> by <code>skd</code> to access the skd disks if that is your primary affiliation.<br />
On Ubuntu this is very similar: <code>Files > Go > Enter Location ...</code>. Enter the address: <pre>smb://<user name>@leo.hpc.uib.no/gfi</pre> and enter your password in the next pop-up window, while keeping "UiB" in the "Domain" field.</div>Csp001http://gfi.wiki.uib.no/index.php?title=Using_cyclone&diff=1001Using cyclone2018-10-05T11:40:08Z<p>Csp001: /* Compilers and libraries */</p>
<hr />
<div>== Connection and first steps ==<br />
<br />
Use ssh to connect<br />
<pre>ssh -Y <username>@cyclone.hpc.uib.no</pre><br />
or just simply:<br />
<pre>ssh -Y cyclone.hpc.uib.no</pre><br />
if you're connecting from a computer where you are logged in under the same name. When you are connecting for the first time, you will be asked to verify a signature. Reply "yes" to this question.<br />
<br />
=== Home directories ===<br />
<br />
<code>cyclone.hpc.uib.no</code> shares home directories with the new hexagon cluster. These home directories are separate from your standard UiB home directory. The contents of your home directories will not be synced, so you will manually need to transfer your scripts to the new system.<br />
<br />
=== How to access software ===<br />
<br />
In contrast to the old skd-cyclone, most scientific software is only available through software modules. Modules need to be loaded manually before the respective software can be used. We use software modules, because they provide are a clean and handy way to offer conflicting software or software versions: Instead of updating software and potentially breaking user scripts and programs new software is then made available in parallel to those that require it.<br />
<br />
=== Start-up scripts ===<br />
<br />
It might be handy to automatically load modules for software that you use frequently every time you login to cyclone. To accomplish that for bash, there are two relevant files, <code>$HOME/.bashrc</code> and <code>$HOME/.bash_profile</code> . <code>.bash_profile</code> should contain things that need to be defined at login time only, like <code>PATH</code> and other environment variables, startup programs, etc. You just need things once, not in every shell you open. In most cases, you also need the things from <code>.bashrc</code> in your login shell. That's why <code>.bash_profile</code> sources <code>.bashrc</code> as well, but .bashrc doesn't usually source <code>.bash_profile</code>. In contrast, <code>.bashrc</code> should typically contain things you want to set in every shell you open, like aliases, functions, etc. These are per shell session items that are not inherited from environment ([https://unix.stackexchange.com/questions/346336/why-have-both-bash-profile-and-bashrc source and detailed explanation]).<br />
<br />
==== An example <code>.bash_profile</code> for inspiration ====<br />
<br />
<pre>module load cdo/1.6.9<br />
module load ncarg/6.3.0-login<br />
<br />
alias rm="rm -i"<br />
alias cp="cp -i"<br />
alias erai="cd /Data/skd/share/Reanalysis/ERA_INTERIM/6HOURLY/"<br />
<br />
if [ -f ~/.bashrc ]; then<br />
. ~/.bashrc<br />
fi</pre><br />
<br />
==== An example <code>.bash_profile</code> for inspiration ====<br />
<br />
<pre>alias rm="rm -i"<br />
alias cp="cp -i"<br />
alias erai="cd /Data/skd/share/Reanalysis/ERA_INTERIM/6HOURLY/"</pre><br />
<br />
<br />
== Available software ==<br />
<br />
Below is a list of frequently used software and which module to load on the new cyclone. Relevant module names are printed like for <code>matlab/2015b</code>. Modules can be loaded by <code>module load <module name></code>, and unloaded <code>module unload <module name></code>. [[Using modules on cyclone|More details on the module system]].<br />
<br />
To list all available modules, use the command<br />
<pre>module avail</pre><br />
<br />
Hexagon-specific modules are now no longer listed and available on cyclone. All packages listed with this command should work, so please report to <code>support@hpc.uib.no</code> if they do not.<br />
<br />
=== Data analysis and plotting ===<br />
<br />
* CDO<br />
*: <code>cdo</code>, <code>cdo/1.6.2</code><br />
* Dynlib<br />
*: See temporary solution for python. Requires in addition <code>OpenBLAS/0.3.1-GCC-7.3.0-2.30</code> and <code>ScaLAPACK/2.0.2-gompi-2018b-OpenBLAS-0.3.1</code>.<br />
* Matlab<br />
*: ''Currently unavailable''<br />
* NCL<br />
*: ''Currently unavailable''<br />
* nco<br />
*: ''Currently unavailable''<br />
* ncview<br />
*: <code>ncview</code>, <code>ncview/2.1.7-foss-2018b</code>. Load only when needed! The package is currently known to break some GUI programs like gedit and gvim. <br />
* python, plus selection of scientific packages<br />
*: Temporary solution, use one of the two below commands to enable the virtual environment:<br />
*: <code>source /Data/gfi/users/local/share/virtualenv/dynpie2/bin/activate</code> for python 2.7.5.<br />
*: <code>source /Data/gfi/users/local/share/virtualenv/dynpie3/bin/activate</code> for python 3.4.9.<br />
*: For the pygrib module, <code>grib_api/1.24.0-foss-2018b</code> is required in addition. '''Note''': These virtual environments will at some point be replaced by ones based on the new python versions 2.7.15 and 3.7.0 that are now available on cyclone. This change will be announced on dynlib-users@gfi.uib.no, please contact Clemens Spensberger if you are not on this list and like to be informed.<br />
* R<br />
*: ''Currently unavailable''<br />
<br />
=== Text editors ===<br />
<br />
* emacs<br />
*: ''<no module required>''<br />
* gedit<br />
*: ''<no module required>''<br />
* gvim<br />
*: ''<no module required>''<br />
* vi(m)<br />
*: ''<no module required>''<br />
<br />
=== Compilers and libraries ===<br />
<br />
* blas<br />
*: <code>OpenBLAS/0.3.1-GCC-7.3.0-2.30</code><br />
* gcc, gfortran<br />
*: <code>GCC</code>, <code>GCC/7.3.0-2.30</code><br />
* grib_api<br />
*: <code>grib_api/1.24.0-foss-2018b</code><br />
* HDF5 libraries<br />
*: <code>HDF5/1.10.2-foss-2018b</code><br />
* lapack<br />
*: <code>ScaLAPACK/2.0.2-gompi-2018b-OpenBLAS-0.3.1</code><br />
* netcdf<br />
*: For C-libaries: <code>netCDF/4.6.1-foss-2018b</code>, <br />
*: For Fortran-libraries <code>netCDF-Fortran/4.4.4-foss-2018b</code>, compile with option <code>-I/shared/apps/netCDF-Fortran/4.4.4-foss-2018b/include</code><br />
<br />
== Accessing the data from your own machines ==<br />
<br />
Note: From your personal machines you will need to be connected to the UiB VPN to be able to mount the following network drives. <br />
<br />
On MacOS you can mount folders through <code>Finder > Go > Connect to Server ...</code>. In the dialogue window that pops up, enter<br />
<pre>smb://<user name>@leo.hpc.uib.no/gfi</pre><br />
as the '''Server Address'''. You might want to replace <code>gfi</code> by <code>skd</code> to access the skd disks if that is your primary affiliation.<br />
On Ubuntu this is very similar: <code>Files > Go > Enter Location ...</code>. Enter the address: <pre>smb://<user name>@leo.hpc.uib.no/gfi</pre> and enter your password in the next pop-up window, while keeping "UiB" in the "Domain" field.</div>Csp001http://gfi.wiki.uib.no/index.php?title=Using_cyclone&diff=1000Using cyclone2018-10-05T09:36:13Z<p>Csp001: /* Available software */</p>
<hr />
<div>== Connection and first steps ==<br />
<br />
Use ssh to connect<br />
<pre>ssh -Y <username>@cyclone.hpc.uib.no</pre><br />
or just simply:<br />
<pre>ssh -Y cyclone.hpc.uib.no</pre><br />
if you're connecting from a computer where you are logged in under the same name. When you are connecting for the first time, you will be asked to verify a signature. Reply "yes" to this question.<br />
<br />
=== Home directories ===<br />
<br />
<code>cyclone.hpc.uib.no</code> shares home directories with the new hexagon cluster. These home directories are separate from your standard UiB home directory. The contents of your home directories will not be synced, so you will manually need to transfer your scripts to the new system.<br />
<br />
=== How to access software ===<br />
<br />
In contrast to the old skd-cyclone, most scientific software is only available through software modules. Modules need to be loaded manually before the respective software can be used. We use software modules, because they provide are a clean and handy way to offer conflicting software or software versions: Instead of updating software and potentially breaking user scripts and programs new software is then made available in parallel to those that require it.<br />
<br />
=== Start-up scripts ===<br />
<br />
It might be handy to automatically load modules for software that you use frequently every time you login to cyclone. To accomplish that for bash, there are two relevant files, <code>$HOME/.bashrc</code> and <code>$HOME/.bash_profile</code> . <code>.bash_profile</code> should contain things that need to be defined at login time only, like <code>PATH</code> and other environment variables, startup programs, etc. You just need things once, not in every shell you open. In most cases, you also need the things from <code>.bashrc</code> in your login shell. That's why <code>.bash_profile</code> sources <code>.bashrc</code> as well, but .bashrc doesn't usually source <code>.bash_profile</code>. In contrast, <code>.bashrc</code> should typically contain things you want to set in every shell you open, like aliases, functions, etc. These are per shell session items that are not inherited from environment ([https://unix.stackexchange.com/questions/346336/why-have-both-bash-profile-and-bashrc source and detailed explanation]).<br />
<br />
==== An example <code>.bash_profile</code> for inspiration ====<br />
<br />
<pre>module load cdo/1.6.9<br />
module load ncarg/6.3.0-login<br />
<br />
alias rm="rm -i"<br />
alias cp="cp -i"<br />
alias erai="cd /Data/skd/share/Reanalysis/ERA_INTERIM/6HOURLY/"<br />
<br />
if [ -f ~/.bashrc ]; then<br />
. ~/.bashrc<br />
fi</pre><br />
<br />
==== An example <code>.bash_profile</code> for inspiration ====<br />
<br />
<pre>alias rm="rm -i"<br />
alias cp="cp -i"<br />
alias erai="cd /Data/skd/share/Reanalysis/ERA_INTERIM/6HOURLY/"</pre><br />
<br />
<br />
== Available software ==<br />
<br />
Below is a list of frequently used software and which module to load on the new cyclone. Relevant module names are printed like for <code>matlab/2015b</code>. Modules can be loaded by <code>module load <module name></code>, and unloaded <code>module unload <module name></code>. [[Using modules on cyclone|More details on the module system]].<br />
<br />
To list all available modules, use the command<br />
<pre>module avail</pre><br />
<br />
Hexagon-specific modules are now no longer listed and available on cyclone. All packages listed with this command should work, so please report to <code>support@hpc.uib.no</code> if they do not.<br />
<br />
=== Data analysis and plotting ===<br />
<br />
* CDO<br />
*: <code>cdo</code>, <code>cdo/1.6.2</code><br />
* Dynlib<br />
*: See temporary solution for python. Requires in addition <code>OpenBLAS/0.3.1-GCC-7.3.0-2.30</code> and <code>ScaLAPACK/2.0.2-gompi-2018b-OpenBLAS-0.3.1</code>.<br />
* Matlab<br />
*: ''Currently unavailable''<br />
* NCL<br />
*: ''Currently unavailable''<br />
* nco<br />
*: ''Currently unavailable''<br />
* ncview<br />
*: <code>ncview</code>, <code>ncview/2.1.7-foss-2018b</code>. Load only when needed! The package is currently known to break some GUI programs like gedit and gvim. <br />
* python, plus selection of scientific packages<br />
*: Temporary solution, use one of the two below commands to enable the virtual environment:<br />
*: <code>source /Data/gfi/users/local/share/virtualenv/dynpie2/bin/activate</code> for python 2.7.5.<br />
*: <code>source /Data/gfi/users/local/share/virtualenv/dynpie3/bin/activate</code> for python 3.4.9.<br />
*: For the pygrib module, <code>grib_api/1.24.0-foss-2018b</code> is required in addition. '''Note''': These virtual environments will at some point be replaced by ones based on the new python versions 2.7.15 and 3.7.0 that are now available on cyclone. This change will be announced on dynlib-users@gfi.uib.no, please contact Clemens Spensberger if you are not on this list and like to be informed.<br />
* R<br />
*: ''Currently unavailable''<br />
<br />
=== Text editors ===<br />
<br />
* emacs<br />
*: ''<no module required>''<br />
* gedit<br />
*: ''<no module required>''<br />
* gvim<br />
*: ''<no module required>''<br />
* vi(m)<br />
*: ''<no module required>''<br />
<br />
=== Compilers and libraries ===<br />
<br />
* blas<br />
*: <code>OpenBLAS/0.3.1-GCC-7.3.0-2.30</code><br />
* gcc, gfortran<br />
*: <code>GCC</code>, <code>GCC/7.3.0-2.30</code><br />
* grib_api<br />
*: <code>grib_api/1.24.0-foss-2018b</code><br />
* lapack<br />
*: <code>ScaLAPACK/2.0.2-gompi-2018b-OpenBLAS-0.3.1</code><br />
* netcdf<br />
*: <code>netCDF/4.6.1-foss-2018b</code>, <code>netCDF-Fortran/4.4.4-foss-2018b</code><br />
* HDF5 libraries<br />
*: <code>module load HDF5/1.10.2-foss-2018b</code><br />
<br />
== Accessing the data from your own machines ==<br />
<br />
Note: From your personal machines you will need to be connected to the UiB VPN to be able to mount the following network drives. <br />
<br />
On MacOS you can mount folders through <code>Finder > Go > Connect to Server ...</code>. In the dialogue window that pops up, enter<br />
<pre>smb://<user name>@leo.hpc.uib.no/gfi</pre><br />
as the '''Server Address'''. You might want to replace <code>gfi</code> by <code>skd</code> to access the skd disks if that is your primary affiliation.<br />
On Ubuntu this is very similar: <code>Files > Go > Enter Location ...</code>. Enter the address: <pre>smb://<user name>@leo.hpc.uib.no/gfi</pre> and enter your password in the next pop-up window, while keeping "UiB" in the "Domain" field.</div>Csp001http://gfi.wiki.uib.no/index.php?title=Using_cyclone&diff=999Using cyclone2018-10-05T09:33:59Z<p>Csp001: /* Compilers and libraries */</p>
<hr />
<div>== Connection and first steps ==<br />
<br />
Use ssh to connect<br />
<pre>ssh -Y <username>@cyclone.hpc.uib.no</pre><br />
or just simply:<br />
<pre>ssh -Y cyclone.hpc.uib.no</pre><br />
if you're connecting from a computer where you are logged in under the same name. When you are connecting for the first time, you will be asked to verify a signature. Reply "yes" to this question.<br />
<br />
=== Home directories ===<br />
<br />
<code>cyclone.hpc.uib.no</code> shares home directories with the new hexagon cluster. These home directories are separate from your standard UiB home directory. The contents of your home directories will not be synced, so you will manually need to transfer your scripts to the new system.<br />
<br />
=== How to access software ===<br />
<br />
In contrast to the old skd-cyclone, most scientific software is only available through software modules. Modules need to be loaded manually before the respective software can be used. We use software modules, because they provide are a clean and handy way to offer conflicting software or software versions: Instead of updating software and potentially breaking user scripts and programs new software is then made available in parallel to those that require it.<br />
<br />
=== Start-up scripts ===<br />
<br />
It might be handy to automatically load modules for software that you use frequently every time you login to cyclone. To accomplish that for bash, there are two relevant files, <code>$HOME/.bashrc</code> and <code>$HOME/.bash_profile</code> . <code>.bash_profile</code> should contain things that need to be defined at login time only, like <code>PATH</code> and other environment variables, startup programs, etc. You just need things once, not in every shell you open. In most cases, you also need the things from <code>.bashrc</code> in your login shell. That's why <code>.bash_profile</code> sources <code>.bashrc</code> as well, but .bashrc doesn't usually source <code>.bash_profile</code>. In contrast, <code>.bashrc</code> should typically contain things you want to set in every shell you open, like aliases, functions, etc. These are per shell session items that are not inherited from environment ([https://unix.stackexchange.com/questions/346336/why-have-both-bash-profile-and-bashrc source and detailed explanation]).<br />
<br />
==== An example <code>.bash_profile</code> for inspiration ====<br />
<br />
<pre>module load cdo/1.6.9<br />
module load ncarg/6.3.0-login<br />
<br />
alias rm="rm -i"<br />
alias cp="cp -i"<br />
alias erai="cd /Data/skd/share/Reanalysis/ERA_INTERIM/6HOURLY/"<br />
<br />
if [ -f ~/.bashrc ]; then<br />
. ~/.bashrc<br />
fi</pre><br />
<br />
==== An example <code>.bash_profile</code> for inspiration ====<br />
<br />
<pre>alias rm="rm -i"<br />
alias cp="cp -i"<br />
alias erai="cd /Data/skd/share/Reanalysis/ERA_INTERIM/6HOURLY/"</pre><br />
<br />
<br />
== Available software ==<br />
<br />
Below is a list of frequently used software and which module to load on the new cyclone. Relevant module names are printed like for <code>matlab/2015b</code>. Modules can be loaded by <code>module load <module name></code>, and unloaded <code>module unload <module name></code>. [[Using modules on cyclone|More details on the module system]].<br />
<br />
To list all available modules, use the command<br />
<pre>module avail</pre><br />
<br />
Please be aware that some of these modules will be specific to hexagon and it's cray architecture. Hence module names containing "cray" might not work on cyclone, although some exceptions are known to exist, see <code>netcdf</code> and <code>ncview</code>. Vice-versa, if the module name contains "foss", the module will be specific to cyclone and might not work on hexagon.<br />
<br />
=== Data analysis and plotting ===<br />
<br />
* CDO<br />
*: <code>cdo</code>, <code>cdo/1.6.2</code><br />
* Dynlib<br />
*: See temporary solution for python. Requires in addition <code>OpenBLAS/0.3.1-GCC-7.3.0-2.30</code> and <code>ScaLAPACK/2.0.2-gompi-2018b-OpenBLAS-0.3.1</code>.<br />
* Matlab<br />
*: ''Currently unavailable''<br />
* NCL<br />
*: ''Currently unavailable''<br />
* nco<br />
*: ''Currently unavailable''<br />
* ncview<br />
*: <code>ncview</code>, <code>ncview/2.1.7-foss-2018b</code>. Load only when needed! The package is currently known to break some GUI programs like gedit and gvim. <br />
* python, plus selection of scientific packages<br />
*: Temporary solution, use one of the two below commands to enable the virtual environment:<br />
*: <code>source /Data/gfi/users/local/share/virtualenv/dynpie2/bin/activate</code> for python 2.7.5.<br />
*: <code>source /Data/gfi/users/local/share/virtualenv/dynpie3/bin/activate</code> for python 3.4.9.<br />
*: For the pygrib module, <code>grib_api/1.24.0-foss-2018b</code> is required in addition. '''Note''': These virtual environments will at some point be replaced by ones based on the new python versions 2.7.15 and 3.7.0 that are now available on cyclone. This change will be announced on dynlib-users@gfi.uib.no, please contact Clemens Spensberger if you are not on this list and like to be informed.<br />
* R<br />
*: ''Currently unavailable''<br />
<br />
=== Text editors ===<br />
<br />
* emacs<br />
*: ''<no module required>''<br />
* gedit<br />
*: ''<no module required>''<br />
* gvim<br />
*: ''<no module required>''<br />
* vi(m)<br />
*: ''<no module required>''<br />
<br />
=== Compilers and libraries ===<br />
<br />
* blas<br />
*: <code>OpenBLAS/0.3.1-GCC-7.3.0-2.30</code><br />
* gcc, gfortran<br />
*: <code>GCC</code>, <code>GCC/7.3.0-2.30</code><br />
* grib_api<br />
*: <code>grib_api/1.24.0-foss-2018b</code><br />
* lapack<br />
*: <code>ScaLAPACK/2.0.2-gompi-2018b-OpenBLAS-0.3.1</code><br />
* netcdf<br />
*: <code>netCDF/4.6.1-foss-2018b</code>, <code>netCDF-Fortran/4.4.4-foss-2018b</code><br />
* HDF5 libraries<br />
*: <code>module load HDF5/1.10.2-foss-2018b</code><br />
<br />
== Accessing the data from your own machines ==<br />
<br />
Note: From your personal machines you will need to be connected to the UiB VPN to be able to mount the following network drives. <br />
<br />
On MacOS you can mount folders through <code>Finder > Go > Connect to Server ...</code>. In the dialogue window that pops up, enter<br />
<pre>smb://<user name>@leo.hpc.uib.no/gfi</pre><br />
as the '''Server Address'''. You might want to replace <code>gfi</code> by <code>skd</code> to access the skd disks if that is your primary affiliation.<br />
On Ubuntu this is very similar: <code>Files > Go > Enter Location ...</code>. Enter the address: <pre>smb://<user name>@leo.hpc.uib.no/gfi</pre> and enter your password in the next pop-up window, while keeping "UiB" in the "Domain" field.</div>Csp001http://gfi.wiki.uib.no/index.php?title=Using_cyclone&diff=998Using cyclone2018-10-05T09:31:57Z<p>Csp001: </p>
<hr />
<div>== Connection and first steps ==<br />
<br />
Use ssh to connect<br />
<pre>ssh -Y <username>@cyclone.hpc.uib.no</pre><br />
or just simply:<br />
<pre>ssh -Y cyclone.hpc.uib.no</pre><br />
if you're connecting from a computer where you are logged in under the same name. When you are connecting for the first time, you will be asked to verify a signature. Reply "yes" to this question.<br />
<br />
=== Home directories ===<br />
<br />
<code>cyclone.hpc.uib.no</code> shares home directories with the new hexagon cluster. These home directories are separate from your standard UiB home directory. The contents of your home directories will not be synced, so you will manually need to transfer your scripts to the new system.<br />
<br />
=== How to access software ===<br />
<br />
In contrast to the old skd-cyclone, most scientific software is only available through software modules. Modules need to be loaded manually before the respective software can be used. We use software modules, because they provide are a clean and handy way to offer conflicting software or software versions: Instead of updating software and potentially breaking user scripts and programs new software is then made available in parallel to those that require it.<br />
<br />
=== Start-up scripts ===<br />
<br />
It might be handy to automatically load modules for software that you use frequently every time you login to cyclone. To accomplish that for bash, there are two relevant files, <code>$HOME/.bashrc</code> and <code>$HOME/.bash_profile</code> . <code>.bash_profile</code> should contain things that need to be defined at login time only, like <code>PATH</code> and other environment variables, startup programs, etc. You just need things once, not in every shell you open. In most cases, you also need the things from <code>.bashrc</code> in your login shell. That's why <code>.bash_profile</code> sources <code>.bashrc</code> as well, but .bashrc doesn't usually source <code>.bash_profile</code>. In contrast, <code>.bashrc</code> should typically contain things you want to set in every shell you open, like aliases, functions, etc. These are per shell session items that are not inherited from environment ([https://unix.stackexchange.com/questions/346336/why-have-both-bash-profile-and-bashrc source and detailed explanation]).<br />
<br />
==== An example <code>.bash_profile</code> for inspiration ====<br />
<br />
<pre>module load cdo/1.6.9<br />
module load ncarg/6.3.0-login<br />
<br />
alias rm="rm -i"<br />
alias cp="cp -i"<br />
alias erai="cd /Data/skd/share/Reanalysis/ERA_INTERIM/6HOURLY/"<br />
<br />
if [ -f ~/.bashrc ]; then<br />
. ~/.bashrc<br />
fi</pre><br />
<br />
==== An example <code>.bash_profile</code> for inspiration ====<br />
<br />
<pre>alias rm="rm -i"<br />
alias cp="cp -i"<br />
alias erai="cd /Data/skd/share/Reanalysis/ERA_INTERIM/6HOURLY/"</pre><br />
<br />
<br />
== Available software ==<br />
<br />
Below is a list of frequently used software and which module to load on the new cyclone. Relevant module names are printed like for <code>matlab/2015b</code>. Modules can be loaded by <code>module load <module name></code>, and unloaded <code>module unload <module name></code>. [[Using modules on cyclone|More details on the module system]].<br />
<br />
To list all available modules, use the command<br />
<pre>module avail</pre><br />
<br />
Please be aware that some of these modules will be specific to hexagon and it's cray architecture. Hence module names containing "cray" might not work on cyclone, although some exceptions are known to exist, see <code>netcdf</code> and <code>ncview</code>. Vice-versa, if the module name contains "foss", the module will be specific to cyclone and might not work on hexagon.<br />
<br />
=== Data analysis and plotting ===<br />
<br />
* CDO<br />
*: <code>cdo</code>, <code>cdo/1.6.2</code><br />
* Dynlib<br />
*: See temporary solution for python. Requires in addition <code>OpenBLAS/0.3.1-GCC-7.3.0-2.30</code> and <code>ScaLAPACK/2.0.2-gompi-2018b-OpenBLAS-0.3.1</code>.<br />
* Matlab<br />
*: ''Currently unavailable''<br />
* NCL<br />
*: ''Currently unavailable''<br />
* nco<br />
*: ''Currently unavailable''<br />
* ncview<br />
*: <code>ncview</code>, <code>ncview/2.1.7-foss-2018b</code>. Load only when needed! The package is currently known to break some GUI programs like gedit and gvim. <br />
* python, plus selection of scientific packages<br />
*: Temporary solution, use one of the two below commands to enable the virtual environment:<br />
*: <code>source /Data/gfi/users/local/share/virtualenv/dynpie2/bin/activate</code> for python 2.7.5.<br />
*: <code>source /Data/gfi/users/local/share/virtualenv/dynpie3/bin/activate</code> for python 3.4.9.<br />
*: For the pygrib module, <code>grib_api/1.24.0-foss-2018b</code> is required in addition. '''Note''': These virtual environments will at some point be replaced by ones based on the new python versions 2.7.15 and 3.7.0 that are now available on cyclone. This change will be announced on dynlib-users@gfi.uib.no, please contact Clemens Spensberger if you are not on this list and like to be informed.<br />
* R<br />
*: ''Currently unavailable''<br />
<br />
=== Text editors ===<br />
<br />
* emacs<br />
*: ''<no module required>''<br />
* gedit<br />
*: ''<no module required>''<br />
* gvim<br />
*: ''<no module required>''<br />
* vi(m)<br />
*: ''<no module required>''<br />
<br />
=== Compilers and libraries ===<br />
<br />
* blas<br />
*: <code>OpenBLAS/0.3.1-GCC-7.3.0-2.30</code><br />
* gcc, gfortran<br />
*: <code>GCC</code>, <code>GCC/7.3.0-2.30</code>. '''Note the upper-case''' module name, there is also a small-case <code>gcc</code>.<br />
* grib_api<br />
*: <code>grib_api/1.24.0-foss-2018b</code><br />
* lapack<br />
*: <code>ScaLAPACK/2.0.2-gompi-2018b-OpenBLAS-0.3.1</code><br />
* netcdf<br />
*: <code>netCDF/4.6.1-foss-2018b</code>, <code>netCDF-Fortran/4.4.4-foss-2018b</code><br />
* HDF5 libraries<br />
*: <code>module load HDF5/1.10.2-foss-2018b</code><br />
<br />
== Accessing the data from your own machines ==<br />
<br />
Note: From your personal machines you will need to be connected to the UiB VPN to be able to mount the following network drives. <br />
<br />
On MacOS you can mount folders through <code>Finder > Go > Connect to Server ...</code>. In the dialogue window that pops up, enter<br />
<pre>smb://<user name>@leo.hpc.uib.no/gfi</pre><br />
as the '''Server Address'''. You might want to replace <code>gfi</code> by <code>skd</code> to access the skd disks if that is your primary affiliation.<br />
On Ubuntu this is very similar: <code>Files > Go > Enter Location ...</code>. Enter the address: <pre>smb://<user name>@leo.hpc.uib.no/gfi</pre> and enter your password in the next pop-up window, while keeping "UiB" in the "Domain" field.</div>Csp001http://gfi.wiki.uib.no/index.php?title=Using_cyclone&diff=997Using cyclone2018-10-05T09:21:03Z<p>Csp001: </p>
<hr />
<div>== Connection and first steps ==<br />
<br />
Use ssh to connect<br />
<pre>ssh -Y <username>@cyclone.hpc.uib.no</pre><br />
or just simply:<br />
<pre>ssh -Y cyclone.hpc.uib.no</pre><br />
if you're connecting from a computer where you are logged in under the same name. When you are connecting for the first time, you will be asked to verify a signature. Reply "yes" to this question.<br />
<br />
=== Home directories ===<br />
<br />
<code>cyclone.hpc.uib.no</code> shares home directories with the new hexagon cluster. These home directories are separate from your standard UiB home directory. The contents of your home directories will not be synced, so you will manually need to transfer your scripts to the new system.<br />
<br />
=== How to access software ===<br />
<br />
In contrast to the old skd-cyclone, most scientific software is only available through software modules. Modules need to be loaded manually before the respective software can be used. We use software modules, because they provide are a clean and handy way to offer conflicting software or software versions: Instead of updating software and potentially breaking user scripts and programs new software is then made available in parallel to those that require it.<br />
<br />
=== Start-up scripts ===<br />
<br />
It might be handy to automatically load modules for software that you use frequently every time you login to cyclone. To accomplish that for bash, there are two relevant files, <code>$HOME/.bashrc</code> and <code>$HOME/.bash_profile</code> . <code>.bash_profile</code> should contain things that need to be defined at login time only, like <code>PATH</code> and other environment variables, startup programs, etc. You just need things once, not in every shell you open. In most cases, you also need the things from <code>.bashrc</code> in your login shell. That's why <code>.bash_profile</code> sources <code>.bashrc</code> as well, but .bashrc doesn't usually source <code>.bash_profile</code>. In contrast, <code>.bashrc</code> should typically contain things you want to set in every shell you open, like aliases, functions, etc. These are per shell session items that are not inherited from environment ([https://unix.stackexchange.com/questions/346336/why-have-both-bash-profile-and-bashrc source and detailed explanation]).<br />
<br />
==== An example <code>.bash_profile</code> for inspiration ====<br />
<br />
<pre>module load cdo/1.6.9<br />
module load ncarg/6.3.0-login<br />
<br />
alias rm="rm -i"<br />
alias cp="cp -i"<br />
alias erai="cd /Data/skd/share/Reanalysis/ERA_INTERIM/6HOURLY/"<br />
<br />
if [ -f ~/.bashrc ]; then<br />
. ~/.bashrc<br />
fi</pre><br />
<br />
==== An example <code>.bash_profile</code> for inspiration ====<br />
<br />
<pre>alias rm="rm -i"<br />
alias cp="cp -i"<br />
alias erai="cd /Data/skd/share/Reanalysis/ERA_INTERIM/6HOURLY/"</pre><br />
<br />
<br />
== Available software ==<br />
<br />
Below is a list of frequently used software and which module to load on the new cyclone. Relevant module names are printed like for <code>matlab/2015b</code>. Modules can be loaded by <code>module load <module name></code>, and unloaded <code>module unload <module name></code>. [[Using modules on cyclone|More details on the module system]].<br />
<br />
To list all available modules, use the command<br />
<pre>module avail</pre><br />
<br />
Please be aware that some of these modules will be specific to hexagon and it's cray architecture. Hence module names containing "cray" might not work on cyclone, although some exceptions are known to exist, see <code>netcdf</code> and <code>ncview</code>. Vice-versa, if the module name contains "foss", the module will be specific to cyclone and might not work on hexagon.<br />
<br />
=== Data analysis and plotting ===<br />
<br />
* CDO<br />
*: <code>cdo</code>, <code>cdo/1.6.2</code><br />
* Dynlib<br />
*: See temporary solution for python. Requires in addition <code>OpenBLAS/0.3.1-GCC-7.3.0-2.30</code> and <code>ScaLAPACK/2.0.2-gompi-2018b-OpenBLAS-0.3.1</code>.<br />
* Matlab<br />
*: ''Currently unavailable''<br />
* NCL<br />
*: ''Currently unavailable''<br />
* nco<br />
*: ''Currently unavailable''<br />
* ncview<br />
*: <code>ncview</code>, <code>ncview/2.1.7-foss-2018b</code>. Load only when needed! The package is currently known to break some GUI programs like gedit and gvim. <br />
* python, plus selection of scientific packages<br />
*: Temporary solution, use one of the two below commands to enable the virtual environment:<br />
*: <code>source /Data/gfi/users/local/share/virtualenv/dynpie2/bin/activate</code> for python 2.7.<br />
*: <code>source /Data/gfi/users/local/share/virtualenv/dynpie3/bin/activate</code> for python 3.4.<br />
*: For the pygrib module, <code>grib_api/1.24.0-foss-2018b</code> is required in addition.<br />
* R<br />
*: ''Currently unavailable''<br />
<br />
=== Text editors ===<br />
<br />
* emacs<br />
*: ''<no module required>''<br />
* gedit<br />
*: ''<no module required>''<br />
* gvim<br />
*: ''<no module required>''<br />
* vi(m)<br />
*: ''<no module required>''<br />
<br />
=== Compilers and libraries ===<br />
<br />
* blas<br />
*: <code>OpenBLAS/0.3.1-GCC-7.3.0-2.30</code><br />
* gcc, gfortran<br />
*: <code>GCC</code>, <code>GCC/7.3.0-2.30</code>. '''Note the upper-case''' module name, there is also a small-case <code>gcc</code>.<br />
* grib_api<br />
*: <code>grib_api/1.24.0-foss-2018b</code><br />
* lapack<br />
*: <code>ScaLAPACK/2.0.2-gompi-2018b-OpenBLAS-0.3.1</code><br />
* netcdf<br />
*: <code>netCDF/4.6.1-foss-2018b</code>, <code>netCDF-Fortran/4.4.4-foss-2018b</code><br />
* HDF5 libraries<br />
*: <code>module load HDF5/1.10.2-foss-2018b</code><br />
<br />
== Accessing the data from your own machines ==<br />
<br />
Note: From your personal machines you will need to be connected to the UiB VPN to be able to mount the following network drives. <br />
<br />
On MacOS you can mount folders through <code>Finder > Go > Connect to Server ...</code>. In the dialogue window that pops up, enter<br />
<pre>smb://<user name>@leo.hpc.uib.no/gfi</pre><br />
as the '''Server Address'''. You might want to replace <code>gfi</code> by <code>skd</code> to access the skd disks if that is your primary affiliation.<br />
On Ubuntu this is very similar: <code>Files > Go > Enter Location ...</code>. Enter the address: <pre>smb://<user name>@leo.hpc.uib.no/gfi</pre> and enter your password in the next pop-up window, while keeping "UiB" in the "Domain" field.</div>Csp001http://gfi.wiki.uib.no/index.php?title=Using_cyclone&diff=996Using cyclone2018-10-05T08:11:38Z<p>Csp001: /* Text editors */</p>
<hr />
<div>== Connection and first steps ==<br />
<br />
Use ssh to connect<br />
<pre>ssh -Y <username>@cyclone.hpc.uib.no</pre><br />
or just simply:<br />
<pre>ssh -Y cyclone.hpc.uib.no</pre><br />
if you're connecting from a computer where you are logged in under the same name. When you are connecting for the first time, you will be asked to verify a signature. Reply "yes" to this question.<br />
<br />
=== Home directories ===<br />
<br />
<code>cyclone.hpc.uib.no</code> shares home directories with the new hexagon cluster. These home directories are separate from your standard UiB home directory. The contents of your home directories will not be synced, so you will manually need to transfer your scripts to the new system.<br />
<br />
=== How to access software ===<br />
<br />
In contrast to the old skd-cyclone, most scientific software is only available through software modules. Modules need to be loaded manually before the respective software can be used. We use software modules, because they provide are a clean and handy way to offer conflicting software or software versions: Instead of updating software and potentially breaking user scripts and programs new software is then made available in parallel to those that require it.<br />
<br />
=== Start-up scripts ===<br />
<br />
It might be handy to automatically load modules for software that you use frequently every time you login to cyclone. To accomplish that for bash, there are two relevant files, <code>$HOME/.bashrc</code> and <code>$HOME/.bash_profile</code> . <code>.bash_profile</code> should contain things that need to be defined at login time only, like <code>PATH</code> and other environment variables, startup programs, etc. You just need things once, not in every shell you open. In most cases, you also need the things from <code>.bashrc</code> in your login shell. That's why <code>.bash_profile</code> sources <code>.bashrc</code> as well, but .bashrc doesn't usually source <code>.bash_profile</code>. In contrast, <code>.bashrc</code> should typically contain things you want to set in every shell you open, like aliases, functions, etc. These are per shell session items that are not inherited from environment ([https://unix.stackexchange.com/questions/346336/why-have-both-bash-profile-and-bashrc source and detailed explanation]).<br />
<br />
==== An example <code>.bash_profile</code> for inspiration ====<br />
<br />
<pre>module load cdo/1.6.9<br />
module load ncarg/6.3.0-login<br />
<br />
alias rm="rm -i"<br />
alias cp="cp -i"<br />
alias erai="cd /Data/skd/share/Reanalysis/ERA_INTERIM/6HOURLY/"<br />
<br />
if [ -f ~/.bashrc ]; then<br />
. ~/.bashrc<br />
fi</pre><br />
<br />
==== An example <code>.bash_profile</code> for inspiration ====<br />
<br />
<pre>alias rm="rm -i"<br />
alias cp="cp -i"<br />
alias erai="cd /Data/skd/share/Reanalysis/ERA_INTERIM/6HOURLY/"</pre><br />
<br />
<br />
== Available software ==<br />
<br />
Below is a list of frequently used software and which module to load on the new cyclone. Relevant module names are printed like for <code>matlab/2015b</code>. Modules can be loaded by <code>module load <module name></code>, and unloaded <code>module unload <module name></code>. [[Using modules on cyclone|More details on the module system]].<br />
<br />
To list all available modules, use the command<br />
<pre>module avail</pre><br />
<br />
Please be aware that some of these modules will be specific to hexagon and it's cray architecture. Hence module names containing "cray" might not work on cyclone, although some exceptions are known to exist, see <code>netcdf</code> and <code>ncview</code>. Vice-versa, if the module name contains "foss", the module will be specific to cyclone and might not work on hexagon.<br />
<br />
=== Data analysis and plotting ===<br />
<br />
* CDO<br />
*: <code>cdo</code>, <code>cdo/1.6.2</code><br />
* Dynlib<br />
*: See temporary solution for python. Requires in addition <code>OpenBLAS/0.3.1-GCC-7.3.0-2.30</code> and <code>ScaLAPACK/2.0.2-gompi-2018b-OpenBLAS-0.3.1</code>.<br />
* Matlab<br />
*: ''Currently unavailable''<br />
* NCL<br />
*: ''Currently unavailable''<br />
* nco<br />
*: ''Currently unavailable''<br />
* ncview<br />
*: <code>ncview</code>, <code>ncview/2.1.7-foss-2018b</code>. Load only when needed! The package is currently known to break some GUI programs like gedit and gvim. <br />
* python, plus selection of scientific packages<br />
*: Temporary solution, use one of the two below commands to enable the virtual environment:<br />
*: <code>source /Data/gfi/users/local/share/virtualenv/dynpie2/bin/activate</code> for python 2.7.<br />
*: <code>source /Data/gfi/users/local/share/virtualenv/dynpie3/bin/activate</code> for python 3.4.<br />
*: For the pygrib module, <code>grib_api/1.24.0-foss-2018b</code> is required in addition.<br />
* R<br />
*: ''Currently unavailable''<br />
<br />
=== Text editors ===<br />
<br />
* emacs<br />
*: ''Currently unavailable''<br />
* gedit<br />
*: ''<no module required>''<br />
* gvim<br />
*: ''<no module required>''<br />
* vi(m)<br />
*: ''<no module required>''<br />
<br />
=== Compilers and libraries ===<br />
<br />
* blas<br />
*: <code>OpenBLAS/0.3.1-GCC-7.3.0-2.30</code><br />
* gcc, gfortran<br />
*: <code>GCC</code>, <code>GCC/7.3.0-2.30</code>. '''Note the upper-case''' module name, there is also a small-case <code>gcc</code>.<br />
* grib_api<br />
*: <code>grib_api/1.24.0-foss-2018b</code><br />
* lapack<br />
*: <code>ScaLAPACK/2.0.2-gompi-2018b-OpenBLAS-0.3.1</code><br />
* netcdf<br />
*: <code>netCDF/4.6.1-foss-2018b</code>, <code>netCDF-Fortran/4.4.4-foss-2018b</code><br />
* HDF5 libraries<br />
*: <code>module load HDF5/1.10.2-foss-2018b</code><br />
<br />
== Accessing the data from your own machines ==<br />
<br />
Note: From your personal machines you will need to be connected to the UiB VPN to be able to mount the following network drives. <br />
<br />
On MacOS you can mount folders through <code>Finder > Go > Connect to Server ...</code>. In the dialogue window that pops up, enter<br />
<pre>smb://<user name>@leo.hpc.uib.no/gfi</pre><br />
as the '''Server Address'''. You might want to replace <code>gfi</code> by <code>skd</code> to access the skd disks if that is your primary affiliation.<br />
On Ubuntu this is very similar: <code>Files > Go > Enter Location ...</code>. Enter the address: <pre>smb://<user name>@leo.hpc.uib.no/gfi</pre> and enter your password in the next pop-up window, while keeping "UiB" in the "Domain" field.</div>Csp001http://gfi.wiki.uib.no/index.php?title=Using_cyclone&diff=995Using cyclone2018-10-05T08:11:11Z<p>Csp001: </p>
<hr />
<div>== Connection and first steps ==<br />
<br />
Use ssh to connect<br />
<pre>ssh -Y <username>@cyclone.hpc.uib.no</pre><br />
or just simply:<br />
<pre>ssh -Y cyclone.hpc.uib.no</pre><br />
if you're connecting from a computer where you are logged in under the same name. When you are connecting for the first time, you will be asked to verify a signature. Reply "yes" to this question.<br />
<br />
=== Home directories ===<br />
<br />
<code>cyclone.hpc.uib.no</code> shares home directories with the new hexagon cluster. These home directories are separate from your standard UiB home directory. The contents of your home directories will not be synced, so you will manually need to transfer your scripts to the new system.<br />
<br />
=== How to access software ===<br />
<br />
In contrast to the old skd-cyclone, most scientific software is only available through software modules. Modules need to be loaded manually before the respective software can be used. We use software modules, because they provide are a clean and handy way to offer conflicting software or software versions: Instead of updating software and potentially breaking user scripts and programs new software is then made available in parallel to those that require it.<br />
<br />
=== Start-up scripts ===<br />
<br />
It might be handy to automatically load modules for software that you use frequently every time you login to cyclone. To accomplish that for bash, there are two relevant files, <code>$HOME/.bashrc</code> and <code>$HOME/.bash_profile</code> . <code>.bash_profile</code> should contain things that need to be defined at login time only, like <code>PATH</code> and other environment variables, startup programs, etc. You just need things once, not in every shell you open. In most cases, you also need the things from <code>.bashrc</code> in your login shell. That's why <code>.bash_profile</code> sources <code>.bashrc</code> as well, but .bashrc doesn't usually source <code>.bash_profile</code>. In contrast, <code>.bashrc</code> should typically contain things you want to set in every shell you open, like aliases, functions, etc. These are per shell session items that are not inherited from environment ([https://unix.stackexchange.com/questions/346336/why-have-both-bash-profile-and-bashrc source and detailed explanation]).<br />
<br />
==== An example <code>.bash_profile</code> for inspiration ====<br />
<br />
<pre>module load cdo/1.6.9<br />
module load ncarg/6.3.0-login<br />
<br />
alias rm="rm -i"<br />
alias cp="cp -i"<br />
alias erai="cd /Data/skd/share/Reanalysis/ERA_INTERIM/6HOURLY/"<br />
<br />
if [ -f ~/.bashrc ]; then<br />
. ~/.bashrc<br />
fi</pre><br />
<br />
==== An example <code>.bash_profile</code> for inspiration ====<br />
<br />
<pre>alias rm="rm -i"<br />
alias cp="cp -i"<br />
alias erai="cd /Data/skd/share/Reanalysis/ERA_INTERIM/6HOURLY/"</pre><br />
<br />
<br />
== Available software ==<br />
<br />
Below is a list of frequently used software and which module to load on the new cyclone. Relevant module names are printed like for <code>matlab/2015b</code>. Modules can be loaded by <code>module load <module name></code>, and unloaded <code>module unload <module name></code>. [[Using modules on cyclone|More details on the module system]].<br />
<br />
To list all available modules, use the command<br />
<pre>module avail</pre><br />
<br />
Please be aware that some of these modules will be specific to hexagon and it's cray architecture. Hence module names containing "cray" might not work on cyclone, although some exceptions are known to exist, see <code>netcdf</code> and <code>ncview</code>. Vice-versa, if the module name contains "foss", the module will be specific to cyclone and might not work on hexagon.<br />
<br />
=== Data analysis and plotting ===<br />
<br />
* CDO<br />
*: <code>cdo</code>, <code>cdo/1.6.2</code><br />
* Dynlib<br />
*: See temporary solution for python. Requires in addition <code>OpenBLAS/0.3.1-GCC-7.3.0-2.30</code> and <code>ScaLAPACK/2.0.2-gompi-2018b-OpenBLAS-0.3.1</code>.<br />
* Matlab<br />
*: ''Currently unavailable''<br />
* NCL<br />
*: ''Currently unavailable''<br />
* nco<br />
*: ''Currently unavailable''<br />
* ncview<br />
*: <code>ncview</code>, <code>ncview/2.1.7-foss-2018b</code>. Load only when needed! The package is currently known to break some GUI programs like gedit and gvim. <br />
* python, plus selection of scientific packages<br />
*: Temporary solution, use one of the two below commands to enable the virtual environment:<br />
*: <code>source /Data/gfi/users/local/share/virtualenv/dynpie2/bin/activate</code> for python 2.7.<br />
*: <code>source /Data/gfi/users/local/share/virtualenv/dynpie3/bin/activate</code> for python 3.4.<br />
*: For the pygrib module, <code>grib_api/1.24.0-foss-2018b</code> is required in addition.<br />
* R<br />
*: ''Currently unavailable''<br />
<br />
=== Text editors ===<br />
<br />
* emacs<br />
*: /Currently unavailable/<br />
* gedit<br />
*: ''<no module required>''<br />
* gvim<br />
*: ''<no module required>''<br />
* vi(m)<br />
*: ''<no module required>''<br />
<br />
=== Compilers and libraries ===<br />
<br />
* blas<br />
*: <code>OpenBLAS/0.3.1-GCC-7.3.0-2.30</code><br />
* gcc, gfortran<br />
*: <code>GCC</code>, <code>GCC/7.3.0-2.30</code>. '''Note the upper-case''' module name, there is also a small-case <code>gcc</code>.<br />
* grib_api<br />
*: <code>grib_api/1.24.0-foss-2018b</code><br />
* lapack<br />
*: <code>ScaLAPACK/2.0.2-gompi-2018b-OpenBLAS-0.3.1</code><br />
* netcdf<br />
*: <code>netCDF/4.6.1-foss-2018b</code>, <code>netCDF-Fortran/4.4.4-foss-2018b</code><br />
* HDF5 libraries<br />
*: <code>module load HDF5/1.10.2-foss-2018b</code><br />
<br />
== Accessing the data from your own machines ==<br />
<br />
Note: From your personal machines you will need to be connected to the UiB VPN to be able to mount the following network drives. <br />
<br />
On MacOS you can mount folders through <code>Finder > Go > Connect to Server ...</code>. In the dialogue window that pops up, enter<br />
<pre>smb://<user name>@leo.hpc.uib.no/gfi</pre><br />
as the '''Server Address'''. You might want to replace <code>gfi</code> by <code>skd</code> to access the skd disks if that is your primary affiliation.<br />
On Ubuntu this is very similar: <code>Files > Go > Enter Location ...</code>. Enter the address: <pre>smb://<user name>@leo.hpc.uib.no/gfi</pre> and enter your password in the next pop-up window, while keeping "UiB" in the "Domain" field.</div>Csp001http://gfi.wiki.uib.no/index.php?title=Using_cyclone&diff=994Using cyclone2018-10-05T08:10:23Z<p>Csp001: </p>
<hr />
<div>== Connection and first steps ==<br />
<br />
Use ssh to connect<br />
<pre>ssh -Y <username>@cyclone.hpc.uib.no</pre><br />
or just simply:<br />
<pre>ssh -Y cyclone.hpc.uib.no</pre><br />
if you're connecting from a computer where you are logged in under the same name. When you are connecting for the first time, you will be asked to verify a signature. Reply "yes" to this question.<br />
<br />
=== Home directories ===<br />
<br />
<code>cyclone.hpc.uib.no</code> shares home directories with the new hexagon cluster. These home directories are separate from your standard UiB home directory. The contents of your home directories will not be synced, so you will manually need to transfer your scripts to the new system.<br />
<br />
=== How to access software ===<br />
<br />
In contrast to the old skd-cyclone, most scientific software is only available through software modules. Modules need to be loaded manually before the respective software can be used. We use software modules, because they provide are a clean and handy way to offer conflicting software or software versions: Instead of updating software and potentially breaking user scripts and programs new software is then made available in parallel to those that require it.<br />
<br />
=== Start-up scripts ===<br />
<br />
It might be handy to automatically load modules for software that you use frequently every time you login to cyclone. To accomplish that for bash, there are two relevant files, <code>$HOME/.bashrc</code> and <code>$HOME/.bash_profile</code> . <code>.bash_profile</code> should contain things that need to be defined at login time only, like <code>PATH</code> and other environment variables, startup programs, etc. You just need things once, not in every shell you open. In most cases, you also need the things from <code>.bashrc</code> in your login shell. That's why <code>.bash_profile</code> sources <code>.bashrc</code> as well, but .bashrc doesn't usually source <code>.bash_profile</code>. In contrast, <code>.bashrc</code> should typically contain things you want to set in every shell you open, like aliases, functions, etc. These are per shell session items that are not inherited from environment ([https://unix.stackexchange.com/questions/346336/why-have-both-bash-profile-and-bashrc source and detailed explanation]).<br />
<br />
==== An example <code>.bash_profile</code> for inspiration ====<br />
<br />
<pre>module load cdo/1.6.9<br />
module load ncarg/6.3.0-login<br />
<br />
alias rm="rm -i"<br />
alias cp="cp -i"<br />
alias erai="cd /Data/skd/share/Reanalysis/ERA_INTERIM/6HOURLY/"<br />
<br />
if [ -f ~/.bashrc ]; then<br />
. ~/.bashrc<br />
fi</pre><br />
<br />
==== An example <code>.bash_profile</code> for inspiration ====<br />
<br />
<pre>alias rm="rm -i"<br />
alias cp="cp -i"<br />
alias erai="cd /Data/skd/share/Reanalysis/ERA_INTERIM/6HOURLY/"</pre><br />
<br />
<br />
== Available software ==<br />
<br />
Below is a list of frequently used software and which module to load on the new cyclone. Relevant module names are printed like for <code>matlab/2015b</code>. Modules can be loaded by <code>module load <module name></code>, and unloaded <code>module unload <module name></code>. [[Using modules on cyclone|More details on the module system]].<br />
<br />
To list all available modules, use the command<br />
<pre>module avail</pre><br />
<br />
Please be aware that some of these modules will be specific to hexagon and it's cray architecture. Hence module names containing "cray" might not work on cyclone, although some exceptions are known to exist, see <code>netcdf</code> and <code>ncview</code>. Vice-versa, if the module name contains "foss", the module will be specific to cyclone and might not work on hexagon.<br />
<br />
=== Data analysis and plotting ===<br />
<br />
* CDO<br />
*: <code>cdo</code>, <code>cdo/1.6.2</code><br />
* Dynlib<br />
*: See temporary solution for python. Requires in addition <code>OpenBLAS/0.3.1-GCC-7.3.0-2.30</code> and <code>ScaLAPACK/2.0.2-gompi-2018b-OpenBLAS-0.3.1</code>.<br />
* Matlab<br />
*: /Currently unavailable/<br />
* NCL<br />
*: /Currently unavailable/<br />
* nco<br />
*: /Currently unavailable/<br />
* ncview<br />
*: <code>ncview</code>, <code>ncview/2.1.7-foss-2018b</code>. Load only when needed! The package is currently known to break some GUI programs like gedit and gvim. <br />
* python, plus selection of scientific packages<br />
*: Temporary solution, use one of the two below commands to enable the virtual environment:<br />
*: <code>source /Data/gfi/users/local/share/virtualenv/dynpie2/bin/activate</code> for python 2.7.<br />
*: <code>source /Data/gfi/users/local/share/virtualenv/dynpie3/bin/activate</code> for python 3.4.<br />
*: For the pygrib module, <code>grib_api/1.24.0-foss-2018b</code> is required in addition.<br />
* R<br />
*: /Currently unavailable/<br />
<br />
=== Text editors ===<br />
<br />
* emacs<br />
*: /Currently unavailable/<br />
* gedit<br />
*: ''<no module required>''<br />
* gvim<br />
*: ''<no module required>''<br />
* vi(m)<br />
*: ''<no module required>''<br />
<br />
=== Compilers and libraries ===<br />
<br />
* blas<br />
*: <code>OpenBLAS/0.3.1-GCC-7.3.0-2.30</code><br />
* gcc, gfortran<br />
*: <code>GCC</code>, <code>GCC/7.3.0-2.30</code>. '''Note the upper-case''' module name, there is also a small-case <code>gcc</code>.<br />
* grib_api<br />
*: <code>grib_api/1.24.0-foss-2018b</code><br />
* lapack<br />
*: <code>ScaLAPACK/2.0.2-gompi-2018b-OpenBLAS-0.3.1</code><br />
* netcdf<br />
*: <code>netCDF/4.6.1-foss-2018b</code>, <code>netCDF-Fortran/4.4.4-foss-2018b</code><br />
* HDF5 libraries<br />
*: <code>module load HDF5/1.10.2-foss-2018b</code><br />
<br />
== Accessing the data from your own machines ==<br />
<br />
Note: From your personal machines you will need to be connected to the UiB VPN to be able to mount the following network drives. <br />
<br />
On MacOS you can mount folders through <code>Finder > Go > Connect to Server ...</code>. In the dialogue window that pops up, enter<br />
<pre>smb://<user name>@leo.hpc.uib.no/gfi</pre><br />
as the '''Server Address'''. You might want to replace <code>gfi</code> by <code>skd</code> to access the skd disks if that is your primary affiliation.<br />
On Ubuntu this is very similar: <code>Files > Go > Enter Location ...</code>. Enter the address: <pre>smb://<user name>@leo.hpc.uib.no/gfi</pre> and enter your password in the next pop-up window, while keeping "UiB" in the "Domain" field.</div>Csp001http://gfi.wiki.uib.no/index.php?title=Using_cyclone&diff=993Using cyclone2018-10-04T13:31:22Z<p>Csp001: </p>
<hr />
<div>== Connection and first steps ==<br />
<br />
Use ssh to connect<br />
<pre>ssh -Y <username>@cyclone.hpc.uib.no</pre><br />
or just simply:<br />
<pre>ssh -Y cyclone.hpc.uib.no</pre><br />
if you're connecting from a computer where you are logged in under the same name. When you are connecting for the first time, you will be asked to verify a signature. Reply "yes" to this question.<br />
<br />
=== Home directories ===<br />
<br />
<code>cyclone.hpc.uib.no</code> shares home directories with the new hexagon cluster. These home directories are separate from your standard UiB home directory. The contents of your home directories will not be synced, so you will manually need to transfer your scripts to the new system.<br />
<br />
=== How to access software ===<br />
<br />
In contrast to the old skd-cyclone, most scientific software is only available through software modules. Modules need to be loaded manually before the respective software can be used. We use software modules, because they provide are a clean and handy way to offer conflicting software or software versions: Instead of updating software and potentially breaking user scripts and programs new software is then made available in parallel to those that require it.<br />
<br />
=== Start-up scripts ===<br />
<br />
It might be handy to automatically load modules for software that you use frequently every time you login to cyclone. To accomplish that for bash, there are two relevant files, <code>$HOME/.bashrc</code> and <code>$HOME/.bash_profile</code> . <code>.bash_profile</code> should contain things that need to be defined at login time only, like <code>PATH</code> and other environment variables, startup programs, etc. You just need things once, not in every shell you open. In most cases, you also need the things from <code>.bashrc</code> in your login shell. That's why <code>.bash_profile</code> sources <code>.bashrc</code> as well, but .bashrc doesn't usually source <code>.bash_profile</code>. In contrast, <code>.bashrc</code> should typically contain things you want to set in every shell you open, like aliases, functions, etc. These are per shell session items that are not inherited from environment ([https://unix.stackexchange.com/questions/346336/why-have-both-bash-profile-and-bashrc source and detailed explanation]).<br />
<br />
==== An example <code>.bash_profile</code> for inspiration ====<br />
<br />
<pre>module load cdo/1.6.9<br />
module load ncarg/6.3.0-login<br />
<br />
alias rm="rm -i"<br />
alias cp="cp -i"<br />
alias erai="cd /Data/skd/share/Reanalysis/ERA_INTERIM/6HOURLY/"<br />
<br />
if [ -f ~/.bashrc ]; then<br />
. ~/.bashrc<br />
fi</pre><br />
<br />
==== An example <code>.bash_profile</code> for inspiration ====<br />
<br />
<pre>alias rm="rm -i"<br />
alias cp="cp -i"<br />
alias erai="cd /Data/skd/share/Reanalysis/ERA_INTERIM/6HOURLY/"</pre><br />
<br />
<br />
== Available software ==<br />
<br />
Below is a list of frequently used software and which module to load on the new cyclone. Relevant module names are printed like for <code>matlab/2015b</code>. Modules can be loaded by <code>module load <module name></code>, and unloaded <code>module unload <module name></code>. [[Using modules on cyclone|More details on the module system]].<br />
<br />
To list all available modules, use the command<br />
<pre>module avail</pre><br />
<br />
Please be aware that some of these modules will be specific to hexagon and it's cray architecture. Hence module names containing "cray" might not work on cyclone, although some exceptions are known to exist, see <code>netcdf</code> and <code>ncview</code>. Vice-versa, if the module name contains "foss", the module will be specific to cyclone and might not work on hexagon.<br />
<br />
=== Data analysis and plotting ===<br />
<br />
* CDO<br />
*: <code>cdo</code>, <code>cdo/1.6.2</code><br />
* Dynlib<br />
*: See temporary solution for python. Requires in addition <code>OpenBLAS/0.3.1-GCC-7.3.0-2.30</code> and <code>ScaLAPACK/2.0.2-gompi-2018b-OpenBLAS-0.3.1</code>.<br />
* Matlab<br />
*: <code>matlab</code>, <code>matlab/2015b</code><br />
* NCL<br />
*: <code>ncarg</code>, <code>ncarg/6.0.0-login</code><br />
* nco<br />
*: <code>nco</code><br />
* ncview<br />
*: <code>ncview</code>, based on the <code>cray-netcdf</code> package.<br />
* python, plus selection of scientific packages<br />
*: Temporary solution, use one of the two below commands to enable the virtual environment:<br />
*: <code>source /Data/gfi/users/local/share/virtualenv/dynpie2/bin/activate</code> for python 2.7.<br />
*: <code>source /Data/gfi/users/local/share/virtualenv/dynpie3/bin/activate</code> for python 3.4.<br />
*: For the pygrib module, <code>grib_api/1.24.0-foss-2018b</code> is required in addition.<br />
* R<br />
*: <code>R</code>, <code>R/3.2.5</code><br />
<br />
=== Text editors ===<br />
<br />
* emacs<br />
*: <code>emacs</code><br />
* gedit<br />
*: ''<no module required>''<br />
* gvim<br />
*: ''<no module required>''<br />
* vi(m)<br />
*: ''<no module required>''<br />
<br />
=== Compilers and libraries ===<br />
<br />
* blas<br />
*: <code>OpenBLAS/0.3.1-GCC-7.3.0-2.30</code><br />
* gcc, gfortran<br />
*: <code>GCC</code>, <code>GCC/7.3.0-2.30</code>. '''Note the upper-case''' module name, there is also a small-case <code>gcc</code>.<br />
* grib_api<br />
*: <code>grib_api/1.24.0-foss-2018b</code><br />
* lapack<br />
*: <code>ScaLAPACK/2.0.2-gompi-2018b-OpenBLAS-0.3.1</code><br />
* netcdf<br />
*: netCDF libraries installed in the folder <code>/opt/cray/netcdf/4.4.1.1/GNU/5.1</code>. You'll hence need to include <code>-I/opt/cray/netcdf/4.4.1.1/GNU/5.1/include -L/opt/cray/netcdf/4.4.1.1/GNU/5.1/lib</code> in your compile command.<br />
* HDF5 libraries<br />
*: <code>module load HDF5/1.10.2-foss-2018b</code><br />
<br />
== Accessing the data from your own machines ==<br />
<br />
Note: From your personal machines you will need to be connected to the UiB VPN to be able to mount the following network drives. <br />
<br />
On MacOS you can mount folders through <code>Finder > Go > Connect to Server ...</code>. In the dialogue window that pops up, enter<br />
<pre>smb://<user name>@leo.hpc.uib.no/gfi</pre><br />
as the '''Server Address'''. You might want to replace <code>gfi</code> by <code>skd</code> to access the skd disks if that is your primary affiliation.<br />
On Ubuntu this is very similar: <code>Files > Go > Enter Location ...</code>. Enter the address: <pre>smb://<user name>@leo.hpc.uib.no/gfi</pre> and enter your password in the next pop-up window, while keeping "UiB" in the "Domain" field.</div>Csp001http://gfi.wiki.uib.no/index.php?title=Using_cyclone&diff=988Using cyclone2018-10-02T13:57:05Z<p>Csp001: /* Available software */</p>
<hr />
<div>== Connection and first steps ==<br />
<br />
Use ssh to connect<br />
<pre>ssh -Y <username>@cyclone.hpc.uib.no</pre><br />
or just simply:<br />
<pre>ssh -Y cyclone.hpc.uib.no</pre><br />
if you're connecting from a computer where you are logged in under the same name. When you are connecting for the first time, you will be asked to verify a signature. Reply "yes" to this question.<br />
<br />
=== Home directories ===<br />
<br />
<code>cyclone.hpc.uib.no</code> shares home directories with the new hexagon cluster. These home directories are separate from your standard UiB home directory. The contents of your home directories will not be synced, so you will manually need to transfer your scripts to the new system.<br />
<br />
=== How to access software ===<br />
<br />
In contrast to the old skd-cyclone, most scientific software is only available through software modules. Modules need to be loaded manually before the respective software can be used. We use software modules, because they provide are a clean and handy way to offer conflicting software or software versions: Instead of updating software and potentially breaking user scripts and programs new software is then made available in parallel to those that require it.<br />
<br />
=== Start-up scripts ===<br />
<br />
It might be handy to automatically load modules for software that you use frequently every time you login to cyclone. To accomplish that for bash, there are two relevant files, <code>$HOME/.bashrc</code> and <code>$HOME/.bash_profile</code> . <code>.bash_profile</code> should contain things that need to be defined at login time only, like <code>PATH</code> and other environment variables, startup programs, etc. You just need things once, not in every shell you open. In most cases, you also need the things from <code>.bashrc</code> in your login shell. That's why <code>.bash_profile</code> sources <code>.bashrc</code> as well, but .bashrc doesn't usually source <code>.bash_profile</code>. In contrast, <code>.bashrc</code> should typically contain things you want to set in every shell you open, like aliases, functions, etc. These are per shell session items that are not inherited from environment ([https://unix.stackexchange.com/questions/346336/why-have-both-bash-profile-and-bashrc source and detailed explanation]).<br />
<br />
==== An example <code>.bash_profile</code> for inspiration ====<br />
<br />
<pre>module load cdo/1.6.9<br />
module load ncarg/6.3.0-login<br />
<br />
alias rm="rm -i"<br />
alias cp="cp -i"<br />
alias erai="cd /Data/skd/share/Reanalysis/ERA_INTERIM/6HOURLY/"<br />
<br />
if [ -f ~/.bashrc ]; then<br />
. ~/.bashrc<br />
fi</pre><br />
<br />
==== An example <code>.bash_profile</code> for inspiration ====<br />
<br />
<pre>alias rm="rm -i"<br />
alias cp="cp -i"<br />
alias erai="cd /Data/skd/share/Reanalysis/ERA_INTERIM/6HOURLY/"</pre><br />
<br />
<br />
== Available software ==<br />
<br />
Below is a list of frequently used software and which module to load on the new cyclone. Relevant module names are printed like for <code>matlab/2015b</code>. Modules can be loaded by <code>module load <module name></code>, and unloaded <code>module unload <module name></code>. [[Using modules on cyclone|More details on the module system]].<br />
<br />
To list all available modules, use the command<br />
<pre>module avail</pre><br />
<br />
Please be aware that some of these modules will be specific to hexagon and it's cray architecture. Hence module names containing "cray" might not work on cyclone, although some exceptions are known to exist, see <code>netcdf</code> and <code>ncview</code>. Vice-versa, if the module name contains "foss", the module will be specific to cyclone and might not work on hexagon.<br />
<br />
=== Data analysis and plotting ===<br />
<br />
* CDO<br />
*: <code>cdo</code>, <code>cdo/1.6.2</code><br />
* Dynlib<br />
*: See temporary solution for python. Requires in addition <code>OpenBLAS/0.3.1-GCC-7.3.0-2.30</code> and <code>ScaLAPACK/2.0.2-gompi-2018b-OpenBLAS-0.3.1</code>.<br />
* Matlab<br />
*: <code>matlab</code>, <code>matlab/2015b</code><br />
* NCL<br />
*: <code>ncarg</code>, <code>ncarg/6.0.0-login</code><br />
* nco<br />
*: <code>nco</code><br />
* ncview<br />
*: <code>ncview</code>, based on the <code>cray-netcdf</code> package.<br />
* python, plus selection of scientific packages<br />
*: Temporary solution, use one of the two below commands to enable the virtual environment:<br />
*: <code>source /Data/gfi/users/local/share/virtualenv/dynpie2/bin/activate</code> for python 2.7.<br />
*: <code>source /Data/gfi/users/local/share/virtualenv/dynpie2/bin/activate</code> for python 3.4.<br />
*: For the pygrib module, <code>grib_api/1.24.0-foss-2018b</code> is required in addition.<br />
* R<br />
*: <code>R</code>, <code>R/3.2.5</code><br />
<br />
=== Text editors ===<br />
<br />
* emacs<br />
*: <code>emacs</code><br />
* gedit<br />
*: ''<no module required>''<br />
* gvim<br />
*: ''<no module required>''<br />
* vi(m)<br />
*: ''<no module required>''<br />
<br />
=== Compilers and libraries ===<br />
<br />
* blas<br />
*: <code>OpenBLAS/0.3.1-GCC-7.3.0-2.30</code><br />
* gcc, gfortran<br />
*: <code>GCC</code>, <code>GCC/7.3.0-2.30</code>. '''Note the upper-case''' module name, there is also a small-case <code>gcc</code>.<br />
* grib_api<br />
*: <code>grib_api/1.24.0-foss-2018b</code><br />
* lapack<br />
*: <code>ScaLAPACK/2.0.2-gompi-2018b-OpenBLAS-0.3.1</code><br />
* netcdf<br />
*: netCDF libraries installed in the folder <code>/opt/cray/netcdf/4.4.1.1/GNU/5.1</code>. You'll hence need to include <code>-I/opt/cray/netcdf/4.4.1.1/GNU/5.1/include -L/opt/cray/netcdf/4.4.1.1/GNU/5.1/lib</code> in your compile command.<br />
<br />
== Accessing the data from your own machines ==<br />
<br />
Note: From your personal machines you will need to be connected to the UiB VPN to be able to mount the following network drives. <br />
<br />
On MacOS you can mount folders through <code>Finder > Go > Connect to Server ...</code>. In the dialogue window that pops up, enter<br />
<pre>smb://<user name>@leo.hpc.uib.no/gfi</pre><br />
as the '''Server Address'''. You might want to replace <code>gfi</code> by <code>skd</code> to access the skd disks if that is your primary affiliation.</div>Csp001http://gfi.wiki.uib.no/index.php?title=Using_cyclone&diff=987Using cyclone2018-10-02T13:55:52Z<p>Csp001: /* Available software */</p>
<hr />
<div>== Connection and first steps ==<br />
<br />
Use ssh to connect<br />
<pre>ssh -Y <username>@cyclone.hpc.uib.no</pre><br />
or just simply:<br />
<pre>ssh -Y cyclone.hpc.uib.no</pre><br />
if you're connecting from a computer where you are logged in under the same name. When you are connecting for the first time, you will be asked to verify a signature. Reply "yes" to this question.<br />
<br />
=== Home directories ===<br />
<br />
<code>cyclone.hpc.uib.no</code> shares home directories with the new hexagon cluster. These home directories are separate from your standard UiB home directory. The contents of your home directories will not be synced, so you will manually need to transfer your scripts to the new system.<br />
<br />
=== How to access software ===<br />
<br />
In contrast to the old skd-cyclone, most scientific software is only available through software modules. Modules need to be loaded manually before the respective software can be used. We use software modules, because they provide are a clean and handy way to offer conflicting software or software versions: Instead of updating software and potentially breaking user scripts and programs new software is then made available in parallel to those that require it.<br />
<br />
=== Start-up scripts ===<br />
<br />
It might be handy to automatically load modules for software that you use frequently every time you login to cyclone. To accomplish that for bash, there are two relevant files, <code>$HOME/.bashrc</code> and <code>$HOME/.bash_profile</code> . <code>.bash_profile</code> should contain things that need to be defined at login time only, like <code>PATH</code> and other environment variables, startup programs, etc. You just need things once, not in every shell you open. In most cases, you also need the things from <code>.bashrc</code> in your login shell. That's why <code>.bash_profile</code> sources <code>.bashrc</code> as well, but .bashrc doesn't usually source <code>.bash_profile</code>. In contrast, <code>.bashrc</code> should typically contain things you want to set in every shell you open, like aliases, functions, etc. These are per shell session items that are not inherited from environment ([https://unix.stackexchange.com/questions/346336/why-have-both-bash-profile-and-bashrc source and detailed explanation]).<br />
<br />
==== An example <code>.bash_profile</code> for inspiration ====<br />
<br />
<pre>module load cdo/1.6.9<br />
module load ncarg/6.3.0-login<br />
<br />
alias rm="rm -i"<br />
alias cp="cp -i"<br />
alias erai="cd /Data/skd/share/Reanalysis/ERA_INTERIM/6HOURLY/"<br />
<br />
if [ -f ~/.bashrc ]; then<br />
. ~/.bashrc<br />
fi</pre><br />
<br />
==== An example <code>.bash_profile</code> for inspiration ====<br />
<br />
<pre>alias rm="rm -i"<br />
alias cp="cp -i"<br />
alias erai="cd /Data/skd/share/Reanalysis/ERA_INTERIM/6HOURLY/"</pre><br />
<br />
<br />
== Available software ==<br />
<br />
Below is a list of frequently used software and which module to load on the new cyclone. Relevant module names are printed like for <code>matlab/2015b</code>. Modules can be loaded by <code>module load <module name></code>, and unloaded <code>module unload <module name></code>. [[Using modules on cyclone|More details on the module system]].<br />
<br />
To list all available modules, use the command<br />
<pre>module avail</pre><br />
<br />
Please be aware that some of these modules will be specific to hexagon and it's cray architecture. Hence module names containing "cray" might not work on cyclone, although some exceptions are known to exist, see <code>netcdf</code> and <code>ncview</code>. Vice-versa, if the module name contains "foss", the module will be specific to cyclone and typically not work on hexagon.<br />
<br />
=== Data analysis and plotting ===<br />
<br />
* CDO<br />
*: <code>cdo</code>, <code>cdo/1.6.2</code><br />
* Dynlib<br />
*: See temporary solution for python. Requires in addition <code>OpenBLAS/0.3.1-GCC-7.3.0-2.30</code> and <code>ScaLAPACK/2.0.2-gompi-2018b-OpenBLAS-0.3.1</code>.<br />
* Matlab<br />
*: <code>matlab</code>, <code>matlab/2015b</code><br />
* NCL<br />
*: <code>ncarg</code>, <code>ncarg/6.0.0-login</code><br />
* nco<br />
*: <code>nco</code><br />
* ncview<br />
*: <code>ncview</code>, based on the <code>cray-netcdf</code> package.<br />
* python, plus selection of scientific packages<br />
*: Temporary solution, use one of the two below commands to enable the virtual environment:<br />
*: <code>source /Data/gfi/users/local/share/virtualenv/dynpie2/bin/activate</code> for python 2.7.<br />
*: <code>source /Data/gfi/users/local/share/virtualenv/dynpie2/bin/activate</code> for python 3.4.<br />
*: For the pygrib module, <code>grib_api/1.24.0-foss-2018b</code> is required in addition.<br />
* R<br />
*: <code>R</code>, <code>R/3.2.5</code><br />
<br />
=== Text editors ===<br />
<br />
* emacs<br />
*: <code>emacs</code><br />
* gedit<br />
*: ''<no module required>''<br />
* gvim<br />
*: ''<no module required>''<br />
* vi(m)<br />
*: ''<no module required>''<br />
<br />
=== Compilers and libraries ===<br />
<br />
* blas<br />
*: <code>OpenBLAS/0.3.1-GCC-7.3.0-2.30</code><br />
* gcc, gfortran<br />
*: <code>GCC</code>, <code>GCC/7.3.0-2.30</code>. '''Note the upper-case''' module name, there is also a small-case <code>gcc</code>.<br />
* grib_api<br />
*: <code>grib_api/1.24.0-foss-2018b</code><br />
* lapack<br />
*: <code>ScaLAPACK/2.0.2-gompi-2018b-OpenBLAS-0.3.1</code><br />
* netcdf<br />
*: netCDF libraries installed in the folder <code>/opt/cray/netcdf/4.4.1.1/GNU/5.1</code>. You'll hence need to include <code>-I/opt/cray/netcdf/4.4.1.1/GNU/5.1/include -L/opt/cray/netcdf/4.4.1.1/GNU/5.1/lib</code> in your compile command.<br />
<br />
== Accessing the data from your own machines ==<br />
<br />
Note: From your personal machines you will need to be connected to the UiB VPN to be able to mount the following network drives. <br />
<br />
On MacOS you can mount folders through <code>Finder > Go > Connect to Server ...</code>. In the dialogue window that pops up, enter<br />
<pre>smb://<user name>@leo.hpc.uib.no/gfi</pre><br />
as the '''Server Address'''. You might want to replace <code>gfi</code> by <code>skd</code> to access the skd disks if that is your primary affiliation.</div>Csp001http://gfi.wiki.uib.no/index.php?title=The_GFI_computing_system&diff=986The GFI computing system2018-09-29T13:52:56Z<p>Csp001: </p>
<hr />
<div>The Geophysical Institute has acquired a new computing system named '''cyclone.hpc.uib.no''' which replaces the system '''skd-cyclone.klientdrift.uib.no''' from Summer 2018.<br />
<br />
'''A detailed overview over the system [[:File:GFI_cyclone_overview.pdf|can be downloaded here as PDF presentation]].''' The following page contains the system specifications, users might instead want to learn [[Using cyclone]] or [[Using modules on cyclone]].<br />
<br />
Please notify the HPC support [mailto:support@hpc.uib.no support@hpc.uib.no] in any case of problems or questions.<br />
<br />
<br />
==Users==<br />
<br />
The intended users for this system are:<br />
<br />
* BSc students (coursework)<br />
<br />
* MSc students (coursework, thesis)<br />
<br />
* PhD students<br />
<br />
* researchers <br />
<br />
==Requirements==<br />
<br />
Users should be able to use the system in interactive use (klick and point, typing) and in batch use (using shell scripts). Typical tasks are data analysis, plotting. GFI will also run routine data processing of observations and forecasts on this system.<br />
<br />
Therefore, we required the system to be or have<br />
<br />
* low threshold access (easy to use)<br />
<br />
* interactive use<br />
<br />
* safe usage (against unintentional overuse)<br />
<br />
* optimized for serial I/O (as is typical for post-processing tasks)<br />
<br />
* single-node parallelisation jobs<br />
<br />
* lifetime of 5-7 years<br />
<br />
==Computing performance==<br />
<br />
The computing performance has been enhanced substantially: The new system is a Dell PowerEdge R740 Server configuration with the following characteristics:<br />
<br />
* Intel Xeon Gold 6140M, 18 cores, 72 threads, 2.3GHz, 25MB L3 cache<br />
<br />
* 1.5 TB DDR4-2666 memory<br />
<br />
* 2 NVIDIA Tesla GPU, 12 GB<br />
<br />
[[File:dell.jpg|400px]]<br />
<br />
==System characteristics==<br />
<br />
Here are the key facts about using the new system<br />
<br />
* For transition, you will need to recompile your code (if it is compiled code) for the operating system CentOS linux. This is the same operating system as on the UiB high-performace compute system Hexagon. <br />
<br />
* There is no queue system on the new cyclone. Users can submit to the hexagon queue from cyclone (acts as login node).<br />
<br />
* There is a 30-50% resource limitation per user. This will keep individual users from accidentally brining down the system.<br />
<br />
* Different software configurations cand be activated using the command module<br />
<br />
* Access to data storage will be maintained using existing paths, such as /Data/gfi.<br />
<br />
* The same and additional software packages are available (your suggestions?)<br />
<br />
* The system is maintained by the experts from UiB's HPC group. This should be an advantage for GFI.<br />
<br />
==GPU acceleration==<br />
<br />
The new cyclone is equipped with very advanced computing power. There are two Tesla P100 Graphics Processing Units (GPUs) build into the server. This will boost parallel computation power for software that can make use of this feature. Native programming languages, standard libraries, as well as Matlab and python can make use of GPU acceleration for compute operations. GFI is planning on offering courses to introduce to GPU programming.<br />
<br />
[[File:NVIDIA_GPU.jpg|400px]]<br />
<br />
Here are the facts about the GPU accelerators:<br />
<br />
* each Tesla P100 has 3584 cores<br />
<br />
* memory of 12 GB per GPU<br />
<br />
* both GPUs can also be used in combination<br />
<br />
* programming using CUDA, DirectCompute, OpenCL, OpenACC <br />
<br />
* some libraries are already optimized for GPU usage<br />
<br />
* first optimisation step are OpenACC compiler statements<br />
<br />
* bottleneck in GPU programming is to get data on/off the GPU</div>Csp001http://gfi.wiki.uib.no/index.php?title=Using_modules_on_cyclone&diff=985Using modules on cyclone2018-09-29T13:50:45Z<p>Csp001: </p>
<hr />
<div>== Using modules on cyclone==<br />
<br />
This page documents how to use Modulefiles on the Abel (HPC for UiO) and Colossus (HPC for TSD) clusters. Same procedure applies on cyclone. For some specific documentation on available modules refer to [[Using cyclone]].<br />
<br />
To simplify setting up environments for compilers, MPI-versions and some installed applications, the clusters have the [http://modules.sourceforge.net Environment Modules package] installed. This provides means for dynamic modification of a user's environment via modulefiles.<br />
<br />
Each modulefile contains the information needed to configure the shell for an environment. Typically, a modulefile modifies environment variables like PATH, MANPATH, LD_LIBRARY_PATH, CPATH and PKG_CONFIG_PATH to give access to an application or library.<br />
<br />
Modulefiles can be used from most shells, as well as Perl and Python. Modulefiles can be loaded/unloaded on the command line or within your scripts by typing:<br />
<br />
<code><br />
module load modulefile<br />
<br />
module unload modulefile<br />
</code><br />
<br />
(On Colossus, the module commands can only be used in job scripts.) You can also ask for a specific version of a modulefile:<br />
<br />
<code><br />
module load modulefile/version<br />
</code><br />
<br />
For the purpose of reproducability, we encourage users to load specific versions of modulefiles. Also, we recommend using<br />
<br />
<code><br />
module purge<br />
</code><br />
<br />
prior to any module load commands in job scripts, to prevent inheriting environment variables set by module commands in the shell used when submitting the job.<br />
<br />
The available modulefiles can be listed by module avail. Example output:<br />
<br />
<nowiki><br />
$ module avail <br />
------------------------ /usr/share/Modules/modulefiles -------------------------<br />
dot module-cvs module-info modules null use.own<br />
<br />
--------------------------- /cluster/etc/modulefiles ----------------------------<br />
454apps/2.8(default) mcmcphase/2.0(default)<br />
R/2.15.1(default) microbiomeutil/20110519(default)<br />
R/2.15.1.shlib migrate/3.3.2(default)<br />
abyss/1.3.4(default) mothur/1.26.0(default)<br />
adf/2010.02b(default) mrbayes/3.2.1(default)<br />
adf/2012.01b muscle/3.8.31(default)<br />
ampliconnoise/1.25(default) ncl/2.1.18(default)<br />
beagle/1.0(default) newbler/2.8(default)<br />
[...]<br />
</nowiki><br />
<br />
You can also specify a name:<br />
<br />
<nowiki><br />
$ module avail blast<br />
--------------------------- /cluster/etc/modulefiles ----------------------------<br />
blast/2.2.26(default) blast+/2.2.26(default)<br />
</nowiki><br />
<br />
You will get a list of current loaded modulefiles by<br />
<br />
<nowiki><br />
$ module list<br />
Currently Loaded Modulefiles:<br />
1) intel/2011.10 2) R/2.15.1<br />
</nowiki><br />
<br />
A help text exists for most of the modulefiles; to view it, type<br />
<br />
<code><br />
module help modulefile<br />
</code><br />
<br />
To view exactly what a modulefile is doing to your environment, type<br />
<br />
<code><br />
module show modulefile<br />
</code><br />
<br />
For further documentation, please refer to the [http://modules.sourceforge.net Environment Modules homepage]<br />
<br />
'''Personalize default modulefiles'''<br />
<br />
You may add loading of modulefiles to your .bash_profile file to make sure your favorite modulefile is always loaded when logging in. For instance, to always have the intel modulefile load on login, add:<br />
<br />
<code><br />
module load intel<br />
</code><br />
<br />
to the .bash_profile file.</div>Csp001http://gfi.wiki.uib.no/index.php?title=Using_cyclone&diff=984Using cyclone2018-09-29T13:48:40Z<p>Csp001: /* Accessing the data from your own machines */</p>
<hr />
<div>== Connection and first steps ==<br />
<br />
Use ssh to connect<br />
<pre>ssh -Y <username>@cyclone.hpc.uib.no</pre><br />
or just simply:<br />
<pre>ssh -Y cyclone.hpc.uib.no</pre><br />
if you're connecting from a computer where you are logged in under the same name. When you are connecting for the first time, you will be asked to verify a signature. Reply "yes" to this question.<br />
<br />
=== Home directories ===<br />
<br />
<code>cyclone.hpc.uib.no</code> shares home directories with the new hexagon cluster. These home directories are separate from your standard UiB home directory. The contents of your home directories will not be synced, so you will manually need to transfer your scripts to the new system.<br />
<br />
=== How to access software ===<br />
<br />
In contrast to the old skd-cyclone, most scientific software is only available through software modules. Modules need to be loaded manually before the respective software can be used. We use software modules, because they provide are a clean and handy way to offer conflicting software or software versions: Instead of updating software and potentially breaking user scripts and programs new software is then made available in parallel to those that require it.<br />
<br />
=== Start-up scripts ===<br />
<br />
It might be handy to automatically load modules for software that you use frequently every time you login to cyclone. To accomplish that for bash, there are two relevant files, <code>$HOME/.bashrc</code> and <code>$HOME/.bash_profile</code> . <code>.bash_profile</code> should contain things that need to be defined at login time only, like <code>PATH</code> and other environment variables, startup programs, etc. You just need things once, not in every shell you open. In most cases, you also need the things from <code>.bashrc</code> in your login shell. That's why <code>.bash_profile</code> sources <code>.bashrc</code> as well, but .bashrc doesn't usually source <code>.bash_profile</code>. In contrast, <code>.bashrc</code> should typically contain things you want to set in every shell you open, like aliases, functions, etc. These are per shell session items that are not inherited from environment ([https://unix.stackexchange.com/questions/346336/why-have-both-bash-profile-and-bashrc source and detailed explanation]).<br />
<br />
==== An example <code>.bash_profile</code> for inspiration ====<br />
<br />
<pre>module load cdo/1.6.9<br />
module load ncarg/6.3.0-login<br />
<br />
alias rm="rm -i"<br />
alias cp="cp -i"<br />
alias erai="cd /Data/skd/share/Reanalysis/ERA_INTERIM/6HOURLY/"<br />
<br />
if [ -f ~/.bashrc ]; then<br />
. ~/.bashrc<br />
fi</pre><br />
<br />
==== An example <code>.bash_profile</code> for inspiration ====<br />
<br />
<pre>alias rm="rm -i"<br />
alias cp="cp -i"<br />
alias erai="cd /Data/skd/share/Reanalysis/ERA_INTERIM/6HOURLY/"</pre><br />
<br />
<br />
== Available software ==<br />
<br />
Below is a list of frequently used software and which module to load on the new cyclone. Relevant module names are printed like for <code>matlab/2015b</code>. Modules can be loaded by <code>module load <module name></code>, and unloaded <code>module unload <module name></code>. [[Using modules on cyclone|More details on the module system]].<br />
<br />
To list all available modules, use the command<br />
<pre>module avail</pre><br />
<br />
Please be aware that many of these modules will be specific to hexagon and it's cray architecture. Hence module names containing "cray" will typically not work on cyclone. Vice-versa, if the module name contains "foss", the module will be specific to cyclone and typically not work on hexagon.<br />
<br />
=== Data analysis and plotting ===<br />
<br />
* CDO<br />
*: <code>cdo</code>, <code>cdo/1.6.2</code><br />
* Dynlib<br />
*: See temporary solution for python. Requires in addition <code>OpenBLAS/0.3.1-GCC-7.3.0-2.30</code> and <code>ScaLAPACK/2.0.2-gompi-2018b-OpenBLAS-0.3.1</code>.<br />
* Matlab<br />
*: <code>matlab</code>, <code>matlab/2015b</code><br />
* NCL<br />
*: <code>ncarg</code>, <code>ncarg/6.0.0-login</code><br />
* nco<br />
*: <code>nco</code><br />
* ncview<br />
*: <code>ncview</code><br />
* python, plus selection of scientific packages<br />
*: Temporary solution, use one of the two below commands to enable the virtual environment:<br />
*: <code>source /Data/gfi/users/local/share/virtualenv/dynpie2/bin/activate</code> for python 2.7.<br />
*: <code>source /Data/gfi/users/local/share/virtualenv/dynpie2/bin/activate</code> for python 3.4.<br />
*: For the pygrib module, <code>grib_api/1.24.0-foss-2018b</code> is required in addition.<br />
* R<br />
*: <code>R</code>, <code>R/3.2.5</code><br />
<br />
=== Text editors ===<br />
<br />
* emacs<br />
*: <code>emacs</code><br />
* gedit<br />
*: ''<no module required>''<br />
* gvim<br />
*: ''<no module required>''<br />
* vi(m)<br />
*: ''<no module required>''<br />
<br />
=== Compilers and libraries ===<br />
<br />
* blas<br />
*: <code>OpenBLAS/0.3.1-GCC-7.3.0-2.30</code><br />
* gcc, gfortran<br />
*: <code>GCC</code>, <code>GCC/7.3.0-2.30</code>. '''Note the upper-case''' module name, there is also a small-case <code>gcc</code>.<br />
* grib_api<br />
*: <code>grib_api/1.24.0-foss-2018b</code><br />
* lapack<br />
*: <code>ScaLAPACK/2.0.2-gompi-2018b-OpenBLAS-0.3.1</code><br />
* netcdf<br />
*: Temporary solution: netCDF libraries installed in the folder <code>/Data/gfi/users/local</code>.<br />
<br />
== Accessing the data from your own machines ==<br />
<br />
Note: From your personal machines you will need to be connected to the UiB VPN to be able to mount the following network drives. <br />
<br />
On MacOS you can mount folders through <code>Finder > Go > Connect to Server ...</code>. In the dialogue window that pops up, enter<br />
<pre>smb://<user name>@leo.hpc.uib.no/gfi</pre><br />
as the '''Server Address'''. You might want to replace <code>gfi</code> by <code>skd</code> to access the skd disks if that is your primary affiliation.</div>Csp001http://gfi.wiki.uib.no/index.php?title=Using_cyclone&diff=983Using cyclone2018-09-29T13:41:45Z<p>Csp001: /* Available software */</p>
<hr />
<div>== Connection and first steps ==<br />
<br />
Use ssh to connect<br />
<pre>ssh -Y <username>@cyclone.hpc.uib.no</pre><br />
or just simply:<br />
<pre>ssh -Y cyclone.hpc.uib.no</pre><br />
if you're connecting from a computer where you are logged in under the same name. When you are connecting for the first time, you will be asked to verify a signature. Reply "yes" to this question.<br />
<br />
=== Home directories ===<br />
<br />
<code>cyclone.hpc.uib.no</code> shares home directories with the new hexagon cluster. These home directories are separate from your standard UiB home directory. The contents of your home directories will not be synced, so you will manually need to transfer your scripts to the new system.<br />
<br />
=== How to access software ===<br />
<br />
In contrast to the old skd-cyclone, most scientific software is only available through software modules. Modules need to be loaded manually before the respective software can be used. We use software modules, because they provide are a clean and handy way to offer conflicting software or software versions: Instead of updating software and potentially breaking user scripts and programs new software is then made available in parallel to those that require it.<br />
<br />
=== Start-up scripts ===<br />
<br />
It might be handy to automatically load modules for software that you use frequently every time you login to cyclone. To accomplish that for bash, there are two relevant files, <code>$HOME/.bashrc</code> and <code>$HOME/.bash_profile</code> . <code>.bash_profile</code> should contain things that need to be defined at login time only, like <code>PATH</code> and other environment variables, startup programs, etc. You just need things once, not in every shell you open. In most cases, you also need the things from <code>.bashrc</code> in your login shell. That's why <code>.bash_profile</code> sources <code>.bashrc</code> as well, but .bashrc doesn't usually source <code>.bash_profile</code>. In contrast, <code>.bashrc</code> should typically contain things you want to set in every shell you open, like aliases, functions, etc. These are per shell session items that are not inherited from environment ([https://unix.stackexchange.com/questions/346336/why-have-both-bash-profile-and-bashrc source and detailed explanation]).<br />
<br />
==== An example <code>.bash_profile</code> for inspiration ====<br />
<br />
<pre>module load cdo/1.6.9<br />
module load ncarg/6.3.0-login<br />
<br />
alias rm="rm -i"<br />
alias cp="cp -i"<br />
alias erai="cd /Data/skd/share/Reanalysis/ERA_INTERIM/6HOURLY/"<br />
<br />
if [ -f ~/.bashrc ]; then<br />
. ~/.bashrc<br />
fi</pre><br />
<br />
==== An example <code>.bash_profile</code> for inspiration ====<br />
<br />
<pre>alias rm="rm -i"<br />
alias cp="cp -i"<br />
alias erai="cd /Data/skd/share/Reanalysis/ERA_INTERIM/6HOURLY/"</pre><br />
<br />
<br />
== Available software ==<br />
<br />
Below is a list of frequently used software and which module to load on the new cyclone. Relevant module names are printed like for <code>matlab/2015b</code>. Modules can be loaded by <code>module load <module name></code>, and unloaded <code>module unload <module name></code>. [[Using modules on cyclone|More details on the module system]].<br />
<br />
To list all available modules, use the command<br />
<pre>module avail</pre><br />
<br />
Please be aware that many of these modules will be specific to hexagon and it's cray architecture. Hence module names containing "cray" will typically not work on cyclone. Vice-versa, if the module name contains "foss", the module will be specific to cyclone and typically not work on hexagon.<br />
<br />
=== Data analysis and plotting ===<br />
<br />
* CDO<br />
*: <code>cdo</code>, <code>cdo/1.6.2</code><br />
* Dynlib<br />
*: See temporary solution for python. Requires in addition <code>OpenBLAS/0.3.1-GCC-7.3.0-2.30</code> and <code>ScaLAPACK/2.0.2-gompi-2018b-OpenBLAS-0.3.1</code>.<br />
* Matlab<br />
*: <code>matlab</code>, <code>matlab/2015b</code><br />
* NCL<br />
*: <code>ncarg</code>, <code>ncarg/6.0.0-login</code><br />
* nco<br />
*: <code>nco</code><br />
* ncview<br />
*: <code>ncview</code><br />
* python, plus selection of scientific packages<br />
*: Temporary solution, use one of the two below commands to enable the virtual environment:<br />
*: <code>source /Data/gfi/users/local/share/virtualenv/dynpie2/bin/activate</code> for python 2.7.<br />
*: <code>source /Data/gfi/users/local/share/virtualenv/dynpie2/bin/activate</code> for python 3.4.<br />
*: For the pygrib module, <code>grib_api/1.24.0-foss-2018b</code> is required in addition.<br />
* R<br />
*: <code>R</code>, <code>R/3.2.5</code><br />
<br />
=== Text editors ===<br />
<br />
* emacs<br />
*: <code>emacs</code><br />
* gedit<br />
*: ''<no module required>''<br />
* gvim<br />
*: ''<no module required>''<br />
* vi(m)<br />
*: ''<no module required>''<br />
<br />
=== Compilers and libraries ===<br />
<br />
* blas<br />
*: <code>OpenBLAS/0.3.1-GCC-7.3.0-2.30</code><br />
* gcc, gfortran<br />
*: <code>GCC</code>, <code>GCC/7.3.0-2.30</code>. '''Note the upper-case''' module name, there is also a small-case <code>gcc</code>.<br />
* grib_api<br />
*: <code>grib_api/1.24.0-foss-2018b</code><br />
* lapack<br />
*: <code>ScaLAPACK/2.0.2-gompi-2018b-OpenBLAS-0.3.1</code><br />
* netcdf<br />
*: Temporary solution: netCDF libraries installed in the folder <code>/Data/gfi/users/local</code>.<br />
<br />
== Accessing the data from your own machines ==</div>Csp001http://gfi.wiki.uib.no/index.php?title=Using_cyclone&diff=982Using cyclone2018-09-29T13:12:23Z<p>Csp001: </p>
<hr />
<div>== Connection and first steps ==<br />
<br />
Use ssh to connect<br />
<pre>ssh -Y <username>@cyclone.hpc.uib.no</pre><br />
or just simply:<br />
<pre>ssh -Y cyclone.hpc.uib.no</pre><br />
if you're connecting from a computer where you are logged in under the same name. When you are connecting for the first time, you will be asked to verify a signature. Reply "yes" to this question.<br />
<br />
=== Home directories ===<br />
<br />
<code>cyclone.hpc.uib.no</code> shares home directories with the new hexagon cluster. These home directories are separate from your standard UiB home directory. The contents of your home directories will not be synced, so you will manually need to transfer your scripts to the new system.<br />
<br />
=== How to access software ===<br />
<br />
In contrast to the old skd-cyclone, most scientific software is only available through software modules. Modules need to be loaded manually before the respective software can be used. We use software modules, because they provide are a clean and handy way to offer conflicting software or software versions: Instead of updating software and potentially breaking user scripts and programs new software is then made available in parallel to those that require it.<br />
<br />
=== Start-up scripts ===<br />
<br />
It might be handy to automatically load modules for software that you use frequently every time you login to cyclone. To accomplish that for bash, there are two relevant files, <code>$HOME/.bashrc</code> and <code>$HOME/.bash_profile</code> . <code>.bash_profile</code> should contain things that need to be defined at login time only, like <code>PATH</code> and other environment variables, startup programs, etc. You just need things once, not in every shell you open. In most cases, you also need the things from <code>.bashrc</code> in your login shell. That's why <code>.bash_profile</code> sources <code>.bashrc</code> as well, but .bashrc doesn't usually source <code>.bash_profile</code>. In contrast, <code>.bashrc</code> should typically contain things you want to set in every shell you open, like aliases, functions, etc. These are per shell session items that are not inherited from environment ([https://unix.stackexchange.com/questions/346336/why-have-both-bash-profile-and-bashrc source and detailed explanation]).<br />
<br />
==== An example <code>.bash_profile</code> for inspiration ====<br />
<br />
<pre>module load cdo/1.6.9<br />
module load ncarg/6.3.0-login<br />
<br />
alias rm="rm -i"<br />
alias cp="cp -i"<br />
alias erai="cd /Data/skd/share/Reanalysis/ERA_INTERIM/6HOURLY/"<br />
<br />
if [ -f ~/.bashrc ]; then<br />
. ~/.bashrc<br />
fi</pre><br />
<br />
==== An example <code>.bash_profile</code> for inspiration ====<br />
<br />
<pre>alias rm="rm -i"<br />
alias cp="cp -i"<br />
alias erai="cd /Data/skd/share/Reanalysis/ERA_INTERIM/6HOURLY/"</pre><br />
<br />
<br />
== Available software ==<br />
<br />
=== Data analysis and plotting ===<br />
<br />
=== Text editors ===<br />
<br />
=== Compilers and libraries ===<br />
<br />
<br />
<br />
== Accessing the data from your own machines ==</div>Csp001http://gfi.wiki.uib.no/index.php?title=Using_cyclone&diff=981Using cyclone2018-09-29T13:09:49Z<p>Csp001: Created page with "== Connection and first steps == Use ssh to connect <pre>ssh -Y <username>@cyclone.hpc.uib.no</pre> or just simply: <pre>ssh -Y cyclone.hpc.uib.no</pre> if you're connecting..."</p>
<hr />
<div>== Connection and first steps ==<br />
<br />
Use ssh to connect<br />
<pre>ssh -Y <username>@cyclone.hpc.uib.no</pre><br />
or just simply:<br />
<pre>ssh -Y cyclone.hpc.uib.no</pre><br />
if you're connecting from a computer where you are logged in under the same name. When you are connecting for the first time, you will be asked to verify a signature. Reply "yes" to this question.<br />
<br />
=== Home directories ===<br />
<br />
<code>cyclone.hpc.uib.no</code> shares home directories with the new hexagon cluster. These home directories are separate from your standard UiB home directory. The contents of your home directories will not be synced, so you will manually need to transfer your scripts to the new system.<br />
<br />
=== How to access software ===<br />
<br />
In contrast to the old skd-cyclone, most scientific software is only available through software modules. Modules need to be loaded manually before the respective software can be used. We use software modules, because they provide are a clean and handy way to offer conflicting software or software versions: Instead of updating software and potentially breaking user scripts and programs new software is then made available in parallel to those that require it.<br />
<br />
=== Start-up scripts ===<br />
<br />
It might be handy to automatically load modules for software that you use frequently every time you login to cyclone. To accomplish that for bash, there are two relevant files, <code>$HOME/.bashrc</code> and <code>$HOME/.bash_profile</code> . <code>.bash_profile</code> should contain things that need to be defined at login time only, like <code>PATH</code> and other environment variables, startup programs, etc. You just need things once, not in every shell you open. In most cases, you also need the things from <code>.bashrc</code> in your login shell. That's why <code>.bash_profile</code> sources <code>.bashrc</code> as well, but .bashrc doesn't usually source <code>.bash_profile</code>. In contrast, <code>.bashrc</code> should typically contain things you want to set in every shell you open, like aliases, functions, etc. These are per shell session items that are not inherited from environment ([https://unix.stackexchange.com/questions/346336/why-have-both-bash-profile-and-bashrc source and detailed explanation]).<br />
<br />
<br />
== Available software ==<br />
<br />
=== Data analysis and plotting ===<br />
<br />
=== Text editors ===<br />
<br />
=== Compilers and libraries ===<br />
<br />
<br />
<br />
== Accessing the data from your own machines ==</div>Csp001http://gfi.wiki.uib.no/index.php?title=Main_Page&diff=980Main Page2018-09-29T12:45:05Z<p>Csp001: /* IT */</p>
<hr />
<div>== Geophysical Institute ==<br />
<br />
[[File:GFI.jpg]]<br />
<br />
==Research and PhD/Postdoc Groups==<br />
===[[Meteorology]]===<br />
===[[ResClim Bergen subgroup]]===<br />
<br />
==IT==<br />
===[[The GFI computing system]]===<br />
===[[Using cyclone]]===<br />
===[[Using modules on cyclone]]===<br />
===[[Bedymo]]===<br />
===[[Dynlib]]===<br />
===[[Forecast plotting]]===<br />
===[[Git]]===<br />
===[[NCL]]===<br />
===[[Python]]===<br />
===[[WRF]]===<br />
===[[WaterSip]]===<br />
===[[Using the queue system on skd-cyclone]]===<br />
<br />
==Social Activities and Groups==<br />
===[[Football]]===<br />
===[[Gale Brewing Club]]===<br />
===[[Geosupen]]===<br />
===[[GFI-social]]===<br />
===[[Kakeklubben]]===<br />
===[[Music]]===<br />
===[[PhD Forum]]===<br />
===[[Schafkopf]]===<br />
===[[Volleyball]]===<br />
<br />
[[Category:IT]]</div>Csp001http://gfi.wiki.uib.no/index.php?title=Dynlib_utils_functions&diff=843Dynlib utils functions2017-09-18T14:14:46Z<p>Csp001: Outdated and obsolete, to be deleted.</p>
<hr />
<div>{{db-author}}</div>Csp001http://gfi.wiki.uib.no/index.php?title=Dynlib_diag_functions&diff=842Dynlib diag functions2017-09-18T14:14:08Z<p>Csp001: Outdated and obsolete, to be deleted.</p>
<hr />
<div>{{db-author}}</div>Csp001http://gfi.wiki.uib.no/index.php?title=Dynlib_derivatives_functions&diff=841Dynlib derivatives functions2017-09-18T14:13:22Z<p>Csp001: Outdated and obsolete, to be deleted.</p>
<hr />
<div>{{db-author}}</div>Csp001http://gfi.wiki.uib.no/index.php?title=Git&diff=840Git2017-09-18T14:09:45Z<p>Csp001: Updated paths</p>
<hr />
<div>The development of [[Bedymo]] and [[Dynlib]] is coordinated with the version control system [http://git-scm.com git]. git is a ''distributed'' version control system in that there is no central repository required, as would be for older systems like [http://subversion.apache.org/ svn (subversion)] or [http://cvs.nongnu.org/ cvs]. Any central repository is only central by ''convention''.<br />
<br />
== Background ==<br />
<br />
=== Common ideas behind all version control systems ===<br />
<br />
All version control systems store the history of a set of files and directories in a '''repository''', and are able to restore the file as it used to be in a previous version. In addition to the actual changes in the file(s) all systems also keep meta-information like the editing user, the date and time of the changes as well as a small description of the changes. The development of the project is tracked through '''commits''', which creates and stores a new '''version''' or '''revision''' of all changed files.<br />
<br />
=== Distributed version control ===<br />
<br />
In a distributed version control system like git, there is no central repository. Every copy of the repository is technically equal, and is equally able to crate new '''versions'''. In a non-distributed version control system, only the central repository residing on a (publicly available) server is able to create new versions. Hence, you need connection to that server to be able to commit changes.<br />
<br />
=== Advantages of distributed version control ===<br />
<br />
Apart from the ability to track changes and view the entire history of the project also when offline (on a cruise, plane, conference or summer school with limited connectivity) the main advantage of distributed version control systems lies in the flexibility of the work flow, which can be easily setup to match the work groups inner workings: Often several people work on the same tool or model, but develop in different directions. Using the setup suggested below those people can still share bug fixes easily and merge there developments in the end.<br />
<br />
=== Disadvantages of distributed version control ===<br />
<br />
The added flexibility of a distributed system comes at the cost of loosing an intuitive way to address the different revisions. Using a central repository, one simply increases an internal revision counter, such that revision 765 supersedes revision 764. Without a central repository there is noone that could assign those kind of numbers. git uses the SHA1-hash of the commited files as an identifier for the revision, e.g. something like <code>bbe0e301cb39b597a49b3819ccf8b0d08d817d2e</code>. One need however only type the first couple of symbols until the identifier becomes unique. In this example taken from dynlib, <code>bbe0</code> is enough to uniquely identify the revision. In addition one can always manually assign human-friendlier names such as <code>gamma-0.4.2</code> for the above revision.<br />
<br />
== Usage for [[Bedymo]] and [[Dynlib]] ==<br />
<br />
All instructions are shown here for dynlib. The setup for bedymo is indentical, so that you need only replace dynlib by bedymo to obtain the corresponding command for bedymo.<br />
<br />
=== Obtaining dynlib ===<br />
<br />
# The official source code repository resides a shared user directory. The <code>clone</code> command copies the entire repository into a dynlib folder in your current working directory.<br />
#:<code>git clone /Data/gfi/users/local/src/dynlib.git</code><br />
# Change into the dynlib folder.<br />
#:<code>cd dynlib</code><br />
# Compile the library.<br />
#:<code>./compile</code><br />
<br />
=== Updating dynlib ===<br />
<br />
# The repository you cloned from is saved in the git configuration as <code>origin</code> designating your ''source repository''. That's where the following command fetches updates from.<br />
#:<code>git pull</code><br />
# Re-Compile the library.<br />
#:<code>./compile</code><br />
<br />
=== Fetching updates by some other user ===<br />
<br />
Let's assume the user <code>tsp065</code> has coded some very interesting routines that have however not yet found thier way in the official respository. <br />
#Then, if <code>tsp065</code> followed the instructions in the [[#Developing dynlib]] section, you can add Thomas' repository as one of your ''remote repositories'' by<br />
#:<code>git remote add thomas /Data/gfi/users/local/src/dynlib_tsp065.git</code><br />
#:The name <code>thomas</code> is an aribtrary name for the remote repository. <br />
# Then you can fetch updates from Thomas' respository just like from the official one.<br />
#:<code>git pull thomas</code><br />
# Re-Compile the library.<br />
#:<code>./compile</code><br />
<br />
== Developing Bedymo and Dynlib ==<br />
<br />
=== Locally saving your changes ===<br />
<br />
Suppose you have edited some of the Fortran95 source code files, and want to save and share them.<br />
# Then first you have to commit the new version into your local development repository.<br />
#:<code>git commit -a</code><br />
#:Give a sensible and brief description of your changes in the editor that is opened (automatically)<br />
<br />
=== Setup of your personal publicly shared repository ===<br />
<br />
# Creating a ''bare'' repository for sharing.<br />
#:<code>git clone --bare . /Data/gfi/users/local/src/dynlib_<your-ID>.git</code><br />
# It is convenient to again setup a named ''remote repository''. <br />
#:<code>git remote add own /Data/gfi/users/local/src/dynlib_<your-ID>.git</code><br />
<br />
=== Sharing your changes ===<br />
<br />
# Then you have to ''push'' your new version to a repository that other people can read.<br />
#:<code>git push own</code><br />
<br />
== More information ==<br />
<br />
# [http://git-scm.com/book The git book]</div>Csp001http://gfi.wiki.uib.no/index.php?title=Dynlib&diff=839Dynlib2017-09-18T14:04:59Z<p>Csp001: /* Obtaining dynlib */</p>
<hr />
<div>== [http://folk.uib.no/csp001/dynlib_doc/ Documentation] ==<br />
<br />
The steps necessary to obtain dynlib are described below. A more thorough documentation is compiled in [http://folk.uib.no/csp001/dynlib_doc/ the main documentation website].<br />
<br />
== Use the centrally installed dynlib ==<br />
<br />
Dynlib is installed centrally for python 2.7 and python 3.4 in the python environments at <code>/Data/gfi/users/local/share/virtualenv/dynpie2</code> and <code>/Data/gfi/users/local/share/virtualenv/dynpie3</code>. You'll only have to activate one of these python enviroments to start using dynlib:<br />
<pre>source /Data/gfi/users/local/share/virtualenv/dynpieX/bin/activate</pre><br />
In this command <code>X=2</code> for python 2.7 and <code>X=3</code> for python 3.4. For convenience add this command to your <code>~/.bash_profile</code> to activate the respective python environment automatically at each login.<br />
<br />
'''Note''': For some types of login <code>.bash_profile</code> is not taken into account. In case you'll experience problems create a symbolic link <code>~/.bashrc</code> to point to the <code>~/.bash_profile</code> and re-login.<br />
<br />
== Quick start to developing with dynlib ==<br />
<br />
The following procedure is only necessary if you want to start developing dynlib further, for example if you want to add your own functions to dynlib. If you only want to use dynlib, the procedure in the above section is all you need.<br />
<br />
=== Obtaining dynlib ===<br />
<br />
# Copying the source code repository<br />
#:<code>$ git clone /Data/gfi/users/local/src/dynlib.git</code><br />
#:To clone the repository to your laptop or any machine outside the UiB network, use<br />
#:<code>$ git clone <username>@login.uib.no:/Data/gfi/users/local/src/dynlib.git</code><br />
# Change into the dynlib folder<br />
#:<code>$ cd dynlib</code><br />
# Compile the library<br />
#:<code>$ ./compile</code><br />
# (known broken right now) Make sure everything works as expected <br />
#:<code>$ ./test</code><br />
# To use your personal development version of dynlib instead of the centrally installed one, create a symlink in your scripts folder that points to the development version<br />
#:<code><in script folder>$ ln -s <path-to-dynlib>/lib dynlib</code><br />
Happy developing!<br />
<br />
=== Editing the Fortran code ===<br />
<br />
The fortran code lives in <code>lib/fortran</code> directory. At the moment there are 16 source code files<br /><br />
<nowiki>$ ls *.f90<br />
config.f90 detect_lines.f90 ellipse.f90 stat.f90<br />
const.f90 detect_rwb_contour.f90 interpol.f90 tend.f90<br />
derivatives.f90 diag.f90 kind.f90 thermodyn.f90<br />
detect.f90 diag_tend.f90 sphere.f90 utils.f90</nowiki><br />
The most important are <code>diag.f90</code> which contains subroutines that calculate various diagnostics, and <code>detect.f90</code> which contains feature detection algorithms. Changed Fortran sources need to be recompiled, again using <br />
:<code>$ ./compile</code><br />
<br />
=== [[git|Version control]] ===<br />
<br />
The changes you made to the source code files can be listed by<br />
:<code>$ git status</code><br />
or viewed in detailed diff-comparisons by<br />
:<code>$ git diff</code><br />
or for one file only<br />
:<code>$ git diff <filename></code><br />
<br />
In case you want to undo your changes, you can revert any file to the last committed version by<br />
:<code>git checkout <filename></code><br />
<br />
Commit your changes from time to time and give a sensible and brief description of your changes in the editor that is opened (automatically)<br />
:<code>$ git commit -a</code><br />
The commit is then stored in your copy of the source code repository, but not yet available for others, which allows you to also commit work-in-progress.<br />
<br />
A more thorough introduction to the version control system is given [[git|here]] or on the [http://git-scm.com/book official documentation].<br />
<br />
=== Using the Fortran functions ===<br />
<br />
An example python script which calculates deformation using the Fortran function is provided in the [http://folk.uib.no/csp001/dynlib_doc/examples.html documentation].<br />
<br />
== Dynlib functions ==<br />
<br />
The functions are classified into different categories. All functions and categories listed in the [http://folk.uib.no/csp001/dynlib_doc/apidoc.html API documentation].<br />
<br />
[[Category:Dynlib]]<br />
[[Category:Libraries]]</div>Csp001http://gfi.wiki.uib.no/index.php?title=Dynlib&diff=838Dynlib2017-09-18T14:04:15Z<p>Csp001: /* Obtaining dynlib */</p>
<hr />
<div>== [http://folk.uib.no/csp001/dynlib_doc/ Documentation] ==<br />
<br />
The steps necessary to obtain dynlib are described below. A more thorough documentation is compiled in [http://folk.uib.no/csp001/dynlib_doc/ the main documentation website].<br />
<br />
== Use the centrally installed dynlib ==<br />
<br />
Dynlib is installed centrally for python 2.7 and python 3.4 in the python environments at <code>/Data/gfi/users/local/share/virtualenv/dynpie2</code> and <code>/Data/gfi/users/local/share/virtualenv/dynpie3</code>. You'll only have to activate one of these python enviroments to start using dynlib:<br />
<pre>source /Data/gfi/users/local/share/virtualenv/dynpieX/bin/activate</pre><br />
In this command <code>X=2</code> for python 2.7 and <code>X=3</code> for python 3.4. For convenience add this command to your <code>~/.bash_profile</code> to activate the respective python environment automatically at each login.<br />
<br />
'''Note''': For some types of login <code>.bash_profile</code> is not taken into account. In case you'll experience problems create a symbolic link <code>~/.bashrc</code> to point to the <code>~/.bash_profile</code> and re-login.<br />
<br />
== Quick start to developing with dynlib ==<br />
<br />
The following procedure is only necessary if you want to start developing dynlib further, for example if you want to add your own functions to dynlib. If you only want to use dynlib, the procedure in the above section is all you need.<br />
<br />
=== Obtaining dynlib ===<br />
<br />
# Copying the source code repository<br />
#:<code>$ git clone /Data/gfi/users/local/src/dynlib.git</code><br />
#:To clone the repository to your laptop or any machine outside the UiB network, use<br />
#:<code>$ git clone <username>@login.uib.no:/Data/gfi/users/local/src/dynlib.git</code><br />
# Change into the dynlib folder<br />
#:<code>$ cd dynlib</code><br />
# Compile the library<br />
#:<code>$ ./compile</code><br />
# (known broken right now) Make sure everything works as expected <br />
#:<code>$ ./test</code><br />
# To use your personal development version of dynlib instead of the centrally installed one, create a symlink in your scripts folder that points to the development version<br />
#:<code><in script folder>$ ln -s <path-to-dynlib>/lib dynlib<br />
Happy developing!<br />
<br />
=== Editing the Fortran code ===<br />
<br />
The fortran code lives in <code>lib/fortran</code> directory. At the moment there are 16 source code files<br /><br />
<nowiki>$ ls *.f90<br />
config.f90 detect_lines.f90 ellipse.f90 stat.f90<br />
const.f90 detect_rwb_contour.f90 interpol.f90 tend.f90<br />
derivatives.f90 diag.f90 kind.f90 thermodyn.f90<br />
detect.f90 diag_tend.f90 sphere.f90 utils.f90</nowiki><br />
The most important are <code>diag.f90</code> which contains subroutines that calculate various diagnostics, and <code>detect.f90</code> which contains feature detection algorithms. Changed Fortran sources need to be recompiled, again using <br />
:<code>$ ./compile</code><br />
<br />
=== [[git|Version control]] ===<br />
<br />
The changes you made to the source code files can be listed by<br />
:<code>$ git status</code><br />
or viewed in detailed diff-comparisons by<br />
:<code>$ git diff</code><br />
or for one file only<br />
:<code>$ git diff <filename></code><br />
<br />
In case you want to undo your changes, you can revert any file to the last committed version by<br />
:<code>git checkout <filename></code><br />
<br />
Commit your changes from time to time and give a sensible and brief description of your changes in the editor that is opened (automatically)<br />
:<code>$ git commit -a</code><br />
The commit is then stored in your copy of the source code repository, but not yet available for others, which allows you to also commit work-in-progress.<br />
<br />
A more thorough introduction to the version control system is given [[git|here]] or on the [http://git-scm.com/book official documentation].<br />
<br />
=== Using the Fortran functions ===<br />
<br />
An example python script which calculates deformation using the Fortran function is provided in the [http://folk.uib.no/csp001/dynlib_doc/examples.html documentation].<br />
<br />
== Dynlib functions ==<br />
<br />
The functions are classified into different categories. All functions and categories listed in the [http://folk.uib.no/csp001/dynlib_doc/apidoc.html API documentation].<br />
<br />
[[Category:Dynlib]]<br />
[[Category:Libraries]]</div>Csp001http://gfi.wiki.uib.no/index.php?title=Dynlib&diff=837Dynlib2017-09-18T14:00:38Z<p>Csp001: /* Using the Fortran functions */</p>
<hr />
<div>== [http://folk.uib.no/csp001/dynlib_doc/ Documentation] ==<br />
<br />
The steps necessary to obtain dynlib are described below. A more thorough documentation is compiled in [http://folk.uib.no/csp001/dynlib_doc/ the main documentation website].<br />
<br />
== Use the centrally installed dynlib ==<br />
<br />
Dynlib is installed centrally for python 2.7 and python 3.4 in the python environments at <code>/Data/gfi/users/local/share/virtualenv/dynpie2</code> and <code>/Data/gfi/users/local/share/virtualenv/dynpie3</code>. You'll only have to activate one of these python enviroments to start using dynlib:<br />
<pre>source /Data/gfi/users/local/share/virtualenv/dynpieX/bin/activate</pre><br />
In this command <code>X=2</code> for python 2.7 and <code>X=3</code> for python 3.4. For convenience add this command to your <code>~/.bash_profile</code> to activate the respective python environment automatically at each login.<br />
<br />
'''Note''': For some types of login <code>.bash_profile</code> is not taken into account. In case you'll experience problems create a symbolic link <code>~/.bashrc</code> to point to the <code>~/.bash_profile</code> and re-login.<br />
<br />
== Quick start to developing with dynlib ==<br />
<br />
The following procedure is only necessary if you want to start developing dynlib further, for example if you want to add your own functions to dynlib. If you only want to use dynlib, the procedure in the above section is all you need.<br />
<br />
=== Obtaining dynlib ===<br />
<br />
# Create a new folder for the project that'll use dynlib, and go into that directory.<br />
#:<code>$ mkdir <project-name></code><br />
#:<code>$ cd <project-name></code><br />
# Copying the source code repository<br />
#:<code>$ git clone /Data/gfi/users/local/src/dynlib.git</code><br />
#:To clone the repository to your laptop or any machine outside the UiB network, use<br />
#:<code>$ git clone <username>@login.uib.no:/Data/gfi/users/local/src/dynlib.git</code><br />
# Change into the dynlib folder<br />
#:<code>$ cd dynlib</code><br />
# Compile the library<br />
#:<code>$ ./compile</code><br />
# (known broken right now) Make sure everything works as expected <br />
#:<code>$ ./test</code><br />
Happy developing!<br />
<br />
=== Editing the Fortran code ===<br />
<br />
The fortran code lives in <code>lib/fortran</code> directory. At the moment there are 16 source code files<br /><br />
<nowiki>$ ls *.f90<br />
config.f90 detect_lines.f90 ellipse.f90 stat.f90<br />
const.f90 detect_rwb_contour.f90 interpol.f90 tend.f90<br />
derivatives.f90 diag.f90 kind.f90 thermodyn.f90<br />
detect.f90 diag_tend.f90 sphere.f90 utils.f90</nowiki><br />
The most important are <code>diag.f90</code> which contains subroutines that calculate various diagnostics, and <code>detect.f90</code> which contains feature detection algorithms. Changed Fortran sources need to be recompiled, again using <br />
:<code>$ ./compile</code><br />
<br />
=== [[git|Version control]] ===<br />
<br />
The changes you made to the source code files can be listed by<br />
:<code>$ git status</code><br />
or viewed in detailed diff-comparisons by<br />
:<code>$ git diff</code><br />
or for one file only<br />
:<code>$ git diff <filename></code><br />
<br />
In case you want to undo your changes, you can revert any file to the last committed version by<br />
:<code>git checkout <filename></code><br />
<br />
Commit your changes from time to time and give a sensible and brief description of your changes in the editor that is opened (automatically)<br />
:<code>$ git commit -a</code><br />
The commit is then stored in your copy of the source code repository, but not yet available for others, which allows you to also commit work-in-progress.<br />
<br />
A more thorough introduction to the version control system is given [[git|here]] or on the [http://git-scm.com/book official documentation].<br />
<br />
=== Using the Fortran functions ===<br />
<br />
An example python script which calculates deformation using the Fortran function is provided in the [http://folk.uib.no/csp001/dynlib_doc/examples.html documentation].<br />
<br />
== Dynlib functions ==<br />
<br />
The functions are classified into different categories. All functions and categories listed in the [http://folk.uib.no/csp001/dynlib_doc/apidoc.html API documentation].<br />
<br />
[[Category:Dynlib]]<br />
[[Category:Libraries]]</div>Csp001http://gfi.wiki.uib.no/index.php?title=Dynlib&diff=836Dynlib2017-09-18T13:59:18Z<p>Csp001: /* Editing the Fortran code */</p>
<hr />
<div>== [http://folk.uib.no/csp001/dynlib_doc/ Documentation] ==<br />
<br />
The steps necessary to obtain dynlib are described below. A more thorough documentation is compiled in [http://folk.uib.no/csp001/dynlib_doc/ the main documentation website].<br />
<br />
== Use the centrally installed dynlib ==<br />
<br />
Dynlib is installed centrally for python 2.7 and python 3.4 in the python environments at <code>/Data/gfi/users/local/share/virtualenv/dynpie2</code> and <code>/Data/gfi/users/local/share/virtualenv/dynpie3</code>. You'll only have to activate one of these python enviroments to start using dynlib:<br />
<pre>source /Data/gfi/users/local/share/virtualenv/dynpieX/bin/activate</pre><br />
In this command <code>X=2</code> for python 2.7 and <code>X=3</code> for python 3.4. For convenience add this command to your <code>~/.bash_profile</code> to activate the respective python environment automatically at each login.<br />
<br />
'''Note''': For some types of login <code>.bash_profile</code> is not taken into account. In case you'll experience problems create a symbolic link <code>~/.bashrc</code> to point to the <code>~/.bash_profile</code> and re-login.<br />
<br />
== Quick start to developing with dynlib ==<br />
<br />
The following procedure is only necessary if you want to start developing dynlib further, for example if you want to add your own functions to dynlib. If you only want to use dynlib, the procedure in the above section is all you need.<br />
<br />
=== Obtaining dynlib ===<br />
<br />
# Create a new folder for the project that'll use dynlib, and go into that directory.<br />
#:<code>$ mkdir <project-name></code><br />
#:<code>$ cd <project-name></code><br />
# Copying the source code repository<br />
#:<code>$ git clone /Data/gfi/users/local/src/dynlib.git</code><br />
#:To clone the repository to your laptop or any machine outside the UiB network, use<br />
#:<code>$ git clone <username>@login.uib.no:/Data/gfi/users/local/src/dynlib.git</code><br />
# Change into the dynlib folder<br />
#:<code>$ cd dynlib</code><br />
# Compile the library<br />
#:<code>$ ./compile</code><br />
# (known broken right now) Make sure everything works as expected <br />
#:<code>$ ./test</code><br />
Happy developing!<br />
<br />
=== Editing the Fortran code ===<br />
<br />
The fortran code lives in <code>lib/fortran</code> directory. At the moment there are 16 source code files<br /><br />
<nowiki>$ ls *.f90<br />
config.f90 detect_lines.f90 ellipse.f90 stat.f90<br />
const.f90 detect_rwb_contour.f90 interpol.f90 tend.f90<br />
derivatives.f90 diag.f90 kind.f90 thermodyn.f90<br />
detect.f90 diag_tend.f90 sphere.f90 utils.f90</nowiki><br />
The most important are <code>diag.f90</code> which contains subroutines that calculate various diagnostics, and <code>detect.f90</code> which contains feature detection algorithms. Changed Fortran sources need to be recompiled, again using <br />
:<code>$ ./compile</code><br />
<br />
=== [[git|Version control]] ===<br />
<br />
The changes you made to the source code files can be listed by<br />
:<code>$ git status</code><br />
or viewed in detailed diff-comparisons by<br />
:<code>$ git diff</code><br />
or for one file only<br />
:<code>$ git diff <filename></code><br />
<br />
In case you want to undo your changes, you can revert any file to the last committed version by<br />
:<code>git checkout <filename></code><br />
<br />
Commit your changes from time to time and give a sensible and brief description of your changes in the editor that is opened (automatically)<br />
:<code>$ git commit -a</code><br />
The commit is then stored in your copy of the source code repository, but not yet available for others, which allows you to also commit work-in-progress.<br />
<br />
A more thorough introduction to the version control system is given [[git|here]] or on the [http://git-scm.com/book official documentation].<br />
<br />
=== Using the Fortran functions ===<br />
<br />
An example python script which calculates deformation using the Fortran function is provided with <code>example_diag.py</code>.<br />
<br />
== Dynlib functions ==<br />
<br />
The functions are classified into different categories. All functions and categories listed in the [http://folk.uib.no/csp001/dynlib_doc/apidoc.html API documentation].<br />
<br />
[[Category:Dynlib]]<br />
[[Category:Libraries]]</div>Csp001http://gfi.wiki.uib.no/index.php?title=Dynlib&diff=831Dynlib2017-09-12T08:48:04Z<p>Csp001: Fixed typo.</p>
<hr />
<div>== [http://folk.uib.no/csp001/dynlib_doc/ Documentation] ==<br />
<br />
The steps necessary to obtain dynlib are described below. A more thorough documentation is compiled in [http://folk.uib.no/csp001/dynlib_doc/ the main documentation website].<br />
<br />
== Use the centrally installed dynlib ==<br />
<br />
Dynlib is installed centrally for python 2.7 and python 3.4 in the python environments at <code>/Data/gfi/users/local/share/virtualenv/dynpie2</code> and <code>/Data/gfi/users/local/share/virtualenv/dynpie3</code>. You'll only have to activate one of these python enviroments to start using dynlib:<br />
<pre>source /Data/gfi/users/local/share/virtualenv/dynpieX/bin/activate</pre><br />
In this command <code>X=2</code> for python 2.7 and <code>X=3</code> for python 3.4. For convenience add this command to your <code>~/.bash_profile</code> to activate the respective python environment automatically at each login.<br />
<br />
'''Note''': For some types of login <code>.bash_profile</code> is not taken into account. In case you'll experience problems create a symbolic link <code>~/.bashrc</code> to point to the <code>~/.bash_profile</code> and re-login.<br />
<br />
== Quick start to developing with dynlib ==<br />
<br />
The following procedure is only necessary if you want to start developing dynlib further, for example if you want to add your own functions to dynlib. If you only want to use dynlib, the procedure in the above section is all you need.<br />
<br />
=== Obtaining dynlib ===<br />
<br />
# Create a new folder for the project that'll use dynlib, and go into that directory.<br />
#:<code>$ mkdir <project-name></code><br />
#:<code>$ cd <project-name></code><br />
# Copying the source code repository<br />
#:<code>$ git clone /Data/gfi/users/local/src/dynlib.git</code><br />
#:To clone the repository to your laptop or any machine outside the UiB network, use<br />
#:<code>$ git clone <username>@login.uib.no:/Data/gfi/users/local/src/dynlib.git</code><br />
# Change into the dynlib folder<br />
#:<code>$ cd dynlib</code><br />
# Compile the library<br />
#:<code>$ ./compile</code><br />
# (known broken right now) Make sure everything works as expected <br />
#:<code>$ ./test</code><br />
Happy developing!<br />
<br />
=== Editing the Fortran code ===<br />
<br />
The fortran code lives in <code>src</code> directory. At the moment there are 12 source code files<br />
:<code>$ ls src/*.f95<br />
:src/config.f95 src/derivatives.f95 src/detect_fronts.f95 src/diag.f95 src/humidity.f95 src/stat.f95<br />
:src/const.f95 src/detect.f95 src/detect_rwb_contour.f95 src/ellipse.f95 src/kind.f95 src/utils.f95</code><br />
:The most important are <code>diag.f95</code> which contains subroutines that calculate various diagnostics, and <code>stat.f95</code> which contains statistical functions. Changed Fortran sources need to be recompiled, again using <br />
:<code>$ ./compile</code><br />
<br />
=== [[git|Version control]] ===<br />
<br />
The changes you made to the source code files can be listed by<br />
:<code>$ git status</code><br />
or viewed in detailed diff-comparisons by<br />
:<code>$ git diff</code><br />
or for one file only<br />
:<code>$ git diff <filename></code><br />
<br />
In case you want to undo your changes, you can revert any file to the last committed version by<br />
:<code>git checkout <filename></code><br />
<br />
Commit your changes from time to time and give a sensible and brief description of your changes in the editor that is opened (automatically)<br />
:<code>$ git commit -a</code><br />
The commit is then stored in your copy of the source code repository, but not yet available for others, which allows you to also commit work-in-progress.<br />
<br />
A more thorough introduction to the version control system is given [[git|here]] or on the [http://git-scm.com/book official documentation].<br />
<br />
=== Using the Fortran functions ===<br />
<br />
An example python script which calculates deformation using the Fortran function is provided with <code>example_diag.py</code>.<br />
<br />
== Dynlib functions ==<br />
<br />
The functions are classified into different categories. All functions and categories listed in the [http://folk.uib.no/csp001/dynlib_doc/apidoc.html API documentation].<br />
<br />
[[Category:Dynlib]]<br />
[[Category:Libraries]]</div>Csp001