- Use '/' key to quickly access this field.
- Enter a name of repository, or repository group for quick search.
- Prefix query to allow special search:
user:admin, to search for usernames, always global
user_group:devops, to search for user groups, always global
pr:303, to search for pull request number, title, or description, always global
commit:efced4, to search for commits, scoped to repositories or groups
file:models.py, to search for file paths, scoped to repositories or groups
For advanced full text search visit: repository search
<h1align="center">What's new in Madrigal 3.2.2?</h1>
<h1align="center"style="text-align: left">Madrigal 3.2.2 Release - Jan 2021</h1>
<palign="center"style="text-align: left">Fixed bug in linking to external data using the Select Single Experiment user interface. </p>
<h1align="center">What's new in Madrigal 3.2.1?</h1>
<h1align="center"style="text-align: left">Madrigal 3.2.1 Release - Nov 2020</h1>
<h2align="center"style="text-align: left">Allows Madrigal to create citations to groups of files</h2>
<palign="center"style="text-align: left">With Madrigal 3.2.1, users can use the API to create citations to groups of files, and can display those groups with that citation. </p>
<h1align="center">What's new in Madrigal 3.1.1?</h1>
<h1align="center"style="text-align: left">Madrigal 3.1.1 Release - Nov 2019</h1>
<h2align="center"style="text-align: left">Allows Madrigal to run using https</h2>
<palign="center"style="text-align: left">With Madrigal 3.1.1, the code is compatable with https. Instructions are given to install or convert Madrigal to https. </p>
<h1align="center">What's new in Madrigal 3.1?</h1>
<h1align="center"style="text-align: left">Madrigal 3.1 Release - Oct 2019</h1>
<h2align="center"style="text-align: left">Conversion to Python 3</h2>
<palign="center"style="text-align: left">With Madrigal 3.1, all python code has been updated to use python 3 instead of python 2. The functionality is unchanged from Madrigal 3.0.</p>
<h2align="center"style="text-align: left">Migration to Hdf5 file format</h2>
<palign="center"style="text-align: left">With Madrigal 3.0, the old 16 bit integer based file format has been replaced with Hdf5. However, all the data model and well-defined parameters have been retained. The CEDAR Hdf5 format is designed to be completely self-contained. That is, any user with an Hdf5 reader can fully understand all data in the file without any reference to documentation. A full description of the format can be found <ahref="{%static'CEDARMadrigalHdf5Format.pdf'%}">here</a>.</p>
<h2align="center"style="text-align: left">Web interface generates scripts to download any amount of data</h2>
<palign="center"style="text-align: left">With Madrigal 3, you can generate a script command to download a whole series of files with a few click. You can also create a script that will filter those same files and allow you to choose the parameters you want, again with just a few clicks. These scripts can be run with python, Matlab, or IDL.</p>
<h2align="center"style="text-align: left">Download files in a new format</h2>
<palign="center"style="text-align: left">Prior to Madrigal 3, files could be downloaded only as ascii or Hdf5 (or the difficult to understand CEDAR format). Now they can be downloaded as ascii, Hdf5, or netCDF4.</p>
<h2align="center"style="text-align: left">Get data with selected/derived parameters and filters in new formats</h2>
<palign="center"style="text-align: left">Prior to Madrigal 3, data with selected/derived parameters and filters was available
only as ascii. Now it can be downloaded as ascii, Hdf5, or netCDF4.</p>
<h2align="center"style="text-align: left">Independent spatial parameters now built in to data model</h2>
<palign="center"style="text-align: left">Prior to Madrigal 3.0, there was no way to automatically tell what the independent spatial parameters were in vector data. With Madrigal 3.0, any data with vector data must define its independent spatial parameters, which can be found in the Hdf5 Metadata group. This allows Madrigal to automatically add array layouts of the data, making for easier plotting.</p>
<h2align="center"style="text-align: left">All new web interface</h2>
<palign="center"style="text-align: left">A much simplified web interface based on Django and bootstrap. Developed with much assistance from Jicamarca Observatory and Jose Antonio Sal y Rosas Celi.</p>
<h2align="center"style="text-align: left">Simple FTP-like web interface added</h2>
<palign="center"style="text-align: left">Designed for non-native English speakers. The url follows a very simple pattern that can be easily parsed if the user in unable to understand the Madrigal API's and automatically generated scripts.</p>
<h2align="center"style="text-align: left">Create CEDAR Hdf5 files with either Matlab or python</h2>
<palign="center"style="text-align: left">Prior to Madrigal 3, there was only a python API to easily create Madrigal files. Now both Matlab and python can be used to create CEDAR Hdf5 files.</p>
<palign="center"style="text-align: left">The <em>Access metadata</em> menu item on the main navigation menu allows easy access to all Madrigal CEDAR metadata, including Madrigal sites, instruments, parameter definitions, and kind of data codes.</p>
</blockquote>
<h1>Madrigal 2.6.3.2 Release - March 22, 2012</h1>
<p>Added support to file download cgi scripts to allow logging of remote API requests to download files.</p>
<h1>Madrigal 2.6.3.1 Release - March 13, 2012</h1>
<p>Added popup javascript window to warn users not to click "Download File" button multiple times.</p>
<p>Small bug fix involving creating Hdf5 export files in data.py.</p>
<h1>Madrigal 2.6.1 Release - January 20, 2012</h1>
<p>Small bug fix involving a memory leak in _Madrec.c and a rare problem creating Hdf5 export files in data.py. </p>
<h1>Madrigal 2.6 Release - November 2011 </h1>
<blockquote>
<h2>New simple local web user interface </h2>
<p>A new easy to use interface to access local Madrigal data was developed by Jicamarca with support from Millstone Hill staff. This interface in now very robust and has been tested with data from all Madrigal sites.</p>
<h2>HDF5 file download availablity</h2>
<p>Users can now download data files as HDF5, in addition to simple column delimited ascii and the more complex <ahref="{%static'cedarFormat.pdf'%}"target="_self">CEDAR formats</a>. This is also the result of a Jicamarca/Millstone Hill collaborations.</p>
<h2>Users can register interest in experiments or instruments</h2>
<p>Users can now register interest in experiments or instruments, and get emails whenever that Madrigal experiment or instrument is updated.</p>
<h2>Administrative improvements - can now add external disks to experiments</h2>
<p>It is now easy to expand the Madrigal database by <ahref="ad_other.html#experiments"target="_self">mounting additional hard disks</a> to make more room for data.</p>
<h2>New metadata - experiment PI's and analyst</h2>
<p>Experiments now have direct email links to the experiment PI. These PI's can be updated on an experiment or intrument basis.</p>
<h2>Global seach now more robust</h2>
<p>The global search UI now generates scripts so you can run the global search right from your computer using either the <ahref="rt_python.html"target="_self">python remote API</a>, the <ahref="rt_matlab.html"target="_self">Matlab remote API</a>, or the<ahref="rt_idl.html"target="_self"> IDL remote API</a>.</p>
<p> </p>
</blockquote>
<hr/>
<p> </p>
<h1>Madrigal 2.5.2 Release - May 2009</h1>
<blockquote>
<p>A bug fix release - no new features. </p>
</blockquote>
<h1>Madrigal 2.5.1 Release - March 2009</h1>
<blockquote>
<p>This minor revision to Madrigal 2.5 was needed to support using Madrigal as an archiving database. The experiment metadata was expanded to allow archived experiments. Archived experiments are not shared between Madrigal sites, but are visible as local experiments. </p>
</blockquote>
<h1>Madrigal 2.5 Release - February 2009 </h1>
<blockquote>
<h2>Simplification of Web User Interface </h2>
<p>Both the Browse for Individual Madrigal Experiments and the Global Madrigal Database Report web interface have been simplified. Searching for instruments under Browse for Individual Madrigal Experiments is now easier through the use of an instrument category selector.</p>
<h2>One step file printing available</h2>
<p>Under Browse for Individual Madrigal Experiments, users can now choose to print an ascii version of any Madrigal file with one click. With this option they can not include any derived parameters or data filters.</p>
<h2>Installation simplified </h2>
<p>Autotools is now used to compile all code, significantly reducing the number of parameters in the madrigal.cfg configuration file.</p>
<h2>64-bit tested </h2>
<p>Madrigal has now been fully tested as a 64-bit application. It is important that all Madrigal installations switch to 64-bit machines by the year 2037, because 32-bit unix cannot handle dates beyond then.</p>
<h2>International Reference Ionosphere (IRI) derived parameters now available</h2>
<p>All parameters calculated by the International Reference Ionosphere (IRI) model can now be selected as derived parameters.</p>
<h2>Additional automatic sharing of metadata added</h2>
<p>For administrators: Now when new sites or instruments are added to Madrigal, these metadata files are automatically added to your site. </p>
<h2>Experiment level security</h2>
<p>Previously, individual Madrigal files could be made public or private. Now entire experiments can be made public, private, or hidden altogether. See the script <ahref="ad_createExp.html#changeExpStatus">changeExpStatus.py</a> for details. </p>
<p>Under this convention, the date of the directory name represented the start date of the experiment, with one letter optionally added. This meant there was a limited number of experiments that could be created for a particular day for a particular experiment. This part of the directory naming convention has been dropped, and now the convention is:</p>
<pre>$MADROOT/experiments/YYYY/<3 letter inst mnemonic>/*,
<p>A new web user-interface has been added that allows easy printing and plotting of basic Madrigal data. To make it easy to use, advanced Madrigal features such as derived parameters and filtering of data have been removed.</p>
<h2>On-demand plot creation</h2>
<p>Madrigal now allows users to create basic scatter plots and pcolor plots versus range or altitude of any measured or derived parameter in a data set.</p>
<h2>Logging of user data access</h2>
<p>Madrigal now <ahref="ad_logging.html">logs user's names, emails, and affiliations</a> whenever data files are directly accessed in a file administrators can access. </p>
<h2>Automatic updating of all geophysical data</h2>
<p>Madrigal now automatically updates all its internal geophysical files (e.g., Kp, Fof2, Dst, Imf, etc) every time updateMaster is run. </p>
<h2>Simple-to-use python module to create and edit Madrigal files</h2>
<p>There is now a <ahref="ad_createFiles.html#python">simple-to-use python module</a> to create and edit Madrigal files. </p>
<h2>New administrative scripts to manage Madrigal experiments</h2>
<p>Administrators can now add or modify all Madrigal experiments using <ahref="ad_createExp.html">simple administrative scripts</a>, instead of trying to edit Madrigal metadata files themselves or use the complex genExp script. </p>
<h2>Complete documentation rewrite</h2>
<p>Madrigal documentation has now been completely rewritten and reorganized into three manuals: one for <ahref="wt_usersGuide.html">users</a>, one for <ahref="admin.html">administrators</a>, and one for <ahref="dev_contents.html">developers</a>. </p>
<h2>Automatic graphics conversion</h2>
<p>Madrigal will now allow users to select any graphics format they prefer for <ahref="ad_createExp.html#auxillary">graphics administrators place in experiments</a>. This feature was contributed by Eiscat. </p>
<h2>Update of IGRF/MSIS</h2>
<p>The Madrigal derivation engine is now using the <ahref="http://www.ngdc.noaa.gov/IAGA/vmod/igrf.html">IGRF 2010 coefficients</a>, and the <ahref="https://omniweb.gsfc.nasa.gov/vitmo/msis_vitmo.html">MSIS 2000 model</a>. </p>
<h2>Limiting of disk space used for global search files</h2>
<p>Administrators can now limit the maximum amount of disk space used to store temporary global search files. See the section on editing the madrigal.cfg file in the installation guide. </p>
</blockquote>
<p> </p>
<hr/>
<p> </p>
<h1>Madrigal 2.3 Release - March 2004</h1>
<blockquote>
<h2>Remote programming access to Madrigal via web services using any platform</h2>
<p>Madrigal now exposes all the information and capabilities it has as web services, which allows
easy access to Madrigal from any computer on the internet using any platform (Unix, Windows, Mac, etc).
Madrigal's web services are basically cgi scripts with simple output that allows easy parsing of the
information. Any language that supports the HTTP standard can then access any Madrigal site. We have
written remote API's using python and Matlab, but almost any language could be used. See the section
on <ahref="{%url'docs''rt_contents.html'%}">remote programming access</a> for details of these APIs and the underlying web services.</p>
<p>Note that this approach of remotely accessing Madrigal data has been always possible before by parsing the
html output meant to be displayed in a web browser (this general programming method is referred to as "screen
scraping"). However, not only is this parsing difficult; but the code often breaks when the user interface
is modified in any way. With web services the returned cgi scripts are designed to be both simple to parse
and stable.</p>
<p>The web services are not implemented according to the SOAP or XMLRPC standard since not all scripting
languages have support for these standards (or for XML parsing). Instead they use the simple approach
of returning data requested via a query as a delimited text file. These web services are fully