Asiya is a software for Automatic Machine Translation (meta-)evaluation.
Asiya-Online allows accessing the Asiya Framework for testing purposes, with no need to install packages.
Discussion on features and bugs of this software as well as information about updates takes place on the Asiya News Feed
to which you can subscribe at:
and post messages at the Forum:
Any feedback (comments, suggestions, bug reporting) from the nlp community members will be highly appreciated.
The Asiya package is licensed under LGPL, which means that it may be linked to and used by commercial software packages. But the license also enforces that any changes or improvements made to the library must be redistributed under LGPL terms.
Thus, if you improve the software or data, either adding new functionalities, fixing bugs, or adding new metrics, you can not distribute them under different conditions than those stated in the license (i.e. freely and with no usage restrictions).
The on-line version of Asiya allows you to obtain automatic evaluation scores
according to a selected set of metric representatives, together with the ULC combined score
(i.e., arithmetic mean) over a heuristically defined set of metrics.
Then, you can analyse your translations using the tools provided, such as the interactive plots and the automatic linguistic annotations.
The tSearch application has been designed to assist MT developers to search translations in the testbeds according to the MT quality criteria.
If you have your own data already evaluated with Asiya, you don't need to run Asiya again. Just upload the complete folder to fill in the databases needed by the tSearch application.
If you need to evaluate your translations, use the Online interface to run Asiya. Then, you don't need to upload the results, they will be loaded for you in databases.
Note: IE is not fully supported by Asiya. Please, you may need to use Firefox or Chrome to use all the functionalities of the interfaces. We will fix this issue in future releases.