This simplified ranking is based on WMT18's own results tables, which rank NMT engines based on their standardized average scores from human evaluation. Additionally, this table does not take into account that some scores between NMT engines were so close that WMT18 considered them to be essentially tied, i.e. there was no statistically significant disparity between output. The organizers also included 39 online MT systems (originating from 5 services), which they anonymized as ONLINE-A,B,F,G,Y.