Re: Partnering with SYSTRAN for neural machine translation

Jeff Beatty <[email protected]> Fri, 18 Oct 2019 10:09:45 -0600
Newsgroups gmane.comp.mozilla.localization
Message-ID <CALWECqusAfa6XxPzX_vzRsQUi1f2sLXK0=-yEVvnW9DWnPdUNw@mail.gmail.com>
VGhlIEZBUSBbMV0gYWRkcmVzc2VzIHRoYXQgcXVlc3Rpb24sIGJ1dCBJJ2xsIGdpdmUgbW9yZSBk
ZXRhaWxzIGhlcmUuCgpTWVNUUkFOIGhhcyBhbHJlYWR5IGJ1aWx0IGdlbmVyaWMgbmV1cmFsIG1v
ZGVscyBmb3IgYXJvdW5kIDUwIGxhbmd1YWdlcwp0aGF0IHJ1biBhcyBhIG5ldXJhbCBsYXllciBv
biB0b3Agb2YgdGhlaXIgcnVsZXMtYmFzZWQgZW5naW5lICh0aGV5IGNhbGwKdGhlc2UgInN1cHBv
cnRlZCIgbGFuZ3VhZ2VzKS4gQmVjYXVzZSBvZiB0aGlzLCB0aGUgYW1vdW50IG9mIGRvbWFpbgpz
cGVjaWZpYyBkYXRhIHJlcXVpcmVkIHRvIHRyYWluIGEgZG9tYWluLXNwZWNpZmljIG5ldXJhbCBt
b2RlbCBpbiB0aG9zZQpsYW5ndWFnZXMgaXMgc2lnbmlmaWNhbnRseSBsb3dlciB0aGFuIGlmIHdl
IHdlcmUgdHJhaW5pbmcgbW9kZWxzIHdpdGhvdXQKdGhhdCBnZW5lcmljIGxheWVyLiBGb3IgYXJv
dW5kIDQwIG9mIHRob3NlIDUwICJzdXBwb3J0ZWQiIGxhbmd1YWdlcywgd2UKaGF2ZSBlbm91Z2gg
ZGF0YSAodGhlIHRocmVzaG9sZCBpcyA1MEsgdW5pdHMpLiBOb3csIGl0IGlzIHBvc3NpYmxlIHRv
IHRyYWluCmRvbWFpbi1zcGVjaWZpYyBuZXVyYWwgbW9kZWxzIGZvciBsYW5ndWFnZXMgdGhhdCBk
byBub3QgYmVuZWZpdCBmcm9tIGhhdmluZwp0aGUgU1lTVFJBTiBnZW5lcmljIG5ldXJhbCBtb2Rl
bCBsYXllciwgYnV0IGJlY2F1c2UgaXQgd291bGQgYmUgZnJvbQpzY3JhdGNoLCB0aGUgcmVxdWly
ZWQgYW1vdW50IG9mIGRhdGEgaXMgbXVjaCBoaWdoZXIgKHRocmVzaG9sZCBpcyAzMDBLCnVuaXRz
KS4KCldlIGtub3cgdGhhdCBmb3IgY29udGVudCBsb2NhbGl6ZWQgaW4gUG9udG9vbiwgd2UgZG9u
J3QgZ2V0IGFueXdoZXJlIG5lYXIKdGhhdCAzMDBLIHRocmVzaG9sZCBmb3IgYW55IGxvY2FsZS4g
SWYgd2UgbG9va2VkIG91dHNpZGUgb2YgUG9udG9vbiBhbmQgb3VyCnByb2R1Y3QgLyB3ZWIgcmVw
b3MsIGl0J3MgdmVyeSB1bmNsZWFyIGhvdyBsYXJnZSB0aGUgZGF0YXNldCBpcywgZXZlbiBpbgpF
bmdsaXNoIGFsb25lLiBJIHBsYW4gdG8gd29yayB3aXRoIHRob3NlIG90aGVyIGFyZWFzIG9mIE1v
emlsbGEgKHRoaW5raW5nCnNwZWNpZmljYWxseSBhYm91dCBTVU1PKSB0byBsZWFybiBob3cgdG8g
bWVhc3VyZSB0aGUgc2l6ZSBvZiB0aGF0IGRhdGFzZXQKYW5kIGRldGVybWluZSBpZiBpdCArIHRo
ZSBQb250b29uIGRhdGFzZXQgYXJlIGxhcmdlIGVub3VnaCB0byBtZWV0IHRoZSAzMDBLCnRocmVz
aG9sZC4gSWYgc28sIHRoZW4gd2UgY2FuIGRlZmluZSBhIHBhdGggdG93YXJkIGNyZWF0aW5nIG1v
cmUgbGFuZ3VhZ2UKbW9kZWxzIGZvciBhbGwgbGFuZ3VhZ2VzLgoKWzFdIGh0dHA6Ly9iaXQubHkv
c3lzdHJhbl9tb3ppbGxhX0ZBUQoKT24gRnJpLCBPY3QgMTgsIDIwMTkgYXQgOTo1NyBBTSBNQiA8
YmVsa2FjZW03N0BnbWFpbC5jb20+IHdyb3RlOgoKPiBTb3VuZHMgZ29vZCwgYnV0IHdpbGwgYWxs
IGxvY2FsZXMgYmUgaW52b2x2ZWQ/IFNvbWUgb2YgdGhlbSBkb24ndCBoYXZlCj4gY29udGVudCBl
bm91Z2guCj4gRG8geW91IHRoaW5rIHRoYXQgdGhlIG1vZGVscyB3aWxsIGJlIGdvb2Qgb25seSB3
aXRoIE1vemlsbGEncwo+IHRyYW5zbGF0aW9ucz8gSSBrbm93IHRoYXQgTVQgTW9kZWxzIG5lZWRz
IGh1Z2UgZGF0YSB0byBnZW5lcmF0ZSBnb29kIHVzYWJsZQo+IE1vZGVscwo+Cj4KPgo+IE9uIEZy
aSwgT2N0IDE4LCAyMDE5IGF0IDU6MjkgUE0gVmVlIFNhdGF5YW1hcyB2aWEgZGV2LWwxMG4gPAo+
IGRldi1sMTBuQGxpc3RzLm1vemlsbGEub3JnPiB3cm90ZToKPgo+PiBUaGFuayB5b3UuIEl0IHNv
dW5kcyBncmVhdHMgc2luY2UgdGhlIGRhdGFzZXQgY2FuIGJlIHVzZWQgZm9yIHJlc2VhcmNoaW5n
Cj4+IChvciBzb21ldGhpbmcgZWxzZSkgYW5kIHRyYW5zbGF0aW9uIHJlc3VsdHMgY2FuIGJlIGNv
bXBhcmVkIHdpdGggdGhlCj4+IFNZU1RSQU4ncyBtb2RlbC4KPj4KPj4gVmVlCj4+Cj4+IFNlbnQg
d2l0aCBbUHJvdG9uTWFpbF0oaHR0cHM6Ly9wcm90b25tYWlsLmNvbSkgU2VjdXJlIEVtYWlsLgo+
Pgo+PiDigJDigJDigJDigJDigJDigJDigJAgT3JpZ2luYWwgTWVzc2FnZSDigJDigJDigJDigJDi
gJDigJDigJAKPj4gT24g4Lin4Lix4LiZRnJpZGF54LiX4Li14LmIIDE4IE9jdG9iZXIgMjAxOSDg
uYDguKfguKXguLIgMTk6NDUsIEplZmYgQmVhdHR5IDwKPj4gamJlYXR0eUBtb3ppbGxhLmNvbT4g
d3JvdGU6Cj4+Cj4+ID4gVGhleSBhcmUgdW5kZXIgdGhlIE1QTC4gVGhlc2UgcmVzdWx0aW5nIG1v
ZGVscyBhcmUgc3VjaCBhbiBhYnN0cmFjdGlvbgo+PiBmcm9tIHRoZSBkYXRhc2V0cyB0aGF0IHRo
ZSBkYXRhc2V0IGxpY2Vuc2UgYW5kIHRoZSBuZXVyYWwgbW9kZWwgbGljZW5zZSBjYW4KPj4gYmUg
ZGlzdGluY3QuCj4+ID4KPj4gPiBFbCB2aWUuLCAxOCBkZSBvY3R1YnJlIGRlIDIwMTkgMDI6MDQs
IFZlZSBTYXRheWFtYXMgPAo+PiB2ZWUuc2FAcHJvdG9ubWFpbC5jb20+IGVzY3JpYmnDszoKPj4g
Pgo+PiA+PiBEbyB0aGUgYmlsaW5ndWFsIGRhdGFzZXRzIGhhdmUgYSBwYXJ0aWN1bGFyIGxpY2Vu
c2U/Cj4+ID4+Cj4+ID4+IFZlZQo+PiA+Pgo+PiA+PiBTZW50IHdpdGggUHJvdG9uTWFpbCBTZWN1
cmUgRW1haWwuCj4+ID4+Cj4+ID4+IOKAkOKAkOKAkOKAkOKAkOKAkOKAkCBPcmlnaW5hbCBNZXNz
YWdlIOKAkOKAkOKAkOKAkOKAkOKAkOKAkAo+PiA+PiBPbiDguKfguLHguJlGcmlkYXnguJfguLXg
uYggMTggT2N0b2JlciAyMDE5IOC5gOC4p+C4peC4siAxNTowMCwgSmVmZiBCZWF0dHkgPAo+PiBq
YmVhdHR5QG1vemlsbGEuY29tPiB3cm90ZToKPj4gPj4KPj4gPj4+IEhlbGxvIGxvY2FsaXplcnMh
Cj4+ID4+Pgo+PiA+Pj4gdGw7ZHI6IE1vemlsbGEgc2Vla3MgdG8gd2lkZW4gdGhlIGltcGFjdCBv
ZiB5b3VyIGwxMG4gY29udHJpYnV0aW9ucy4KPj4gV2XigJlyZQo+PiA+Pj4gcGFydG5lcmluZyB3
aXRoIFNZU1RSQU7igJlzIG5ldXJhbCBtYWNoaW5lIHRyYW5zbGF0aW9uIChNVCkgbWFya2V0cGxh
Y2UKPj4gdG8KPj4gPj4+IGxpY2Vuc2UgbmV1cmFsIG1vZGVscyB0cmFpbmVkIG9uIE1vemlsbGHi
gJlzIGxpbmd1aXN0aWMgZGF0YSBmcm9tCj4+IFBvbnRvb27igJlzCj4+ID4+PiB0cmFuc2xhdGlv
biBtZW1vcnkuIFBsZWFzZSByZWZyYWluIGZyb20gY29tbWVudGluZyBvbiB0aGlzIGluIHB1Ymxp
Ywo+PiA+Pj4gZm9ydW1zIChUd2l0dGVyLCBSZWRkaXQsIGV0Yy4pIHVudGlsIDE6MDBwbSBDRVQu
Cj4+ID4+Pgo+PiA+Pj4gV2UgYXJlIGdyYXRlZnVsIGZvciB0aGUgdGltZSwgZW5lcmd5LCBhbmQg
dHJhbnNsYXRpb25zIHlvdSBjb250cmlidXRlCj4+IHRvCj4+ID4+PiBhZHZhbmNpbmcgdGhlIE1v
emlsbGEgbWlzc2lvbiB0aHJvdWdoIG91ciBwcm9kdWN0cy4gWW91ciBpbXBhY3QgaGFzCj4+IGJl
ZW4KPj4gPj4+IHVuZGVuaWFibHkgaGVscGZ1bCB0byBpbmNyZWFzaW5nIGxpbmd1aXN0aWMgZGl2
ZXJzaXR5IGluIG9wZW4gc291cmNlCj4+ID4+PiBzb2Z0d2FyZSBhbmQgdGhlIFdlYiBhdCBsYXJn
ZS4gQmVjYXVzZSBvZiB5b3VyIGxvY2FsaXphdGlvbnMsIHdl4oCZcmUKPj4gYWJsZSB0bwo+PiA+
Pj4gcmVhY2ggbmV3IG1hcmtldHMgd2l0aCBvdXIgcHJvZHVjdHMgYW5kIGJyaW5nIGluIHJldmVu
dWUgdG8gc3VzdGFpbgo+PiB0aGUKPj4gPj4+IGxvbmdldml0eSBvZiBNb3ppbGxh4oCZcyBleGlz
dGVuY2UgYW5kIG1pc3Npb24uCj4+ID4+Pgo+PiA+Pj4gTW96aWxsYeKAmXMgY29udGludWVkIHN1
c3RhaW5hYmlsaXR5IGlzIGRlcGVuZGVudCB1cG9uIGdldHRpbmcgdGhlIG1vc3QKPj4gb3V0Cj4+
ID4+PiBvZiB0aGUgcmVzb3VyY2VzIE1vemlsbGEgaGFzIGFuZCBmaW5kaW5nIGRpdmVyc2UgZm9y
bXMgb2YgcmV2ZW51ZS4KPj4gQXBwbGllZAo+PiA+Pj4gdG8gbDEwbiwgZXhwYW5kaW5nIHRoZSBz
Y29wZSBvZiBpbXBhY3Qgb2YgeW91ciBjb250cmlidXRpb25zIGlzIGEgaGlnaAo+PiA+Pj4gcHJp
b3JpdHkgZm9yIHVzLiBBcyBzdWNoLCB3ZSBzZWVrIHRvIGZpbmQgZGl2ZXJzZSB3YXlzIGZvciB5
b3VyCj4+ID4+PiBjb250cmlidXRpb25zIHRvIGNvbnRpbnVvdXNseSBhZGQgdmFsdWUgdG8gdGhl
IG9yZ2FuaXphdGlvbi4gV2UKPj4gYmVsaWV2ZQo+PiA+Pj4gd2XigJl2ZSBmb3VuZCBhIG5ldyBj
b250ZXh0IGluIHdoaWNoIHRvIG1heGltaXplIHlvdXIgY29udHJpYnV0aW9ucywKPj4gYW5kIEni
gJltCj4+ID4+PiBlYWdlciB0byB0ZWxsIHlvdSBhYm91dCBpdCBoZXJlLgo+PiA+Pj4KPj4gPj4+
IFNZU1RSQU4sIGEgbWFqb3IgcGxheWVyIGluIHRoZSBlbnRlcnByaXNlIG1hY2hpbmUgdHJhbnNs
YXRpb24gKE1UKQo+PiA+Pj4gc29sdXRpb25zIHNwYWNlLCBoYXMgcmVhY2hlZCBvdXQgdG8gTW96
aWxsYSB0byBwYXJ0bmVyIHdpdGggdXMgaW4KPj4gcHJvdmlkaW5nCj4+ID4+PiBuZXVyYWwgTVQg
c29sdXRpb25zIHRvIGVudGVycHJpc2VzIHdvcmxkd2lkZS4gVGhpcyBpcyBkb25lIGJ5IHVzaW5n
Cj4+IG91cgo+PiA+Pj4gYmlsaW5ndWFsIGRhdGFzZXRzIGFuZCB0cmFpbmluZyBuZXVyYWwgbWFj
aGluZSB0cmFuc2xhdGlvbiBtb2RlbHMgd2l0aAo+PiA+Pj4gdGhlbS4gSW4gb3JkZXIgdG8gY3Jl
YXRlIHRoZXNlLCBTWVNUUkFOIGd1YXJhbnRlZXMgdHJhbnNwYXJlbmN5IGFuZAo+PiB0aGF0Cj4+
ID4+PiBNb3ppbGxhIHJldGFpbnMgdGhlIHJpZ2h0cyB0byBwcm9jZXNzIGFuZCBkaXNzZW1pbmF0
ZSB0aGlzIGRhdGEuIFRoZQo+PiBkYXRhLAo+PiA+Pj4gbGlrZSB0aGUgbW9kZWxzIGNyZWF0ZWQs
IHJlbWFpbiB0aGUgZW50aXJlIHByb3BlcnR5IG9mIE1vemlsbGEuCj4+IFNZU1RSQU4KPj4gPj4+
IGxpY2Vuc2VzIHRoZXNlIG1vZGVscyB0aHJvdWdoIHRoZWlyIG5ldXJhbCBNVCBtYXJrZXRwbGFj
ZSB0bwo+PiBlbnRlcnByaXNlCj4+ID4+PiB1c2VycyBhbmQgc2hhcmVzIGFueSByZXZlbnVlIGdl
bmVyYXRlZCBmcm9tIGVudGVycHJpc2UgdXNlcnMgbGljZW5zaW5nCj4+ID4+PiBNb3ppbGxh4oCZ
cyBuZXVyYWwgbW9kZWxzLiBXZSBwbGFuIHRvIHBhcnRuZXIgd2l0aCBTWVNUUkFOIHRvIHRyYWlu
Cj4+IG5ldXJhbAo+PiA+Pj4gbW9kZWxzIHVzaW5nIGRhdGEgZnJvbSBQb250b29u4oCZcyB0cmFu
c2xhdGlvbiBtZW1vcnkgZGF0YWJhc2UgKHdoaWNoCj4+IGhhcwo+PiA+Pj4gYmVlbiBlbnRpcmVs
eSBhbm9ueW1pemVkKSwgYW5kIHRoZW4gbGljZW5zZSB0aG9zZSBtb2RlbHMgb24gdGhlCj4+ID4+
PiBtYXJrZXRwbGFjZS4gV2UgcGxhbiB0byBjb29yZGluYXRlIHdpdGggU1VNTyBhbmQgTUROIGF0
IGxhdGVyIGRhdGVzIHRvCj4+ID4+PiBkZXRlcm1pbmUgd2hldGhlciB3ZSBjYW4gZG8gdGhlIHNh
bWUgd2l0aCB0aGVpciBsYW5ndWFnZSBkYXRhc2V0cy4KPj4gPj4+Cj4+ID4+PiBXZeKAmXJlIGVu
dGh1c2lhc3RpYyBhYm91dCB0aGlzIG9wcG9ydHVuaXR5IHRvIHBhcnRuZXIgd2l0aCBTWVNUUkFO
IGZvcgo+PiBhCj4+ID4+PiBudW1iZXIgb2YgcmVhc29uczoKPj4gPj4+Cj4+ID4+PiAxLgo+PiA+
Pj4KPj4gPj4+IFdlIGFyZSBndWFyYW50ZWVkIGZyZWUgYWNjZXNzIHRvIHRoZSB0cmFpbmVkIG1v
ZGVsIHRvIGluY29ycG9yYXRlIGludG8KPj4gPj4+IFBvbnRvb24sIHByb3ZpZGluZyB5b3Ugd2l0
aCBiZXR0ZXIgcXVhbGl0eSBNVCBzdWdnZXN0aW9ucyBpbiBQb250b29u4oCZcwo+PiA+Pj4gbWFj
aGluZXJ5IHRhYi4KPj4gPj4+IDIuCj4+ID4+Pgo+PiA+Pj4gVHJhbnNsYXRpb25zIHlvdSBjb250
cmlidXRlZCB0byBwYXN0IHByb2R1Y3RzIChlLmcuLCBGaXJlZm94IE9TKSBmaW5kCj4+ID4+PiBu
ZXcgbGlmZSBhcyBwYXJ0IG9mIHRoZSBkYXRhc2V0IHVzZWQgdG8gdHJhaW4gdGhlc2UgbmV1cmFs
IG1vZGVscy4KPj4gPj4+IDMuCj4+ID4+Pgo+PiA+Pj4gV2UgY2FuIGxvd2VyIHRoZSBiYXJyaWVy
IHRvIGVudHJ5IGZvciBvdGhlciBlbnRlcnByaXNlcyB0byBwcm9kdWNlCj4+ID4+PiBzb2Z0d2Fy
ZSBpbiBtb3JlIGxhbmd1YWdlcywgaW1wcm92aW5nIG11bHRpbGluZ3VhbCBkaXZlcnNpdHkgYW5k
Cj4+ID4+PiByZXByZXNlbnRhdGlvbiBpbiB0ZWNoLgo+PiA+Pj4gNC4KPj4gPj4+Cj4+ID4+PiBU
aHJvdWdoIG91ciBpbmZsdWVuY2UgaW4gdGhlIG1hcmtldHBsYWNlLCB3ZSBjYW4gc3RhbmRhcmRp
emUgdGhlIHdheQo+PiA+Pj4gc29tZSBvZiB0aGUgbW9zdCBpbXBvcnRhbnQgZWxlbWVudHMgb2Yg
b3VyIG1pc3Npb24gYXJlIGRpc2N1c3NlZCBhbmQKPj4gPj4+IGxhYmVsZWQgaW4gb3RoZXIgbGFu
Z3VhZ2VzIChlLmcuLCBtdWx0aXBsZSBwcml2YWN5IHByb2R1Y3RzIHVzaW5nIHRoZQo+PiBzYW1l
Cj4+ID4+PiB2ZXJuYWN1bGFyLCBpbmZsdWVuY2VkIGJ5IE1vemlsbGHigJlzIG5ldXJhbCBtb2Rl
bCkuCj4+ID4+PiA1Lgo+PiA+Pj4KPj4gPj4+IFdlIGNhbiBleHBlcmltZW50IHdpdGggZGl2ZXJz
aWZ5aW5nIE1vemlsbGHigJlzIHBvdGVudGlhbCByZXZlbnVlCj4+IHRocm91Z2gKPj4gPj4+IG5l
dyBhbmQgZXhjaXRpbmcgcGFydG5lcnNoaXBzLCBlbnN1cmluZyB0aGF0IE1vemlsbGEgcmVtYWlu
cwo+PiBmaW5hbmNpYWxseQo+PiA+Pj4gdmlhYmxlIGFuZCBzdHJvbmcuCj4+ID4+Pgo+PiA+Pj4g
SSBob3BlIHlvdeKAmWxsIGpvaW4gdXMgaW4gb3VyIGV4Y2l0ZW1lbnQgdG8gZW1iYXJrIG9uIGEg
dW5pcXVlCj4+IGV4cGVyaW1lbnQKPj4gPj4+IHdpdGggU1lTVFJBTi4gSXTigJlzIGdyZWF0IHRv
IGhhdmUgYSBuZXcgb3Bwb3J0dW5pdHkgdG8gaW5jcmVhc2UgeW91cgo+PiA+Pj4gY29udHJpYnV0
aW9uc+KAmSBpbXBhY3Qgb24gTW96aWxsYSBhbmQgdGhlIFdlYiBhcyBhIHdob2xlLiBJZiB5b3Ug
aGF2ZQo+PiBhbnkKPj4gPj4+IHF1ZXN0aW9ucywgcGxlYXNlIGZpcnN0IHJlZmVyIHRvIHRoaXMg
RkFRIFsxXSwgd2hpY2ggaW5jbHVkZXMgbW9yZQo+PiBkZXRhaWxzCj4+ID4+PiBhYm91dCBob3cg
YWxsIG9mIHRoaXMgd2lsbCB3b3JrLiBJZiB5b3UgY2Fu4oCZdCBmaW5kIGFuc3dlcnMgdG8geW91
cgo+PiA+Pj4gcXVlc3Rpb25zIHRoZXJlLCBwbGVhc2UgcmVhY2ggb3V0IHRvIHVzIHRvIGRpc2N1
c3MgZnVydGhlci4KPj4gPj4+Cj4+ID4+PiBUaGFuayB5b3UsCj4+ID4+Pgo+PiA+Pj4gSmVmZgo+
PiA+Pj4KPj4gPj4+IFsxXSBodHRwOi8vYml0Lmx5L3N5c3RyYW5fbW96aWxsYV9GQVEKPj4gPj4+
Cj4+ID4+PiBkZXYtbDEwbiBtYWlsaW5nIGxpc3QKPj4gPj4+IGRldi1sMTBuQGxpc3RzLm1vemls
bGEub3JnCj4+ID4+PiBodHRwczovL2xpc3RzLm1vemlsbGEub3JnL2xpc3RpbmZvL2Rldi1sMTBu
Cj4+IF9fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fCj4+IGRl
di1sMTBuIG1haWxpbmcgbGlzdAo+PiBkZXYtbDEwbkBsaXN0cy5tb3ppbGxhLm9yZwo+PiBodHRw
czovL2xpc3RzLm1vemlsbGEub3JnL2xpc3RpbmZvL2Rldi1sMTBuCj4+Cj4KX19fX19fX19fX19f
X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX18KZGV2LWwxMG4gbWFpbGluZyBsaXN0
CmRldi1sMTBuQGxpc3RzLm1vemlsbGEub3JnCmh0dHBzOi8vbGlzdHMubW96aWxsYS5vcmcvbGlz
dGluZm8vZGV2LWwxMG4K