Integrate it Wikidata into Unicode Inflection

[grhoten]

The revised dictionary-parser can parse Wikidata, but some issues need to be resolved.

The initial issues include:

• The proper way to support or map Q112154 (apocope) into usable grammemes need to be taken into account. It might be trying to differentiate between usage in a sentence and usage in isolation.
• The dictionary-parser output needs to be addressed
• The unit tests need to be fixed.

Tool output that needs to be addressed:

Line 2645: Q1521634 is not a known grammeme for L21238(donna)
Line 2646: Q54943392 is not a known grammeme for L21240(uomo)
Line 2653: Q650250 is not a known grammeme for L21276(senza)
Line 77178: Q66364639 is not a known grammeme for L641005(località)
Line 77193: Q54943392 is not a known grammeme for L641085(poeta)
Line 77322: Q54948374 is not a known grammeme for L642043(ambiente)
Line 82496: Q54943392 is not a known grammeme for L684152(lacrima)
Line 84465: Q112154 is not a known grammeme for L700393(eccezione)
Line 88468: Q58233068 is not a known grammeme for L732795(umarell)
Line 89680: Q112154 is not a known grammeme for L742527(monsignore)
Line 139419: Q56161479 is not a known grammeme for L1144930(covid)
Line 143827: Q112154 is not a known grammeme for L1180137(professore)
Line 146327: Q112154 is not a known grammeme for L1199784(bambino)
Line 147596: Q220054 is not a known grammeme for L1209999(ahi)
Line 147816: Q112154 is not a known grammeme for L1211866(tale)
Line 147994: Q112154 is not a known grammeme for L1213314(dare)
Line 153174: Q112154 is not a known grammeme for L1255651(alcuno)
Line 162535: Q54943392 is not a known grammeme for L1330383(subitaneo)
Line 163602: Q54943392 is not a known grammeme for L1338824(dagherrotipo)
Line 172756: Q112154 is not a known grammeme for L5139(essere)
Line 173174: Q2824480 is not a known part of speech grammeme for L8334(codesto)
Line 173175: Q2824480 is not a known part of speech grammeme for L8339(quello)
Line 174774: Q112154 is not a known grammeme for L21252(bene)
Line 176956: Q112154 is not a known grammeme for L38246(andare)
Line 177592: Q112154 is not a known grammeme for L43226(bello)
Line 230766: Q54943392 is not a known grammeme for L482760(uovo)
Line 241947: Q54943392 is not a known grammeme for L580779(accappatoio)
Line 249117: Q66364639 is not a known part of speech grammeme for L640470(gel)
Line 249392: Q54943392 is not a known grammeme for L642802(neo)
Line 254764: Q112154 is not a known grammeme for L686057(valle)
Line 311584: Q545779 is not a known grammeme for L1144336(villa)
Line 311725: Q112154 is not a known grammeme for L1145393(santo)
Line 316999: Q112154 is not a known grammeme for L1188357(investire)
Line 318468: Q54943392 is not a known grammeme for L1200429(anfibio)
Line 318907: Q18478758 is not a known grammeme for L1203813(dietista)
Line 319664: Q18478758 is not a known grammeme for L1209919(musicista)
Line 319971: Q54943392 is not a known grammeme for L1212537(iato)
Line 320287: Q18478758 is not a known grammeme for L1215176(paracadutista)
Line 321975: Q112154 is not a known grammeme for L1228691(suora)
Line 322476: Q18478758 is not a known grammeme for L1232697(qualunque)
Line 322640: Q112154 is not a known grammeme for L1233944(potere)
Line 322977: Q112154 is not a known grammeme for L1236824(sapere)
Line 323840: Q112154 is not a known grammeme for L1243878(valere)
Line 325279: Q3618903 is not a known part of speech grammeme for L1255650(taluno)
Line 325280: Q3618903 is not a known part of speech grammeme for L1255652(certo)
Line 335858: Q56161479 is not a known grammeme for L1341654(paracadute)
Line 344425: Q43747 is not a known grammeme for L1725(chi)
Line 345268: Q2824480 is not a known part of speech grammeme for L8213(questo)
Line 346815: Q164573 is not a known grammeme for L21271(io)
Line 349561: Q54948374 is not a known grammeme for L43228(tempo)
Line 420963: Q545779 is not a known grammeme for L640193(cerotto)
Line 421060: Q18478758 is not a known grammeme for L641009(belga)
Line 421105: Q54948374 is not a known grammeme for L641350(riso)
Line 421129: Q54948374 is not a known grammeme for L641532(ostrica)
Line 421315: Q164573 is not a known grammeme for L643346(ella)
Line 421316: Q164573 is not a known grammeme for L643349(esse)
Line 482930: Q112154 is not a known grammeme for L1145092(cardinale)
Line 482995: Q112154 is not a known grammeme for L1145594(uccello)
Line 484476: Q112154 is not a known grammeme for L1157567(grande)
Line 485472: Q112154 is not a known grammeme for L1165630(sino)
Line 485493: Q112154 is not a known grammeme for L1165857(eppure)
Line 487433: Q112154 is not a known grammeme for L1181866(cantone)
Line 488317: Q54943392 is not a known grammeme for L1189155(crogiolo)
Line 491195: Q18478758 is not a known grammeme for L1211943(chirurgo)
Line 491362: Q18478758 is not a known grammeme for L1213301(giornalista)
Line 493680: Q18478758 is not a known grammeme for L1232666(vivace)
Line 516331: Q112154 is not a known grammeme for L8203(buono)
Line 517950: Q112154 is not a known grammeme for L21231(quale)
Line 517953: Q164573 is not a known grammeme for L21275(noi)
Line 518504: Q112154 is not a known grammeme for L25373(vedere)
Line 522675: Q1130279 is not a known grammeme for L60353(Jacopo)
Line 551967: Q18478758 is not a known grammeme for L307338(ritrattista)
Line 584501: Q54948374 is not a known grammeme for L580877(peccato)
Line 591770: Q54948374 is not a known grammeme for L640281(ora)
Line 591772: Q54943392 is not a known grammeme for L640290(signore)
Line 591782: Q54948374 is not a known grammeme for L640371(momento)
Line 591843: Q54948374 is not a known grammeme for L640872(barca)
Line 591854: Q66364639 is not a known grammeme for L641007(località)
Line 592103: Q164573 is not a known grammeme for L643347(voi)
Line 597067: Q112154 is not a known grammeme for L683141(valore)
Line 597483: Q112154 is not a known grammeme for L686364(canale)
Line 658348: Q112154 is not a known grammeme for L1175346(cavaliere)
Line 662762: Q58233068 is not a known grammeme for L1211381(CD-ROM)
Line 662822: Q54943392 is not a known grammeme for L1211892(nessuno)
Line 662826: Q18478758 is not a known grammeme for L1211949(terrorista)
Line 668166: Q112154 is not a known grammeme for L1255649(taluno)
Line 686939: Q650250 is not a known grammeme for L1727(quando)
Line 687393: Q545779 is not a known grammeme for L5577(gatto)
Line 687675: Q112154 is not a known grammeme for L7875(cane)
Line 688448: Q112154 is not a known grammeme for L14169(volere)
Line 763519: Q54948374 is not a known grammeme for L640242(occhio)
Line 763559: Q18478758 is not a known grammeme for L640544(breve)
Line 763563: Q54948374 is not a known grammeme for L640573(sigaro)
Line 763625: Q54944750 is not a known grammeme for L641104(confessore)
Line 763710: Q56247521 is not a known grammeme for L641756(insieme)
Line 764676: Q18478758 is not a known grammeme for L649835(fascista)
Line 768766: Q58157328 is not a known grammeme for L683558(panico)
Line 826098: Q18478758 is not a known grammeme for L1150883(importante)
Line 826103: Q112154 is not a known grammeme for L1150906(particolare)
Line 827983: Q112154 is not a known grammeme for L1165919(seppure)
Line 829683: Q112154 is not a known grammeme for L1179875(dottore)
Line 833625: Q18478758 is not a known grammeme for L1211851(progettista)
Line 833758: Q54943392 is not a known grammeme for L1212854(portauovo)
Line 834051: Q18478758 is not a known grammeme for L1215102(strumentista)
Line 834390: Q112154 is not a known grammeme for L1217823(migliore)
Line 834458: Q18478758 is not a known grammeme for L1218357(chitarrista)
Line 835775: Q54943392 is not a known grammeme for L1228628(scarogna)
Line 835928: Q54943392 is not a known grammeme for L1229749(enigma)
Line 835961: Q545779 is not a known grammeme for L1230029(merda)
Line 836421: Q1050744 is not a known part of speech grammeme for L1233763(cui)
Line 836670: Q112154 is not a known grammeme for L1235660(vincere)
Line 860656: Q18478758 is not a known grammeme for L21239(giovane)
Line 860657: Q43747 is not a known grammeme for L21248(che)
Line 934870: Q112154 is not a known grammeme for L641205(pane)
Line 934894: Q54943392 is not a known grammeme for L641366(abbondare)
Line 935135: Q164573 is not a known grammeme for L643344(tu)
Line 935138: Q112154 is not a known grammeme for L643382(dovere)
Line 937760: Q112154 is not a known grammeme for L664445(fiore)
Line 939969: Q112154 is not a known grammeme for L683138(colore)
Line 940515: Q112154 is not a known grammeme for L688115(quartiere)
Line 943011: Q54943392 is not a known grammeme for L707557(ametista)
Line 997817: Q18478758 is not a known grammeme for L1150882(grave)
Line 997821: Q18478758 is not a known grammeme for L1150915(potente)
Line 999444: Q54943392 is not a known grammeme for L1164389(fintamente)
Line 1000888: Q54943392 is not a known grammeme for L1175730(assiologico)
Line 1003606: Q18478758 is not a known grammeme for L1197448(dalmata)
Line 1003934: Q54943392 is not a known grammeme for L1200192(acceso)
Line 1005123: Q18478758 is not a known grammeme for L1209918(macchinista)
Line 1005127: Q112154 is not a known grammeme for L1209975(lasciare)
Line 1005754: Q18478758 is not a known grammeme for L1215125(astronauta)
Line 1006059: Q3618903 is not a known part of speech grammeme for L1217831(qualche)
Line 1007513: Q112154 is not a known grammeme for L1229293(casale)
Line 1017814: Q15911314 is not a known part of speech grammeme for L1311048(Museimpresa)
Line 1032285: Q545779 is not a known grammeme for L21227(libro)
Line 1032288: Q54943392 is not a known grammeme for L21237(dire)
Line 1099115: Q54943392 is not a known grammeme for L580789(acciaio)
Line 1106313: Q58233068 is not a known grammeme for L640363(paese)
Line 1106374: Q66364639 is not a known part of speech grammeme for L640787(polo)
Line 1106376: Q66364639 is not a known part of speech grammeme for L640791(polo)
Line 1106488: Q54948374 is not a known grammeme for L641829(frase)
Line 1106677: Q164573 is not a known grammeme for L643345(egli)
Line 1106678: Q164573 is not a known grammeme for L643348(essi)
Line 1111692: Q545779 is not a known grammeme for L683503(topo)
Line 1168346: Q112154 is not a known grammeme for L1145075(bambino)
Line 1170911: Q112154 is not a known grammeme for L1165698(male)
Line 1172605: Q112154 is not a known grammeme for L1179500(peggiore)
Line 1172900: Q112154 is not a known grammeme for L1181825(barone)
Line 1175071: Q3618903 is not a known part of speech grammeme for L1199371(alcuno)
Line 1175119: Q3618903 is not a known part of speech grammeme for L1199699(altro)
Line 1176381: Q18478758 is not a known grammeme for L1209915(camionista)
Line 1176388: Q18478758 is not a known grammeme for L1209976(telegrafista)
Line 1176623: Q18478758 is not a known grammeme for L1211846(ingegnere)
Line 1176816: Q54943392 is not a known grammeme for L1213328(ubriaco)
Line 1177356: Q18478758 is not a known grammeme for L1217796(batterista)
Line 1178777: Q112154 is not a known grammeme for L1229504(natale)
Line 1179138: Q18478758 is not a known grammeme for L1232475(maronita)
Line 1179140: Q3618903 is not a known part of speech grammeme for L1232495(ogni)
Line 1179157: Q18478758 is not a known grammeme for L1232696(qualsiasi)
Line 1179158: Q18478758 is not a known grammeme for L1232698(qualsiasi)
Line 1190962: Q54943392 is not a known grammeme for L1329453(accenditoio)
Line 1203348: Q43747 is not a known grammeme for L21273(più)
Line 1206028: Q54948374 is not a known grammeme for L43224(vita)
Line 1236957: Q54943392 is not a known grammeme for L307495(ubriaco)
Line 1277333: Q54948374 is not a known grammeme for L640238(mano)
Line 1277472: Q54948374 is not a known grammeme for L641404(secchio)
Line 1280620: Q54943392 is not a known grammeme for L666358(gioco)
Line 1282638: Q54943392 is not a known grammeme for L683062(edificio)
Line 1282689: Q112154 is not a known grammeme for L683461(sole)
Line 1282798: Q18478758 is not a known grammeme for L684481(analfabeta)
Line 1282819: Q54943392 is not a known grammeme for L684627(reparto)
Line 1283407: Q112154 is not a known grammeme for L689364(cielo)
Line 1285502: Q54943392 is not a known grammeme for L706643(raviolo)
Line 1339800: Q112154 is not a known grammeme for L1144891(ragione)
Line 1339819: Q18478758 is not a known grammeme for L1145058(atleta)
Line 1342325: Q650250 is not a known grammeme for L1165467(ci)
Line 1343558: Q54943392 is not a known grammeme for L1175120(restauro)
Line 1343845: Q54943392 is not a known grammeme for L1177668(pernicioso)
Line 1344078: Q112154 is not a known grammeme for L1179473(minore)
Line 1344361: Q54943392 is not a known grammeme for L1181804(aquilone)
Line 1345305: Q54943392 is not a known grammeme for L1189171(picciolo)
Line 1347643: Q54943392 is not a known grammeme for L1207692(staio)
Line 1348578: Q18478758 is not a known grammeme for L1215112(consigliere)
Line 1350753: Q112154 is not a known grammeme for L1232700(quale)
Line 1351122: Q112154 is not a known grammeme for L1235656(vivere)

Here is the current generated lexical dictionary files to debug the test failures.

it.zip

[grhoten]

It looks like dictionary-parser isn't bringing in some of the Italian words. For example, ora is missing as a noun from the data.

These are the options that I'm using.

--language it --inflection-types noun,adjective,article,verb --add-sound consonant-start,vowel-start --ignore-property Q164573 --ignore-property Q488383 --ignore-property Q175026 --map-grammeme Q650250,ignorable-inflection