Differences between revisions 4 and 6 (spanning 2 versions)

Preliminary results for POS induction

Note: in the baselines, CPOS, POS and UPOS are used to match the amount of tags those columns have for each dataset. The same goes for CPOS-MK, POS-MK, and UPOS-MK, which were made using a different tool.

Averages over languageswith cutoff 10 for submissions

measure	Christodoulopoulos, standard	Chrupala, standard-column3	Chrupala, standard-column4
M-1	68.6829876391	76.5107286096	75.9002750672
M-M	45.7598697077	38.6901601565	40.6371555008
VI	3.29549124698	3.73909727709	3.69384378012
VM	52.6598296566	53.7514171644	58.1458809399

Averages over languages with cutoff 10 for baselines

measure	CPOS	CPOS-MK	POS	POS-MK	UPOS	UPOS-MK
M-1	62.6299192299	65.1927193106	72.4802031122	72.6503959584	55.3421238127	58.4994267076
M-M	41.2675966155	43.0338998843	33.3444767206	34.6035102232	42.9249488539	45.369973969
VI	3.70773119248	3.61144572597	4.19181484845	3.97071553021	3.6334290507	3.55445522787
VM	46.5907665493	48.5134872712	50.5163416831	51.4260360779	41.6230488654	44.6569810058

Results for submissions

M-1

cutoff: 10
file	Christodoulopoulos, standard	Chrupala, standard-column3	Chrupala, standard-column4
arabic_padt	63.1578947368	72.8070175439	72.8070175439
basque_3lb	65.2823920266	73.1450719823	75.276854928
czech_pdt	67.2175721064	71.5252972224	75.2998880418
danish_cdt	69.0721649485	79.381443299	71.8873909596
dutch_alpino	57.2789115646	74.1496598639	76.0544217687
english_childes	82.5730435475	87.3338110023	85.3873099276
english_ptb	77.943615257	76.8380320619	72.4709784411
portuguese_floresta	72.0408163265	74.8979591837	75.9183673469
slovene_jos	62.8472222222	76.4756944444	75.3472222222
swedish_talbanken	69.4162436548	78.5532994924	78.5532994924
cutoff: 15
file	Christodoulopoulos, standard	Chrupala, standard-column3	Chrupala, standard-column4
arabic_padt	N/A	76.2295081967	76.2295081967
basque_3lb	65.4140295359	73.3517932489	75.4087552743
czech_pdt	67.0143415906	71.2276127084	74.9353827855
danish_cdt	70.1274709034	79.7524478108	72.2889340477
dutch_alpino	64.347826087	73.5403726708	75.652173913
english_childes	82.4751905652	87.3615705451	85.3408600604
english_ptb	79.886086249	77.5589910496	73.458096013
portuguese_floresta	73.2727272727	75.6363636364	76.1818181818
slovene_jos	63.5895970277	75.5358673907	73.6210345813
swedish_talbanken	69.0654205607	74.6728971963	74.6728971963
cutoff: none
file	Christodoulopoulos, standard	Chrupala, standard-column3	Chrupala, standard-column4
arabic_padt	N/A	79.0983606557	79.0007806401
basque_3lb	65.3235396992	72.59181532	75.2291010843
czech_pdt	67.3015104905	72.4004239973	76.0003686933
danish_cdt	70.7745759248	79.9032631651	71.6193201172
dutch_alpino	70.1342882722	74.0376007162	76.078782453
english_childes	82.4856367417	87.3850058158	85.3547636671
english_ptb	81.0052219321	77.9391009809	73.4634111919
portuguese_floresta	74.0412476564	76.1377194478	77.1262996421
slovene_jos	65.3092806296	75.5272582571	72.7107927665
swedish_talbanken	67.8571428571	73.5502121641	73.5502121641

M-M

cutoff: 10
file	Christodoulopoulos, standard	Chrupala, standard-column3	Chrupala, standard-column4
arabic_padt	38.5964912281	32.4561403509	32.4561403509
basque_3lb	45.6256921373	42.9401993355	53.1284606866
czech_pdt	49.7201044943	31.486911553	33.8167084289
danish_cdt	47.2640761301	34.4964314036	35.4877081681
dutch_alpino	35.9183673469	46.5306122449	42.4489795918
english_childes	49.1521375687	47.9301011066	64.9988058276
english_ptb	47.6506357103	50.0829187396	40.464344942
portuguese_floresta	50.2040816327	32.6530612245	34.8979591837
slovene_jos	52.6041666667	33.6805555556	34.0277777778
swedish_talbanken	40.8629441624	34.6446700508	34.6446700508
cutoff: 15
file	Christodoulopoulos, standard	Chrupala, standard-column3	Chrupala, standard-column4
arabic_padt	N/A	34.0163934426	34.4262295082
basque_3lb	43.68407173	42.8138185654	52.9535864979
czech_pdt	51.188270546	32.3932386377	33.2418399323
danish_cdt	46.6100129318	32.8653242195	33.696656198
dutch_alpino	49.5031055901	45.0931677019	41.4285714286
english_childes	49.7231410902	48.3640155329	64.5476772616
english_ptb	46.2489829129	53.506916192	41.5134255492
portuguese_floresta	49	32.0909090909	33.8181818182
slovene_jos	50.5573020863	33.0665904544	33.0094312661
swedish_talbanken	39.1588785047	33.4112149533	33.4112149533
cutoff: none
file	Christodoulopoulos, standard	Chrupala, standard-column3	Chrupala, standard-column4
arabic_padt	N/A	37.7634660422	39.1491022639
basque_3lb	41.1542497377	41.0353270374	52.3819517314
czech_pdt	51.6164898091	31.0370652011	31.7381586073
danish_cdt	45.7047482799	31.5075958853	31.7732815587
dutch_alpino	56.1683079678	43.0975828111	39.982094897
english_childes	49.9700398294	48.5707236262	64.5024849318
english_ptb	47.094418178	52.7856185167	41.3450003528
portuguese_floresta	48.4063405488	34.2082836202	35.3843531618
slovene_jos	53.0353274086	33.187425388	32.5905292479
swedish_talbanken	40.5410183876	34.0700141443	34.0700141443

VM

cutoff: 10
file	Christodoulopoulos, standard	Chrupala, standard-column3	Chrupala, standard-column4
arabic_padt	43.6211964667	49.8816447135	49.8816447135
basque_3lb	48.5364097962	50.9597089904	58.1153238489
czech_pdt	44.7327885912	38.8961752109	44.037405893
danish_cdt	53.5911751218	57.5333414417	64.7519294992
dutch_alpino	38.0201628027	50.3408491583	50.8321055566
english_childes	68.0779879749	67.6083952977	78.4198747296
english_ptb	62.5731127003	58.5209699106	63.0063848654
portuguese_floresta	58.9882679955	54.1297334766	57.0552971031
slovene_jos	49.8388790979	50.738367554	56.4538572993
swedish_talbanken	58.618316019	58.9049858901	58.9049858901
cutoff: 15
file	Christodoulopoulos, standard	Chrupala, standard-column3	Chrupala, standard-column4
arabic_padt	N/A	51.4339604059	51.6203052218
basque_3lb	46.7165180787	49.606179371	55.8093389597
czech_pdt	46.7519242235	40.4179130514	45.101577753
danish_cdt	54.7255334698	56.8718598564	64.2754814386
dutch_alpino	46.7147146388	52.8388520919	52.1605322185
english_childes	68.1322390813	67.6975103315	78.1945034091
english_ptb	63.7504602406	60.4391855367	62.8882641464
portuguese_floresta	57.6750545739	53.3265086894	56.4041368033
slovene_jos	50.1665409271	47.9950001142	53.5940480803
swedish_talbanken	58.37082748	56.4199196205	56.4199196205
cutoff: none
file	Christodoulopoulos, standard	Chrupala, standard-column3	Chrupala, standard-column4
arabic_padt	N/A	51.4446158921	52.9529877892
basque_3lb	46.3245847729	48.2992268307	54.4461272977
czech_pdt	48.7612140547	42.4290461732	46.7616977218
danish_cdt	56.1571306338	56.8333258341	63.61895607
dutch_alpino	53.3505084217	54.8328949261	53.3996287428
english_childes	68.1802789742	67.7669510414	78.1824366341
english_ptb	64.1892826164	60.1749543008	61.3064540327
portuguese_floresta	58.4617618641	52.360531594	54.7369091966
slovene_jos	51.296379987	46.6090427073	51.8823187682
swedish_talbanken	58.2345531728	56.0931724273	56.0931724273

VI

cutoff: 10
file	Christodoulopoulos, standard	Chrupala, standard-column3	Chrupala, standard-column4
arabic_padt	3.4818745246	3.2823041269	3.2823041269
basque_3lb	3.4430583016	3.8326267531	3.4610793641
czech_pdt	3.4098817039	5.0591037998	5.4736553927
danish_cdt	3.5680167855	3.8992497896	3.7658341725
dutch_alpino	3.9333377443	3.1358828244	3.482192106
english_childes	2.5788568068	2.8120126426	2.0736802206
english_ptb	3.0163722794	3.4462285103	3.7348205442
portuguese_floresta	2.863504147	3.7681306175	3.7142603395
slovene_jos	3.1771279401	4.2096730529	4.0048508809
swedish_talbanken	3.4828822366	3.9457606538	3.9457606538
cutoff: 15
file	Christodoulopoulos, standard	Chrupala, standard-column3	Chrupala, standard-column4
arabic_padt	N/A	3.4561537611	3.4601369686
basque_3lb	3.5902820742	3.945022692	3.6444144248
czech_pdt	3.3436911848	4.9386211968	5.5651366918
danish_cdt	3.5313583568	4.0779517713	3.9320889674
dutch_alpino	3.5501478111	3.3157551657	3.7160865368
english_childes	2.5921638664	2.8292186976	2.1087371011
english_ptb	3.0049430763	3.3049743661	3.8608413046
portuguese_floresta	2.9591654811	3.9415069907	3.8980890069
slovene_jos	3.1901368255	4.586505035	4.4154748033
swedish_talbanken	3.6477495783	4.367492103	4.367492103
cutoff: none
file	Christodoulopoulos, standard	Chrupala, standard-column3	Chrupala, standard-column4
arabic_padt	N/A	3.8046603261	3.7609800016
basque_3lb	3.6484529041	4.0890793321	3.7832000183
czech_pdt	3.2384899475	4.7941891571	5.4769309594
danish_cdt	3.4696588214	4.1515542889	4.0777087659
dutch_alpino	3.1332855012	3.2828645726	3.7242854122
english_childes	2.5919566677	2.8278027552	2.1120688253
english_ptb	2.9501995985	3.2981153915	4.0282456539
portuguese_floresta	2.9110733729	4.0714783915	4.1121533422
slovene_jos	3.139972222	4.8038759744	4.6838716319
swedish_talbanken	3.7756295217	4.572911917	4.572911917

Results for baselines

M-1

cutoff: 10
file	CPOS	CPOS-MK	POS	POS-MK	UPOS	UPOS-MK
arabic_padt	52.63157894736842	60.526315789473685	N/A	64.03508771929825	54.385964912280706	61.40350877192983
basque_3lb	59.71760797342193	61.240310077519375	65.4485049833887	65.0609080841639	59.33001107419712	57.94573643410853
czech_pdt	60.142879991469854	64.567894652663	73.0447299674788	78.0508610118889	59.60974569494055	57.327930905795164
danish_cdt	63.83822363203806	62.60904044409199	73.949246629659	75.69389373513084	42.86280729579698	51.78429817605076
dutch_alpino	54.96598639455782	59.863945578231295	80.54421768707482	81.7687074829932	53.197278911564624	54.69387755102041
english_childes	79.16965209776292	80.96489133030809	86.37051190191863	88.0304115914338	64.0872541995064	71.35180320038214
english_ptb	72.19458264234385	73.79767827529021	76.45107794361525	77.44610281923715	57.490326147042566	62.133775566611384
portuguese_floresta	63.469387755102034	65.10204081632654	67.14285714285714	67.3469387755102	58.57142857142858	59.183673469387756
slovene_jos	56.33680555555556	56.25	65.53819444444444	62.06597222222222	53.125	52.951388888888886
swedish_talbanken	63.83248730964467	67.00507614213198	63.83248730964467	67.00507614213198	50.76142131979695	56.21827411167513
cutoff: 15
file	CPOS	CPOS-MK	POS	POS-MK	UPOS	UPOS-MK
arabic_padt	59.83606557377049	63.934426229508205	58.606557377049185	61.885245901639344	58.19672131147541	59.83606557377049
basque_3lb	60.706751054852326	60.77267932489452	65.26898734177216	65.50632911392405	59.005801687763714	57.67405063291139
czech_pdt	60.14547450765113	64.8642466662092	74.33381367368878	78.87646103524784	59.63311146183582	56.43999176559391
danish_cdt	66.35876593386291	63.88324404212082	75.37409939035655	76.57491224829116	42.896730094217624	50.803620912617774
dutch_alpino	56.27329192546584	63.16770186335404	82.54658385093168	83.72670807453416	54.90683229813664	59.3167701863354
english_childes	78.82568675391917	80.87516180066159	86.29009060837049	88.00158205091327	63.50496188695527	70.92262332805983
english_ptb	74.62978030919447	76.81041497152155	78.56794141578519	79.91863303498779	59.70707892595606	61.75752644426363
portuguese_floresta	65.0909090909091	64.0909090909091	68.54545454545455	66.45454545454545	60.45454545454545	60.36363636363637
slovene_jos	58.9882823663904	57.35924549871392	66.96198913975422	64.21834809945699	56.130322949414115	51.700485853100886
swedish_talbanken	62.523364485981304	65.23364485981308	62.523364485981304	65.23364485981308	48.22429906542056	51.12149532710281
cutoff: none
file	CPOS	CPOS-MK	POS	POS-MK	UPOS	UPOS-MK
arabic_padt	62.90007806401249	67.46682279469165	66.58860265417643	69.1647150663544	62.91959406713505	64.36377829820454
basque_3lb	60.20986358866737	59.573277369709686	63.84749912556838	64.42812172088142	57.9783140958377	56.3903462749213
czech_pdt	61.30736349705621	65.8641825953706	76.05336835919947	79.94769163411796	60.8787575034853	57.12269422649292
danish_cdt	67.38197424892704	64.66380543633763	76.27222562844881	77.22596907146263	42.63233190271817	47.60542271271885
dutch_alpino	57.99462846911369	68.18263205013429	84.17188898836169	84.76275738585497	57.314234556848696	63.043867502238136
english_childes	78.8163970251313	80.86073807761447	86.29234077050509	88.00535758344789	63.39572098269359	70.81879383877904
english_ptb	76.91235622045022	79.09110154540964	80.69120033871992	82.1889774892386	61.85343306753228	61.860489732552395
portuguese_floresta	67.34276461564683	67.20640872677689	71.60388614283279	69.21765808760865	63.5929776717232	64.59860235213908
slovene_jos	61.58199584383428	58.43392138656762	68.93045054604943	65.68510412521555	58.31896361144272	50.3647698633771
swedish_talbanken	61.2093352192362	64.3917963224894	61.2093352192362	64.3917963224894	47.50707213578501	46.03960396039604

M-M

cutoff: 10
file	CPOS	CPOS-MK	POS	POS-MK	UPOS	UPOS-MK
arabic_padt	35.96491228070175	41.228070175438596	N/A	41.228070175438596	36.84210526315789	49.122807017543856
basque_3lb	39.42414174972315	43.050941306755256	27.491694352159467	31.3953488372093	48.36655592469546	44.85049833887043
czech_pdt	44.56469584688383	41.653782587833874	28.623980380657887	26.128911872900783	45.99882710454764	38.22039771818521
danish_cdt	42.98176050753371	44.88501189532118	26.090404440919908	30.84853291038858	39.452815226011104	46.62965900079302
dutch_alpino	33.605442176870746	41.224489795918366	21.63265306122449	21.360544217687075	31.15646258503401	34.42176870748299
english_childes	46.76777326645968	48.12514927155481	39.82167024918398	36.39837592548364	52.65106281347026	61.0142504577661
english_ptb	44.776119402985074	43.67053620784964	44.3338861249309	40.96185737976783	43.78109452736319	46.434494195688224
portuguese_floresta	44.69387755102041	43.87755102040816	38.9795918367347	37.3469387755102	44.48979591836735	45.714285714285715
slovene_jos	44.61805555555556	40.36458333333333	37.84722222222222	38.10763888888889	40.19097222222222	42.62152777777778
swedish_talbanken	35.27918781725889	42.25888324873097	35.27918781725889	42.25888324873097	46.31979695431472	44.67005076142132
cutoff: 15
file	CPOS	CPOS-MK	POS	POS-MK	UPOS	UPOS-MK
arabic_padt	40.98360655737705	40.98360655737705	35.24590163934426	38.52459016393443	41.39344262295082	46.31147540983606
basque_3lb	37.869198312236286	40.625	26.002109704641352	29.047995780590718	47.00685654008439	41.904008438818565
czech_pdt	47.08479150941238	43.81847709233971	29.630137926302062	27.962670692376314	46.84690866671241	40.34172785287861
danish_cdt	41.75133936818769	44.72566044707186	23.83151671900979	28.69019028265287	38.333641234066135	45.242933678182155
dutch_alpino	43.60248447204969	49.25465838509317	21.73913043478261	21.86335403726708	39.68944099378882	46.58385093167702
english_childes	47.033654537609664	48.899755501222494	40.327916007478784	36.44110455918309	52.880051776211715	60.95570257442831
english_ptb	48.44589096826689	46.03742880390562	44.93083807973963	43.8079739625712	47.58340113913751	51.521562245728234
portuguese_floresta	46.27272727272727	42.18181818181818	38.72727272727273	36.18181818181818	45.909090909090914	44.72727272727273
slovene_jos	44.12689339811375	38.46813375250072	37.496427550728775	37.83938268076593	40.382966561874824	41.92626464704201
swedish_talbanken	35.14018691588785	41.02803738317757	35.14018691588785	41.02803738317757	43.97196261682243	39.76635514018692
cutoff: none
file	CPOS	CPOS-MK	POS	POS-MK	UPOS	UPOS-MK
arabic_padt	39.20765027322404	50.975800156128024	32.396565183450434	41.31537861046058	41.88134270101484	50.78064012490242
basque_3lb	36.04057362714236	37.6495278069255	24.763903462749212	27.534102833158446	44.76390346274921	39.328436516264425
czech_pdt	47.63287361884023	44.46441533303377	28.088670745336607	26.730842349037363	46.551565218393186	40.38459322756444
danish_cdt	39.743851761019144	41.75352544451257	21.425165201989234	25.001703113291097	35.56781797125145	41.9578990394441
dutch_alpino	48.16472694717995	55.89973142345569	21.396598030438675	21.378692927484334	43.11548791405551	54.01969561324977
english_childes	47.1925557787882	49.19460011984068	40.53434845440767	36.98494942018258	52.966056889076874	60.98833315709704
english_ptb	48.9115094206478	46.45402582739398	43.68781313951027	44.26116717239433	49.84651753581257	52.840307670594875
portuguese_floresta	49.58241009033578	45.11675472984489	42.64530424407704	36.54337821714675	48.79836372933356	46.65075847963184
slovene_jos	46.809921740283855	40.34575761595261	40.16005659459698	39.34208781005438	42.26466816996065	40.562408807534155
swedish_talbanken	36.12093352192362	41.902404526166904	36.12093352192362	41.902404526166904	44.57213578500707	38.04809052333805

VM

cutoff: 10
file	CPOS	CPOS-MK	POS	POS-MK	UPOS	UPOS-MK
arabic_padt	40.70892370921145	44.92949974839461	N/A	47.63765859008712	38.62193584873766	45.27795358075366
basque_3lb	42.199208767808	44.29923225199735	40.72593677574713	42.4594847551127	43.54625131660638	42.24257552073488
czech_pdt	35.77458673903885	39.62525709541947	40.97481709019173	44.679177076308925	34.59052456932714	35.848348255191546
danish_cdt	48.57123261161907	48.491757723049986	49.47795255239334	52.94524153380195	34.3524320008746	40.49473163040624
dutch_alpino	32.5128425192392	38.52142425483501	47.72058362689208	48.646729973671974	31.63907224647688	33.98468809069307
english_childes	64.14638879707744	66.66092238520315	65.92862173333124	66.50149011067717	59.059621276766535	64.37131233910588
english_ptb	57.53672719722389	59.21539374080928	60.08486788124321	60.05605387888573	47.97000200901931	52.11407795988572
portuguese_floresta	50.058031351373266	49.757892829223316	51.99031654658284	50.691889684757996	45.00076798162327	45.263240181107975
slovene_jos	41.23706730467941	37.2562719922	44.581322446253395	44.26541448444238	36.24058072558894	37.0959315080564
swedish_talbanken	53.16265649565568	56.37722069111704	53.16265649565568	56.37722069111704	45.20930067887769	49.876950992074654
cutoff: 15
file	CPOS	CPOS-MK	POS	POS-MK	UPOS	UPOS-MK
arabic_padt	42.17979984333175	45.189953994292104	40.238159341388005	43.20726896696791	39.45187196388214	42.753953244237856
basque_3lb	40.68126166169092	41.747777213081974	39.58594436503491	40.5857286481685	41.673030321288714	39.59897956583877
czech_pdt	38.861629644067825	42.238684800207196	43.253519267489324	46.781287389708694	37.74132361720956	37.28843917624059
danish_cdt	49.8009381016879	50.42809916493637	49.0596385970732	52.57501020695084	35.11019970719561	40.83717502179684
dutch_alpino	38.64651435986231	45.419600662789385	49.32667887737986	50.35183093757589	37.84268482039108	41.80473812307209
english_childes	64.09041319498611	66.76713984101629	65.94659316651865	66.52809632387915	58.67145151792853	64.11897747741847
english_ptb	60.340906416958475	61.42791234166548	61.58546592281968	62.05338628949516	51.61293788345791	54.580664368336194
portuguese_floresta	50.41758133621912	48.962947240124855	51.59741227911414	49.3302188210619	45.89877588635289	45.826811622396846
slovene_jos	42.4372660370666	36.322787549998296	44.53782007551118	43.07282941448256	36.88194410667212	36.33327001399023
swedish_talbanken	51.74446960382848	54.34695181692608	51.74446960382848	54.34695181692608	42.58481070859618	46.20601768058087
cutoff: none
file	CPOS	CPOS-MK	POS	POS-MK	UPOS	UPOS-MK
arabic_padt	39.61795755461081	47.08732676716075	42.15312147648852	44.00558261756578	39.36537133401538	44.125960150211256
basque_3lb	39.46346101543157	40.13738687040009	38.528137245158355	39.337371537033384	40.47206171221522	37.61799549481319
czech_pdt	42.12121684814763	45.00335964493397	45.252256135411	48.73635803120324	41.11145116640931	38.84081757184108
danish_cdt	50.2047532580977	51.67705933004042	49.21275346415013	51.972902702804845	35.29042026183746	39.93654755587245
dutch_alpino	43.35371516610631	51.408673129977046	49.40512630836002	50.19809618675929	43.72708697359774	47.242776533219065
english_childes	64.13684369988403	66.84961073491165	66.01356950258125	66.57260375467816	58.67456285536073	64.07050847572633
english_ptb	61.64692734584472	62.71455894395888	62.00746932096162	62.993768053637524	53.74609473193219	54.53582750074919
portuguese_floresta	51.71952101086868	51.90661955603858	52.93663001068718	51.314736760749156	49.467699935149476	49.86273904785976
slovene_jos	44.50437698444875	36.822751238770934	45.81572592134726	43.482088612028974	38.61354309740944	36.480878108892725
swedish_talbanken	51.76404795402425	54.28376463629581	51.76404795402425	54.28376463629581	43.39045410147195	44.50675543104269

VI

cutoff: 10
file	CPOS	CPOS-MK	POS	POS-MK	UPOS	UPOS-MK
arabic_padt	3.6037196135150844	3.3713816221063233	N/A	3.231537026117248	3.4965299736308255	3.209369987128977
basque_3lb	3.9570963009822266	3.8195742100369157	4.94319783845247	4.641000246009852	3.54698776855054	3.655702758023394
czech_pdt	3.851354553613626	3.7390316792865277	4.836063958677166	4.598761344254692	3.7987744497269773	3.9454681465834947
danish_cdt	3.958239350557819	3.960441688918996	5.0481947150234125	4.545365330903609	4.116815334646562	3.905252508039036
dutch_alpino	4.1734217141834264	3.893354493497702	4.848075820662275	4.767617150320152	4.155799406533266	4.042608031227681
english_childes	2.9007138858035972	2.7029856352464856	3.0293426667804866	3.0139275400173693	2.685454779723036	2.431373057864715
english_ptb	3.3775253746102774	3.3187757207604447	3.3239325685968364	3.4107402741833885	3.570048470909011	3.3211028966581115
portuguese_floresta	3.434082959516149	3.5337511236285066	3.5143131460073267	3.633625707152781	3.5039336661851586	3.5599891777558255
slovene_jos	3.782248346979371	4.050753279027225	4.1443030968066825	4.140172875939027	3.7578587878985643	3.939802496629385
swedish_talbanken	4.038909825015005	3.7244078072360205	4.038909825015005	3.7244078072360205	3.7020878691546244	3.5338832187752125
cutoff: 15
file	CPOS	CPOS-MK	POS	POS-MK	UPOS	UPOS-MK
arabic_padt	3.628957723669198	3.4795494329127483	4.034781118491125	3.7554515505987736	3.5803200846797205	3.414072925568897
basque_3lb	4.096865655574767	4.002333004670198	5.057956223743966	4.840001558235681	3.6757138149733715	3.8123843730692406
czech_pdt	3.716411969198163	3.632910285751592	4.73145148827073	4.4861201550512115	3.6887743943615456	3.903821377735426
danish_cdt	3.9337669052070776	3.8633061293693842	5.178951500354037	4.651606749314703	4.117740177422952	3.8895226665381575
dutch_alpino	3.948596607395471	3.6383399748132557	5.107819725569282	4.9926119652532925	3.936611030452549	3.740853008296976
english_childes	2.9248491720201404	2.711930203783507	3.0510899865216805	3.0359685540357635	2.7217540684242967	2.465427500862682
english_ptb	3.2257331696268063	3.1920157737900703	3.2841031351563807	3.296937389449576	3.3792331472133172	3.169747343637947
portuguese_floresta	3.4191926747830235	3.587863046547434	3.5835699972492856	3.738307899751621	3.47926617489964	3.541378652607975
slovene_jos	3.738933461183935	4.1650402915136375	4.184266048254768	4.308525937171898	3.7704283341462514	4.0116347355026125
swedish_talbanken	4.297569625791702	4.021231923114433	4.297569625791702	4.021231923114433	4.010449489945643	3.874741297889907
cutoff: none
file	CPOS	CPOS-MK	POS	POS-MK	UPOS	UPOS-MK
arabic_padt	3.9422909961841985	3.4647655342844788	4.097755344566557	3.9468517455697008	3.703609623146906	3.4587128229131134
basque_3lb	4.198535147667102	4.116096856071136	5.157146337639819	4.9587214856592325	3.763513979697533	3.930665336214437
czech_pdt	3.5414346353584483	3.4777673175502946	4.617839170808079	4.34893563812455	3.528316015722751	3.7984160347354208
danish_cdt	3.9574187163256545	3.8153191227581225	5.232069581089807	4.803883575029757	4.13097500523504	3.920793085328947
dutch_alpino	3.667054251555202	3.2562703408423794	5.220305345572781	5.140864550321195	3.6011050209848863	3.3882776712298
english_childes	2.925460699480433	2.708678369019159	3.0492217736447946	3.0365543256921352	2.7246079785101123	2.4726442115598033
english_ptb	3.104412037172135	3.0607779204207914	3.2297346963538884	3.2083384001899957	3.1964613511025375	3.0943185410274854
portuguese_floresta	3.3157616644507604	3.3498657486776593	3.4768413123239537	3.5855956892698613	3.2533514799356067	3.278528843547279
slovene_jos	3.6142805823691075	4.149003430098631	4.086674036470554	4.328803406631884	3.7345892107712264	3.9862589371187758
swedish_talbanken	4.453266373984464	4.165532958263058	4.453266373984464	4.165532958263058	4.106404467878098	4.07207779069561

-  ⇤ ← Revision 4 as of 2012-04-20 12:12:38 → 
  Size: 30487
  Editor: TrevorCohn
  Comment:
+   ← Revision 6 as of 2012-04-20 20:57:51 → ⇥
  Size: 30175
  Editor: TrevorCohn
  Comment:
-Deletions are marked like this.
+Additions are marked like this.
 Line 6:
+Note: in the baselines, CPOS, POS and UPOS are used to match the amount of
tags those columns have for each dataset. The same goes for CPOS-MK, POS-MK,
and UPOS-MK, which were made using a different tool.
-Line 18:
+Line 23:
+== Results for submissions ==
-Line 169:
+Line 174:
-= Baseline results = 
== Averages over languages and cutoffs: ==
|| measure || CPOS || CPOS-MK || POS || POS-MK || UPOS || UPOS-MK ||
|| M-1 || 64.1778107031 || 66.288451792 || 72.6552244004 || 73.3972839315 || 56.4157680952 || 58.2379634075 ||
|| M-M || 42.8131248749 || 44.0039372644 || 33.254865061 || 34.2805642312 || 44.1191703659 || 45.9514018832 ||
|| VI || 3.69093679979 || 3.5991018308 || 4.23650849855 || 4.0786000253 || 3.61458384522 || 3.55896098116 ||
|| VM || 47.7880422177 || 49.529261273 || 50.1590211718 || 51.1996747496 || 42.9186088452 || 45.1046547407 ||
+== Results for baselines ==