detrDominoTest

This model is a fine-tuned version of aviola/detrDominoTest on the temp_domino2 dataset. It achieves the following results on the evaluation set:

Loss: 0.3054
Map: 0.795
Map 50: 0.9644
Map 75: 0.9489
Map Small: 0.6649
Map Medium: 0.8058
Map Large: 0.875
Mar 1: 0.563
Mar 10: 0.8475
Mar 100: 0.8475
Mar Small: 0.7197
Mar Medium: 0.8572
Mar Large: 0.875
Map Pip-1: 0.7408
Mar 100 Pip-1: 0.8615
Map Pip-10: 0.8189
Mar 100 Pip-10: 0.8524
Map Pip-11: 0.8134
Mar 100 Pip-11: 0.8462
Map Pip-12: 0.8307
Mar 100 Pip-12: 0.8579
Map Pip-2: 0.841
Mar 100 Pip-2: 0.855
Map Pip-3: 0.7812
Mar 100 Pip-3: 0.8533
Map Pip-4: 0.8175
Mar 100 Pip-4: 0.8429
Map Pip-5: 0.7701
Mar 100 Pip-5: 0.8355
Map Pip-6: 0.7159
Mar 100 Pip-6: 0.7682
Map Pip-7: 0.8037
Mar 100 Pip-7: 0.8692
Map Pip-8: 0.843
Mar 100 Pip-8: 0.8813
Map Pip-9: 0.7638
Mar 100 Pip-9: 0.8467

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 5e-05
train_batch_size: 8
eval_batch_size: 8
seed: 42
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: cosine
num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Map	Map 50	Map 75	Map Small	Map Medium	Map Large	Mar 1	Mar 10	Mar 100	Mar Small	Mar Medium	Mar Large	Map Pip-1	Mar 100 Pip-1	Map Pip-10	Mar 100 Pip-10	Map Pip-11	Mar 100 Pip-11	Map Pip-12	Mar 100 Pip-12	Map Pip-2	Mar 100 Pip-2	Map Pip-3	Mar 100 Pip-3	Map Pip-4	Mar 100 Pip-4	Map Pip-5	Mar 100 Pip-5	Map Pip-6	Mar 100 Pip-6	Map Pip-7	Mar 100 Pip-7	Map Pip-8	Mar 100 Pip-8	Map Pip-9	Mar 100 Pip-9
No log	1.0	39	0.3831	0.7707	0.9684	0.927	0.5938	0.792	0.8	0.5445	0.8254	0.8283	0.6727	0.8425	0.925	0.6593	0.8154	0.8327	0.8476	0.7972	0.85	0.8122	0.8421	0.7815	0.84	0.8186	0.86	0.7848	0.819	0.7498	0.8097	0.7032	0.7727	0.7729	0.8385	0.7822	0.8375	0.7537	0.8067
No log	2.0	78	0.3396	0.7759	0.9671	0.935	0.5735	0.7961	0.95	0.552	0.8251	0.8251	0.5955	0.8415	0.95	0.7095	0.8	0.8458	0.8762	0.7965	0.8269	0.8161	0.8526	0.7549	0.795	0.7708	0.8333	0.7731	0.7952	0.7655	0.8226	0.6989	0.7682	0.7717	0.8423	0.8346	0.875	0.7732	0.8133
No log	3.0	117	0.3413	0.7665	0.9736	0.945	0.6044	0.7818	0.95	0.5434	0.8206	0.8216	0.6561	0.8315	0.95	0.6818	0.8154	0.8044	0.8381	0.763	0.8038	0.814	0.8368	0.8183	0.855	0.7968	0.8267	0.7756	0.8143	0.773	0.829	0.6994	0.75	0.7752	0.8538	0.7946	0.8562	0.7014	0.78
No log	4.0	156	0.3630	0.7517	0.9697	0.9465	0.6005	0.7677	0.9	0.534	0.8094	0.8094	0.6439	0.8207	0.9	0.6363	0.7692	0.8175	0.8476	0.7821	0.8192	0.7616	0.8053	0.776	0.815	0.7621	0.82	0.7999	0.819	0.7593	0.8194	0.6738	0.7409	0.7666	0.8462	0.7832	0.8313	0.7022	0.78
No log	5.0	195	0.3685	0.7546	0.9572	0.9281	0.5432	0.7767	0.7625	0.5394	0.8172	0.8187	0.6152	0.8331	0.875	0.6488	0.8231	0.8343	0.8619	0.7554	0.8077	0.784	0.8474	0.7966	0.845	0.7246	0.82	0.8225	0.8476	0.7397	0.8065	0.7159	0.7545	0.7259	0.8	0.7993	0.8438	0.708	0.7667
No log	6.0	234	0.3723	0.7631	0.9685	0.9171	0.6247	0.7764	0.925	0.5454	0.8146	0.8146	0.6773	0.8233	0.925	0.7055	0.8385	0.7739	0.8048	0.7866	0.8192	0.7976	0.8368	0.786	0.82	0.746	0.8133	0.8275	0.8476	0.7449	0.7968	0.7101	0.75	0.7107	0.7923	0.8261	0.8562	0.7418	0.8
No log	7.0	273	0.3554	0.7663	0.9724	0.9386	0.6053	0.7857	0.925	0.5409	0.8192	0.8198	0.6591	0.8314	0.925	0.7293	0.8308	0.8056	0.8476	0.7934	0.8269	0.8256	0.8526	0.7477	0.795	0.751	0.8333	0.8182	0.8524	0.7572	0.8129	0.7043	0.7591	0.746	0.7923	0.8267	0.875	0.6905	0.76
No log	8.0	312	0.3772	0.753	0.961	0.9144	0.5717	0.774	0.925	0.5344	0.8075	0.8084	0.6303	0.8232	0.925	0.7172	0.8	0.7985	0.8238	0.7954	0.8346	0.7836	0.8211	0.7747	0.815	0.7661	0.8467	0.7922	0.8238	0.7433	0.8032	0.6735	0.7455	0.6932	0.7885	0.7621	0.8125	0.7359	0.7867
No log	9.0	351	0.3680	0.7603	0.9688	0.9231	0.605	0.7738	0.9	0.5446	0.8082	0.8088	0.6455	0.82	0.9	0.7341	0.8231	0.8035	0.8476	0.7777	0.8115	0.8294	0.8474	0.7754	0.81	0.7356	0.8	0.8142	0.8333	0.7692	0.8226	0.6743	0.7409	0.7332	0.7962	0.7726	0.8125	0.7042	0.76
No log	10.0	390	0.3842	0.7361	0.9719	0.9261	0.5901	0.7512	0.875	0.53	0.7929	0.7932	0.6364	0.8044	0.9	0.7093	0.7615	0.7597	0.8143	0.7931	0.8231	0.7435	0.7947	0.7316	0.765	0.7113	0.8067	0.7918	0.8238	0.7465	0.8032	0.6395	0.7045	0.7224	0.7885	0.7574	0.8125	0.7269	0.82
No log	11.0	429	0.3707	0.7449	0.9691	0.932	0.5949	0.7595	0.975	0.5337	0.806	0.8063	0.6379	0.8169	0.975	0.7366	0.8462	0.7883	0.8333	0.7493	0.7962	0.7859	0.8158	0.7558	0.8	0.7327	0.8267	0.773	0.8095	0.7741	0.829	0.6793	0.7409	0.7383	0.8231	0.7239	0.7812	0.7013	0.7733
No log	12.0	468	0.3725	0.7494	0.9619	0.9344	0.6046	0.7639	0.9	0.5368	0.8088	0.8095	0.6545	0.8202	0.9	0.7211	0.8308	0.7904	0.819	0.7713	0.8115	0.7896	0.8368	0.7352	0.765	0.7698	0.8133	0.781	0.8286	0.7739	0.8323	0.6444	0.7318	0.7599	0.8308	0.7156	0.7875	0.7401	0.8267
0.3708	13.0	507	0.3603	0.7604	0.9737	0.9428	0.6148	0.7774	0.9	0.5354	0.8098	0.8102	0.65	0.8218	0.9	0.7263	0.7923	0.787	0.8333	0.7927	0.8346	0.7742	0.8316	0.7697	0.8	0.76	0.7933	0.7854	0.8286	0.7544	0.8161	0.6845	0.7455	0.7327	0.7962	0.7767	0.8313	0.7808	0.82
0.3708	14.0	546	0.3518	0.7604	0.9671	0.9351	0.6309	0.7722	0.95	0.5431	0.8149	0.8159	0.6606	0.8254	0.95	0.7241	0.8231	0.8124	0.8238	0.7864	0.8154	0.8048	0.8316	0.7808	0.825	0.7626	0.8267	0.778	0.819	0.7292	0.7903	0.6355	0.7136	0.7794	0.8654	0.7803	0.85	0.7509	0.8067
0.3708	15.0	585	0.3711	0.7405	0.9639	0.896	0.5804	0.7557	0.95	0.5378	0.8032	0.8032	0.6121	0.8161	0.95	0.6714	0.8154	0.7787	0.8143	0.7892	0.8192	0.739	0.8	0.7384	0.79	0.7617	0.8267	0.7737	0.8048	0.7659	0.8258	0.602	0.6773	0.7855	0.8538	0.767	0.8313	0.7131	0.78
0.3708	16.0	624	0.3562	0.7587	0.9622	0.9351	0.5894	0.7776	0.925	0.5471	0.8182	0.8193	0.6364	0.8322	0.925	0.6482	0.8385	0.8094	0.8429	0.7884	0.8115	0.8029	0.8263	0.7913	0.82	0.7394	0.8	0.7939	0.8333	0.7428	0.829	0.6968	0.7591	0.7733	0.8269	0.7765	0.8375	0.7413	0.8067
0.3708	17.0	663	0.3939	0.7434	0.963	0.9271	0.6029	0.7557	0.925	0.5355	0.7964	0.7975	0.6455	0.8072	0.925	0.687	0.7769	0.7825	0.8143	0.7534	0.7808	0.7847	0.8211	0.7474	0.795	0.7514	0.8	0.7445	0.7905	0.7378	0.8258	0.7045	0.7545	0.734	0.7923	0.7368	0.825	0.7574	0.7933
0.3708	18.0	702	0.3832	0.7299	0.9633	0.8936	0.5973	0.7443	0.925	0.5284	0.7942	0.7945	0.6258	0.8045	0.925	0.6571	0.8154	0.7968	0.8286	0.7588	0.7885	0.7437	0.7737	0.723	0.78	0.7491	0.8	0.7686	0.8095	0.7393	0.8097	0.6504	0.7273	0.7116	0.7962	0.767	0.8188	0.6931	0.7867
0.3708	19.0	741	0.3596	0.756	0.9635	0.9066	0.5885	0.7727	0.875	0.541	0.8184	0.8184	0.6621	0.8296	0.875	0.7242	0.8538	0.821	0.8476	0.777	0.8038	0.7652	0.8105	0.7732	0.82	0.7665	0.82	0.7971	0.8381	0.7583	0.8194	0.6624	0.7455	0.7384	0.8308	0.7717	0.8313	0.7173	0.8
0.3708	20.0	780	0.3683	0.7612	0.9639	0.9358	0.631	0.779	0.7375	0.5374	0.8183	0.8197	0.6833	0.8311	0.85	0.689	0.8154	0.8223	0.8381	0.7803	0.8038	0.8172	0.8263	0.7537	0.8	0.7671	0.8133	0.7806	0.8333	0.7725	0.8355	0.6862	0.7591	0.7538	0.8538	0.7661	0.8375	0.7454	0.82
0.3708	21.0	819	0.3645	0.7675	0.9677	0.9265	0.5878	0.7858	0.85	0.5424	0.8246	0.8252	0.6682	0.8384	0.85	0.7228	0.8308	0.7889	0.8238	0.7897	0.8115	0.7997	0.8474	0.7476	0.805	0.802	0.84	0.7969	0.8333	0.7595	0.8065	0.6952	0.7818	0.7647	0.8462	0.7934	0.8562	0.75	0.82
0.3708	22.0	858	0.3777	0.7607	0.9619	0.93	0.6276	0.776	0.9	0.5388	0.8223	0.8249	0.697	0.8348	0.9	0.6858	0.8538	0.7868	0.8238	0.7764	0.8077	0.8306	0.8526	0.7746	0.83	0.7922	0.84	0.8176	0.8476	0.746	0.8032	0.6699	0.7636	0.7264	0.8269	0.78	0.85	0.7416	0.8
0.3708	23.0	897	0.3532	0.7677	0.9615	0.9309	0.6114	0.7815	0.875	0.5458	0.8214	0.8217	0.6652	0.8335	0.875	0.6714	0.8077	0.7988	0.8238	0.7901	0.8269	0.842	0.8579	0.7779	0.82	0.7714	0.8133	0.8097	0.8381	0.7556	0.8129	0.691	0.75	0.77	0.8462	0.7881	0.8375	0.7469	0.8267
0.3708	24.0	936	0.3546	0.7696	0.9681	0.9385	0.6058	0.7819	0.9	0.5429	0.8229	0.8233	0.6788	0.8331	0.9	0.7156	0.8154	0.792	0.8286	0.8082	0.8462	0.8238	0.8526	0.7677	0.815	0.7925	0.8267	0.782	0.8238	0.7649	0.8226	0.7122	0.7682	0.7567	0.8231	0.7703	0.8438	0.749	0.8133
0.3708	25.0	975	0.3651	0.764	0.963	0.9319	0.5945	0.7788	0.925	0.5363	0.819	0.8213	0.6576	0.8332	0.925	0.6889	0.8154	0.7908	0.8381	0.8041	0.8346	0.8226	0.8526	0.7512	0.8	0.7845	0.8267	0.7923	0.8143	0.757	0.8194	0.7231	0.7955	0.7693	0.8269	0.7477	0.8188	0.7362	0.8133
0.3647	26.0	1014	0.3579	0.7522	0.9627	0.9224	0.5684	0.7718	0.7875	0.5353	0.8172	0.8193	0.647	0.8316	0.9	0.65	0.8231	0.7766	0.8286	0.7873	0.8192	0.798	0.8316	0.7617	0.825	0.7624	0.8133	0.7986	0.8381	0.7514	0.8226	0.7005	0.7773	0.7357	0.8231	0.8009	0.8562	0.7037	0.7733
0.3647	27.0	1053	0.3478	0.7722	0.9654	0.9393	0.5952	0.7921	0.9	0.542	0.8329	0.8329	0.6515	0.8486	0.9	0.6669	0.8308	0.8077	0.8333	0.7836	0.8192	0.8066	0.8368	0.8162	0.86	0.8172	0.86	0.8157	0.8381	0.7643	0.8323	0.6787	0.7727	0.763	0.8423	0.8063	0.8562	0.7401	0.8133
0.3647	28.0	1092	0.3548	0.7622	0.9605	0.9301	0.5752	0.7805	0.8781	0.5393	0.8186	0.8195	0.6394	0.8329	0.9	0.6486	0.8231	0.8143	0.8429	0.7778	0.8077	0.7877	0.8158	0.7795	0.815	0.8061	0.8533	0.7792	0.8095	0.7595	0.8419	0.6903	0.7682	0.7596	0.8192	0.7893	0.8375	0.754	0.8
0.3647	29.0	1131	0.3761	0.7473	0.9562	0.9307	0.6266	0.7609	0.875	0.5315	0.8078	0.8089	0.6667	0.8193	0.875	0.6492	0.8308	0.7912	0.8238	0.7703	0.8038	0.7751	0.8	0.7692	0.795	0.7556	0.82	0.7916	0.8238	0.7694	0.8194	0.6874	0.75	0.7689	0.8423	0.7746	0.8375	0.6649	0.76
0.3647	30.0	1170	0.3424	0.7624	0.9653	0.9307	0.6605	0.7723	0.8833	0.5458	0.8201	0.8201	0.697	0.829	0.9	0.6695	0.8385	0.7992	0.8238	0.793	0.8192	0.7972	0.8211	0.7894	0.825	0.7615	0.82	0.789	0.8238	0.7719	0.829	0.6836	0.7318	0.7466	0.8269	0.804	0.8687	0.7442	0.8133
0.3647	31.0	1209	0.3459	0.7745	0.9651	0.9226	0.6118	0.7894	0.9	0.541	0.8231	0.8239	0.6561	0.8369	0.9	0.6797	0.8154	0.8204	0.8381	0.7959	0.8269	0.8347	0.8526	0.7722	0.815	0.7904	0.8267	0.803	0.8286	0.7616	0.8194	0.7078	0.7545	0.763	0.8346	0.8241	0.8687	0.7414	0.8067
0.3647	32.0	1248	0.3604	0.7687	0.9698	0.9452	0.606	0.784	0.825	0.5444	0.8159	0.8159	0.6591	0.8285	0.825	0.7222	0.8385	0.7988	0.8286	0.7875	0.8115	0.7993	0.8263	0.7737	0.81	0.8202	0.8467	0.7956	0.8143	0.7673	0.8129	0.7102	0.7682	0.7578	0.8308	0.782	0.85	0.71	0.7533
0.3647	33.0	1287	0.3488	0.7746	0.9719	0.9411	0.635	0.7886	0.825	0.5467	0.8234	0.8239	0.6848	0.8356	0.825	0.7174	0.8077	0.8026	0.8286	0.8074	0.8385	0.8236	0.8526	0.7782	0.815	0.789	0.8333	0.8001	0.8286	0.7664	0.8226	0.7297	0.7864	0.7594	0.8308	0.765	0.85	0.7566	0.7933
0.3647	34.0	1326	0.3774	0.7615	0.9606	0.9323	0.6755	0.7723	0.825	0.535	0.8195	0.8199	0.7303	0.8276	0.825	0.6784	0.8154	0.7705	0.8095	0.7803	0.8115	0.8217	0.8579	0.7548	0.8	0.7654	0.8133	0.7767	0.819	0.7505	0.8194	0.7157	0.7818	0.7716	0.8423	0.8356	0.8687	0.7173	0.8
0.3647	35.0	1365	0.3671	0.7461	0.9647	0.8973	0.5755	0.764	0.85	0.5404	0.8079	0.8079	0.6167	0.8233	0.85	0.6925	0.8077	0.7819	0.8143	0.7778	0.8077	0.7873	0.8158	0.7288	0.8	0.7817	0.8067	0.7738	0.8095	0.7303	0.8129	0.6881	0.7682	0.7126	0.8038	0.7963	0.8687	0.7026	0.78
0.3647	36.0	1404	0.3604	0.7603	0.9628	0.9211	0.5709	0.7786	0.85	0.5435	0.8112	0.8112	0.6303	0.8268	0.85	0.7226	0.8308	0.7665	0.7905	0.8099	0.8385	0.8065	0.8316	0.7669	0.815	0.7489	0.8	0.789	0.8048	0.7648	0.8161	0.7246	0.7864	0.7536	0.8231	0.7548	0.825	0.7152	0.7733
0.3647	37.0	1443	0.3428	0.7776	0.9712	0.9339	0.6261	0.7926	0.9	0.5532	0.8306	0.8313	0.6848	0.8446	0.9	0.7509	0.8615	0.7924	0.8238	0.8001	0.8346	0.8503	0.8684	0.7855	0.825	0.8124	0.8467	0.8012	0.8286	0.7723	0.8194	0.7011	0.7727	0.7839	0.85	0.749	0.8313	0.7321	0.8133
0.3647	38.0	1482	0.3478	0.7699	0.962	0.9428	0.6391	0.7855	0.9	0.5478	0.8235	0.8235	0.6682	0.8371	0.9	0.6912	0.8308	0.7782	0.8	0.8063	0.8308	0.8305	0.8579	0.7655	0.805	0.7891	0.8333	0.7948	0.8333	0.7555	0.8161	0.7119	0.7773	0.7909	0.8423	0.795	0.8687	0.7301	0.7867
0.3448	39.0	1521	0.3364	0.7651	0.9705	0.9359	0.6459	0.7773	0.875	0.5441	0.8202	0.8205	0.6879	0.8314	0.875	0.736	0.8385	0.7913	0.8143	0.8102	0.8423	0.8351	0.8526	0.7775	0.815	0.7768	0.8467	0.7973	0.8286	0.7415	0.8161	0.6688	0.7364	0.7834	0.8577	0.7613	0.8313	0.7018	0.7667
0.3448	40.0	1560	0.3587	0.7637	0.9703	0.9207	0.6239	0.7762	0.925	0.5447	0.8144	0.8144	0.6682	0.8239	0.925	0.7714	0.8538	0.7711	0.8095	0.8072	0.8231	0.8018	0.8263	0.7764	0.825	0.7827	0.82	0.764	0.7952	0.745	0.8226	0.6794	0.7636	0.7655	0.8308	0.8111	0.8562	0.6887	0.7467
0.3448	41.0	1599	0.3255	0.7904	0.9805	0.962	0.6426	0.8061	0.9	0.5546	0.8325	0.8331	0.6985	0.8436	0.9	0.7856	0.8462	0.8096	0.8286	0.8266	0.85	0.8263	0.8421	0.8067	0.86	0.7991	0.84	0.7951	0.8333	0.7505	0.8129	0.7429	0.7818	0.7766	0.8462	0.8191	0.8562	0.7468	0.8
0.3448	42.0	1638	0.3370	0.7869	0.9703	0.9425	0.6512	0.7984	0.925	0.557	0.8354	0.8354	0.697	0.846	0.925	0.7076	0.8231	0.7993	0.8333	0.8252	0.8462	0.8316	0.8579	0.8062	0.845	0.8117	0.86	0.7905	0.819	0.7614	0.8258	0.7499	0.8045	0.7784	0.8269	0.8097	0.8562	0.7711	0.8267
0.3448	43.0	1677	0.3588	0.7607	0.9568	0.9296	0.6168	0.7724	0.875	0.548	0.8159	0.8159	0.653	0.8267	0.875	0.7101	0.8462	0.7958	0.8095	0.7779	0.8115	0.7812	0.8053	0.7649	0.795	0.7917	0.8467	0.7927	0.819	0.7425	0.8226	0.7341	0.7773	0.7517	0.8269	0.7666	0.8438	0.7194	0.7867
0.3448	44.0	1716	0.3477	0.7795	0.9678	0.9398	0.61	0.7952	0.875	0.5486	0.8234	0.8238	0.6697	0.8381	0.875	0.8197	0.8538	0.7896	0.8238	0.8269	0.8462	0.8326	0.8579	0.7767	0.81	0.7852	0.8333	0.8019	0.8238	0.7393	0.8065	0.6834	0.7636	0.7739	0.8308	0.8006	0.8625	0.7235	0.7733
0.3448	45.0	1755	0.3447	0.7744	0.9709	0.9261	0.6342	0.7876	0.9	0.551	0.8255	0.8255	0.6758	0.8388	0.9	0.7865	0.8308	0.7672	0.8	0.8035	0.8346	0.8338	0.8579	0.7888	0.825	0.7846	0.86	0.7846	0.819	0.7549	0.8194	0.7213	0.7955	0.7713	0.8462	0.7688	0.8313	0.7278	0.7867
0.3448	46.0	1794	0.3430	0.7741	0.9704	0.9294	0.6212	0.7883	0.925	0.5513	0.8192	0.8205	0.6697	0.8326	0.925	0.7891	0.8231	0.7791	0.819	0.8068	0.8269	0.8379	0.8579	0.7579	0.795	0.7864	0.8467	0.7933	0.8143	0.7645	0.8355	0.6911	0.7682	0.7841	0.8423	0.7769	0.8438	0.722	0.7733
0.3448	47.0	1833	0.3547	0.7624	0.9709	0.9265	0.6266	0.7786	0.9	0.5453	0.817	0.817	0.6864	0.8279	0.9	0.7801	0.8615	0.7803	0.8048	0.8041	0.8308	0.7921	0.8263	0.7849	0.815	0.7573	0.8267	0.7775	0.8	0.7644	0.8323	0.6757	0.7591	0.7818	0.8423	0.7467	0.8188	0.7045	0.7867
0.3448	48.0	1872	0.3337	0.7789	0.9694	0.9436	0.6685	0.7908	0.9	0.5532	0.8315	0.8319	0.7212	0.8408	0.9	0.7529	0.8385	0.8186	0.8524	0.827	0.8462	0.8253	0.8474	0.7835	0.83	0.7971	0.8467	0.7951	0.8286	0.7789	0.8484	0.675	0.7591	0.7713	0.8231	0.7884	0.8687	0.7333	0.7933
0.3448	49.0	1911	0.3230	0.7799	0.9706	0.9481	0.6638	0.7912	0.9	0.5525	0.8289	0.8293	0.7015	0.8402	0.9	0.7015	0.8231	0.7753	0.8048	0.8337	0.8538	0.8148	0.8368	0.7871	0.82	0.8297	0.8667	0.7949	0.8238	0.7769	0.8387	0.7055	0.7773	0.7986	0.85	0.7769	0.8562	0.7639	0.8
0.3448	50.0	1950	0.3338	0.7779	0.9668	0.9304	0.6896	0.7882	0.9	0.5514	0.8258	0.8287	0.7242	0.8375	0.9	0.7171	0.8462	0.7719	0.8143	0.8369	0.8615	0.8328	0.8526	0.7718	0.81	0.7655	0.8133	0.7822	0.819	0.7728	0.8323	0.7233	0.7591	0.8051	0.8615	0.8148	0.8813	0.7404	0.7933
0.3448	51.0	1989	0.3329	0.7742	0.9633	0.9366	0.6585	0.7849	0.9	0.5551	0.8314	0.8314	0.7045	0.8412	0.9	0.7177	0.8385	0.7831	0.8381	0.8298	0.8577	0.7877	0.8421	0.7898	0.835	0.7565	0.8267	0.7795	0.8238	0.7742	0.8355	0.7239	0.7636	0.7991	0.8538	0.8084	0.8687	0.741	0.7933
0.3244	52.0	2028	0.3387	0.7726	0.9641	0.9352	0.6517	0.7867	0.9	0.5514	0.8285	0.8285	0.697	0.8386	0.9	0.7406	0.8538	0.8301	0.8667	0.8229	0.8462	0.7583	0.8158	0.8058	0.85	0.7491	0.8	0.7802	0.8143	0.7618	0.8323	0.7198	0.7636	0.7965	0.85	0.7871	0.8562	0.7196	0.7933
0.3244	53.0	2067	0.3371	0.7832	0.9671	0.9449	0.6874	0.7952	0.9	0.5569	0.8328	0.8331	0.7333	0.8412	0.9	0.7871	0.8615	0.7975	0.8286	0.816	0.85	0.8129	0.8421	0.7926	0.83	0.7737	0.8333	0.799	0.8286	0.7682	0.8323	0.702	0.7545	0.8012	0.8423	0.8436	0.8875	0.7049	0.8067
0.3244	54.0	2106	0.3511	0.7682	0.9667	0.9373	0.6718	0.7788	0.9	0.5493	0.8221	0.8225	0.7197	0.8302	0.9	0.7665	0.8231	0.7621	0.8095	0.8072	0.8346	0.8005	0.8316	0.7891	0.835	0.755	0.82	0.7594	0.8143	0.7664	0.829	0.7	0.7682	0.7882	0.8423	0.8087	0.8687	0.7147	0.7933
0.3244	55.0	2145	0.3340	0.7674	0.9672	0.9298	0.6237	0.7799	0.9	0.5504	0.8273	0.8276	0.7152	0.8359	0.9	0.7155	0.8231	0.7725	0.8095	0.8097	0.8308	0.7913	0.8316	0.7796	0.835	0.7677	0.8333	0.7688	0.8095	0.7588	0.8387	0.7163	0.7909	0.7751	0.8346	0.8289	0.8875	0.7247	0.8067
0.3244	56.0	2184	0.3461	0.7747	0.9619	0.9308	0.6657	0.7857	0.9	0.557	0.8247	0.8251	0.7106	0.834	0.9	0.7096	0.8308	0.8014	0.8286	0.821	0.8423	0.7874	0.8158	0.8007	0.83	0.8116	0.8533	0.7689	0.8095	0.7625	0.829	0.7082	0.7727	0.8057	0.8538	0.8221	0.875	0.697	0.76
0.3244	57.0	2223	0.3470	0.7747	0.9593	0.943	0.6614	0.786	0.9	0.5548	0.8299	0.8299	0.7182	0.8383	0.9	0.7153	0.8385	0.7961	0.8333	0.8345	0.8538	0.7896	0.8421	0.7963	0.83	0.8181	0.8467	0.7944	0.8286	0.7582	0.829	0.6994	0.7682	0.8031	0.8654	0.7977	0.8562	0.6936	0.7667
0.3244	58.0	2262	0.3367	0.7766	0.9662	0.9395	0.6466	0.7903	0.7875	0.5509	0.8302	0.8302	0.6924	0.8405	0.9	0.7642	0.8385	0.7876	0.8286	0.8196	0.8462	0.8063	0.8474	0.7951	0.825	0.777	0.84	0.7838	0.8238	0.7518	0.8355	0.7024	0.7636	0.7848	0.8462	0.8286	0.875	0.7181	0.7933
0.3244	59.0	2301	0.3343	0.7839	0.9692	0.9297	0.6242	0.8023	0.7875	0.5508	0.8327	0.8347	0.6788	0.8473	0.9	0.7949	0.8538	0.823	0.8524	0.8115	0.8423	0.8057	0.8421	0.7891	0.84	0.7982	0.8467	0.7915	0.8333	0.7713	0.8258	0.698	0.7682	0.8114	0.8692	0.8257	0.8687	0.6864	0.7733
0.3244	60.0	2340	0.3160	0.7843	0.9699	0.9412	0.6567	0.7996	0.875	0.5588	0.8369	0.8369	0.7015	0.8484	0.875	0.7567	0.8462	0.8036	0.8476	0.8449	0.8654	0.8155	0.8474	0.8116	0.84	0.7813	0.84	0.777	0.819	0.7591	0.8258	0.7329	0.7864	0.8063	0.8692	0.8221	0.8687	0.7011	0.7867
0.3244	61.0	2379	0.3186	0.7788	0.97	0.9377	0.6608	0.7902	0.875	0.5533	0.8332	0.8336	0.6985	0.8458	0.875	0.7187	0.8308	0.7957	0.8333	0.8303	0.8577	0.831	0.8526	0.8094	0.84	0.8014	0.8333	0.785	0.8333	0.7568	0.8226	0.7048	0.7682	0.7863	0.85	0.8166	0.875	0.7092	0.8067
0.3244	62.0	2418	0.3139	0.7736	0.9665	0.9358	0.6263	0.7854	0.9	0.5528	0.8299	0.8314	0.697	0.8418	0.9	0.7243	0.8308	0.7997	0.8333	0.7954	0.8269	0.8232	0.8526	0.8103	0.835	0.754	0.8267	0.7928	0.819	0.7659	0.829	0.7033	0.7727	0.7879	0.8615	0.8047	0.8687	0.722	0.82
0.3244	63.0	2457	0.3227	0.7887	0.9736	0.9476	0.6921	0.799	0.9	0.5551	0.8387	0.8387	0.7424	0.8467	0.9	0.7834	0.8615	0.8091	0.8476	0.8349	0.8577	0.8292	0.8526	0.7917	0.835	0.8085	0.86	0.7871	0.8143	0.7692	0.8419	0.7118	0.7773	0.8088	0.8731	0.7981	0.85	0.7325	0.7933
0.3244	64.0	2496	0.3161	0.7804	0.9686	0.9448	0.6907	0.789	0.9	0.5544	0.8354	0.8362	0.7409	0.8438	0.9	0.7723	0.8692	0.7887	0.8333	0.8127	0.8423	0.7941	0.8368	0.7913	0.835	0.788	0.8533	0.8054	0.8333	0.7517	0.829	0.7488	0.7909	0.7987	0.8615	0.7913	0.8562	0.7217	0.7933
0.2973	65.0	2535	0.3186	0.7846	0.9666	0.9405	0.6644	0.7976	0.85	0.5538	0.8374	0.8374	0.7273	0.8467	0.85	0.8024	0.8538	0.7887	0.8238	0.8159	0.8423	0.8234	0.8526	0.812	0.86	0.7879	0.8533	0.7942	0.8238	0.7602	0.8323	0.7184	0.7818	0.8023	0.8769	0.8258	0.875	0.6846	0.7733
0.2973	66.0	2574	0.3230	0.7824	0.9629	0.9384	0.659	0.7941	0.875	0.5561	0.8418	0.8423	0.7258	0.8513	0.875	0.7691	0.8769	0.807	0.8381	0.7975	0.8385	0.825	0.8474	0.8294	0.87	0.7628	0.8467	0.8065	0.8333	0.7636	0.8355	0.7133	0.7773	0.7965	0.8692	0.8084	0.875	0.7098	0.8
0.2973	67.0	2613	0.3210	0.7839	0.9637	0.9361	0.6755	0.7947	0.875	0.5596	0.8434	0.8434	0.7273	0.8533	0.875	0.7315	0.8692	0.815	0.8524	0.8115	0.85	0.8449	0.8684	0.8356	0.87	0.7724	0.8467	0.8201	0.8429	0.751	0.8194	0.707	0.7636	0.7984	0.8692	0.8127	0.8687	0.7063	0.8
0.2973	68.0	2652	0.3237	0.7861	0.9655	0.9493	0.682	0.7961	0.875	0.5601	0.8426	0.8433	0.7364	0.8517	0.875	0.7583	0.8846	0.8046	0.8381	0.813	0.85	0.8225	0.8421	0.8129	0.855	0.7957	0.8533	0.8048	0.8381	0.7667	0.8387	0.722	0.7727	0.7927	0.8654	0.828	0.875	0.7118	0.8067
0.2973	69.0	2691	0.3199	0.7825	0.9684	0.9462	0.6812	0.7922	0.875	0.5576	0.8384	0.8403	0.75	0.8469	0.875	0.7381	0.8692	0.8035	0.8333	0.7955	0.8385	0.8152	0.8368	0.8194	0.865	0.772	0.8333	0.8116	0.8333	0.7617	0.8194	0.7319	0.8	0.8026	0.8731	0.8295	0.8813	0.7093	0.8
0.2973	70.0	2730	0.3144	0.7844	0.9671	0.9439	0.6711	0.794	0.875	0.5592	0.8409	0.8428	0.7409	0.8508	0.875	0.7423	0.8615	0.8172	0.8429	0.8043	0.8423	0.8186	0.8474	0.8122	0.855	0.7951	0.84	0.7987	0.8286	0.7633	0.829	0.7176	0.7864	0.7947	0.8731	0.8172	0.8938	0.7312	0.8133
0.2973	71.0	2769	0.3160	0.7883	0.9743	0.9428	0.6638	0.7998	0.875	0.5575	0.8407	0.8424	0.7227	0.8517	0.875	0.7803	0.8692	0.828	0.8571	0.8113	0.8462	0.8335	0.8526	0.8126	0.855	0.7893	0.84	0.7934	0.8238	0.759	0.8258	0.7196	0.7864	0.8123	0.8769	0.7994	0.8562	0.7208	0.82
0.2973	72.0	2808	0.3126	0.7862	0.9724	0.9444	0.6806	0.7953	0.875	0.5582	0.841	0.8424	0.7409	0.85	0.875	0.7453	0.8615	0.8237	0.8524	0.7994	0.8308	0.8224	0.8474	0.8292	0.86	0.7968	0.84	0.7884	0.8238	0.7712	0.8419	0.7228	0.7864	0.8025	0.8692	0.8052	0.875	0.7281	0.82
0.2973	73.0	2847	0.3082	0.7896	0.9708	0.9463	0.6745	0.8021	0.875	0.5595	0.8444	0.8454	0.7288	0.8548	0.875	0.7778	0.8769	0.8244	0.8571	0.7996	0.8385	0.8326	0.8579	0.8208	0.85	0.763	0.8467	0.7888	0.8238	0.7714	0.8355	0.7132	0.7864	0.8152	0.8769	0.8191	0.875	0.7498	0.82
0.2973	74.0	2886	0.3101	0.7935	0.9729	0.9513	0.6723	0.8077	0.875	0.5598	0.8458	0.8469	0.7333	0.8562	0.875	0.8075	0.8692	0.8271	0.8571	0.8077	0.8423	0.8319	0.8579	0.8345	0.86	0.7732	0.8533	0.8136	0.8429	0.7574	0.829	0.7122	0.7864	0.8045	0.8692	0.8001	0.8687	0.7522	0.8267
0.2973	75.0	2925	0.3094	0.7829	0.9619	0.9425	0.6697	0.7952	0.875	0.5573	0.8418	0.8418	0.7182	0.852	0.875	0.7548	0.8692	0.8009	0.8429	0.8063	0.8423	0.8228	0.8474	0.8045	0.835	0.7582	0.84	0.7975	0.8286	0.7637	0.8323	0.7199	0.7864	0.7981	0.8692	0.8077	0.8687	0.7605	0.84
0.2973	76.0	2964	0.3021	0.7847	0.9702	0.9443	0.6618	0.7977	0.875	0.5604	0.8437	0.844	0.7152	0.8551	0.875	0.7506	0.8538	0.8136	0.8524	0.8015	0.8385	0.8289	0.8526	0.8311	0.855	0.77	0.8533	0.7943	0.8286	0.7766	0.8387	0.7137	0.7818	0.791	0.8654	0.8005	0.875	0.7442	0.8333
0.2728	77.0	3003	0.3078	0.7897	0.9675	0.9508	0.6532	0.8038	0.875	0.5568	0.8426	0.8426	0.7091	0.8536	0.875	0.7906	0.8538	0.807	0.8381	0.8039	0.8423	0.8284	0.8526	0.844	0.87	0.7799	0.86	0.7876	0.819	0.7775	0.8419	0.7118	0.7727	0.7916	0.8577	0.7997	0.8625	0.7546	0.84
0.2728	78.0	3042	0.3073	0.7935	0.9634	0.9439	0.6684	0.8063	0.875	0.5638	0.8491	0.8491	0.7136	0.8601	0.875	0.756	0.8692	0.812	0.8524	0.8189	0.85	0.8361	0.8632	0.8104	0.845	0.7815	0.8467	0.8143	0.8476	0.774	0.8323	0.7187	0.7727	0.8152	0.8808	0.8068	0.8625	0.7782	0.8667
0.2728	79.0	3081	0.3117	0.7861	0.9667	0.946	0.6695	0.7963	0.875	0.561	0.8446	0.8446	0.7288	0.8532	0.875	0.7423	0.8615	0.803	0.8476	0.805	0.8346	0.8163	0.8421	0.816	0.85	0.783	0.8667	0.808	0.8429	0.7622	0.8258	0.725	0.7864	0.7987	0.8692	0.8362	0.8813	0.7377	0.8267
0.2728	80.0	3120	0.3131	0.7875	0.9621	0.9428	0.6658	0.7993	0.875	0.5599	0.8436	0.8436	0.7197	0.8528	0.875	0.7455	0.8615	0.816	0.8619	0.82	0.85	0.8177	0.8526	0.8289	0.85	0.7627	0.8533	0.8057	0.8381	0.7692	0.8355	0.7129	0.7727	0.7961	0.8654	0.8306	0.875	0.7452	0.8067
0.2728	81.0	3159	0.3104	0.792	0.9635	0.9457	0.6798	0.8009	0.875	0.5609	0.8476	0.8476	0.7318	0.8563	0.875	0.7586	0.8769	0.8082	0.8476	0.8082	0.8462	0.8404	0.8632	0.8343	0.85	0.7755	0.8533	0.7909	0.8286	0.775	0.8323	0.7231	0.7818	0.8079	0.8769	0.8322	0.875	0.7496	0.84
0.2728	82.0	3198	0.3063	0.7931	0.9639	0.9469	0.6657	0.8033	0.875	0.5593	0.8485	0.8485	0.7288	0.8573	0.875	0.746	0.8615	0.818	0.8524	0.8034	0.8423	0.8448	0.8684	0.8299	0.855	0.7792	0.8533	0.8002	0.8286	0.7654	0.8323	0.719	0.7818	0.82	0.8846	0.8302	0.875	0.7612	0.8467
0.2728	83.0	3237	0.3069	0.7947	0.965	0.9489	0.6776	0.8044	0.875	0.5604	0.847	0.847	0.7333	0.8559	0.875	0.7467	0.8538	0.8142	0.8476	0.8142	0.8462	0.8436	0.8684	0.8185	0.84	0.7807	0.86	0.8182	0.8429	0.7604	0.8355	0.726	0.7773	0.8124	0.8769	0.8389	0.875	0.7624	0.84
0.2728	84.0	3276	0.3071	0.7929	0.9646	0.9484	0.6733	0.8028	0.875	0.5605	0.8447	0.8452	0.7242	0.8542	0.875	0.7446	0.8615	0.811	0.8476	0.8129	0.8462	0.839	0.8632	0.8409	0.855	0.7704	0.84	0.8199	0.8476	0.7642	0.8194	0.7101	0.7682	0.8087	0.8731	0.8384	0.8813	0.7546	0.84
0.2728	85.0	3315	0.3051	0.7919	0.9642	0.9484	0.671	0.8025	0.875	0.5622	0.8473	0.8473	0.7197	0.8566	0.875	0.748	0.8692	0.8187	0.8476	0.8167	0.8462	0.8329	0.8632	0.8233	0.845	0.7791	0.86	0.7975	0.8333	0.7671	0.829	0.7133	0.7727	0.8028	0.8731	0.8397	0.8813	0.7637	0.8467
0.2728	86.0	3354	0.3082	0.7922	0.964	0.9479	0.6935	0.8011	0.875	0.5605	0.8453	0.8453	0.7424	0.8529	0.875	0.7513	0.8692	0.8101	0.8429	0.8079	0.8423	0.8271	0.8526	0.84	0.855	0.7738	0.8533	0.7953	0.8333	0.767	0.8258	0.7192	0.7773	0.8104	0.8769	0.8517	0.8813	0.7529	0.8333
0.2728	87.0	3393	0.3085	0.7917	0.9631	0.9476	0.6712	0.8034	0.875	0.562	0.8456	0.8461	0.7212	0.8559	0.875	0.7538	0.8692	0.8173	0.8476	0.8139	0.8462	0.831	0.8579	0.8095	0.845	0.7788	0.8533	0.8002	0.8381	0.7672	0.8226	0.7228	0.7727	0.813	0.8731	0.8356	0.8813	0.7572	0.8467
0.2728	88.0	3432	0.3055	0.7929	0.9628	0.9472	0.669	0.8052	0.875	0.562	0.8473	0.8473	0.7242	0.8574	0.875	0.7436	0.8538	0.8254	0.8571	0.8197	0.8538	0.8304	0.8579	0.8236	0.85	0.7707	0.8533	0.8037	0.8429	0.7703	0.8323	0.7142	0.7682	0.8185	0.8769	0.8355	0.875	0.7595	0.8467
0.2728	89.0	3471	0.3054	0.7939	0.9633	0.9475	0.6657	0.8064	0.875	0.5628	0.8472	0.8472	0.7106	0.8579	0.875	0.7378	0.8538	0.8267	0.8571	0.8183	0.85	0.8361	0.8632	0.8213	0.85	0.7731	0.8533	0.8028	0.8381	0.7727	0.8355	0.7163	0.7682	0.8122	0.8692	0.843	0.8813	0.7662	0.8467
0.2674	90.0	3510	0.3074	0.7927	0.9634	0.9479	0.6694	0.8042	0.875	0.5623	0.8466	0.8466	0.7197	0.857	0.875	0.7378	0.8538	0.815	0.8476	0.8143	0.8462	0.8293	0.8579	0.8305	0.855	0.7732	0.8533	0.8143	0.8429	0.7654	0.8323	0.7197	0.7727	0.8058	0.8692	0.8438	0.8813	0.7629	0.8467
0.2674	91.0	3549	0.3062	0.7949	0.9644	0.9491	0.6722	0.8053	0.875	0.5626	0.8476	0.8476	0.7288	0.8565	0.875	0.7415	0.8615	0.8163	0.8524	0.8095	0.8423	0.8264	0.8526	0.8404	0.855	0.7812	0.8533	0.8162	0.8476	0.77	0.8323	0.7203	0.7727	0.8099	0.8731	0.8431	0.8813	0.7641	0.8467
0.2674	92.0	3588	0.3069	0.7931	0.9637	0.9483	0.6626	0.8049	0.875	0.5623	0.846	0.846	0.7152	0.8559	0.875	0.7433	0.8615	0.8252	0.8571	0.8134	0.8462	0.8343	0.8632	0.823	0.85	0.7856	0.8533	0.8143	0.8381	0.7699	0.8355	0.717	0.7682	0.7917	0.8577	0.8431	0.8813	0.7563	0.84
0.2674	93.0	3627	0.3068	0.7936	0.9637	0.9483	0.6672	0.8048	0.875	0.5635	0.8472	0.8472	0.7152	0.8572	0.875	0.7415	0.8615	0.8198	0.8571	0.8152	0.8462	0.8306	0.8579	0.8245	0.85	0.7753	0.8533	0.8154	0.8429	0.7694	0.8323	0.7154	0.7682	0.8075	0.8692	0.8431	0.8813	0.7652	0.8467
0.2674	94.0	3666	0.3064	0.7939	0.9637	0.9483	0.6611	0.8056	0.875	0.563	0.8472	0.8472	0.7106	0.8578	0.875	0.7378	0.8538	0.821	0.8571	0.8152	0.8462	0.8308	0.8579	0.8301	0.85	0.7753	0.8533	0.8166	0.8429	0.7701	0.8355	0.7138	0.7682	0.8089	0.8731	0.8431	0.8813	0.7641	0.8467
0.2674	95.0	3705	0.3051	0.7949	0.9644	0.9489	0.6634	0.806	0.875	0.5634	0.8475	0.8475	0.7152	0.8578	0.875	0.7371	0.8538	0.8202	0.8571	0.8154	0.8462	0.831	0.8579	0.8319	0.85	0.781	0.8533	0.8183	0.8429	0.7704	0.8355	0.7154	0.7682	0.8116	0.8769	0.8431	0.8813	0.7629	0.8467
0.2674	96.0	3744	0.3059	0.7941	0.9644	0.9491	0.6619	0.8052	0.875	0.5625	0.8466	0.8466	0.7152	0.8566	0.875	0.7408	0.8615	0.8181	0.8524	0.8154	0.8462	0.8307	0.8579	0.8416	0.855	0.7812	0.8533	0.8183	0.8429	0.7657	0.8323	0.7159	0.7682	0.7938	0.8615	0.8431	0.8813	0.7641	0.8467
0.2674	97.0	3783	0.3058	0.7939	0.9644	0.9491	0.6665	0.8049	0.875	0.5629	0.8466	0.8466	0.7152	0.8566	0.875	0.7408	0.8615	0.8176	0.8524	0.8134	0.8462	0.8312	0.8579	0.8419	0.855	0.7812	0.8533	0.8166	0.8429	0.7657	0.8323	0.7159	0.7682	0.7939	0.8615	0.843	0.8813	0.765	0.8467
0.2674	98.0	3822	0.3055	0.7942	0.9644	0.9489	0.6626	0.8053	0.875	0.5627	0.8469	0.8469	0.7152	0.8569	0.875	0.7408	0.8615	0.8189	0.8524	0.8134	0.8462	0.8307	0.8579	0.8415	0.855	0.7812	0.8533	0.8175	0.8429	0.7701	0.8355	0.7159	0.7682	0.7939	0.8615	0.843	0.8813	0.7638	0.8467
0.2674	99.0	3861	0.3054	0.7951	0.9644	0.9489	0.6649	0.8059	0.875	0.563	0.8475	0.8475	0.7197	0.8572	0.875	0.7408	0.8615	0.8199	0.8524	0.8134	0.8462	0.8307	0.8579	0.841	0.855	0.7812	0.8533	0.8175	0.8429	0.7701	0.8355	0.7159	0.7682	0.8037	0.8692	0.843	0.8813	0.7638	0.8467
0.2674	100.0	3900	0.3054	0.795	0.9644	0.9489	0.6649	0.8058	0.875	0.563	0.8475	0.8475	0.7197	0.8572	0.875	0.7408	0.8615	0.8189	0.8524	0.8134	0.8462	0.8307	0.8579	0.841	0.855	0.7812	0.8533	0.8175	0.8429	0.7701	0.8355	0.7159	0.7682	0.8037	0.8692	0.843	0.8813	0.7638	0.8467

Framework versions

Transformers 4.44.2
Pytorch 2.4.0+cu121
Datasets 2.21.0
Tokenizers 0.19.1

Loading…

detrDominoTest

This model is a fine-tuned version of aviola/detrDominoTest on the temp_domino2 dataset. It achieves the following results on the evaluation set:

Loss: 0.3054

Map: 0.795

Map 50: 0.9644

Map 75: 0.9489

Map Small: 0.6649

Map Medium: 0.8058

Map Large: 0.875

Mar 1: 0.563

Mar 10: 0.8475

Mar 100: 0.8475

Mar Small: 0.7197

Mar Medium: 0.8572

Mar Large: 0.875

Map Pip-1: 0.7408

Mar 100 Pip-1: 0.8615

Map Pip-10: 0.8189

Mar 100 Pip-10: 0.8524

Map Pip-11: 0.8134

Mar 100 Pip-11: 0.8462

Map Pip-12: 0.8307

Mar 100 Pip-12: 0.8579

Map Pip-2: 0.841

Mar 100 Pip-2: 0.855

Map Pip-3: 0.7812

Mar 100 Pip-3: 0.8533

Map Pip-4: 0.8175

Mar 100 Pip-4: 0.8429

Map Pip-5: 0.7701

Mar 100 Pip-5: 0.8355

Map Pip-6: 0.7159

Mar 100 Pip-6: 0.7682

Map Pip-7: 0.8037

Mar 100 Pip-7: 0.8692

Map Pip-8: 0.843

Mar 100 Pip-8: 0.8813

Map Pip-9: 0.7638

Mar 100 Pip-9: 0.8467

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 5e-05

train_batch_size: 8

eval_batch_size: 8

seed: 42

optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08

lr_scheduler_type: cosine

num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Map	Map 50	Map 75	Map Small	Map Medium	Map Large	Mar 1	Mar 10	Mar 100	Mar Small	Mar Medium	Mar Large	Map Pip-1	Mar 100 Pip-1	Map Pip-10	Mar 100 Pip-10	Map Pip-11	Mar 100 Pip-11	Map Pip-12	Mar 100 Pip-12	Map Pip-2	Mar 100 Pip-2	Map Pip-3	Mar 100 Pip-3	Map Pip-4	Mar 100 Pip-4	Map Pip-5	Mar 100 Pip-5	Map Pip-6	Mar 100 Pip-6	Map Pip-7	Mar 100 Pip-7	Map Pip-8	Mar 100 Pip-8	Map Pip-9	Mar 100 Pip-9
No log	1.0	39	0.3831	0.7707	0.9684	0.927	0.5938	0.792	0.8	0.5445	0.8254	0.8283	0.6727	0.8425	0.925	0.6593	0.8154	0.8327	0.8476	0.7972	0.85	0.8122	0.8421	0.7815	0.84	0.8186	0.86	0.7848	0.819	0.7498	0.8097	0.7032	0.7727	0.7729	0.8385	0.7822	0.8375	0.7537	0.8067
No log	2.0	78	0.3396	0.7759	0.9671	0.935	0.5735	0.7961	0.95	0.552	0.8251	0.8251	0.5955	0.8415	0.95	0.7095	0.8	0.8458	0.8762	0.7965	0.8269	0.8161	0.8526	0.7549	0.795	0.7708	0.8333	0.7731	0.7952	0.7655	0.8226	0.6989	0.7682	0.7717	0.8423	0.8346	0.875	0.7732	0.8133
No log	3.0	117	0.3413	0.7665	0.9736	0.945	0.6044	0.7818	0.95	0.5434	0.8206	0.8216	0.6561	0.8315	0.95	0.6818	0.8154	0.8044	0.8381	0.763	0.8038	0.814	0.8368	0.8183	0.855	0.7968	0.8267	0.7756	0.8143	0.773	0.829	0.6994	0.75	0.7752	0.8538	0.7946	0.8562	0.7014	0.78
No log	4.0	156	0.3630	0.7517	0.9697	0.9465	0.6005	0.7677	0.9	0.534	0.8094	0.8094	0.6439	0.8207	0.9	0.6363	0.7692	0.8175	0.8476	0.7821	0.8192	0.7616	0.8053	0.776	0.815	0.7621	0.82	0.7999	0.819	0.7593	0.8194	0.6738	0.7409	0.7666	0.8462	0.7832	0.8313	0.7022	0.78
No log	5.0	195	0.3685	0.7546	0.9572	0.9281	0.5432	0.7767	0.7625	0.5394	0.8172	0.8187	0.6152	0.8331	0.875	0.6488	0.8231	0.8343	0.8619	0.7554	0.8077	0.784	0.8474	0.7966	0.845	0.7246	0.82	0.8225	0.8476	0.7397	0.8065	0.7159	0.7545	0.7259	0.8	0.7993	0.8438	0.708	0.7667
No log	6.0	234	0.3723	0.7631	0.9685	0.9171	0.6247	0.7764	0.925	0.5454	0.8146	0.8146	0.6773	0.8233	0.925	0.7055	0.8385	0.7739	0.8048	0.7866	0.8192	0.7976	0.8368	0.786	0.82	0.746	0.8133	0.8275	0.8476	0.7449	0.7968	0.7101	0.75	0.7107	0.7923	0.8261	0.8562	0.7418	0.8
No log	7.0	273	0.3554	0.7663	0.9724	0.9386	0.6053	0.7857	0.925	0.5409	0.8192	0.8198	0.6591	0.8314	0.925	0.7293	0.8308	0.8056	0.8476	0.7934	0.8269	0.8256	0.8526	0.7477	0.795	0.751	0.8333	0.8182	0.8524	0.7572	0.8129	0.7043	0.7591	0.746	0.7923	0.8267	0.875	0.6905	0.76
No log	8.0	312	0.3772	0.753	0.961	0.9144	0.5717	0.774	0.925	0.5344	0.8075	0.8084	0.6303	0.8232	0.925	0.7172	0.8	0.7985	0.8238	0.7954	0.8346	0.7836	0.8211	0.7747	0.815	0.7661	0.8467	0.7922	0.8238	0.7433	0.8032	0.6735	0.7455	0.6932	0.7885	0.7621	0.8125	0.7359	0.7867
No log	9.0	351	0.3680	0.7603	0.9688	0.9231	0.605	0.7738	0.9	0.5446	0.8082	0.8088	0.6455	0.82	0.9	0.7341	0.8231	0.8035	0.8476	0.7777	0.8115	0.8294	0.8474	0.7754	0.81	0.7356	0.8	0.8142	0.8333	0.7692	0.8226	0.6743	0.7409	0.7332	0.7962	0.7726	0.8125	0.7042	0.76
No log	10.0	390	0.3842	0.7361	0.9719	0.9261	0.5901	0.7512	0.875	0.53	0.7929	0.7932	0.6364	0.8044	0.9	0.7093	0.7615	0.7597	0.8143	0.7931	0.8231	0.7435	0.7947	0.7316	0.765	0.7113	0.8067	0.7918	0.8238	0.7465	0.8032	0.6395	0.7045	0.7224	0.7885	0.7574	0.8125	0.7269	0.82
No log	11.0	429	0.3707	0.7449	0.9691	0.932	0.5949	0.7595	0.975	0.5337	0.806	0.8063	0.6379	0.8169	0.975	0.7366	0.8462	0.7883	0.8333	0.7493	0.7962	0.7859	0.8158	0.7558	0.8	0.7327	0.8267	0.773	0.8095	0.7741	0.829	0.6793	0.7409	0.7383	0.8231	0.7239	0.7812	0.7013	0.7733
No log	12.0	468	0.3725	0.7494	0.9619	0.9344	0.6046	0.7639	0.9	0.5368	0.8088	0.8095	0.6545	0.8202	0.9	0.7211	0.8308	0.7904	0.819	0.7713	0.8115	0.7896	0.8368	0.7352	0.765	0.7698	0.8133	0.781	0.8286	0.7739	0.8323	0.6444	0.7318	0.7599	0.8308	0.7156	0.7875	0.7401	0.8267
0.3708	13.0	507	0.3603	0.7604	0.9737	0.9428	0.6148	0.7774	0.9	0.5354	0.8098	0.8102	0.65	0.8218	0.9	0.7263	0.7923	0.787	0.8333	0.7927	0.8346	0.7742	0.8316	0.7697	0.8	0.76	0.7933	0.7854	0.8286	0.7544	0.8161	0.6845	0.7455	0.7327	0.7962	0.7767	0.8313	0.7808	0.82
0.3708	14.0	546	0.3518	0.7604	0.9671	0.9351	0.6309	0.7722	0.95	0.5431	0.8149	0.8159	0.6606	0.8254	0.95	0.7241	0.8231	0.8124	0.8238	0.7864	0.8154	0.8048	0.8316	0.7808	0.825	0.7626	0.8267	0.778	0.819	0.7292	0.7903	0.6355	0.7136	0.7794	0.8654	0.7803	0.85	0.7509	0.8067
0.3708	15.0	585	0.3711	0.7405	0.9639	0.896	0.5804	0.7557	0.95	0.5378	0.8032	0.8032	0.6121	0.8161	0.95	0.6714	0.8154	0.7787	0.8143	0.7892	0.8192	0.739	0.8	0.7384	0.79	0.7617	0.8267	0.7737	0.8048	0.7659	0.8258	0.602	0.6773	0.7855	0.8538	0.767	0.8313	0.7131	0.78
0.3708	16.0	624	0.3562	0.7587	0.9622	0.9351	0.5894	0.7776	0.925	0.5471	0.8182	0.8193	0.6364	0.8322	0.925	0.6482	0.8385	0.8094	0.8429	0.7884	0.8115	0.8029	0.8263	0.7913	0.82	0.7394	0.8	0.7939	0.8333	0.7428	0.829	0.6968	0.7591	0.7733	0.8269	0.7765	0.8375	0.7413	0.8067
0.3708	17.0	663	0.3939	0.7434	0.963	0.9271	0.6029	0.7557	0.925	0.5355	0.7964	0.7975	0.6455	0.8072	0.925	0.687	0.7769	0.7825	0.8143	0.7534	0.7808	0.7847	0.8211	0.7474	0.795	0.7514	0.8	0.7445	0.7905	0.7378	0.8258	0.7045	0.7545	0.734	0.7923	0.7368	0.825	0.7574	0.7933
0.3708	18.0	702	0.3832	0.7299	0.9633	0.8936	0.5973	0.7443	0.925	0.5284	0.7942	0.7945	0.6258	0.8045	0.925	0.6571	0.8154	0.7968	0.8286	0.7588	0.7885	0.7437	0.7737	0.723	0.78	0.7491	0.8	0.7686	0.8095	0.7393	0.8097	0.6504	0.7273	0.7116	0.7962	0.767	0.8188	0.6931	0.7867
0.3708	19.0	741	0.3596	0.756	0.9635	0.9066	0.5885	0.7727	0.875	0.541	0.8184	0.8184	0.6621	0.8296	0.875	0.7242	0.8538	0.821	0.8476	0.777	0.8038	0.7652	0.8105	0.7732	0.82	0.7665	0.82	0.7971	0.8381	0.7583	0.8194	0.6624	0.7455	0.7384	0.8308	0.7717	0.8313	0.7173	0.8
0.3708	20.0	780	0.3683	0.7612	0.9639	0.9358	0.631	0.779	0.7375	0.5374	0.8183	0.8197	0.6833	0.8311	0.85	0.689	0.8154	0.8223	0.8381	0.7803	0.8038	0.8172	0.8263	0.7537	0.8	0.7671	0.8133	0.7806	0.8333	0.7725	0.8355	0.6862	0.7591	0.7538	0.8538	0.7661	0.8375	0.7454	0.82
0.3708	21.0	819	0.3645	0.7675	0.9677	0.9265	0.5878	0.7858	0.85	0.5424	0.8246	0.8252	0.6682	0.8384	0.85	0.7228	0.8308	0.7889	0.8238	0.7897	0.8115	0.7997	0.8474	0.7476	0.805	0.802	0.84	0.7969	0.8333	0.7595	0.8065	0.6952	0.7818	0.7647	0.8462	0.7934	0.8562	0.75	0.82
0.3708	22.0	858	0.3777	0.7607	0.9619	0.93	0.6276	0.776	0.9	0.5388	0.8223	0.8249	0.697	0.8348	0.9	0.6858	0.8538	0.7868	0.8238	0.7764	0.8077	0.8306	0.8526	0.7746	0.83	0.7922	0.84	0.8176	0.8476	0.746	0.8032	0.6699	0.7636	0.7264	0.8269	0.78	0.85	0.7416	0.8
0.3708	23.0	897	0.3532	0.7677	0.9615	0.9309	0.6114	0.7815	0.875	0.5458	0.8214	0.8217	0.6652	0.8335	0.875	0.6714	0.8077	0.7988	0.8238	0.7901	0.8269	0.842	0.8579	0.7779	0.82	0.7714	0.8133	0.8097	0.8381	0.7556	0.8129	0.691	0.75	0.77	0.8462	0.7881	0.8375	0.7469	0.8267
0.3708	24.0	936	0.3546	0.7696	0.9681	0.9385	0.6058	0.7819	0.9	0.5429	0.8229	0.8233	0.6788	0.8331	0.9	0.7156	0.8154	0.792	0.8286	0.8082	0.8462	0.8238	0.8526	0.7677	0.815	0.7925	0.8267	0.782	0.8238	0.7649	0.8226	0.7122	0.7682	0.7567	0.8231	0.7703	0.8438	0.749	0.8133
0.3708	25.0	975	0.3651	0.764	0.963	0.9319	0.5945	0.7788	0.925	0.5363	0.819	0.8213	0.6576	0.8332	0.925	0.6889	0.8154	0.7908	0.8381	0.8041	0.8346	0.8226	0.8526	0.7512	0.8	0.7845	0.8267	0.7923	0.8143	0.757	0.8194	0.7231	0.7955	0.7693	0.8269	0.7477	0.8188	0.7362	0.8133
0.3647	26.0	1014	0.3579	0.7522	0.9627	0.9224	0.5684	0.7718	0.7875	0.5353	0.8172	0.8193	0.647	0.8316	0.9	0.65	0.8231	0.7766	0.8286	0.7873	0.8192	0.798	0.8316	0.7617	0.825	0.7624	0.8133	0.7986	0.8381	0.7514	0.8226	0.7005	0.7773	0.7357	0.8231	0.8009	0.8562	0.7037	0.7733
0.3647	27.0	1053	0.3478	0.7722	0.9654	0.9393	0.5952	0.7921	0.9	0.542	0.8329	0.8329	0.6515	0.8486	0.9	0.6669	0.8308	0.8077	0.8333	0.7836	0.8192	0.8066	0.8368	0.8162	0.86	0.8172	0.86	0.8157	0.8381	0.7643	0.8323	0.6787	0.7727	0.763	0.8423	0.8063	0.8562	0.7401	0.8133
0.3647	28.0	1092	0.3548	0.7622	0.9605	0.9301	0.5752	0.7805	0.8781	0.5393	0.8186	0.8195	0.6394	0.8329	0.9	0.6486	0.8231	0.8143	0.8429	0.7778	0.8077	0.7877	0.8158	0.7795	0.815	0.8061	0.8533	0.7792	0.8095	0.7595	0.8419	0.6903	0.7682	0.7596	0.8192	0.7893	0.8375	0.754	0.8
0.3647	29.0	1131	0.3761	0.7473	0.9562	0.9307	0.6266	0.7609	0.875	0.5315	0.8078	0.8089	0.6667	0.8193	0.875	0.6492	0.8308	0.7912	0.8238	0.7703	0.8038	0.7751	0.8	0.7692	0.795	0.7556	0.82	0.7916	0.8238	0.7694	0.8194	0.6874	0.75	0.7689	0.8423	0.7746	0.8375	0.6649	0.76
0.3647	30.0	1170	0.3424	0.7624	0.9653	0.9307	0.6605	0.7723	0.8833	0.5458	0.8201	0.8201	0.697	0.829	0.9	0.6695	0.8385	0.7992	0.8238	0.793	0.8192	0.7972	0.8211	0.7894	0.825	0.7615	0.82	0.789	0.8238	0.7719	0.829	0.6836	0.7318	0.7466	0.8269	0.804	0.8687	0.7442	0.8133
0.3647	31.0	1209	0.3459	0.7745	0.9651	0.9226	0.6118	0.7894	0.9	0.541	0.8231	0.8239	0.6561	0.8369	0.9	0.6797	0.8154	0.8204	0.8381	0.7959	0.8269	0.8347	0.8526	0.7722	0.815	0.7904	0.8267	0.803	0.8286	0.7616	0.8194	0.7078	0.7545	0.763	0.8346	0.8241	0.8687	0.7414	0.8067
0.3647	32.0	1248	0.3604	0.7687	0.9698	0.9452	0.606	0.784	0.825	0.5444	0.8159	0.8159	0.6591	0.8285	0.825	0.7222	0.8385	0.7988	0.8286	0.7875	0.8115	0.7993	0.8263	0.7737	0.81	0.8202	0.8467	0.7956	0.8143	0.7673	0.8129	0.7102	0.7682	0.7578	0.8308	0.782	0.85	0.71	0.7533
0.3647	33.0	1287	0.3488	0.7746	0.9719	0.9411	0.635	0.7886	0.825	0.5467	0.8234	0.8239	0.6848	0.8356	0.825	0.7174	0.8077	0.8026	0.8286	0.8074	0.8385	0.8236	0.8526	0.7782	0.815	0.789	0.8333	0.8001	0.8286	0.7664	0.8226	0.7297	0.7864	0.7594	0.8308	0.765	0.85	0.7566	0.7933
0.3647	34.0	1326	0.3774	0.7615	0.9606	0.9323	0.6755	0.7723	0.825	0.535	0.8195	0.8199	0.7303	0.8276	0.825	0.6784	0.8154	0.7705	0.8095	0.7803	0.8115	0.8217	0.8579	0.7548	0.8	0.7654	0.8133	0.7767	0.819	0.7505	0.8194	0.7157	0.7818	0.7716	0.8423	0.8356	0.8687	0.7173	0.8
0.3647	35.0	1365	0.3671	0.7461	0.9647	0.8973	0.5755	0.764	0.85	0.5404	0.8079	0.8079	0.6167	0.8233	0.85	0.6925	0.8077	0.7819	0.8143	0.7778	0.8077	0.7873	0.8158	0.7288	0.8	0.7817	0.8067	0.7738	0.8095	0.7303	0.8129	0.6881	0.7682	0.7126	0.8038	0.7963	0.8687	0.7026	0.78
0.3647	36.0	1404	0.3604	0.7603	0.9628	0.9211	0.5709	0.7786	0.85	0.5435	0.8112	0.8112	0.6303	0.8268	0.85	0.7226	0.8308	0.7665	0.7905	0.8099	0.8385	0.8065	0.8316	0.7669	0.815	0.7489	0.8	0.789	0.8048	0.7648	0.8161	0.7246	0.7864	0.7536	0.8231	0.7548	0.825	0.7152	0.7733
0.3647	37.0	1443	0.3428	0.7776	0.9712	0.9339	0.6261	0.7926	0.9	0.5532	0.8306	0.8313	0.6848	0.8446	0.9	0.7509	0.8615	0.7924	0.8238	0.8001	0.8346	0.8503	0.8684	0.7855	0.825	0.8124	0.8467	0.8012	0.8286	0.7723	0.8194	0.7011	0.7727	0.7839	0.85	0.749	0.8313	0.7321	0.8133
0.3647	38.0	1482	0.3478	0.7699	0.962	0.9428	0.6391	0.7855	0.9	0.5478	0.8235	0.8235	0.6682	0.8371	0.9	0.6912	0.8308	0.7782	0.8	0.8063	0.8308	0.8305	0.8579	0.7655	0.805	0.7891	0.8333	0.7948	0.8333	0.7555	0.8161	0.7119	0.7773	0.7909	0.8423	0.795	0.8687	0.7301	0.7867
0.3448	39.0	1521	0.3364	0.7651	0.9705	0.9359	0.6459	0.7773	0.875	0.5441	0.8202	0.8205	0.6879	0.8314	0.875	0.736	0.8385	0.7913	0.8143	0.8102	0.8423	0.8351	0.8526	0.7775	0.815	0.7768	0.8467	0.7973	0.8286	0.7415	0.8161	0.6688	0.7364	0.7834	0.8577	0.7613	0.8313	0.7018	0.7667
0.3448	40.0	1560	0.3587	0.7637	0.9703	0.9207	0.6239	0.7762	0.925	0.5447	0.8144	0.8144	0.6682	0.8239	0.925	0.7714	0.8538	0.7711	0.8095	0.8072	0.8231	0.8018	0.8263	0.7764	0.825	0.7827	0.82	0.764	0.7952	0.745	0.8226	0.6794	0.7636	0.7655	0.8308	0.8111	0.8562	0.6887	0.7467
0.3448	41.0	1599	0.3255	0.7904	0.9805	0.962	0.6426	0.8061	0.9	0.5546	0.8325	0.8331	0.6985	0.8436	0.9	0.7856	0.8462	0.8096	0.8286	0.8266	0.85	0.8263	0.8421	0.8067	0.86	0.7991	0.84	0.7951	0.8333	0.7505	0.8129	0.7429	0.7818	0.7766	0.8462	0.8191	0.8562	0.7468	0.8
0.3448	42.0	1638	0.3370	0.7869	0.9703	0.9425	0.6512	0.7984	0.925	0.557	0.8354	0.8354	0.697	0.846	0.925	0.7076	0.8231	0.7993	0.8333	0.8252	0.8462	0.8316	0.8579	0.8062	0.845	0.8117	0.86	0.7905	0.819	0.7614	0.8258	0.7499	0.8045	0.7784	0.8269	0.8097	0.8562	0.7711	0.8267
0.3448	43.0	1677	0.3588	0.7607	0.9568	0.9296	0.6168	0.7724	0.875	0.548	0.8159	0.8159	0.653	0.8267	0.875	0.7101	0.8462	0.7958	0.8095	0.7779	0.8115	0.7812	0.8053	0.7649	0.795	0.7917	0.8467	0.7927	0.819	0.7425	0.8226	0.7341	0.7773	0.7517	0.8269	0.7666	0.8438	0.7194	0.7867
0.3448	44.0	1716	0.3477	0.7795	0.9678	0.9398	0.61	0.7952	0.875	0.5486	0.8234	0.8238	0.6697	0.8381	0.875	0.8197	0.8538	0.7896	0.8238	0.8269	0.8462	0.8326	0.8579	0.7767	0.81	0.7852	0.8333	0.8019	0.8238	0.7393	0.8065	0.6834	0.7636	0.7739	0.8308	0.8006	0.8625	0.7235	0.7733
0.3448	45.0	1755	0.3447	0.7744	0.9709	0.9261	0.6342	0.7876	0.9	0.551	0.8255	0.8255	0.6758	0.8388	0.9	0.7865	0.8308	0.7672	0.8	0.8035	0.8346	0.8338	0.8579	0.7888	0.825	0.7846	0.86	0.7846	0.819	0.7549	0.8194	0.7213	0.7955	0.7713	0.8462	0.7688	0.8313	0.7278	0.7867
0.3448	46.0	1794	0.3430	0.7741	0.9704	0.9294	0.6212	0.7883	0.925	0.5513	0.8192	0.8205	0.6697	0.8326	0.925	0.7891	0.8231	0.7791	0.819	0.8068	0.8269	0.8379	0.8579	0.7579	0.795	0.7864	0.8467	0.7933	0.8143	0.7645	0.8355	0.6911	0.7682	0.7841	0.8423	0.7769	0.8438	0.722	0.7733
0.3448	47.0	1833	0.3547	0.7624	0.9709	0.9265	0.6266	0.7786	0.9	0.5453	0.817	0.817	0.6864	0.8279	0.9	0.7801	0.8615	0.7803	0.8048	0.8041	0.8308	0.7921	0.8263	0.7849	0.815	0.7573	0.8267	0.7775	0.8	0.7644	0.8323	0.6757	0.7591	0.7818	0.8423	0.7467	0.8188	0.7045	0.7867
0.3448	48.0	1872	0.3337	0.7789	0.9694	0.9436	0.6685	0.7908	0.9	0.5532	0.8315	0.8319	0.7212	0.8408	0.9	0.7529	0.8385	0.8186	0.8524	0.827	0.8462	0.8253	0.8474	0.7835	0.83	0.7971	0.8467	0.7951	0.8286	0.7789	0.8484	0.675	0.7591	0.7713	0.8231	0.7884	0.8687	0.7333	0.7933
0.3448	49.0	1911	0.3230	0.7799	0.9706	0.9481	0.6638	0.7912	0.9	0.5525	0.8289	0.8293	0.7015	0.8402	0.9	0.7015	0.8231	0.7753	0.8048	0.8337	0.8538	0.8148	0.8368	0.7871	0.82	0.8297	0.8667	0.7949	0.8238	0.7769	0.8387	0.7055	0.7773	0.7986	0.85	0.7769	0.8562	0.7639	0.8
0.3448	50.0	1950	0.3338	0.7779	0.9668	0.9304	0.6896	0.7882	0.9	0.5514	0.8258	0.8287	0.7242	0.8375	0.9	0.7171	0.8462	0.7719	0.8143	0.8369	0.8615	0.8328	0.8526	0.7718	0.81	0.7655	0.8133	0.7822	0.819	0.7728	0.8323	0.7233	0.7591	0.8051	0.8615	0.8148	0.8813	0.7404	0.7933
0.3448	51.0	1989	0.3329	0.7742	0.9633	0.9366	0.6585	0.7849	0.9	0.5551	0.8314	0.8314	0.7045	0.8412	0.9	0.7177	0.8385	0.7831	0.8381	0.8298	0.8577	0.7877	0.8421	0.7898	0.835	0.7565	0.8267	0.7795	0.8238	0.7742	0.8355	0.7239	0.7636	0.7991	0.8538	0.8084	0.8687	0.741	0.7933
0.3244	52.0	2028	0.3387	0.7726	0.9641	0.9352	0.6517	0.7867	0.9	0.5514	0.8285	0.8285	0.697	0.8386	0.9	0.7406	0.8538	0.8301	0.8667	0.8229	0.8462	0.7583	0.8158	0.8058	0.85	0.7491	0.8	0.7802	0.8143	0.7618	0.8323	0.7198	0.7636	0.7965	0.85	0.7871	0.8562	0.7196	0.7933
0.3244	53.0	2067	0.3371	0.7832	0.9671	0.9449	0.6874	0.7952	0.9	0.5569	0.8328	0.8331	0.7333	0.8412	0.9	0.7871	0.8615	0.7975	0.8286	0.816	0.85	0.8129	0.8421	0.7926	0.83	0.7737	0.8333	0.799	0.8286	0.7682	0.8323	0.702	0.7545	0.8012	0.8423	0.8436	0.8875	0.7049	0.8067
0.3244	54.0	2106	0.3511	0.7682	0.9667	0.9373	0.6718	0.7788	0.9	0.5493	0.8221	0.8225	0.7197	0.8302	0.9	0.7665	0.8231	0.7621	0.8095	0.8072	0.8346	0.8005	0.8316	0.7891	0.835	0.755	0.82	0.7594	0.8143	0.7664	0.829	0.7	0.7682	0.7882	0.8423	0.8087	0.8687	0.7147	0.7933
0.3244	55.0	2145	0.3340	0.7674	0.9672	0.9298	0.6237	0.7799	0.9	0.5504	0.8273	0.8276	0.7152	0.8359	0.9	0.7155	0.8231	0.7725	0.8095	0.8097	0.8308	0.7913	0.8316	0.7796	0.835	0.7677	0.8333	0.7688	0.8095	0.7588	0.8387	0.7163	0.7909	0.7751	0.8346	0.8289	0.8875	0.7247	0.8067
0.3244	56.0	2184	0.3461	0.7747	0.9619	0.9308	0.6657	0.7857	0.9	0.557	0.8247	0.8251	0.7106	0.834	0.9	0.7096	0.8308	0.8014	0.8286	0.821	0.8423	0.7874	0.8158	0.8007	0.83	0.8116	0.8533	0.7689	0.8095	0.7625	0.829	0.7082	0.7727	0.8057	0.8538	0.8221	0.875	0.697	0.76
0.3244	57.0	2223	0.3470	0.7747	0.9593	0.943	0.6614	0.786	0.9	0.5548	0.8299	0.8299	0.7182	0.8383	0.9	0.7153	0.8385	0.7961	0.8333	0.8345	0.8538	0.7896	0.8421	0.7963	0.83	0.8181	0.8467	0.7944	0.8286	0.7582	0.829	0.6994	0.7682	0.8031	0.8654	0.7977	0.8562	0.6936	0.7667
0.3244	58.0	2262	0.3367	0.7766	0.9662	0.9395	0.6466	0.7903	0.7875	0.5509	0.8302	0.8302	0.6924	0.8405	0.9	0.7642	0.8385	0.7876	0.8286	0.8196	0.8462	0.8063	0.8474	0.7951	0.825	0.777	0.84	0.7838	0.8238	0.7518	0.8355	0.7024	0.7636	0.7848	0.8462	0.8286	0.875	0.7181	0.7933
0.3244	59.0	2301	0.3343	0.7839	0.9692	0.9297	0.6242	0.8023	0.7875	0.5508	0.8327	0.8347	0.6788	0.8473	0.9	0.7949	0.8538	0.823	0.8524	0.8115	0.8423	0.8057	0.8421	0.7891	0.84	0.7982	0.8467	0.7915	0.8333	0.7713	0.8258	0.698	0.7682	0.8114	0.8692	0.8257	0.8687	0.6864	0.7733
0.3244	60.0	2340	0.3160	0.7843	0.9699	0.9412	0.6567	0.7996	0.875	0.5588	0.8369	0.8369	0.7015	0.8484	0.875	0.7567	0.8462	0.8036	0.8476	0.8449	0.8654	0.8155	0.8474	0.8116	0.84	0.7813	0.84	0.777	0.819	0.7591	0.8258	0.7329	0.7864	0.8063	0.8692	0.8221	0.8687	0.7011	0.7867
0.3244	61.0	2379	0.3186	0.7788	0.97	0.9377	0.6608	0.7902	0.875	0.5533	0.8332	0.8336	0.6985	0.8458	0.875	0.7187	0.8308	0.7957	0.8333	0.8303	0.8577	0.831	0.8526	0.8094	0.84	0.8014	0.8333	0.785	0.8333	0.7568	0.8226	0.7048	0.7682	0.7863	0.85	0.8166	0.875	0.7092	0.8067
0.3244	62.0	2418	0.3139	0.7736	0.9665	0.9358	0.6263	0.7854	0.9	0.5528	0.8299	0.8314	0.697	0.8418	0.9	0.7243	0.8308	0.7997	0.8333	0.7954	0.8269	0.8232	0.8526	0.8103	0.835	0.754	0.8267	0.7928	0.819	0.7659	0.829	0.7033	0.7727	0.7879	0.8615	0.8047	0.8687	0.722	0.82
0.3244	63.0	2457	0.3227	0.7887	0.9736	0.9476	0.6921	0.799	0.9	0.5551	0.8387	0.8387	0.7424	0.8467	0.9	0.7834	0.8615	0.8091	0.8476	0.8349	0.8577	0.8292	0.8526	0.7917	0.835	0.8085	0.86	0.7871	0.8143	0.7692	0.8419	0.7118	0.7773	0.8088	0.8731	0.7981	0.85	0.7325	0.7933
0.3244	64.0	2496	0.3161	0.7804	0.9686	0.9448	0.6907	0.789	0.9	0.5544	0.8354	0.8362	0.7409	0.8438	0.9	0.7723	0.8692	0.7887	0.8333	0.8127	0.8423	0.7941	0.8368	0.7913	0.835	0.788	0.8533	0.8054	0.8333	0.7517	0.829	0.7488	0.7909	0.7987	0.8615	0.7913	0.8562	0.7217	0.7933
0.2973	65.0	2535	0.3186	0.7846	0.9666	0.9405	0.6644	0.7976	0.85	0.5538	0.8374	0.8374	0.7273	0.8467	0.85	0.8024	0.8538	0.7887	0.8238	0.8159	0.8423	0.8234	0.8526	0.812	0.86	0.7879	0.8533	0.7942	0.8238	0.7602	0.8323	0.7184	0.7818	0.8023	0.8769	0.8258	0.875	0.6846	0.7733
0.2973	66.0	2574	0.3230	0.7824	0.9629	0.9384	0.659	0.7941	0.875	0.5561	0.8418	0.8423	0.7258	0.8513	0.875	0.7691	0.8769	0.807	0.8381	0.7975	0.8385	0.825	0.8474	0.8294	0.87	0.7628	0.8467	0.8065	0.8333	0.7636	0.8355	0.7133	0.7773	0.7965	0.8692	0.8084	0.875	0.7098	0.8
0.2973	67.0	2613	0.3210	0.7839	0.9637	0.9361	0.6755	0.7947	0.875	0.5596	0.8434	0.8434	0.7273	0.8533	0.875	0.7315	0.8692	0.815	0.8524	0.8115	0.85	0.8449	0.8684	0.8356	0.87	0.7724	0.8467	0.8201	0.8429	0.751	0.8194	0.707	0.7636	0.7984	0.8692	0.8127	0.8687	0.7063	0.8
0.2973	68.0	2652	0.3237	0.7861	0.9655	0.9493	0.682	0.7961	0.875	0.5601	0.8426	0.8433	0.7364	0.8517	0.875	0.7583	0.8846	0.8046	0.8381	0.813	0.85	0.8225	0.8421	0.8129	0.855	0.7957	0.8533	0.8048	0.8381	0.7667	0.8387	0.722	0.7727	0.7927	0.8654	0.828	0.875	0.7118	0.8067
0.2973	69.0	2691	0.3199	0.7825	0.9684	0.9462	0.6812	0.7922	0.875	0.5576	0.8384	0.8403	0.75	0.8469	0.875	0.7381	0.8692	0.8035	0.8333	0.7955	0.8385	0.8152	0.8368	0.8194	0.865	0.772	0.8333	0.8116	0.8333	0.7617	0.8194	0.7319	0.8	0.8026	0.8731	0.8295	0.8813	0.7093	0.8
0.2973	70.0	2730	0.3144	0.7844	0.9671	0.9439	0.6711	0.794	0.875	0.5592	0.8409	0.8428	0.7409	0.8508	0.875	0.7423	0.8615	0.8172	0.8429	0.8043	0.8423	0.8186	0.8474	0.8122	0.855	0.7951	0.84	0.7987	0.8286	0.7633	0.829	0.7176	0.7864	0.7947	0.8731	0.8172	0.8938	0.7312	0.8133
0.2973	71.0	2769	0.3160	0.7883	0.9743	0.9428	0.6638	0.7998	0.875	0.5575	0.8407	0.8424	0.7227	0.8517	0.875	0.7803	0.8692	0.828	0.8571	0.8113	0.8462	0.8335	0.8526	0.8126	0.855	0.7893	0.84	0.7934	0.8238	0.759	0.8258	0.7196	0.7864	0.8123	0.8769	0.7994	0.8562	0.7208	0.82
0.2973	72.0	2808	0.3126	0.7862	0.9724	0.9444	0.6806	0.7953	0.875	0.5582	0.841	0.8424	0.7409	0.85	0.875	0.7453	0.8615	0.8237	0.8524	0.7994	0.8308	0.8224	0.8474	0.8292	0.86	0.7968	0.84	0.7884	0.8238	0.7712	0.8419	0.7228	0.7864	0.8025	0.8692	0.8052	0.875	0.7281	0.82
0.2973	73.0	2847	0.3082	0.7896	0.9708	0.9463	0.6745	0.8021	0.875	0.5595	0.8444	0.8454	0.7288	0.8548	0.875	0.7778	0.8769	0.8244	0.8571	0.7996	0.8385	0.8326	0.8579	0.8208	0.85	0.763	0.8467	0.7888	0.8238	0.7714	0.8355	0.7132	0.7864	0.8152	0.8769	0.8191	0.875	0.7498	0.82
0.2973	74.0	2886	0.3101	0.7935	0.9729	0.9513	0.6723	0.8077	0.875	0.5598	0.8458	0.8469	0.7333	0.8562	0.875	0.8075	0.8692	0.8271	0.8571	0.8077	0.8423	0.8319	0.8579	0.8345	0.86	0.7732	0.8533	0.8136	0.8429	0.7574	0.829	0.7122	0.7864	0.8045	0.8692	0.8001	0.8687	0.7522	0.8267
0.2973	75.0	2925	0.3094	0.7829	0.9619	0.9425	0.6697	0.7952	0.875	0.5573	0.8418	0.8418	0.7182	0.852	0.875	0.7548	0.8692	0.8009	0.8429	0.8063	0.8423	0.8228	0.8474	0.8045	0.835	0.7582	0.84	0.7975	0.8286	0.7637	0.8323	0.7199	0.7864	0.7981	0.8692	0.8077	0.8687	0.7605	0.84
0.2973	76.0	2964	0.3021	0.7847	0.9702	0.9443	0.6618	0.7977	0.875	0.5604	0.8437	0.844	0.7152	0.8551	0.875	0.7506	0.8538	0.8136	0.8524	0.8015	0.8385	0.8289	0.8526	0.8311	0.855	0.77	0.8533	0.7943	0.8286	0.7766	0.8387	0.7137	0.7818	0.791	0.8654	0.8005	0.875	0.7442	0.8333
0.2728	77.0	3003	0.3078	0.7897	0.9675	0.9508	0.6532	0.8038	0.875	0.5568	0.8426	0.8426	0.7091	0.8536	0.875	0.7906	0.8538	0.807	0.8381	0.8039	0.8423	0.8284	0.8526	0.844	0.87	0.7799	0.86	0.7876	0.819	0.7775	0.8419	0.7118	0.7727	0.7916	0.8577	0.7997	0.8625	0.7546	0.84
0.2728	78.0	3042	0.3073	0.7935	0.9634	0.9439	0.6684	0.8063	0.875	0.5638	0.8491	0.8491	0.7136	0.8601	0.875	0.756	0.8692	0.812	0.8524	0.8189	0.85	0.8361	0.8632	0.8104	0.845	0.7815	0.8467	0.8143	0.8476	0.774	0.8323	0.7187	0.7727	0.8152	0.8808	0.8068	0.8625	0.7782	0.8667
0.2728	79.0	3081	0.3117	0.7861	0.9667	0.946	0.6695	0.7963	0.875	0.561	0.8446	0.8446	0.7288	0.8532	0.875	0.7423	0.8615	0.803	0.8476	0.805	0.8346	0.8163	0.8421	0.816	0.85	0.783	0.8667	0.808	0.8429	0.7622	0.8258	0.725	0.7864	0.7987	0.8692	0.8362	0.8813	0.7377	0.8267
0.2728	80.0	3120	0.3131	0.7875	0.9621	0.9428	0.6658	0.7993	0.875	0.5599	0.8436	0.8436	0.7197	0.8528	0.875	0.7455	0.8615	0.816	0.8619	0.82	0.85	0.8177	0.8526	0.8289	0.85	0.7627	0.8533	0.8057	0.8381	0.7692	0.8355	0.7129	0.7727	0.7961	0.8654	0.8306	0.875	0.7452	0.8067
0.2728	81.0	3159	0.3104	0.792	0.9635	0.9457	0.6798	0.8009	0.875	0.5609	0.8476	0.8476	0.7318	0.8563	0.875	0.7586	0.8769	0.8082	0.8476	0.8082	0.8462	0.8404	0.8632	0.8343	0.85	0.7755	0.8533	0.7909	0.8286	0.775	0.8323	0.7231	0.7818	0.8079	0.8769	0.8322	0.875	0.7496	0.84
0.2728	82.0	3198	0.3063	0.7931	0.9639	0.9469	0.6657	0.8033	0.875	0.5593	0.8485	0.8485	0.7288	0.8573	0.875	0.746	0.8615	0.818	0.8524	0.8034	0.8423	0.8448	0.8684	0.8299	0.855	0.7792	0.8533	0.8002	0.8286	0.7654	0.8323	0.719	0.7818	0.82	0.8846	0.8302	0.875	0.7612	0.8467
0.2728	83.0	3237	0.3069	0.7947	0.965	0.9489	0.6776	0.8044	0.875	0.5604	0.847	0.847	0.7333	0.8559	0.875	0.7467	0.8538	0.8142	0.8476	0.8142	0.8462	0.8436	0.8684	0.8185	0.84	0.7807	0.86	0.8182	0.8429	0.7604	0.8355	0.726	0.7773	0.8124	0.8769	0.8389	0.875	0.7624	0.84
0.2728	84.0	3276	0.3071	0.7929	0.9646	0.9484	0.6733	0.8028	0.875	0.5605	0.8447	0.8452	0.7242	0.8542	0.875	0.7446	0.8615	0.811	0.8476	0.8129	0.8462	0.839	0.8632	0.8409	0.855	0.7704	0.84	0.8199	0.8476	0.7642	0.8194	0.7101	0.7682	0.8087	0.8731	0.8384	0.8813	0.7546	0.84
0.2728	85.0	3315	0.3051	0.7919	0.9642	0.9484	0.671	0.8025	0.875	0.5622	0.8473	0.8473	0.7197	0.8566	0.875	0.748	0.8692	0.8187	0.8476	0.8167	0.8462	0.8329	0.8632	0.8233	0.845	0.7791	0.86	0.7975	0.8333	0.7671	0.829	0.7133	0.7727	0.8028	0.8731	0.8397	0.8813	0.7637	0.8467
0.2728	86.0	3354	0.3082	0.7922	0.964	0.9479	0.6935	0.8011	0.875	0.5605	0.8453	0.8453	0.7424	0.8529	0.875	0.7513	0.8692	0.8101	0.8429	0.8079	0.8423	0.8271	0.8526	0.84	0.855	0.7738	0.8533	0.7953	0.8333	0.767	0.8258	0.7192	0.7773	0.8104	0.8769	0.8517	0.8813	0.7529	0.8333
0.2728	87.0	3393	0.3085	0.7917	0.9631	0.9476	0.6712	0.8034	0.875	0.562	0.8456	0.8461	0.7212	0.8559	0.875	0.7538	0.8692	0.8173	0.8476	0.8139	0.8462	0.831	0.8579	0.8095	0.845	0.7788	0.8533	0.8002	0.8381	0.7672	0.8226	0.7228	0.7727	0.813	0.8731	0.8356	0.8813	0.7572	0.8467
0.2728	88.0	3432	0.3055	0.7929	0.9628	0.9472	0.669	0.8052	0.875	0.562	0.8473	0.8473	0.7242	0.8574	0.875	0.7436	0.8538	0.8254	0.8571	0.8197	0.8538	0.8304	0.8579	0.8236	0.85	0.7707	0.8533	0.8037	0.8429	0.7703	0.8323	0.7142	0.7682	0.8185	0.8769	0.8355	0.875	0.7595	0.8467
0.2728	89.0	3471	0.3054	0.7939	0.9633	0.9475	0.6657	0.8064	0.875	0.5628	0.8472	0.8472	0.7106	0.8579	0.875	0.7378	0.8538	0.8267	0.8571	0.8183	0.85	0.8361	0.8632	0.8213	0.85	0.7731	0.8533	0.8028	0.8381	0.7727	0.8355	0.7163	0.7682	0.8122	0.8692	0.843	0.8813	0.7662	0.8467
0.2674	90.0	3510	0.3074	0.7927	0.9634	0.9479	0.6694	0.8042	0.875	0.5623	0.8466	0.8466	0.7197	0.857	0.875	0.7378	0.8538	0.815	0.8476	0.8143	0.8462	0.8293	0.8579	0.8305	0.855	0.7732	0.8533	0.8143	0.8429	0.7654	0.8323	0.7197	0.7727	0.8058	0.8692	0.8438	0.8813	0.7629	0.8467
0.2674	91.0	3549	0.3062	0.7949	0.9644	0.9491	0.6722	0.8053	0.875	0.5626	0.8476	0.8476	0.7288	0.8565	0.875	0.7415	0.8615	0.8163	0.8524	0.8095	0.8423	0.8264	0.8526	0.8404	0.855	0.7812	0.8533	0.8162	0.8476	0.77	0.8323	0.7203	0.7727	0.8099	0.8731	0.8431	0.8813	0.7641	0.8467
0.2674	92.0	3588	0.3069	0.7931	0.9637	0.9483	0.6626	0.8049	0.875	0.5623	0.846	0.846	0.7152	0.8559	0.875	0.7433	0.8615	0.8252	0.8571	0.8134	0.8462	0.8343	0.8632	0.823	0.85	0.7856	0.8533	0.8143	0.8381	0.7699	0.8355	0.717	0.7682	0.7917	0.8577	0.8431	0.8813	0.7563	0.84
0.2674	93.0	3627	0.3068	0.7936	0.9637	0.9483	0.6672	0.8048	0.875	0.5635	0.8472	0.8472	0.7152	0.8572	0.875	0.7415	0.8615	0.8198	0.8571	0.8152	0.8462	0.8306	0.8579	0.8245	0.85	0.7753	0.8533	0.8154	0.8429	0.7694	0.8323	0.7154	0.7682	0.8075	0.8692	0.8431	0.8813	0.7652	0.8467
0.2674	94.0	3666	0.3064	0.7939	0.9637	0.9483	0.6611	0.8056	0.875	0.563	0.8472	0.8472	0.7106	0.8578	0.875	0.7378	0.8538	0.821	0.8571	0.8152	0.8462	0.8308	0.8579	0.8301	0.85	0.7753	0.8533	0.8166	0.8429	0.7701	0.8355	0.7138	0.7682	0.8089	0.8731	0.8431	0.8813	0.7641	0.8467
0.2674	95.0	3705	0.3051	0.7949	0.9644	0.9489	0.6634	0.806	0.875	0.5634	0.8475	0.8475	0.7152	0.8578	0.875	0.7371	0.8538	0.8202	0.8571	0.8154	0.8462	0.831	0.8579	0.8319	0.85	0.781	0.8533	0.8183	0.8429	0.7704	0.8355	0.7154	0.7682	0.8116	0.8769	0.8431	0.8813	0.7629	0.8467
0.2674	96.0	3744	0.3059	0.7941	0.9644	0.9491	0.6619	0.8052	0.875	0.5625	0.8466	0.8466	0.7152	0.8566	0.875	0.7408	0.8615	0.8181	0.8524	0.8154	0.8462	0.8307	0.8579	0.8416	0.855	0.7812	0.8533	0.8183	0.8429	0.7657	0.8323	0.7159	0.7682	0.7938	0.8615	0.8431	0.8813	0.7641	0.8467
0.2674	97.0	3783	0.3058	0.7939	0.9644	0.9491	0.6665	0.8049	0.875	0.5629	0.8466	0.8466	0.7152	0.8566	0.875	0.7408	0.8615	0.8176	0.8524	0.8134	0.8462	0.8312	0.8579	0.8419	0.855	0.7812	0.8533	0.8166	0.8429	0.7657	0.8323	0.7159	0.7682	0.7939	0.8615	0.843	0.8813	0.765	0.8467
0.2674	98.0	3822	0.3055	0.7942	0.9644	0.9489	0.6626	0.8053	0.875	0.5627	0.8469	0.8469	0.7152	0.8569	0.875	0.7408	0.8615	0.8189	0.8524	0.8134	0.8462	0.8307	0.8579	0.8415	0.855	0.7812	0.8533	0.8175	0.8429	0.7701	0.8355	0.7159	0.7682	0.7939	0.8615	0.843	0.8813	0.7638	0.8467
0.2674	99.0	3861	0.3054	0.7951	0.9644	0.9489	0.6649	0.8059	0.875	0.563	0.8475	0.8475	0.7197	0.8572	0.875	0.7408	0.8615	0.8199	0.8524	0.8134	0.8462	0.8307	0.8579	0.841	0.855	0.7812	0.8533	0.8175	0.8429	0.7701	0.8355	0.7159	0.7682	0.8037	0.8692	0.843	0.8813	0.7638	0.8467
0.2674	100.0	3900	0.3054	0.795	0.9644	0.9489	0.6649	0.8058	0.875	0.563	0.8475	0.8475	0.7197	0.8572	0.875	0.7408	0.8615	0.8189	0.8524	0.8134	0.8462	0.8307	0.8579	0.841	0.855	0.7812	0.8533	0.8175	0.8429	0.7701	0.8355	0.7159	0.7682	0.8037	0.8692	0.843	0.8813	0.7638	0.8467

Framework versions

Transformers 4.44.2

Pytorch 2.4.0+cu121

Datasets 2.21.0

Tokenizers 0.19.1