The Prague Texture Segmentation Datagenerator and Benchmark

The Prague Texture Segmentation Datagenerator and Benchmark - Result Details

optimized
for

It is possible that the resulting index maps don't correspond to the training set's indeces according to the data.xml file!
It leads to the wrong values of pixel-wise criteria as a result.


Benchmark - Colour [normal] CL		result by		huangyuan's unet (psp21ewt)


set \ criterion	CS	OS	US	ME	NE	O	C	CA	CO	CC	I	II	EA	MS	RM	CI	GCE	LCE	BCE	GBCE	BGM	SC	SSC	VD	L	AVI	NVI	NMI	M	ARI	JC	DC	FMI	WI	WII	NBDE
#3 - all	99.78	0.00	0.00	0.00	0.00	0.21	0.15	99.56	99.78	99.78	0.22	0.12	99.78	99.67	0.06	99.78	0.44	0.35	0.53	0.44	99.78	99.56	99.56	0.22	99.78	0.27	1.53	98.47	0.30	99.32	99.10	99.55	99.55	99.55	99.55	0.17
#4 - all	98.93	0.00	0.00	0.00	0.00	0.94	1.13	97.89	98.93	98.93	1.07	0.37	98.93	98.40	0.09	98.93	2.12	1.98	2.26	2.12	98.93	97.89	97.89	1.07	98.86	1.09	4.88	95.01	1.06	97.29	96.10	98.01	98.01	97.98	98.04	0.63
#5 - all	99.35	0.00	0.00	0.00	0.00	0.65	0.47	98.72	99.35	99.36	0.65	0.19	99.35	99.03	0.07	99.35	1.28	1.14	1.42	1.28	99.35	98.72	98.72	0.65	99.14	0.70	2.71	97.06	0.50	98.67	98.04	99.01	99.01	98.92	99.10	0.30
#6 - all	98.23	0.00	0.00	0.00	0.00	2.05	1.89	96.51	98.23	98.24	1.77	0.69	98.22	97.34	0.30	98.23	3.44	2.64	4.30	3.49	98.23	96.54	96.51	1.77	97.65	1.58	5.51	93.68	1.53	95.89	94.00	96.91	96.91	96.26	97.56	0.88
#7 - all	97.59	0.00	0.00	0.00	0.00	3.27	2.30	95.39	97.59	97.60	2.41	0.34	97.59	96.38	0.19	97.59	4.65	4.20	5.12	4.67	97.59	95.38	95.39	2.41	96.21	2.07	6.65	92.92	1.19	95.86	93.37	96.57	96.57	96.74	96.41	1.01
#8 - all	98.96	0.00	0.00	0.00	0.00	1.12	0.97	97.95	98.96	98.97	1.04	0.15	98.96	98.45	0.07	98.96	2.05	1.82	2.29	2.06	98.96	97.95	97.95	1.04	98.80	1.06	3.18	96.69	0.52	97.89	96.46	98.20	98.20	98.28	98.11	0.36
#9 - all	96.27	27.12	0.00	0.84	0.00	3.01	3.66	93.14	96.27	95.81	3.73	0.48	95.99	94.40	0.52	96.02	5.99	4.68	7.89	6.57	96.27	93.64	93.22	3.35	86.58	2.56	7.26	91.58	1.74	94.04	90.65	95.09	95.10	95.61	94.59	2.14
#10 - all	97.90	0.00	0.00	0.00	0.00	2.20	2.03	95.94	97.90	97.93	2.10	0.20	97.91	96.86	0.20	97.91	4.08	3.40	4.80	4.12	97.90	95.91	95.94	2.10	97.49	1.94	5.25	94.60	0.81	95.94	93.05	96.40	96.40	96.87	95.93	0.63
#11 - all	98.19	0.00	0.00	0.00	0.00	1.77	1.33	96.48	98.19	98.21	1.81	0.19	98.19	97.29	0.12	98.20	3.54	3.04	4.04	3.54	98.19	96.47	96.48	1.81	97.74	1.68	4.37	95.41	0.67	96.69	94.31	97.07	97.07	97.09	97.05	0.52
#12 - all	98.41	0.00	0.00	0.00	0.00	1.46	1.41	96.88	98.41	98.43	1.59	0.17	98.40	97.61	0.15	98.41	3.09	2.42	3.80	3.12	98.41	96.90	96.88	1.59	97.32	1.45	3.64	95.97	0.63	97.11	95.06	97.47	97.47	97.66	97.28	0.45
#6 - bark	98.36	0.00	0.00	0.00	0.00	1.37	1.97	96.79	98.36	98.36	1.64	0.40	98.36	97.54	0.17	98.36	3.20	2.76	3.66	3.22	98.36	96.80	96.79	1.64	97.83	1.51	5.27	94.22	1.17	96.57	94.79	97.33	97.33	97.24	97.41	0.70
#6 - flowers	97.77	0.00	0.00	0.00	0.00	2.55	2.90	95.69	97.77	97.79	2.23	0.43	97.77	96.66	0.28	97.78	4.34	3.73	4.95	4.34	97.77	95.69	95.69	2.23	97.13	1.96	6.82	92.72	1.36	95.85	93.62	96.71	96.71	96.72	96.70	0.85
#6 - glass	97.01	0.00	0.00	0.00	0.00	2.22	3.28	94.23	97.01	97.00	2.99	0.73	96.99	95.51	0.27	97.00	5.74	5.18	6.39	5.83	97.01	94.29	94.23	2.99	96.04	2.48	8.65	90.71	2.06	93.70	90.48	95.00	95.00	94.66	95.35	1.56
#6 - man-made	99.06	0.00	0.00	0.00	0.00	0.91	0.91	98.13	99.06	99.06	0.94	0.21	99.06	98.58	0.12	99.06	1.87	1.62	2.12	1.88	99.06	98.13	98.13	0.94	98.97	0.98	3.43	96.36	0.70	97.83	96.61	98.28	98.28	98.40	98.15	0.45
#6 - nature	99.24	0.00	0.00	0.00	0.00	0.87	0.87	98.49	99.24	99.24	0.76	0.39	99.24	98.85	0.09	99.24	1.51	1.29	1.73	1.51	99.24	98.49	98.49	0.76	98.78	0.80	2.77	96.09	0.79	98.34	98.00	98.99	98.99	99.02	98.96	0.35
#6 - plants	97.07	0.00	0.00	0.00	0.00	1.36	1.49	94.33	97.07	97.13	2.93	0.86	97.05	95.60	0.86	97.07	5.49	3.91	7.21	5.63	97.07	94.41	94.33	2.93	97.32	2.16	7.50	92.25	2.28	92.52	88.54	93.92	93.92	93.29	94.56	1.42
#6 - rock	98.95	0.00	0.00	0.00	0.00	1.13	1.12	97.92	98.95	98.95	1.05	0.24	98.95	98.42	0.07	98.95	2.09	1.91	2.27	2.09	98.95	97.92	97.92	1.05	98.82	1.05	3.67	96.14	0.77	97.55	96.13	98.03	98.03	98.06	98.00	0.41
#6 - stone	96.66	0.00	0.00	2.55	1.89	1.19	2.77	97.10	98.46	98.55	1.54	0.28	98.43	97.70	0.41	98.47	2.68	2.11	3.42	2.86	98.46	97.20	97.10	1.54	94.36	1.15	4.02	94.44	0.73	98.39	97.91	98.94	98.94	98.93	98.95	0.69
#6 - textile	99.47	0.00	0.00	0.00	0.00	0.60	0.54	98.96	99.47	99.47	0.53	0.12	99.47	99.21	0.03	99.47	1.05	0.98	1.12	1.05	99.47	98.95	98.96	0.53	99.27	0.60	2.08	97.74	0.37	98.89	98.27	99.13	99.13	99.11	99.14	0.22
#6 - wood	94.64	6.90	0.00	3.95	0.00	2.58	5.14	90.30	94.64	91.48	5.36	1.33	92.98	91.96	1.72	93.02	5.36	4.76	9.61	9.01	94.64	93.43	90.85	4.41	83.25	2.55	8.88	89.64	2.38	93.61	90.83	95.19	95.23	92.56	97.98	1.69
mean	98.09	1.70	0.00	0.37	0.09	1.57	1.82	96.52	98.18	98.01	1.82	0.39	98.08	97.27	0.29	98.09	3.20	2.70	3.95	3.44	98.18	96.71	96.55	1.75	96.57	1.48	4.90	94.58	1.08	96.60	94.77	97.29	97.29	97.15	97.44	0.77


criterion	Graph
correct
over
under
missed
noise
F-measure


image	Texture mosaic (undegraded)	Ground truth	Segmentation
#3 - all
#4 - all
#5 - all
#6 - all
#7 - all
#8 - all
#9 - all
#10 - all
#11 - all
#12 - all
#6 - bark
#6 - flowers
#6 - glass
#6 - man-made
#6 - nature
#6 - plants
#6 - rock
#6 - stone
#6 - textile
#6 - wood