SuperShip dataset: reference (200 images) SuperShip commit: 3c750e6ec1bb443a2771d5fb75cbd7bf3803281b SuperShip device: CUDA_VISIBLE_DEVICES=4 wrote 60000 detections run 1/3: 4.161548 s, 60000 detections, /home/yzhang/scc/SuperShip/output/log_scoring_baseline/submission.run1.json wrote 60000 detections run 2/3: 4.396014 s, 60000 detections, /home/yzhang/scc/SuperShip/output/log_scoring_baseline/submission.run2.json wrote 60000 detections run 3/3: 4.026786 s, 60000 detections, /home/yzhang/scc/SuperShip/output/log_scoring_baseline/submission.run3.json {"runs_seconds":[4.161547566,4.396013534,4.02678629],"median_seconds":4.161547566} ==> /home/yzhang/scc/SuperShip/output/log_scoring_baseline/submission.run1.json Evaluate annotation type *bbox* COCOeval_opt.evaluate() finished... DONE (t=0.17s). Accumulating evaluation results... COCOeval_opt.accumulate() finished... DONE (t=0.00s). Average Precision (AP) @[ IoU=0.50:0.95 | area= all | maxDets=100 ] = 0.679 Average Precision (AP) @[ IoU=0.50 | area= all | maxDets=100 ] = 0.793 Average Precision (AP) @[ IoU=0.75 | area= all | maxDets=100 ] = 0.770 Average Precision (AP) @[ IoU=0.50:0.95 | area= small | maxDets=100 ] = -1.000 Average Precision (AP) @[ IoU=0.50:0.95 | area=medium | maxDets=100 ] = 0.492 Average Precision (AP) @[ IoU=0.50:0.95 | area= large | maxDets=100 ] = 0.721 Average Recall (AR) @[ IoU=0.50:0.95 | area= all | maxDets= 1 ] = 0.509 Average Recall (AR) @[ IoU=0.50:0.95 | area= all | maxDets= 10 ] = 0.831 Average Recall (AR) @[ IoU=0.50:0.95 | area= all | maxDets=100 ] = 0.875 Average Recall (AR) @[ IoU=0.50:0.95 | area= small | maxDets=100 ] = -1.000 Average Recall (AR) @[ IoU=0.50:0.95 | area=medium | maxDets=100 ] = 0.809 Average Recall (AR) @[ IoU=0.50:0.95 | area= large | maxDets=100 ] = 0.890 Average Recall (AR) @[ IoU=0.50 | area= all | maxDets=100 ] = 0.990 Average Recall (AR) @[ IoU=0.75 | area= all | maxDets=100 ] = 0.944 headline metrics: mAP@[.5:.95] 0.6791 AP@0.50 0.7929 AP@0.75 0.7700 AP (small) -1.0000 AP (medium) 0.4924 AP (large) 0.7213 AR@1 0.5092 AR@10 0.8308 AR@100 0.8750 AR (small) -1.0000 AR (medium) 0.8091 AR (large) 0.8901 per-class AP@[.5:.95]: 0:aircraft_carrier 0.6844 1:warship 0.8143 2:other_ship 0.5386 ==> /home/yzhang/scc/SuperShip/output/log_scoring_baseline/submission.run2.json Evaluate annotation type *bbox* COCOeval_opt.evaluate() finished... DONE (t=0.17s). Accumulating evaluation results... COCOeval_opt.accumulate() finished... DONE (t=0.00s). Average Precision (AP) @[ IoU=0.50:0.95 | area= all | maxDets=100 ] = 0.679 Average Precision (AP) @[ IoU=0.50 | area= all | maxDets=100 ] = 0.793 Average Precision (AP) @[ IoU=0.75 | area= all | maxDets=100 ] = 0.770 Average Precision (AP) @[ IoU=0.50:0.95 | area= small | maxDets=100 ] = -1.000 Average Precision (AP) @[ IoU=0.50:0.95 | area=medium | maxDets=100 ] = 0.492 Average Precision (AP) @[ IoU=0.50:0.95 | area= large | maxDets=100 ] = 0.721 Average Recall (AR) @[ IoU=0.50:0.95 | area= all | maxDets= 1 ] = 0.509 Average Recall (AR) @[ IoU=0.50:0.95 | area= all | maxDets= 10 ] = 0.831 Average Recall (AR) @[ IoU=0.50:0.95 | area= all | maxDets=100 ] = 0.875 Average Recall (AR) @[ IoU=0.50:0.95 | area= small | maxDets=100 ] = -1.000 Average Recall (AR) @[ IoU=0.50:0.95 | area=medium | maxDets=100 ] = 0.809 Average Recall (AR) @[ IoU=0.50:0.95 | area= large | maxDets=100 ] = 0.890 Average Recall (AR) @[ IoU=0.50 | area= all | maxDets=100 ] = 0.990 Average Recall (AR) @[ IoU=0.75 | area= all | maxDets=100 ] = 0.944 headline metrics: mAP@[.5:.95] 0.6791 AP@0.50 0.7929 AP@0.75 0.7700 AP (small) -1.0000 AP (medium) 0.4924 AP (large) 0.7213 AR@1 0.5092 AR@10 0.8308 AR@100 0.8750 AR (small) -1.0000 AR (medium) 0.8091 AR (large) 0.8901 per-class AP@[.5:.95]: 0:aircraft_carrier 0.6844 1:warship 0.8143 2:other_ship 0.5386 ==> /home/yzhang/scc/SuperShip/output/log_scoring_baseline/submission.run3.json Evaluate annotation type *bbox* COCOeval_opt.evaluate() finished... DONE (t=0.16s). Accumulating evaluation results... COCOeval_opt.accumulate() finished... DONE (t=0.00s). Average Precision (AP) @[ IoU=0.50:0.95 | area= all | maxDets=100 ] = 0.679 Average Precision (AP) @[ IoU=0.50 | area= all | maxDets=100 ] = 0.793 Average Precision (AP) @[ IoU=0.75 | area= all | maxDets=100 ] = 0.770 Average Precision (AP) @[ IoU=0.50:0.95 | area= small | maxDets=100 ] = -1.000 Average Precision (AP) @[ IoU=0.50:0.95 | area=medium | maxDets=100 ] = 0.492 Average Precision (AP) @[ IoU=0.50:0.95 | area= large | maxDets=100 ] = 0.721 Average Recall (AR) @[ IoU=0.50:0.95 | area= all | maxDets= 1 ] = 0.509 Average Recall (AR) @[ IoU=0.50:0.95 | area= all | maxDets= 10 ] = 0.831 Average Recall (AR) @[ IoU=0.50:0.95 | area= all | maxDets=100 ] = 0.875 Average Recall (AR) @[ IoU=0.50:0.95 | area= small | maxDets=100 ] = -1.000 Average Recall (AR) @[ IoU=0.50:0.95 | area=medium | maxDets=100 ] = 0.809 Average Recall (AR) @[ IoU=0.50:0.95 | area= large | maxDets=100 ] = 0.890 Average Recall (AR) @[ IoU=0.50 | area= all | maxDets=100 ] = 0.990 Average Recall (AR) @[ IoU=0.75 | area= all | maxDets=100 ] = 0.944 headline metrics: mAP@[.5:.95] 0.6791 AP@0.50 0.7929 AP@0.75 0.7700 AP (small) -1.0000 AP (medium) 0.4924 AP (large) 0.7213 AR@1 0.5092 AR@10 0.8308 AR@100 0.8750 AR (small) -1.0000 AR (medium) 0.8091 AR (large) 0.8901 per-class AP@[.5:.95]: 0:aircraft_carrier 0.6844 1:warship 0.8143 2:other_ship 0.5386 SuperShip workflow completed