Evaluation Metric
We employ the standard Peak Signal To Noise Ratio (PSNR) and the Structural Similarity Index (SSIM) in grayscale, as is commonly used in the literature. The final evaluation metric can be calculated using the following formula:
\(Score = \log_k(SSIM * k^{PSNR}) = PSNR + \log_k(SSIM)\)
In our implementation, k=1.2.
Format of Submission
The test data are provided in the following format:
And as your submission, you should upload a zip file which are as the following format:
Format of Filenames
Within the zip file, you are required to name each of the result image using the same name as the input image name, and save as .mat format. For example, the input file for the test set named:
test_scene_1_0001.mat
should be
< test_gt_scene_1_0001_gt.mat >
You should insert two "_gt" into the file names. And all the .mat files should be under the same folder, there should be no subfolders in your submission.
Format of .mat File
The format included in the mat file is as follows:
| Key | Value |
|---|---|
| name | test_0001.mat |
| raw_image | ndarray(512,512,4) |
Submission