This challenge consists of two phases. The submission and evaluation procedures for each phase are as follows.


📌 Submission¶

  • Each team is allowed a maximum of 2 submissions.
  • The submission must be a single .json file containing report results for all TIFF files.
Submission File Format (.json)¶

The file should follow a list-based JSON format as shown below:

[  
  {  
    "id": "---",  
    "report": "---"  
  },  
  {  
    "id": "---",  
    "report": "---"  
  },

... ,

  {  
    "id": "---",  
    "report": "---"  
  }    
]

*Submissions with invalid JSON format will not be scored. Please ensure your file is properly formatted.


📌 Evaluation Metric¶

The final score is calculated as follows:
ranking score = 0.15 × (ROUGE + BLEU) + 0.4 × KEY score + 0.3 × EMB score
(*The weights were determined based on consultation with clinical experts)

The leaderboard will reflect each team's best score among their submissions.