TASK 1 / PARTICIPANT HUB
Training, development, and test files for Task 1 are available below. No pre-registration or access code is required; submit directly through the separate development and test pages.
Use the published development questions and expected IDs. Accepted submissions show the Final answer and Reasoning steps scores, a receipt, and current rank immediately. The team's best eligible result also appears on the public leaderboard. Enter a consistent Team Name.
View development submission stepsThe test questions are available now. Test uploads receive format feedback and an acceptance receipt when accepted. Enter the same Team Name, a Contact Email, and the canonical ZIP. Test scores and ranks are now published under the frozen evaluation configuration, with an evaluation note on the results page.
Open Test resultsThe public leaderboard shows each team's best eligible development result and current rank, alongside organizer practice baselines in a separate table. Contact emails, raw submissions, receipts, and test results are excluded.
View development leaderboardDOWNLOADS
Use each release manifest to verify your download. The development package contains 13 files and the test package contains three files.
Data license and provenance: scope notice and CC BY 4.0 text.
The frozen scorer is finreason.task1.scorer/2.0.0. Final ranking uses descending lexicographic order of (CombinedFAC, HiddenFAC, CombinedCheckpoint), with each key quantized to six decimal places using round-half-even. CombinedFAC and CombinedCheckpoint each weight the seen and hidden strata within the Test evaluation equally; they do not average development leaderboard scores with Test scores. Teams identical on all three keys share the same rank. Submission time is not an additional tie-breaker.
Subject to the resource licence, teams may generate additional training, few-shot or local evaluation data from public FinChain templates, use those templates to categorize questions for analysis, and match questions to public templates to compute predictions. Computing predictions with a public symbolic template is permitted. Describe the FinChain version, matching and execution procedure, and contribution to predictions in the Working Notes. Accessing private evaluation answers, bypassing submission limits or exploiting the evaluation service is prohibited.
Each normalized Team Name may make two accepted submissions per UTC day and 40 accepted submissions in total. The daily window resets at 00:00 UTC. Rejected uploads and identical re-uploads of an accepted ZIP do not consume another submission. Keep one consistent Team Name. Test submissions remain unlimited before the deadline.
To restore earlier predictions, generate a new valid ZIP containing that earlier predictions.jsonl and upload it under the same Team Name and Contact Email before the deadline. The new ZIP must differ from the previously accepted archive and receive a new acceptance receipt; its prediction contents may remain unchanged. If the portal returns the original receipt and acceptance time, the upload is a replay and the latest submission has not changed. The latest accepted, valid submission before the deadline is used for final evaluation.
Lite, Standard and Advanced are model-based references evaluated on the same 580 development questions with the frozen scorer. They generate final-answer and checkpoint predictions from public questions without gold-answer inputs. Their Final answer / Reasoning steps scores are Lite 0.234048 / 0.555354, Standard 0.980556 / 0.987725, and Advanced 0.984444 / 0.990000. Model identities and full configurations are not currently public. Cite the published baseline labels and development leaderboard. Publication of Test scores for these three systems has not been confirmed.