We propose a computer-based testing environment, Reading Skill Test, to measure the effects of various types of systematic reading support systems. We prove its validity, reliability and one-dimensionality using 31,000 subjects. The effects of furigana system on the 5th to 8th grade students are analyzed using this environment. Furigana is a widely used Japanese reading support system that has been believed to be beneficial especially for pupils. Despite our expectation, we have to conclude that furigana failed to improve pupils’ reading significantly, and discuss why it did so.

A reading skill test to diagnose basic language skills is introduced. The test is designed to measure six component skills relevant to reading in comparison with those of state-of- the-art natural language processing technologies. The results of the first large-scale experiments using the test are reported. Surprisingly, almost half of Japanese junior high school students do no better than machines in dependency analysis. More than half of 7th grade students do no better than making random choices on questions involving inferences and definition understanding.