PROMO All information available in the news

Same Language Subtitling (SLS) and its impact on reading literacy

A summary of evidence[1]

Same Language Subtitling (SLS) is the idea of subtitling audio-visual content in the ‘same’ language as the audio. Word for word, what you hear is what you read. SLS was first coined in 1996 to promote reading literacy in a multilingual country like India with 23 official languages and 700+ dialects (Kothari, 1998). SLS and captioning are overlapping concepts but not the same. Captioning can be transliteration or translation. SLS is strictly transliteration.[2]

Does SLS on audio-visual content cause automatic reading engagement among viewers?

 

Surely, that depends on the viewer’s ability to read so it is worth considering the question for weak readers (who can decode a few letters or words but are unable to read simple texts at Grade 2 level) and good readers (who can read simple texts).

 

For good readers, d’Ydewalle et al.’s (1991) eye-tracking research found that American subjects watching an English movie with SLS and Dutch subjects watching a Dutch movie with SLS, spent considerable time in the subtitle area. Reading SLS was inevitable and comparable for both groups, even though the Dutch subjects had much more experience with subtitles on TV. Reading along with SLS did not depend on habit formation.

Several studies have confirmed that reading along with SLS is inescapable when the viewers are good readers. However, there is a dearth of studies on weak readers’ reading with and improvement from SLS exposure. Our eye-tracking study with weak readers drawn from a remote village in Rajasthan, India found that, “70 percent of weak readers engaged in unprompted reading while watching [Hindi] film clips with SLS” (Arjun et al., 2022).

 

In another study with government school children in Grades 2-5 in rural Rajasthan, we showed them animated stories with and without SLS (PlanetRead, 2018a). The subjects were extremely struggling readers from low-income families. Most children (94%) engaged with SLS, exhibiting an increasing number of eye-fixations on the subtitles, with grade. The stories at a ‘low’ level of reading difficulty (81 simple words/min) invited the most reading engagement. SLS was mostly ignored in the story with a relatively higher level of difficulty (111 words/mn)

 

The main conclusion is that almost all viewers who have some letter decoding will automatically try to read along with SLS even if they are not able to keep up at first. SLS cannot and will be ignored by weak and good readers alike.

The value of SLS and overlapping concepts like captioning, intralingual, and bimodal subtitling, for language learning (first, second, and foreign) has received the bulk of academic attention.[3] The potential impact of SLS on reading literacy remains understudied.

Does regular SLS exposure lead to improved reading skills?

The idea of leveraging Closed-Captioning (CC) on TV to enhance the reading skills of struggling readers, is as old as CC itself (Koskinen et al., 1986) but longitudinal studies are few. Linebarger et al. (2010) commented on one such by Koskinen et al. (1997): “In a longitudinal study of continuous caption use in the home, children who viewed with captions scored significantly higher on normative tests of word identification and passage comprehension when compared with non-caption viewers.”

In Linebarger et al.’s (2010) study with struggling readers in Grades 2-3 from low-income urban locations in the US, SLS exposure was limited to just six 30-minute episodes from children’s TV. Still, “The majority of outcomes… indicated that children who viewed with captions outperformed their counterparts who viewed without captions,” and the improvement was most pronounced among children at risk for poor reading outcomes.

 

Similarly, in New Zealand, Parkhill & Johnson (2009) found that in their six-week ‘AVAILLL’ program for children aged 5-13 years, which uses popular, subtitled movies and accompanying novels to engage students in reading literacy, the greatest gains occurred for ‘low-progress’ readers. A positive impact was also observed for average and higher-level readers.[4] The handful of studies that do exist on the impact of captions or SLS on reading literacy had a short duration of exposure, small sample size, and conducted in majority English speaking countries.

 

Several longitudinal studies have come out of the SLS project in India, now called the Billion Readers (BIRD) initiative.[5]  Kothari and Bandyopadhyay (2014) evaluated the impact of SLS after sustaining it for 5 years on a weekly hour-long program of Hindi film songs telecast nationally in prime time. Among school children who could not read a single letter in Hindi at the baseline (2002), 70% in the high-SLS viewing group became functional readers by the endline (2007) as compared to 34% in the low-SLS group.[6]  In the 15+ age group, 14% in the high-SLS as compared to 5% in the low-SLS group went from non-decoding to functional-reading ability. Adults gained too but children benefited substantially more in what can be described as a schooling + SLS effect.

 

Given the SLS project’s goal of persuading broadcast policy in India to require SLS on all the film songs shown on TV in India, in every language, a maximum SLS exposure of an hour a week, albeit for 5 years, was still too little. That was addressed in Maharashtra state where, for 2 years, SLS had a strong broadcast presence on around 20 Marathi films per week (only the songs were subtitled) on two of the most popular Marathi channels (Kothari andBandyopadhyay, 2015). The Gujarat (control) and Maharashtra samples were comparable at the baseline (2013).[7]  By the endline (2015), in Maharashtra, 68% in Grade 3 could read at Grade 1 level or better as compared to 43% in Gujarat.[8]

The Annual Status of Education Report (ASER) independently found that over the same 2-year period, Maharashtra outperformed all states – 9% more children in Grade 5 were able to read a Grade 2 level text, as compared to no gain nationally.[9]  Among those who got regular SLS exposure, 30% more children in the early grades achieved basic reading ability. The impact of SLS on reading skills was considerably stronger for children in Grades 2-3. A separate study of SLS on TV in Gujarat state confirms its value on film songs for reading literacy (Kothari et al., 2004). What about SLS on children’s TV?

Universally, children love to watch cartoons. PlanetRead (2018a) found that struggling readers cannot but attend to SLS on animated stories. Does that contribute to reading skills? Linebarger et al. (2010) and Linebarger (2001) provide evidence that it does, while underscoring the importance of captions, “especially for children who might not have access to print.”

 

PlanetRead (2018b) conducted a year-long study in 10 primary schools in rural Delhi serving children in Grades 1-5 from low-income families. In 5 treatment schools, the teachers showed all the children in Grades 1-4, 30 minutes of animated stories in Hindi with SLS, three times a week. From a comparable starting point, the average reading score in the treatment schools was 70% higher than the control schools. The impact of the intervention on reading was most apparent in Grades 2-3, pointing again to the strong complementarity of SLS, during the early stages of reading acquisition.

 

The benefits of SLS are not limited to reading literacy. For an overview of the range of benefits attributable to SLS, including reading, media access and language acquisition, see Gernsbacher (2015).

References

  • Arjun, S., Kothari, B., Shah, N. K., & Biswas, P. (2022). Do weak readers in rural India automatically read same language subtitles on Bollywood films?
  • An eye gaze analysis. Journal of Eye Movement Research, 15(5). 
  • d’Ydewalle, G., Praet, C., Verfaillie, K., & Rensbergen, J. V. (1991). Watching Subtitled Television: Automatic Reading Behavior. Communication Research, 18(5), 650–666.
  • d’Ydewalle, G., & Van Rensbergen, J. (1989). Developmental studies of text-picture interactions in the perception of animated cartoons with text. In H. Mandl & J. R. Levin (Eds.), Advances in psychology, 58. Knowledge acquisition from text and pictures (pp. 233-248). Oxford, England: North-Holland.
  • Gernsbacher, Morton Ann. “Video Captions Benefit Everyone” Policy insights from the behavioral and brain sciences vol. 2,1 (2015): 195-202.
  • Koskinen, P.S., Bowen, C.T., Gambrell, L.B., Jensema, C.J. & Kane, K.W. (1997). Captioned television and literacy development: Effects of home viewing on learning disabled students. Paper presented at the Meeting of the American Educational Research Association, Chicago, IL.
  • Koskinen, P. S., Wilson, R. M., Gambrell, L. B., & Jensema, C. J. (1986). Using closed captioned television to enhance reading skills of learning disabled students. National Reading Conference Yearbook, 35, 61-65.
  • Kothari, B. 1998.  Film Songs as Continuing Education: Same Language Subtitling for Literacy.  Economic and Political Weekly, 33(39): 2507-2510 (Sept. 26, 98).
  • Kothari, B., & Bandyopadhyay, T. (2014). Same language subtitling of Bollywood songs on TV: Effects on literacy. Information Technologies & International Development, 10(4), 31–47.
  • Kothari, B. & Bandyopadhyay, T. (2015). An innovation to raise a nation’s reading skills: Scale up of Same Language Subtitling (SLS) on Zee in Maharashtra.
    See also the article from Huffington Post.
  • Kothari, B., Pandey, A., & Chudgar, A. (2004). Reading out of the “idiot box”: Same-language subtitling on television in India. Information Technologies & International Development, 2(1), 23–44.
  • Linebarger, D., Piotrowski, J. T., & Greenwood, C. R. (2010). On-screen print: The role of captions as a supplemental literacy tool. Journal of Research in Reading, 33(2), 148-167.
  • Parkhill, F., & Johnson, J. (2009). An unexpected breakthrough for rapid reading improvement: AVAILLL uses movies so students read it, see it and get it. set: Research Information for Teachers, 1, 28−34.
  • PlanetRead (2018a). AniBooks: Scalable and likeable, but readable?
  • PlanetRead (2018b). AniBooks for early-grade reading.

[1] Authored by Dr. Brij Kothari, Co-Lead, Billion Readers (BIRD) initiative.

[2] Captioning is designed for media access among Deaf and Hard of Hearing (DHH) viewers, so it has to be in a language they can read in and understand, but not necessarily in the ‘same’ language as the audio.

[3] See this comprehensive bibliography on SLS and language learning maintained by Günter Burger.

[4] The Audio Visual Achievement in Literacy Language and Learning (AVAILLL) program is based on the premise that using popular movies with subtitles not only enhances students’ reading skills but also motivates students to read books.

[5] See BillionReaders or PlanetRead.

[6] The study caught Bill Clinton’s attention. Link to Video.

[7] The Gujarat sample had marginally better reading scores.

[8] The majority of children in India do not read at grade level, hence, the use of such outcome measures.

[9] Article from HuffingtonPost.

Skip to content