Skip navigation

CDNLAO


CDNLAO Newsletter

No. 87, December 2016

Services for children and young adults

Measuring the effects of collaboration between schools and public libraries

By Ingrid Bon, senior advisor (Education, Culture, Society) of the Rijnbrink Netherlands, Chair IFLA section Libraries for Children and Young Adults, Corresponding member IFLA Section Literacy and Reading

Introduction

As long as there are public libraries, children’s librarians have been very active in the field of book and reading promotion. But what do we really know about the effect of all the programs? We think that after a meeting with an author many children want to read those books. We know that when a child experiences reading the most important book in his life, every child can become a reader. It is all about the right book at the right time for the right child.

All around the world we can see those activities, those campaigns and we observe changes by the children but can we pinpoint the crucial factor?

This article introduces efforts in measuring the effects of collaboration between schools and public libraries in Netherlands.

1. Introduction

BoekStart

BoekStart promotes early reading, storytelling, nursery rhymes with very young children and let parents and children experience the pleasure of reading books together. It gives young children a jumpstart at primary school and tightens the bond between parents and children.

The results of this program have been monitored by annual questionnaires. And a promotional research showed that:

  • More parents started early reading for their children
  • Parents who read to their babies before 8 months old have children with better results on language skills
  • Effects are even stronger on the long run
  • Over active babies profit the most of the program
  • Parents visit the library more often and become more familiar with baby books.

One out of three parents interacts on the invitation to go to the library, subscribe their baby, collect a small suitcase with two baby books and information on reading. 99% of Dutch libraries take part in this national program so the parents are made acquainted with the special corner and materials (BoekStart Evaluation, 2014). The programs make parents read more, their children like it and ask for more. Thus they take an advantage in their language skills which even gets bigger when getting older.

BoekStart in day care centres focuses also on toddlers in playgrounds and other institutions. Early 2015, 100 library organizations (63%) are working along with over 800 (13%) of day care centres. At the end of 2015, the number reached more than 1,000.

Five elements are important in the collaboration between library and day care centres:

  • Creating an attractive reading place
  • Good collection of suitable baby and toddler books (also digital)
  • Expertise of staff is improved by training
  • Reading gets a structural moment in daily routine via the Reading Plan in policy
  • Working together with partners in a reading promotion network (local municipality, healthcare, library, day care)

By 2016, higher educated persons form the majority of the parents have participated in the program. Therefore the Ministry wants to focus on reaching lower educated parents. This wish comes together with funding. We expect that the results of BoekStart will even be more successful because of this focus.

The Public Library at School

To promote reading and to professionalise the approach of reading, the Public Library at School started in 2009. 75% of the library organizations are participating with 2,400 primary schools. This is 36% of all 6,650 Dutch primary schools.

Libraries and schools are working on a structural basis on language and vocabulary improvement, reading promotion, and media skills of children. The aim is to let children read more, both in school and in their leisure time at home. Only then the positive effect of reading on reading motivation and language skills will be really improved.

With the program the Public Library at School, primary schools and libraries sign a contract for several years in which they agree to work together on:

  • A joint policy on reading for school and library
  • An up-to-date attractive collection enriches the reading education
  • Books and other materials can be taken home
  • Books will be presented on covers frontal, movable bookshelves
  • A reading consultant from the library assists the reading coordinator from school
  • Every year targets will be determined based on monitored results
  • Every year all activities will be put down in a reading and media plan
  • A digital portal helps with search and registration of materials, stimulates reading, keeps track of reading history and finding reliable information

A final scientific report on the results and effect of The Public Library at School is published which shows positive results in stimulating reading skills. All pupils show improved skills on a school that takes part when compared to schools that do not take part. Girls show the biggest positive effects. Improvement in not only skills but also their motivation to read in leisure time could be observed (Nielen & Bus, 2013).

Reading promotion becomes a part of the language policy at school. Schools and libraries develop a reading plan that describes the goals on the area of reading pleasure and how the team will work on that. The plan describes collection, skills of the professionals, daily routine and monitoring the policy. A national tool called Monitor the Library at School was developed specially for this program.

On an annual basis, teachers, pupils and libraries fill in a questionnaire and the results show graphics on school levels and national levels.

Monitor

On a commission of the Dutch Ministry of Education, Culture and Science, a project team has developed a national internet-based monitoring instrument which charts the impact of the collaboration between elementary schools and libraries (in-school as well as out-of-school). The instrument consists of digital questionnaires to students, teachers and school librarians. The questionnaires are administered once per year. In 2012, the data were collected from approximately 30,000 students, 3,000 teachers and 300 reading consultants from all over the Netherlands. The 2015 round shows that 127,000 students, 12,000 teachers and 1,272 reading consultants filled out the questionnaire.

The questionnaire is also adapted for day care centers since 2015 and shows in the pilot stage: 39 libraries, 188 day care centers and 701 pedagogical workers.

The main goal of the monitor is to help individual schools, day care centers and libraries to optimize the impact of their collaboration. At each school, the teachers are given feedback from the monitor by the public library. The monitor data makes it possible to pinpoint specific aspects of student classroom behavior, provides detailed information for discussions amongst teaching staff and to inform school policy. As the data is retained in a national database it has also been used for analysis at a national and provincial level.

The Monitor the Library at School in the Netherlands is a national digital tool on the internet which libraries use to examine and measure the effects of cooperation with primary schools. The tool consists of questionnaires for pupils (aged 8+), teachers and library staff (reading consultants). These respondents fill out a questionnaire once a year.

The questionnaire provides a snapshot of the:

  • lending and reading behaviour of pupils;
  • reading attitudes of pupils;
  • promotion of reading by teachers;
  • library environment that supports the cooperation (e.g. the size of the collection in the school or the opening hours of the Library); and
  • the information literacy skills of the pupils and information literacy education practised by staff in the school (added in 2013).

The Monitor (developed by Sardes) was tested for the first time in 2010. From 2011-2015 students contributing has grown from 5,000 to 127,516 pupils. The last survey was done by 12,883 teachers and 1,272 reading consultants. The aim of the monitor is two-fold:

  • first, to facilitate data-driven, one-to-one cooperation between schools and libraries; and
  • second, to inform library policy regarding the educational role of libraries in the context of local policy making.

The Monitor provides data on six levels:

  1. class/group (pupils and teachers);
  2. school (total outcome of all groups);
  3. municipality (all participating schools in the same municipality);
  4. working area of the library (often more than one municipality);
  5. provincial level (all participating schools in one province); and
  6. national level (all participating schools in the Netherlands).

Policy makers can use the Monitor to develop policy, monitor that policy, to evaluate the policy and to justify the policy. This can be done on each of the six levels.

2. Data collection

As described above, the Monitor contains questionnaires for pupils, teachers and library staff (reading consultant). The following data is collected via the three questionnaires.

Pupils:

  • demographic data - year group, date of birth and gender;
  • reading for pleasure;
  • reading behaviour;
  • home reading culture;
  • perception of the public library; and
  • information skills (added in 2013).

Teachers:

  • year group;
  • reading aloud;
  • book introductions;
  • reading circles;
  • use of book collections in factual subjects (e.g. history, geography); and
  • information skills (added in 2013).

Library staff (reading consultant):

  • school demographic data;
  • lending figures;
  • school policy regarding reading promotion and information skills;
  • school library (collection, opening hours);
  • staffing (education, activities in school); and
  • inclusion of information skills course (added in 2013).

The questionnaires can be filled out on a yearly basis, between October 1 and January 31. The library invites the schools in their area to participate. The decision to participate is made by schools individually. Each library has a Monitor Coordinator who coordinates the data collection. The reading consultant from the library works with the Reading Coordinators (teachers) in the schools to ensure the questionnaires are filled in on time. The reading consultant is also responsible for library issues in each school.

3. Feedback to the school

The reading consultant and the Monitor Coordinator from the library conduct an analysis of the collected data each year and present this to the school. They can choose from two different reports:

  1. standard report with the most important data; and
  2. a tailored report detailing results from selected the issues, e.g. particular subjects that are a focus for the school.

The library presents and discusses the report at a school staff meeting. During this meeting they present results and findings from the data analysis, develop new goals (if needed) and make mutually agreed decisions on how the library and school will work on and measure the effectiveness of these goals.

4. Key data from the standard report

Reading motivation

The question for reading motivation is How do you feel on reading a book? The national average data are shown in the report as well as the specific data from individual schools. So each school can see, per year group, how they differ from the national average. When presenting these results, the library explains that the national average is not a benchmark, but just a national average. In other words, even if the results from a school equal the national average, this does not necessarily mean the school can be satisfied with their results. In Diagram 1 we can see that the school demonstrates a better result than the national average, with both boys and girls scoring above the national average. If the school participates in the data collection annually, the results from previous years will also be provided. Comparing past results may indicate that while current scores are still above the national average, previous scores indicate a change in scores and a lowering of reading motivation. Therefore, obtaining a complete data set over a number of years is very important as it provides a much better explanation of what is happening at the school level.


< Diagram 1: Student behaviour, reading motivation, standard report >

Reading frequency

Diagram 2 indicates that this school is scoring well on the level of reading frequency. For grades 5-8 (around 9-12 years old), there is a lower percentage of pupils who read on a daily basis, but the percentage of pupils that states they never read is significantly smaller than the national average. Grades 4 and 8 show a very positive result. Grade 6 is below the national average with a pattern that is clearly different from the other grades, a fact that would be highlighted in the discussion with teachers. Is there anything special about this group of children? Does the teacher do things differently to the other teachers? It is quite possible that in this situation the teachers would decide on a new goal for reading frequency for Grade 6, i.e. the reading frequency of Grade 6 needs to rise. Activities and approaches to meet the new goal would be agreed upon after the final analysis has been completed.


< Diagram 2: Student behaviour, reading frequency, standard report >

Borrowing behaviour

In the Standard Report, results for borrowing behaviour are also compared with the national data. In this example, the pattern of borrowing differs very much from the national data. It is possible that the school and the library, recognising that reading motivation declines in the higher grades, invested a lot of time and effort in stimulating the borrowing of books in the higher grades. It seems that due to this extra attention to raising motivation in grades 7 and 8, the lower grades are falling behind. A new goal in this situation could be to increase the borrowing figures for grades 4, 5 and 6.


< Diagram 3: Student behaviour, borrowing, standard report >

Book circles

A book circle is an approach where all pupils discuss informally books and reading under guidance of the teacher. This approach is a good alternative to the traditional book talk presentation or it can be used as an additional activity. In the book circle only authentic, meaningful conversations are conducted in an informal format. The exchange of reading experiences and stimulating personal reading pleasure is a major focus of the club. The teacher does not control, but encourages the conversation and joins in the conversation including discussion about his/her own reading preferences and level of engagement with reading. Schools sometimes use the method espoused by the author Aidan Chambers. In diagram 4, teachers are not using the book circle with the same frequency. Three do not do book circles at all, two only a few times a year and three several times a month. By discussing these different approaches the teachers will become aware of the fact that the children across the school are not receiving the same program. Such discussion may lead to a new target for this item, i.e. the introduction of book circles in all grades.


< Diagram 4: Teacher behaviour, book circles, standard report >

The use of books in factual subjects

Factual subjects like history or geography are useful for reading promotion. It is not difficult to find subjects from textbooks which connect with fiction and non-fiction books. However, the use of fiction and non-fiction, and the promotion of reading in factual subjects is not a common approach in Dutch primary schools. If this approach is done at all, it is informal and intermittent. Diagram 5 indicates that teachers from different grades do not have a consistent approach. The responses range from never to often. Such a result could lead to the development of a new goal, i.e. we will use fiction and non-fiction books in factual subjects in all grades.


< Diagram 5: Teacher behaviour, fiction and non-fiction
in factual subjects, standard report >

Tailored reports

When the school has special policy priorities, the library can prepare a special report, which focuses on these priorities. For example dealing with parent involvement (questions on the home reading environment), policy on reading by boys (tendency to score lower than girls in both reading frequency and language skills), or the use of the library. Since 2013, the library has been also able to prepare a tailored report on information literacy.

5. Data-driven cooperation with schools

Using data from the Monitor to demonstrate how one-on-one cooperation between the library and schools can be effective, has made it very clear how it is possible for the public library to offer real customized services to schools. The public library can deliver customised services for each school, single grades or a subgroup like the boys from Grade 7. This is a huge change when compared with the general product-oriented policies usually in place in Dutch public libraries. Using data in this way requires a new way of thinking and acting. Data-driven means that the data collected by the Monitor can lead to new policy measures and real change. Library personnel and school staff can examine the results (presented as graphics), reach conclusions and formulate new agreements based on cooperation.

Formulating new goals, as discussed in the previous section, however, is not the final step in the equation. After the goals have been set, agreements need to be reached on HOW to achieve these goals. In order to raise the borrowing of books in grade 4, 5 and 6 the school and library can agree on a two-weekly visit to the Library at School. The next step is that both partners DO what they agreed upon and fulfil their respective roles. Then after the next Monitor round of data collection, the school and the library can assess whether the desired changes have taken place. This can result in new goals and agreements or a commitment to ongoing monitoring. Working in this way demands a high level of analytic thinking and strategic behaviour from the library staff. This is a big change for public libraries and represents an ongoing process currently underway.

6. Conclusion

The huge amount of data collected by the Monitor also makes it possible to pinpoint national trends. These trends were published in 2013 for the first time in a separate brochure. With these reports and brochures, school boards, library directors and city councils can make policy decisions based on solid data. The policy regarding cooperation between schools and libraries is often part of a policy focused on educational disadvantages. The Monitor Library at School makes it possible to correct priorities based on real data and assessment of whether activities have been effective, i.e. positive educational advances. For this reason the Monitor Library at School is a worthwhile and useful tool for all involved in policy making at all levels.
On January 1, 2015, a new Library act was introduced in the Netherlands. One of the 5 core functions within the act is promotion of reading and introduction to literature. Another article dictates that public libraries should support local education.

By this act, the goals for the target group young people (0-18 years old) are put down into action.

For more information please contact
info@kunstvanlezen.nl Ingrid.bon@rijnbrink.nl (Chair, IFLA Libraries for Children and Young Adults Section)


Copyright (C) 2016 IFLA Libraries for Children and Young Adults Section