ICILS 2018

Computer and information literacy (CIL)

Variations in students’ CIL

• Students’ CIL varied more within countries than across countries.
• Variations across countries
  • The difference between the highest and lowest average CIL scores across countries was 157 scale points.
  • Denmark had the highest average CIL score of 553 points, and Kazakhstan had the lowest average CIL score of 395 points.
• Variations within countries
  • Differences in the within-country student score distributions tended to be larger in countries with lower average achievement than in countries with higher average achievement scores.
  • The difference between the lowest five percent and the highest ninety-five percent of students’ CIL scores within countries varied between 216 scale points in Denmark (lowest within-country variation) and 347 scale points in Kazakhstan (highest within-country variation).

Students’ proficiency in CIL

• The CIL achievement scale represented students’ proficiency at four levels with increasing sophistication in CIL.
  • Students with CIL achievement scores at Level 1 demonstrated a functional working knowledge of computers as tools.
  • Students at Level 2 could use computers to complete management tasks and gather information under direct instruction.
  • Students at Level 3 demonstrated the ability to work independently on computers to gather information and complete management tasks.
  • Students at Level 4 demonstrated control of computers to search for information and create information products.
• In all countries, 80 percent of students achieved scores that placed them within CIL Levels 1, 2, and 3, with majority of the students reporting a Level 2 CIL proficiency across all countries.
• The differences in average CIL achievement scores in the three countries that met the necessary sample participation requirements for trend analysis in ICILS 2013 and 2018 were small and not statistically significant.

Personal and social backgrounds related to students’ CIL

• Gender
  • Female students demonstrated higher CIL achievement than male students.
  • The average CIL scores of female students were statistically significantly higher than that of male students in 10 out of 13 countries and benchmarking participants.
• Socioeconomic status
  • In all countries, students belonging to high socioeconomic status (denoted by high parental occupation, high parental education, and high number of books in the home) groups performed significantly higher on the CIL achievement scale than those belonging to lower socioeconomic groups.
  • The socioeconomic background is a consistent positive predictor of CIL across countries, however, the effect sizes vary across countries.
• Immigrant and language background
  • In 9 out of 13 countries and benchmarking participants, students from non-immigrant families performed significantly better than students from immigrant families.
  • In 10 of 13 countries and benchmarking participants, students who identified the language of the ICILS test as the language they spoke at home had statistically higher CIL scores than those who reported speaking another language at home.
• Computer use outside school
  • All participating entities indicated that students who reported having two or more computers at home had statistically significantly higher CIL scores than students who reported having less than two computers at home.
  • In 12 out of 13 ICILS 2018 participants, students who reported having used computers for five or more years had statistically significantly higher CIL scale scores than those who reported having computer use experience of less than five years.

Computational thinking (CT)

Variations in students’ CT

• Students’ CT varied more within countries than across countries.
• Variations across countries
  • The difference between the highest and lowest average CT scores across the eight participating countries and one benchmarking participant that completed the ICILS 2018 CT option was 76 scale points
  • Korea had the highest average CT score of 536 points and Luxembourg had the lowest average CT score of 460 points.
• Variations within countries
  • The difference between the lowest five percent and the highest ninety-five percent of students’ CT scores within countries varied between 266 scale points in Portugal (lowest within-country variation) and 371 scale points in Korea (highest within-country variation).

Students’ proficiency in CT

• The CT achievement scale represented students’ proficiency across three regions with increasing sophistication in CT:
  • At the lower region of the scale, students could demonstrate a functional working knowledge of computation as input and output, which meant that they could record data from observed outputs and solve simple coding problems.
  • At the middle region of the scale, students understood that computation could be enabled as practical solutions to real-world problems. They demonstrated the ability to plan solutions associating inputs with outputs and could implement solutions to complex coding using non-linear logic.
  • At the upper region of the scale, students viewed computation as a generalizable problem-solving framework, infer the relationship between observed inputs and outputs to evaluate solutions, implement sophisticated solutions to complex coding problems using logic.

Personal and social backgrounds related to students’ CT

• Gender
  • Across all countries, the average CT scale scores of male students were statistically significantly higher than that of female students. Female gender tended to be negatively related to CT scores.
  • However, statistically significant differences in the average CT scale scores between female and male students were found in only two countries. In one of those countries the difference was in favor of female students and in the other it was in favor of male students.
• Socioeconomic status
  • In all participating countries, students in the high socioeconomic status groups performed significantly higher on the CT scale than those belonging to the lower socioeconomic groups.
  • Socioeconomic background is a consistent positive predictor of CT across countries; however, the effect sizes vary across countries.
• Immigrant and language background
  • Immigrant and language background were found to be associated with student CT achievement.
  • In six out of seven countries, students from non-immigrant families performed significantly better than students from immigrant families.
  • In five of seven countries, students who identified the language of the ICILS test as the language they spoke at home had statistically higher CT scores than those who reported speaking another language at home.
• Computer use outside school
  • All participating entities indicated that students who reported having two or more computers at home had statistically significantly higher CT scores than students who reported to have less than two computers at home.
  • In all countries, students who reported having used computers for five or more years had statistically significantly higher CT scale scores than those who reported having computer use experience of less than five years.

Association between CIL and CT

• Student CT achievement was strongly associated with student CIL achievement.
• The correlation between students’ CIL and CT scale scores was found to be 0.82 on average, across all countries.
• This correlation varied between 0.74 and 0.89 across all countries.

Engagement with information and communications technology (ICT)

Student’s use of ICT

• Students’ daily use of ICT and experience with computers were consistent positive predictors of both CIL and CT.
• About less than half of the Grade 8 students had been using computers for five or more years.
• Seven out of 10 Grade 8 students used ICT daily outside of school, but only 1 in 5 students used it for school-related purposes.
• School-related use of ICT most often involved Internet searching and document production. About one quarter of the students used ICT weekly to collaborate with other students or organize their time and work, and to prepare reports and essays.
• Four out of 5 students indicated confidence in their ability to use ICT for basic tasks such as search for information, insert an image into a document, and complete a school assignment.
• While there was little difference between the confidence of male and female students in using ICT, male students expressed greater confidence in the use of specialist ICT applications.
• Confidence in using general ICT applications was associated with measured CIL and CT, but confidence in using specialist ICT applications was not.
• Male students expressed greater expectations of using ICT for work or study in the future than their female counterparts.

Teachers’ use of ICT

• On average across countries, more than two-thirds of teachers had at least five years of experience with using ICT during lessons or with their preparation.
• While majority of the teachers across countries reported they had confidence in the use of ICT, they were found to be a little hesitant on the use of online ICT engagement platforms and management systems.
• Older teachers were found to be more reluctant in the general use of ICT.
• While many teachers understood the positive outcomes of the use of ICT, some showed concerns about it having its potential negative effects.
• There were considerable differences across countries in the availability of ICT at schools, the extent of teacher collaboration, and conditions for professional learning.
• Teachers placed some or strong emphasis on developing skills related to computer and information literacy and computational thinking.