PISA 2018 Results

Achievement scales
Scale Creation

A generalized partial credit IRT model was used to create the achievement scales.

  • New scales were standardized with a mean score of 500 and standard deviation of 100 among OECD countries.
  • Existing scales were scaled on a calibration sample including responses from past PISA waves, and equated to previous scales using linear transformations.

PISA uses the imputation methodology usually referred to as plausible values (PVs).

  • For each scale and subscale, ten plausible values per student were included in the international database.
  • Plausible values were imputed using a multi-dimensional model.

 

List of Achievement Scales

Reading

Reading subscales

  • Cognitive process subscale: Locate information
  • Cognitive process subscale: Understand
  • Cognitive process subscale: Evaluate and reflect
  • Text structure subscale: Single
  • Text structure subscale: Multiple

 

Mathematics

Science

Global competence

Financial literacy

 

 

Background scales
Scale Creation

Simple indices are the variables that are constructed through the arithmetic transformation or recoding of one or more items in exactly the same way across assessments.

New and trend scale indices are the variables constructed through the scaling of multiple items. Unless otherwise indicated, such indices have been scaled using a two-parameter item response model (a generalized partial credit model was used in the case of items with more than two categories) and the index values correspond to Warm likelihood estimates (WLE).

Scale indices were constructed through the scaling of items. Typically, scale scores for these indices were estimates of latent traits derived through Item Response Theory (IRT) scaling of dichotomous or Likert-type items.

Only scale indices are listed below.

 

List of Background Scales

Student questionnaire scales

  • Index of economic, social and cultural status
  • Meta-cognition: understanding and remembering
  • Meta-cognition: summarising
  • Meta-cognition: assess credibility
  • Home possessions (WLE)
  • Cultural possessions at home (WLE)
  • Home educational resources (WLE)
  • Family wealth (WLE)
  • ICT resources (WLE)
  • Disciplinary climate in test language lessons (WLE)
  • Teacher support in test language lessons (WLE)
  • Teacher-directed instruction (WLE)
  • Perceived feedback (WLE)
  • Parents’ emotional support perceived by student (WLE)
  • Teacher’s stimulation of reading engagement perceived by student (WLE)
  • Adaptation of instruction (WLE)
  • Perceived teacher’s interest (WLE)
  • Joy/Like reading (WLE)
  • Self-concept of reading: Perception of competence (WLE)
  • Self-concept of reading: Perception of difficulty (WLE)
  • Perception of difficulty of the PISA test (WLE)
  • Perception of competitiveness at school (WLE)
  • Perception of cooperation at school (WLE)
  • Attitude towards school: learning activities (WLE)
  • Competitiveness (WLE)
  • Work mastery (WLE)
  • General fear of failure (WLE)
  • Eudaemonia: meaning in life (WLE)
  • Subjective well-being: Positive affect (WLE)
  • Resilience (WLE)
  • Mastery goal orientation (WLE)
  • Self-efficacy regarding global issues (WLE)
  • Student’s awareness of global issues (WLE)
  • Student’s attitudes towards immigrants (WLE)
  • Student’s interest in learning about other cultures (WLE)
  • Perspective-taking (WLE)
  • Cognitive flexibility/adaptability (WLE)
  • Respect for people from other cultures (WLE)
  • Awareness of intercultural communication (WLE)
  • Global-mindedness (WLE)
  • Discriminating school climate (WLE)
  • Subjective well-being: Sense of belonging to school (WLE)
  • Student’s experience of being bullied (WLE)

 

School questionnaire scales

  • Creative extra-curricular activities (Sum)
  • Shortage of educational material (WLE)
  • Shortage of educational staff (WLE)
  • Student behaviour hindering learning (WLE)
  • Teacher behaviour hindering learning (WLE)
  • School principal’s view on teachers’ multicultural and egalitarian beliefs (WLE)

 

Optional educational career questionnaire scales

  • Number of changes in educational biography (Sum)
  • Information about careers (WLE)
  • Information about the labour market provided by the school (WLE)
  • Information about the labour market provided outside of school (WLE)

 

Optional ICT familiarity questionnaire scales

  • ICT use outside of school (leisure) (WLE)
  • Use of ICT outside of school (for school work activities) (WLE)
  • Use of ICT at school in general (WLE)
  • Interest in ICT (WLE)
  • Perceived ICT competence (WLE)
  • Perceived autonomy related to ICT use (WLE)
  • ICT as a topic in social interaction (WLE)
  • Subject-related ICT use during lessons (WLE)
  • Subject-related ICT use outside of lessons (WLE)

 

Optional parent questionnaire scales

  • Current parental support for learning at home (WLE)
  • Parents’ emotional support (WLE)
  • Parents’ perceived school quality (WLE)
  • School policies for parental involvement (WLE)
  • Previous parental support for learning at home (WLE)
  • Parents’ enjoyment of reading (WLE)
  • Parents’ attitudes towards immigrants (WLE)
  • Parents’ interest in learning about other cultures (WLE)
  • Parents’ awareness of global issues (WLE)

 

Optional well-being questionnaire scales

  • Body image (WLE)
  • Social Connections: Parents (WLE)

 

Optional financial literacy questionnaire scales

  • Familiarity with concepts of finance (Sum)
  • Confidence about financial matters (WLE)
  • Confidence about financial matters using digital devices (WLE)
  • Financial education in school lessons (WLE)
  • Parental involvement in matters of Financial Literacy (WLE)

 

Optional teacher questionnaire scales

  • Teacher’s view on staff shortage (WLE)
  • Teacher’s view on educational material shortage (WLE)
  • Test language teacher collaboration (WLE)
  • Exchange and co-ordination for teaching (WLE)
  • Teacher’s satisfaction with the current job environment (WLE)
  • Teacher’s satisfaction with teaching profession (WLE)
  • Teacher’s self-efficacy in classroom management (WLE)
  • Teacher’s self-efficacy in maintaining positive relations with students (WLE)
  • Teacher’s self-efficacy in instructional settings (WLE)
  • Opportunity to learn (OTL) aspects of reading comprehension (WLE)
  • Teacher’s stimulation of reading engagement (WLE)
  • Teacher’s initiation of reading strategies (WLE)
  • Teacher’s use of specific ICT applications (WLE)
  • Disciplinary climate in test language lessons (WLE)
  • Direct teacher’s instruction (WLE)
  • Feedback provided by the teachers (WLE)
  • Student assessment/use (adaption of instruction) (WLE)
  • Feedback provided by the teachers (WLE)
  • Teacher’s attitudes towards immigrants (WLE)
  • Teacher’s training on global competence (WLE)
  • Teachers’ multicultural and egalitarian beliefs (WLE)
  • Teacher’s self-efficacy in multicultural environments (WLE)

 

Overview of key study results

Reading (primary focus)

  • Beijing, Shanghai, Jiangsu and Zhejiang (China) and Singapore scored significantly higher in reading than all other countries/economies that participated in PISA 2018.
  • Estonia, Canada, Finland, and Ireland were the highest-performing OECD countries in reading.
  • Some 77% of students, on average across OECD countries, attained at least Level 2 proficiency in reading. Around 8.7% of students, on average across OECD countries, were top performers in reading, meaning that they attained Level 5 or 6 in the PISA reading test.
  • On average across OECD countries, one in ten disadvantaged students was able to score in the top quarter of reading performance in their countries (“academic resilience”), indicating that disadvantage is not destiny.

 

Mathematics and science

  • On average across OECD countries, 76% of students attained Level 2 or higher in mathematics. However, in 24 countries and economies, more than 50% of students scored below this level of proficiency.
  • Around one in six students in Beijing, Shanghai, Jiangsu and Zhejiang (China) and about one in seven students in Singapore scored at Level 6 in mathematics, the highest level of proficiency that PISA describes.
  • On average across OECD countries, 78% of students attained Level 2 or higher in science.

 

Trends in performance

  • On average across OECD countries, mean performance in reading, mathematics and science remained stable between 2015 and 2018.
  • There were large differences between individual countries and economies in how their performance changed between 2015 and 2018. For example, mean performance in mathematics improved in 13 countries/economies, declined in 3 countries/economies, and remained stable in the remaining 47 participating countries/economies.
  • Seven countries/economies saw improvements, on average, in the reading, mathematics and science performance of their students throughout their participation in PISA. Seven countries saw declining mean performance across all three subjects.
  • Between 2003 and 2018, Brazil, Indonesia, Mexico, Turkey, and Uruguay enrolled many more 15-year-olds in secondary education without sacrificing the quality of the education provided.

 

Equity related to gender

  • In all countries and economies that participated in PISA 2018, girls significantly outperformed boys in reading – by 30 score points, on average across OECD countries.
  • Boys outperformed girls – by five score points – in mathematics, on average across OECD countries, but girls outperformed boys in science by two score points.
  • In all countries and economies, girls reported much greater enjoyment of reading than boys.
  • On average across OECD countries in 2018, both boys and girls reported significantly less enjoyment of reading than their counterparts did in 2009.

 

Equity related to immigrant background

  • On average across OECD countries, 13% of students in 2018 had an immigrant background, up from 10% in 2009.
  • Some 17% of immigrant students scored in the top quarter of reading performance in the country where they sat the PISA test, on average across OECD countries.
  • In 21 out of the 43 countries and economies where a relatively large proportion of students had an immigrant background, immigrant students were more likely than their native-born peers to report a goal-oriented attitude.

 

Financial literacy

  • Average financial literacy performance in Estonia was higher than that in every other participating country/economy, followed by the Canadian provinces and Finland.
  • Some 85% of students, on average across OECD countries/economies, attained at least Level 2 proficiency in financial literacy. Some 10% of students attained the highest level of proficiency in financial literacy, Level 5, on average across OECD countries and economies.
  • Boys scored a small but significant 2 points higher than girls in the PISA 2018 financial literacy assessment, on average across OECD countries/economies. After accounting for performance in mathematics and reading, boys outperformed girls by 10 points.

 

Global competence

  • The top-performing countries/economies were Canada, Hong Kong (China), Scotland (United Kingdom), Singapore, and Chinese Taipei, with mean performance scores more than 50 points above the overall average.
  • The range and variation of relative scores after accounting for performance in mathematics, science and reading were noticeably smaller than that of raw performance scores. Canada, Colombia, Greece, Israel, Panama, Scotland (United Kingdom), Singapore, and Spain showed the highest relative performance in global competence, while Albania, Brunei Darussalam, Kazakhstan, Korea, and the Russian Federation showed the lowest relative performance.
  • Students in Albania, Greece, Lithuania, Malta, Portugal, and the United Arab Emirates reported the highest levels of awareness of global issues, which were substantially higher than the OECD average.
  • Students in Albania, Bosnia and Herzegovina, Korea, Kosovo, Lebanon, North Macedonia, Romania, and Turkey reported the greatest capacity for perspective taking.
  • Students in Albania, Australia, Canada, Ireland, Korea, New Zealand, Scotland (United Kingdom), Spain, and Chinese Taipei reported the most positive attitudes toward immigrants, with values in the index that were significantly higher than the OECD average.

 

Teachers’ attitudes and practices

  • On average across OECD countries and in 43 education systems, students who perceived greater support from teachers scored higher in reading, after accounting for the socio-economic profile of students and schools.
  • Teacher enthusiasm and teachers’ stimulation of reading engagement were the teaching practices most strongly (and positively) associated with students’ enjoyment of reading.

 

Students’ well-being

  • On average across OECD countries, 67% of students reported being satisfied with their lives. Between 2015 and 2018, the share of satisfied students shrank by 5 percentage points.
  • In almost every education system, girls expressed greater fear of failure than boys, and this gender gap was considerably wider amongst top-performing students.
  • In a majority of school systems, students who expressed a greater fear of failure scored higher in reading, but reported less satisfaction with life than students expressing less concern about failing, after accounting for the socio-economic profile of students and schools.

 

Resources invested in education

  • At the system level, greater shortages of educational materials were correlated with lower mean performance in reading, even after accounting for per capita GDP, across OECD countries, and across all participating countries and economies in PISA 2018.
  • On average across OECD countries, around 54% of students attended a school where an effective online learning platform is available to them.
  • Education systems with a greater share of students in schools that offer one or more rooms for homework tended to show better mean performance in reading, mathematics and science, even after accounting for per capita GDP.

 

On how education systems are governed

  • After accounting for students’ and schools’ socio-economic profile, students in public schools scored higher in reading than students in private schools, on average across OECD countries (by 14 score points) and in 19 education systems (ranging from 13 score points higher in Indonesia to 117 points higher in Serbia).
  • At the system level across all countries and economies, school systems with larger shares of students in private independent schools tended to show lower mean performance in reading, mathematics and science, after accounting for per capita GDP. This relationship was not observed across OECD countries.