Науката за образованието: теория и практика
CHEMOMETRIC ANALYSIS OF SCHOOL LIFE IN VARNA
Резюме. In this paper, the authors’ collective is presenting a questionnaire, designed and tested by them for the regular evaluation of the educational environment in high schools. It consists of 50 multiple choice questions about quality of learning and relations between school children and teachers. The questionnaire was tested on the students of three high schools in Varna. It was distributed to male and female students of the 9\(^{th}\), 10\(^{th}\) and 11\(^{th}\) grades. The data set consists of 693 respondents − schoolboys and girls characterized by their answers to 50 questions each one ranked by values from 1 to 5. Non-hierarchical cluster analysis was applied to find patterns of similarity between the questions or between the pupils. The results verified the constructive value of the questionnaire as a method of evaluation of the educational environment in high schools.
Ключови думи: questionnaire; Educational environment; high school; cluster analysis.
Introduction
A school’s good atmosphere is a basis for increasing the educational quality, as it is a premise for the students’ positive attitude towards their school (Tomova et al., 2014; Boyd et al., 2009). The relationships between students, as well as these with their teachers, are an important characteristic of the life within a school (Görsev, 2010; Telli et al., 2010; Vahedi, 2010). The evaluation of the learning environment is a significant factor in the evaluation of curriculums (Genn, 2001). Organising group assignments in class contribute to the formation of friendships between students and turn school life into an enjoyable experience. The belief that students are in a team with their teacher strongly motivates them to attend class (Akinoğlu & Tandoğan, 2007). The feedback from students is undoubtedly important in order to monitor their opinions about the curriculums and the educational methods, the pedagogical approaches of instilling a spirit of cooperation, the relationships between students and their teachers. The systematic use of questionnaires would help indicate the problematic areas in the learning environment, in order for steps to be taken for their correction (Hoad-Reddick & Theaker, 2003; Aldridge et al., 2012). One aspect of the questionnaire would be monitoring whether current teaching practices are used, which can serve as an evaluation of the teachers’ activities. For instance, although a big portion of Bulgarian teachers know and praise the opportunities created by problem-based learning, few of them apply it, due to the high amount of preparation it requires, and due to the need of significant changes in the perception of a class in order for it to be applied (Tafrova-Grigorova, 2010). This constructivist approach for active learning is undoubtedly effective, as it encourages the acquisition of new knowledge based on knowledge acquired in previous classes. It requires from students to be involved in activities that stimulate them to ask questions, to research, and to solve problems; which eventually leads them to the answers of real life problems (Overton, 2007; Hmelo-Silver, 2004). However, the testing of this learning approach requires feedback, in order for it to be appropriate to students’ age and study level. The social differences between students are a stress factor which has serious implications on a school’s educational environment. Under stress, students are more prone to perceiving the environment as negative, which decreases their motivation for attending classes (Maul, 1980).
The use of a specific questionnaire is especially important for teachers and high schools’ administration, in order for them to receive quality feedback from their students. Effective management of the learning process requires the introduction to appropriate changes aimed at improving the educational environment; and this can only be done after the results from its evaluation have been analysed. A link between the environment in which students learn, and the quality of their work has been identified and documented (Boyd et al., 2009; Jawaid, 2013). The positive environment gives students self-confidence and it motivates them to achieve better results. The way students perceive their educational environment is highly influenced by the available learning facilities, by their expectations, by their cultural background and upbringing and by their past education (Genn, 2001; Jawaid et al., 2013). This illustrates the importance of students’ opinions on the educational environment.
In this paper, the authors’ collective is presenting a questionnaire, designed and tested by them for the regular evaluation of the educational environment in high schools. The questionnaire was tested on the students of three high schools in Varna: High School of Mathemathics “Doctor Peter Beron”; High School of Commerce “Georgi S. Rakovski”; Fifth Language School “Joan Exarch”.
Materials and methods
Questionnaire
Questionnaire consists of 50 questions, corresponding to the 5-point Likert psychometric scale for measuring social aptitudes. There are: questions related to the educational process (1, 7, 10, 11, 19, 23, 24, 50); questions related to the role of the teacher in the educational process (2, 9, 21, 28, 29, 31, 32); questions related to the relationship between teacher and pupils (14, 16, 17, 30, 33, 34, 35, 37, 38, 45, 47, 48); questions related to the personal attitude of the pupils to the educational process (8, 12, 15, 18, 20, 22, 25, 39, 40, 41, 42, 49); questions related to optimization of the educational process (3, 4, 5, 6, 13, 26, 27, 36, 43, 44, 46). Answers were thus given in points; the highest number of total points corresponding to a maximal positive view of school life.
The possible answers are: I strongly disagree.; I somewhat disagree.; I am not sure.; I somewhat agree.; I strongly agree.
Statistical approach
In this study non-hierarchical clustering of the input data was used. The advantage of this method is that one could preliminary select the number of clusters into which the input data should be classified. Therefore, in order to cluster the 50 questions from the questionnaire 5 clusters were chosen, which corresponds to the number of categories into which the questionnaire could be subdivided from theoretical point of view. For the clustering of the pupils, participating in the study the number of clusters chosen was three since the participants are from grades 9, 10, and 11. It is difficult to expect that the supervised clustering will result in exactly the same preliminary categories but, at least, it give a starting point for proper data interpretation. This type of cluster analysis allows the identification of smaller groups of specific questions (outliers), to which participants in the questionnaire have a specific attitude. All calculations were performed with software package STATISTICA 8.0
The data set consists of 693 objects − schoolboys and girls of three high schools in Varna, grades 9, 10, and 11, characterized by their answers to 50 questions each one ranked by values from 1 to 5 of a questionnaire about quality of learning and relations between schoolchildren and teachers. The male to female ratio of students is approximately
Results and discussion
Non-hierarchical cluster analysis of the 50 questions - assessment of the learning process
After the non-hierachical cluster analysis the questions were grouped into five categories. The questions from the questionnaire are clustered differently for the three different schools (Table 1, Figs. 1 - 3), although in all of them five clusters are formed by non-hierarchical clustering of the variables (questions 1-50).
Table 1. Non-hierachical cluster analysis of the questions
Figure 1. Plot of means for each cluster (High School of Commerce “Georgi S. Rakovski”)
Attitude towards the questionnaire in different schools
High School of Commerce “Georgi S. Rakovski”, Varna: Four questions indicate a specific attitude – 14, 26, 35 and 38. They are from different categories (questions related to the relationship between teacher and students – 14, 35 and 38 and questions related to optimization of the educational process – 26). It seems that the students are seriously engaged with the problems of aggression at school (14), introduction of common projects (26), teachers are annoyed by the students (35) and introduction of non-traditional lessons (38). All of these questions are characterized by very low scores meaning that the participants do nor accept and approve aggression, feel the lack of common and non-traditional educational instruments and are not teased by their teachers.
Figure 2. Plot of means for each cluster (Fifth Language School “Joan Exarch”)
All other questions are grouped into three other big clusters. Cluster 1 includes dominantly questions related to the optimization of the teaching process and the personal attitude of the students to the educational process (group of educational and personal issues). Cluster 2 is also principally dedicated to the general educational strategy assessment and personal attitude questions (group of educational strategy issues). Cluster 4 is the biggest one and is dominantly linked to all categories of questions (group of general assessment).
As seen in Fig. 1 the participants give lowest marks for questions in clusters 5 and 3 which is already discussed above. For all other clusters the marks are relatively high (between 4 and 5), which is an indication that the students accept the general educational strategy, support the efforts for its optimization and are satisfied with the relationship with the teachers trying to have a personal attitude towards the educational process.
Figure 3. Plot of means for each cluster (High School of Mathematics)
High School of mathematics, Varna: Cluster 5 contains two outlying object having low marks. It indicates that the pupils from this particular school have specific requirements for some elements of the general educational strategy and the relationship to their teachers. As seen in Fig. 3 the spread between the marks for almost all clusters is quite high. It may mean that the pupil responses to the questions are bidirectional and indicate quite individual opinions on all kind of question categories. That is why the content of each of the four larger clusters (1, 2, 3, 4) is of mixed non-specific character meaning that each clusters consists of questions from all categories. This particular school indicates very versatile individual responses.
Fifth Language School “Joan Exarch”, Varna: For the last school tested one outlying cluster is found (cluster 4), which contains lowest marks for questions 14 and 26 dealing with aggression and introduction of original educational projects. The students deny aggression decisively and suffer the lack of originality in the educational procedures. This situation is well illustrated in Fig. 2 (lowest marks for cluster 4 from all participants. Clusters 1, 2 and 3 (as in the previous case of the mathematical gymnasium) are of complex mixed content comprising questions from all categories. The marks are highest and evenly distributed between 4 and 5. Cluster 5, however, is specific by its relatively low marks and includes dominantly questions from categories related to the pupil personal attitude to education and optimization of the educational process. The pupils are obviously critical to the present state and require improvement.
Non-hierarchical clustering of the students from the different schools
The supervised data treatment requires formation of 3 clusters as the preliminary condition was related to the three classes of students participating in the questionnaire (Table 2). It was interesting to find out if the response to the different categories of questions is linked to some extent with the student’s age. Cases numbers 1 - 70 are from 9th grade, 71-140 – 10th grade and 141 – 210 – 11th grade students from the Fifth Language School (Fig. 4) and from the High School of Commerce (Fig. 5). For the School of Mathematics, the respective numbers are 1 – 91, 92 – 182 and 183 – 273.
Figure 4. Fifth Language School “Joan Exarch” (cases)
Figure 5. High School of Commerce “Georgi S. Rakovski”
Fifth Language School “Joan Exarch”: The separation with respect to the grouping of the students from the different grades (9, 10, 11) is not very specific. The 9th class students are dominantly in C1, the 10th graders – in C3 and 11th class students – in C2. But the separation with respect to age is not very distinctive or absolute. It might mean that the separation into clusters for this school (based on the questionnaire results) does not depend entirely on age variable.
If one considers the plot of means for each cluster of students, one can conclude that the grouping is due to the various attitudes of the members towards the various questions. Cluster 2 (C2) is characterized by the lowest marks given as response to the questions. Since C2 is dominated by 11 th class pupils, a possible conclusion could be that the elder students are more critical and unsatisfied by the educational process. Surprisingly, highest marks are characteristic for C3 where dominantly 10 th graders are included. The characteristics of C1 are very close to those of C2. Probably, the younger and eldest students are much more critical that those who are in the middle of the period of education in this gymnasium.
High School of Commerce “Georgi S. Rakovski”, Varna: In this school there is even less specificity with respect to age. The pupils are distributed almost evenly in two big and one small cluster, so no specific dominance of age variable (9\(^{th}\), 10\(^{th}\), 11\(^{th}\) grade) could be found.
The discrimination between the three clusters formed for this school is similar to that established for Fifth Language School “Joan Exarch”: for members in cluster 3 the lowest marks are given, for those in cluster 2 – the highest. Cluster 1 takes intermediate position resembling to high extent the average responses of cluster 3. No specific comment for the pupil’s attitude towards the educational process and the relations to teachers in the different age groups could be done.
High School of Mathematics, Varna: In this particular school the separation of the clusters with respect to the student’s age is unsatisfactory. The situation resembles that of High School of Commerce. The difference is that at the High School of mathematics the three clusters are almost equal in size (number of participants from all three categories). The discriminators for the clusters are, again, the average values for the marks to each question from the questionnaire. The averages for the three clusters are quite similar and homogeneous (this is a sign that in this school the attitude towards educational issues is much leveled without age variations): lowest marks for Cluster 1 and highest – for Cluster 3.
Table 2. Non-hierarchical clustering of the students from the different schools
Conclusion
In general, the students from both Fifth Language School “Joan Exarch” and High School of Commerce “Georgi S. Rakovski” react with higher differentiability to the questionnaire and it makes it possible to analyze better different groups of attitude towards the educational issues. On contrary, the students from the High School of Mathematics reveal a strictly individual attitude towards the different categories of questions and it does not allow strict grouping of both questions and students.
REFERENCES
Akinoğlu, O. & Tandoğan, R.O. (2007). The effect of problem-based active learning in science education on students’ academic achievement, attitude and concept learning. Eurasia J. Math., Sci. & Tech. Educ., 3(1), 71 – 81.
Aldridge, J M., Fraser, B.J., Bell, L. & Dorman, J. (2012). Using a new learning environment questionnaire for reflection in teacher action research. J. Sci. Teacher Educ., 23, 259 – 290.
Boyd, D.J., Grossman, P.L., Lankford, H., Loeb, S. & Wyckoff, J. (2009). Teacher preparation and student achievement. Educ. Eval. &Policy Analysis, 31, 416 – 440.
Genn, J.M. (2001). Curriculum, environment, climate, quality and change in medical education - a unifying perspective. Med. Teach., 23, 337 – 344.
Görsev, I. (2010). The role of teacher talk in young learner‘s language process. Procedia, 2, 277 – 281.
Hmelo-Silver, C.E. (2004). Problem-based learning: what and how do students learn. Educ. Psych. Rev., 16, 235 – 266.
Hoad-Reddick, G. & Theaker, E. (2003). Providing support for problembased learning in dentistry: the Manchester experience. Eur. J. Dental Educ., 7(3), 3 – 12.
Jawaid, M., Raheel, S., Ahmed, F. & Aijaz, H. (2013). Students’ perception of educational environment at public sector medical university of Pakistan. J. Res. Med. Sci. , 18, 417 – 421.
Maul, J.P. (1980). A high school with intensive education: moral atmosphere and moral reasoning. J. Moral Educ. , 10, 9 – 17.
Overton, T. (2007). Context and problem-based learning. New Directions, 7(3) 7 – 12.
Tafrova-Grigorova, A. (2010). Bulgarian chemistry school education – from international and national investigations: what next. Chemistry, 19, 163 – 188 [In Bulgarian].
Telli, S., den Brok, P. & Cakiroglu, J. (2010). The importance of teacher – student interpersonal relationships for Turkish students’ attitudes towards science. Res. Sci. & Tech. Educ., 28, 261 – 276.
Tomova, R., Gateva, P., Hadjiolova, R., Sabit, Z., Slavova, M., Chergarova, G. & Simeonov, V. (2014). Multivariate statistical assessment of DREEM – Bulgaria: student’s perception of the learning environment in the Medical University in Sofia. Chemistry, 23, 697 – 713 [In Bulgarian].
Vahedi, M. (2010). A study of parents’ participation in the high schools administration and its effect on school activities. Procedia, 2, 359 – 363.