Derivation of Indicators for Value Assessment of School Gardens
Article information
Abstract
Background and objective
The boom in urban agriculture has also resulted in the creation of many school gardens. With the increase in various hands-on education programs, people are interested in assessing the value of school gardens. This study was conducted to derive indicators for service value assessement of educational farming experience using school gardens.
Methods
Through literature review, we selected assessment items and sub-factors. The indicators for evaluating the effectiveness of school gardens are classified using the Delphi method that involve a focus group experts. In order to increase the reliability and validity of the selected and classified items, an exploratory factor analysis was conducted. In addition, the relative importance and priority of each factor in each field were assessed using the analytic hierarchy process (AHP).
Results
We classified the indicators into 4 criteria and come up with 13 items and 33 sub-factors in educational value, health value, economic value, and ecological and environmental value. Most of the items for the 4 value criteria derived were significant for assessing the value of agricultural experience services with content validity ratio (CVR) higher than 0.59 and reliability higher than .6. In the value criteria, the experts rated educational value as the most important, followed by health value, ecological and environmental value, and economic value. In the assessment items, the most important was improvement of social functions. In the sub-factors, the most important was strengthening of ties (friendly interactions).
Conclusion
Among the derived indicators assessing the value of school gardens, 4 criteria, 12 evaluation items and 29 sub-factors showed significance. The schematic index would be useful for the assessment.
Introduction
School gardens are created using boxes or open grounds within or near schools, adopting various educational programs for students to promote understanding of food and natural circulation in the process of actually growing and harvesting crops and to recover not only physical and mental health but also sensitivity about life and nature (Jang and Oh, 2012). These school gardens are farms, practical training sites or spaces made in school to grow plants and animals required for education so that students can observe them. They are receiving attention as part of agricultural experience through student gardening, and multiple values of school gardens are rising significantly with the increase of gardens and various experience-based programs on the school grounds due to activation of urban agriculture (Jang, 2016).
Forming school gardens for education is included in the detailed strategies for space expansion in the 5-year plan (1st) to promote urban agriculture by the Ministry of Agriculture, Food and Rural Affairs. It was carried out as the ‘School Farm’ Formation Project (2015–2018) to secure practical spaces for Seoul Urban Agriculture 2.0 Masterplan (Seoul Economic Promotion Headquarters, 2015). For a long time, the U.S., U.K. and Japan have been aware of the importance of inclusive education connected to other fields of study as well as healthy growth and development of students through school garden activities, and thus are actively using school gardens (Jang et al., 2017). School gardens are also increasing in Korea as well, with the support of the central and local governments to provide environmental and food life education and vitalize urban agriculture (Jang and Oh, 2012). As such, school gardens are established as spaces that are small yet useful in carrying out various experiences and activities related to urban agriculture for students in the city that lacks greens. School garden activities had psychological effects on students such as increase in environmental susceptibility and change in positive emotions (Hazzard et al., 2011; Kim et al., 2007; Paek, 2012). Moreover, from the perspective of preservation of urban environment, school gardens served as farmlands in the city despite their small sizes, performing various functions such as absorbing rainwater, promoting circulation, preventing urban heat island, and purifying air (Kang et al., 2007). In other words, they include values beyond just farming activities, such as protection and restoration of the urban environment, leisure activities, ecological education, and community revitalization based on agriculture, and thus are important in terms of a healthy ecological environment by providing habitats for living things in the city that lacks greens. Therefore, it is necessary to continuously expand school garden education as a space to change the environmental awareness and attitude of the growing future generations. However, studies on school gardens thus far were limited to analysis on the current state of school gardens in metropolitan areas (Ansan Urban Agricultural Coalition, 2015; Jang and Oh, 2012; Paek, 2012; Lee et al., 2018) and educational functions, emotional and psychological changes (Cotugna et al., 2012; Hong and Kim, 2017; Kwack and Park, 2017; Rural Development Administration[RDA], 2013; Yun et al., 2018), and none of them analyzed comprehensive and objective service values of agricultural experience in terms of health, economy and ecological environment.
This study is to objectively assess service values of educational farming experience using school gardens based on previous studies that analyzed the current state of school gardens (Chae et al., 2019; Jang et al., 2017) and use the results as the data to establish more efficient school garden policies. The purpose is to derive value assessment indicators for school gardens by selecting initial items to assess the effects of school gardens based on literature review and having them reviewed by a focus group of experts (Fig. 1).
Research Methods
Details
To derive service value assessment indicators of educational farming experience using school gardens, this study adopted scale development or assessment item development as a socio-scientific research method. This is used when quantitative measurement cannot be used to measure the concepts of research subjects or when there is a need for a quantitative approach of complex research subjects. It is a methodological approach for multiple items instead of single items, revealing cognitive and conceptual views. Thus, the developed scales are logically, empirically and organically correlated in the assessment system (Song, 2018). DeVellis (2003) mentioned that, initial items extracted and constructed through prior research in the process of scale development are important as they secure theoretical grounds, and they increase reliability of the theoretical background in the review process of experts in related fields. To select assessment items for service values of school gardens, this study entered keywords such as school garden, agriculture for education, service value assessment of farming experience, etc. on the RISS search site of Korea Education & Research Information Service (KERIS). Out of total 1,019 research articles, we collected eight full text articles of service value assessment research data similar to this study and selected service assessment items and sub-factors (Table 1).
Subjects and methods
The Delphi method requires a panel of at least 10 persons to minimize errors of the small group of experts and maximize the group’s reliability (Anderson, 1997; Ewing, 1991). This study organized the focus group with total 11 experts who have experience participating in research related to school gardens, are public officials working in public institutions related academically or practically to school gardens, or are involved in the academia or relevant research (Table 2).
We gathered and revised the opinions of experts through focus group interviews in the National Institute of Horticultural and Herbal Science located in Wanju-gun, Jeollabuk-do on October 4, 2019. We applied an expert survey technique to ensure validity of the assessment items and indicators and collect other opinions. After rating the suitability and validity of structured survey items on a 5-point Likert scale, we had the experts provide other opinions. The survey in the Delphi method was conducted twice from November 10 to 25, 2019 in the order of items and sub-items for service value assessment of school garden farming experiences. In case the items are invalid or not convergent based on the assessment criteria, other opinions were reviewed and supplemented to conduct a re-survey as an additional round. Collected data were analyzed using SPSS for Windows 25.0 and Excel by setting the hierarchical structure of each item. We verified validity and reliability based on content validity ratio (CVR). Items are considered to have content validity if the values are higher than the minimum value of CVR according to the number of panels as shown in Table 3 (Lawshe, 1975).
We calculated Cronbach’s α to determine internal consistency of the assessment items derived by examining whether the experts responded with stability and consistency. Finally, we presented the importance according to weights among factors as well as priorities of assessment indicators for each item through pairwise comparison between alternatives of the analytic hierarchy process (AHP).
Results and Discussion
Selection of assessment items for service values of school gardens
To derive the assessment method for service values of school gardens, we selected 13 assessment items and 33 sub-items in four school garden values (education, health, economy, ecology and environment) using the Delphi method that involves experts. Educational value had items such as x1 (improvement of social functions), x2 (improvement in academic achievement), x3 (promotion of agricultural awareness), X4 (community revitalization); health value had items such as x5 (promotion of physical health), x6 (improvement of eating habits), x7 (promotion of mental health); economic value had items such as x8 (future value improvement of agricultural products), x9 (job creation), x10 (revitalization of economy); and ecological and environmental value had items such as x11 (improvement of the climatic environment), x12 (ecological service), x13 (landscape beautification; Table 4).
Content validity and reliability testing of the scale
Validity testing
The index to determine content validity is estimated by the correlation coefficient (Kwon, 2008). The panel in this study is comprised of 11 experts, and thus validity is proved if it is higher than the minimum CVR of 0.59 based on Lawshe (1975). However, y4 (improvement in academic interest) and y5 (improvement of concentration) of x2 (improvement in academic achievement) in educational value, y13 (improvement in obesity rate) of x5 (promotion of physical health) in health value, and y23 (raising awareness on food production) of x8 (future value improvement of agricultural products) in economic value had CVR below 0.59 and thus were eliminated as content validity was not proved. Other items all had CVR higher than 0.59 and thus their content validity was proved (Table 5).
Reliability testing
We calculated Cronbach’s α to determine internal consistency of the assessment items derived by examining whether the experts responded with stability and consistency. As a result of analyzing reliability, all items showed .6 or higher as shown in Table 6, ensuring reliability of items for service value assessment. Kang (2016) claimed that items are reliable of the Cronbach’s α is at least .5, which indicates that assessment items for school garden service values are well structured.
Relative importance and priority of factors through AHP
Relative importance and priority of values
As for relative importance and priority of values, relative importance weights were calculated in the order of ‘educational value’(.546), ‘health value’(.223), ‘ecological and environmental value’(.136), ‘economic value’(.095). Lee (2017) claimed that items have consistency if consistency ratio (CR) is less than 10%. Here, the consistency index among superordinate attributes was less than .1, thereby proving significance (Table 7). This is different from the report by RDA (2013) in which environmental value was evaluated to have most importance. However, the result was consistent in terms of significance as the consistency index among attributes such as cognitive, emotional, social, physical/behavioral, environmental and economic effects of school gardens was all below 0.1. This was also different from the result by Lee (2017) who evaluated sociocultural value as top priority in terms of multiple values of urban agriculture. This may be due to the implicative meaning of “school” and expression of change to increase the effect of educational use in group life.
Relative importance and priority of assessment items of values
(1) Relative importance and priority of each assessment item
As for relative importance and priority of educational value assessment items, importance was given in the order of x1 (improvement of social functions), x4 (community revitalization), x3 (promotion of agricultural awareness. Health value had importance in the order of x7 (promotion of mental health), x5 (promotion of physical health), x6(improvement of eating habits). Economic value had importance in the order of x8 (future value improvement of agricultural products), x10 (revitalization of economy), x9 (job creation), while ecological and environmental value had importance in the order of x13 (landscape beautification), x11 (improvement of the climatic environment), x12 (ecological service). All had consistency with CR lower than 0.1 (Table 8). Economic value had the same result as Lee (2017), but ecological and environmental value showed a different result from Lee (2017) in which preservation of the ecosystem was most important.
(2) Overall relative importance and priority of assessment items
As for relative importance and priority of all assessment items considering the values, there was high importance in the order of x1 (improvement of social functions), x4 (community revitalization), x3 (promotion of agricultural awareness), x7 (promotion of mental health), x5 (promotion of physical health), x13 (landscape beautification; Table 9). This is different from Lee (2017) that assessed the value of urban agriculture, which may be due to the difference in the limited space of “school” as well as limited subjects and the purpose of education.
Relative importance and priority of sub-factors
(1) Relative importance and priority by sub-factor of each assessment item
As for relative importance and priority of improvement of social functions, there was high importance in the order of y2 (expansion of interactions), y3 (improvement of communication skills), y1 (awareness of social existence). Promotion of agricultural awareness had importance in the order of y6 (awareness of the relationship between agriculture and humans), y7 (awareness of the relationship between agriculture and ecosystems). Community revitalization had importance in the order of y9 (strengthening of ties [friendly interactions]), y8 (community formation and recovery). Consistency was secured with CR lower than 0.1 (Table 10).
As for relative importance and priority of promotion of physical health, there was high importance in the order of y10 (provision of place for activities), y12 (increase of physical activities), y11 (provision of opportunities for indoor and outdoor exercises). Improvement of eating habits had importance in the order of y14 (improvement of plant friendliness), y15 (understanding of food use effects), y16 (improvement in unbalanced diet). Promotion of mental health had importance in the order of y20 (emotional development), y19 (improvement of satisfaction), y18 (improvement of self-esteem), y17 (subjective well-being). Consistency was secured with CR lower than 0.1 (Table 10).
As for relative importance and priority of promotion of future value improvement of agricultural products, there was high importance in the order of y22 (raising awareness on the value of agricultural products), y21 (securing future consumers). Job creation had importance in the order of y25 (increase in related jobs and active personnel), y24 (development of materials related to formation and management). Revitalization of economy had importance in the order of y26 (revitalization of school garden formation), y27 (revitalization of the garden farming materials industry). Consistency was secured with CR lower than 0.1 (Table 10).
As for relative importance and priority of promotion of improvement of the climatic environment, there was high importance in the order of y29 (natural experience and environmental education), y28 (environmental regulation). Ecological service had importance in the order of y30 (improvement of biodiversity), y31 (improvement of resources [water, soil]). Landscape beautification had importance in the order of y32 (improvement of landscape), y33 (utilization and consumption of various resources). Consistency was secured with CR lower than 0.1 (Table 10).
(2) Overall relative importance and priority of sub-factors
As for overall importance and priority of sub-factors considering values and assessment items, the items had importance in the order of y9 (strengthening of ties [friendly interactions]), y2 (expansion of interactions), y3 (improvement of communication skills), y6 (awareness of the relationship between agriculture and humans), y7 (awareness of the relationship between agriculture and ecosystems), y8 (community formation and recovery), showing that sub-factors of educational value had highest importance (Table 11).
Conclusion
This study was conducted to derive indicators for service value assessment of educational farming experience using school gardens. We came up with 13 assessment items and 33 sub-items of educational value, health value, economic value, ecological and environmental value using the Delphi method and deriving initial items based on literature review. We also conducted an exploratory factor analysis to increase reliability and validity of the items for development of indicators. The results of assessing relative importance and priority of each factor by field based on pairwise comparison of AHP are as follows.
First, among assessment items based on four values derived, the content validity of all assessment items was higher than CVR 0.59 and reliability higher than .6, excluding improvement of academic interest and improvement of concentration from improvement in academic achievement in educational value, improvement in obesity rate from promotion of physical health in health value, and raising awareness on food production from future value improvement of agricultural products in economic value. Therefore, they were approved as items for service value assessment of farming experience.
Second, educational value was the value that experts considered most important, followed by health value, ecological and environmental value, and economic value. This may be due to the implicative meaning of “school” and expression of change to increase the effect of educational use in group life.
Third, improvement of social functions was considered most important among assessment items, followed by community revitalization, promotion of agricultural awareness, promotion of mental health, promotion of physical health, landscape beautification, future value improvement of agricultural products, improvement of eating habits, improvement in academic achievement, improvement of the climatic environment, ecological service, revitalization of economy, and job creation.
Fourth, strengthening of ties (friendly interactions) was considered most important among sub-factors, followed by expansion of interactions, improvement of communication skills, awareness of the relationship between agriculture and humans, awareness of the relationship between agriculture and ecosystems, community formation and recovery, awareness of social existence, improvement of landscape, emotional development, and improvement of plant friendliness.
This study is an initial-stage research on service value assessment of educational farming experience using school gardens, conducted by selecting a panel of experts in the academia and research circles. Interviews with experts in industrial circles and field specialists are pending due to COVID-19, but will be conducted immediately once the current situation settles down. Formation and use of school gardens are expected to constantly increase due to the social atmosphere, and thus there is an urgent need to establish measures for continuous operation of school gardens and maximization of effects. Based on the results of this study, further research is to be conducted to set detailed criteria for value assessment using a modified Delphi method and measure the utility value using the contingent valuation method (CVM) to promote use of school gardens.
Acknowledgements
This study is supported by the Rural Development Administration’s project (PJ01364403).