Evaluation of the development process and effects of a foot care program with educational tools for nurses and care workers as in-home service providers

Objective Nurses and care workers who provide in-home services play important roles in assessing and providing care for older people who lack foot self-care abilities. We aimed to evaluate the development process and effects of a foot care program with educational tools for nurses and care workers as in-home service providers. This is a process evaluation with a descriptive mixed-methods study of quantitative and qualitative data conducted from July to October 2019 in Japan. Results Foot care education tools were developed to address the issues faced by participants with various work patterns and insufficient foot care education in Japan. The contents of these tools were discussed by a panel and reviewed by experts. Three outcomes were analyzed using descriptive statistics and Pearson’s correlation. Changes in foot care practice scores were significantly correlated with performance scores. The evaluations of five of the eight field nurses suggested that excess information was included in the foot care booklet. Overall, 29 nurses and care workers showed higher than average evaluation scores [3.8–4.1 (standard deviation, 0.62–0.91)] for the motion pictures and PowerPoint presentation. A program according to this conceptual framework must be established and periodically evaluated for refinement. Trial Registration The trial registration number for the University Hospital Medical Information Network is UMIN000036307. Registration Date—2019/07/25


Introduction
Nurses and care workers (NCWs) working in-home settings or communities face serious challenges because of the markedly increasing aging population worldwide [1]. Demographic changes are a serious national issue in Japan. Therefore, the Japanese government has urgently called for a community-based integrated system to allow older people to live the rest of their lives in their own ways in the familiar environments by using this system [2].
Community-dwelling older people in Japan experience various health conditions, with some requiring assistance for medical treatment or activities of daily living and some using long-term care insurance [3]. Older people may request foot care from NCWs or may refuse to seek active care [4] despite the high prevalence of foot problems in this population. However, studies on this topic are limited [3,5].

BMC Research Notes
*Correspondence: fujii_k@met.nagoya-u.ac.jp 1 Graduate School of Medicine, School of Health Sciences, Nagoya University, 1-1-20 Daiko-Minami, Higasi-ku, Nagoya, Aichi, Japan Full list of author information is available at the end of the article In older people, an inability to bend to cut the nails, impaired vision and fine hand movements [6,7] results in the lack of foot self-care, possibly leading to foot problems [8,9]. Nurses and care workers may often overlook foot care or related issues due to time constraints at work and limited perception of the significance of the feet. Currently, the limited number of reports on foot care indicates researchers' lack of interest in this topic.
Nurses and care workers are the key people responsible for identifying foot problems because care activities often require physical contact. In Japan, given the lack of foot care specialists, NCWs require more autonomy to assess and care for foot problems. Therefore, a foot care program was developed by the first author with various educational tools to comply with NCWs' diverse work patterns and foot care knowledge and practices. We evaluated the development process and effects of a foot care program with educational tools for NCWs. The research questions were as follows: (1) Was the evaluation process of the educational tool development effective? (2) Is there an association between the performance scores obtained using educational tools and improvement in foot care?

Study design
This is a process evaluation with a descriptive mixedmethods study of quantitative and qualitative data conducted from July to October 2019 in Japan.

Conceptual framework
Educational tools for the foot care program comprised materials and kits. Tools were used in training sessions and were created based on a conceptual framework generated using all collected resources.
This study was not limited to the item pools of other studies on foot care [10,11]. It included the effects of prolonged sedentary or toe movements [12][13][14][15] and differentiation between soft tissue and lymphatic massages based on their physical implications [16,17]. Educational tools were created using five steps: full planning, draft creation, evaluation initiation (before implementation), process evaluation (immediately after implementation), and impact evaluation (after intervention).

Tool creation
Most of the ideas for the tools in the present study were based on previously reported interventions for diabetic patients. A Power Point presentation (PPT), pamphlets, foot care kits, and hands-on skill sessions were used [18][19][20][21][22]. Interventions using telemedicine or mobile phone text messages and telephone follow-ups were also used as references to obtain ideas, as previously reported [22][23][24][25][26].
To create the tools, an illustrator created original drawings appropriate for the content. The animation characteristics were developed for this study with regard to originality and familiarity. The effects of illustrations have been investigated [27]. Reviews of previous studies using video lectures [28][29][30][31] and picture story cards [32] as well as development guidelines [33] were used as references to create the program. All practice programs were based on laws and regulations of Japan and the interpretation reports of the related article by the Ministry of Health, Labor and Welfare, which determine foot care practices that can be performed based on qualifications.

Program evaluators
Overall, 3 types of evaluators were included in this study: 1. A total of 36 NCWs working as "in-home service providers, " i.e., those providing home-visit services, 1-day service, or day care service [34], who participated in a 2-month intervention study of foot care programs [35]. This study focused on the evaluation of the development process and overall effects of the program. Therefore, 36 of the 54 initial participants in the intervention group answered all performance questions at post-intervention and 80% or more of the knowledge and practice questions at pre-and post-intervention were considered as evaluators. 2. Eight field nurses who attended a monthly pressure ulcer study group in the T area (similar to a province) in Japan. 3. A total of 29 randomly selected participants from the intervention group [35]. after the first intervention session.

Procedure of program evaluation
Before the foot care intervention started, eight nurses evaluated foot care booklet and motion pictures (MPs) using an evaluation sheet for convenience and comprehension. The first author (KF) visited 11 in-home service providers 3-5 times for the intervention groups. After the first intervention session, randomly selected participants from the intervention group evaluated the MPs and PPT. Participants had experienced other sessions, including training and follow-up sessions. Foot care booklet, picture flip cards, and foot assessment sheets were given to the provider, and a one-point advice card was provided to each participant. During the post-intervention, the participants were asked to provide answers regarding the performance of the programs. At both the pre-and post-intervention, they were asked to provide answers regarding foot care knowledge and practice questionnaires. Performance scores and changes in the knowledge and practice scores of NCWs as program participants were calculated.

Outcomes
The primary outcome was the association between changes in foot care knowledge and practice scores and performance scores obtained using questionnaires and an evaluation sheet. The secondary outcome was the evaluation by eight field nurses before the intervention. The tertiary outcome was a process evaluation by the 29 participants after the first intervention session.

Instruments
Five types of evaluation sheets (an evaluation sheet for MPs and foot care booklet, an evaluation sheet for the PPT and MPs, foot care knowledge and practice questionnaires, performance tool sheets [35], and a perception sheet) and a tool package comprising the program (Table 1) were used for evaluation. All tools were developed by the first author. The features of the tools were integrated as a foot care learning package and prepared as introductory tools for participants who did not receive sufficient foot care education.

Data analysis
Data were analyzed with descriptive statistics. Correlations of changes in foot care knowledge and practice scores with performance scores for each tool were analyzed using Pearson's correlation coefficient. Changes in foot care knowledge and practice scores were analyzed using a t test; performance scores were calculated by summing scores from descriptive statistics. Figure 1 shows program evaluation flow.

Primary outcomes
Performance scores correlated with skin assessment, skin practices, and consultation in the practice category subscales and the total practice score (Table 2), with no correlations between knowledge and performance scores. Skin assessment and consultation of practice subscale items and total practice scores were significantly associated with performance score (p-value, 0.005, 0.027, 0.017 respectively).

Secondary outcomes
The MPs and foot care booklet were evaluated. Five questions were asked regarding ease of understanding, appropriate length, gaining new knowledge, and the future usability of the MPs and PPT. Given the limited number of evaluators, qualitative comments were weighted as references based on two classifications of skill learning possibility and the structure of the contents see Additional file 1. Five participants noted that excess information was included in the foot care booklet and that the main points should be emphasized to create a smaller pamphlet. For the motion pictures, two of the participants also noted that a large amount of information was included, while other topics that were not included in the MPs were extracted as additional learning topics from the respondents.
Three participants noted that the presenter's speed was extremely fast and difficult to follow. Three participants stated the desire to learn about nail cutting. Some participants recommended including rehabilitation for foot and practical cases.

Discussion
We evaluated the association between the performance scores obtained using the created tools and improvement in foot care knowledge and practices and evaluated the development process of these tools and their effectiveness.
Correlation analysis revealed that the participants' performance scores were related to skin assessment, skin practice, and total consultation practice scores. The original tools as a package helped to provide the essence of most learning methods and pyramids proposed by the National Training Laboratories for Applied Behavioral Sciences [36].
Skin assessment and practice were emphasized in the PPT, MPs, foot care booklet, and one-point foot care card. Foot parts that tend to be overlooked, such as the heel, sole, or skin between the toes, were emphasized so that the participants could learn assessment skills for these parts. Given the high prevalence of nail and skin fungal infections [37], signs for the detection of these infections were covered in some tools. The first author (KF) described the adverse effects of daily sole washing, the risk area of the skin between the toes, and the importance of applying ointments after wiping or washing the skin to avoid stacking ointment. Foot hygiene was covered in the program and has been reported previously [38,39]; however, it was not included in the practice session due to the providers' work circumstances.
Time spent on foot care practices should be considered by in-home service providers using hands-on practical materials with appropriate training personnel. Points of care stated in other scales (nail, hygiene, and sedentary) were also explained; however, additional hands-on practice may be necessary. Nail practice is particularly difficult because of the complexity of nail problems with aging. Studies limited to specific areas in Japan have reported an association between nail problems such as ingrown nails and reduced limb function [40,41]. Nurses and care workers may encounter individuals with various nail problems; however, limited resources or a lack of access to foot care professionals may cause uncertainty among NCWs regarding their capability to provide foot care. Therefore, appropriate nail care methods and materials for in-home NCWs should be developed. There was no significant association between changes in knowledge and performance scores, indicating that time constraints affect the ability to learn various topics in a short time.
Community-dwelling older people with foot problems must seek help [5,42]. Tinea pedis and tinea unguium are among the top five skin disorders in individuals aged ≥ 60 years [43]. Predicting foot ulcers via early screening prevents further worsening of the condition [7,44]. Early problem detection and consultation with other professionals for referral judgment by NCWs are important for foot and general health. The contents of the tools include information on when and what type of foot problems require doctor referrals, highlighting urgent (e.g., sudden coldness of one foot) and recommended (fungal infection on nails or skin) examples.
Overall, the described program is important as an introductory intervention for NCWs caring for older people. As successful educational foot care programs for patients or clients [45], multifaceted interventions modify emotions and perceptions [46], leading to changes in behavior and care practices and fall prevention [47]. Although we observed an association between

Limitations
In contrast to podiatrists in other countries [48], there is no guarantee that referred patients will see a doctor who has adequate foot care knowledge. Such patients may feel disappointed or may be referred to a different doctor. Furthermore, despite the presence of some foot carerelated certificates from different associations, foot care professionals are limited.
Foot care programs may include excess information that must be applied in a short period, and NCWs may require additional practical and hands-on information. Acquiring proper nail care skills requires time, extensive learning, and experience. Basic treatment skills, such as using nail files or treatment for reducing pain due to ingrown nails, should be emphasized.

Additional file 1. Qualitative comments by the eight evaluators.
Additional file 2. Quantitative and qualitative comments by the 29 evaluators.