© The Authors, published by EDP Sciences, 2020

1 Introduction

Health promotion is known as the means to improve the ability of the community to maintain and improve their health [1]. Time and participation from all elements of the community are needed to ensure the effectiveness of health promotion. Effective health promotion should also be carried out at the various levels of ecological level [2]. Recently, health promotion media has become an important strategy to disseminate health information. Improvement in information technology enables health promoters to produce effective media campaigns and understand community needs [3]. As the main process of health promotion, understanding community needs is also an important point the development of health promotion [4].

Various studies had also shown that media campaign played important part in the effectiveness of health promotion. In tobacco control, the provision of pictorial health warning was effective in informing the community about the danger of smoking [5, 6]. Research also showed that people who actively access health information through mass media would be more likely to involve the offered health promotion program [7]. In breastfeeding issues, most mothers would prefer to access information through internet [8].

Indonesia is a high populous country with very vast sociocultural characteristics. In 2018, healthy lifestyle was still one of the health problems in Indonesia that determined the high prevalence of non-communicable diseases [9]. Yogyakarta city is the capital of Indonesia’s province with a unique characteristic of its community. Unlike other urban region, Yogyakarta city was known to have a close-knit community. In 2015, Yogyakarta city had the highest proportion of household (49.41 %) which applied healthy behaviour and cleanliness indicators (perilaku hidup bersih dan sehat/PHBS). The district health office of Yogyakarta city had partnered with other organizations to ensure the application of these indicators by promoting healthy behaviour and cleanliness in schools, primary health centers, and other public areas [10]. District health office was also encouraged the community to adopt independent waste management by sorting household’s waste [11].

In campaigning healthy behaviour and cleanliness to community, District Health Office of Yogyakarta city also developed health promotion media, such as posters, leaflets, and billboards. However, there hadn’t been any evaluation regarding the effectiveness of these media in reaching community as well as change community behaviour to adopt healthy lifestyle and practice cleanliness until now. Evaluation is an important process in health promotion for this process can inform the health promoter of the program’s effectiveness and the improvement needed for the next program.

A health promoter can use many evaluation frameworks to evaluate program success using certain indicators [12–14]. Reach, Effectiveness, Adoption, Implementation, Maintenance (RE-AIM) framework is one of the evaluation frameworks used by many programs to evaluate the program’s effectiveness, especially for those that used socio-ecological approach. The application of this framework was known to encourage the improvement of the program and to the framework itself [15–17]. This study was intended to evaluate the media campaign on healthy lifestyle and cleanliness developed by District Health Office of Yogyakarta city. The evaluation will be conducted using RE-AIM framework to ensure the improvement of the program.

2 Methods

This research used a mixed-method approach. Quantitative method using cross-sectional approach was carried out to determine the Reach of the healthy lifestyle and cleanliness media produced by District Health Office of Yogyakarta city. Descriptive qualitative method is used to describe the Adoption and Effectiveness of the media campaign by asking respondents’ perceptions of the media developed by District Health Office of Yogyakarta city.

2.1 Participants

Total number of participants in this study were 288 participants. The detailed characteristics of the participants were shown in Table 1. Participants of quantitative research were selected by purposive sampling. Respondents consisted of health cadres, high school students and elementary school students. The health cadres were selected using inclusion criteria: village cadres from Yogyakarta city and had experienced at least 1 yr. The participants from high school students were selected with inclusion criteria: age more than 17 yr old and Yogyakarta city residents for the last 6 mon. The participants from elementary school students were selected with inclusion criteria: aged between 10 yr to 11 yr, residents of Yogyakarta city and got permission from parents to participate in research.

Participants in qualitative research were selected purposively with inclusion criteria: residents living in Yogyakarta city for at least 6 mon and aged 13 yr old to 70 yr old. Participants were selected using maximum variation technique with variations in socioeconomic status (upper middle and lower middle) and the age of respondents (adolescents (13 yr to 24 yr), adults (25 yr to 60 yr) and old age (61 yr to 70 yr). Selection of criteria based on previous research which showed that the selection and access to media was influenced by age and socioeconomic status [19, 20]. The detail of qualitative participants variation is provided in Figure 1. To ensure the validity of the data, in-depth interviews were conducted with 1 health promotion media expert.

Fig. 1 Qualitative respondents

2.2 Setting

The study was conducted in Yogyakarta city from September to December 2016. Quantitative data were collected using survey. Quantitative data collections for cadres were conducted during a cadre meeting at the district health office of Yogyakarta city. Quantitative data collection for elementary and high school students were carried out in 4 public and private elementary and high schools in Yogyakarta city.

2.3 Data collection

Quantitative data were collected using a questionnaire adapted from the European Social Survey (ESS) core module in the media and communication section [21]. The questionnaire consisted of 22 open and closed questions that explored the respondents’ experience when they saw media campaign about healthy lifestyle and cleanliness that were developed by District Health Office of Yogyakarta city. There were 11 healthy lifestyle and cleanliness media evaluated in this study. The media were created by District Health Office of Yogyakarta city in 2005 to 2017. In total, there were 5 billboards, 1 poster, 2 stickers, 1 leaflet and 2 guidebooks evaluated in this study. The picture of each media was presented in Figure 2. All of these media had been distributed in several public places Yogyakarta city. In conducting the evaluation, each media was printed on A4 paper. Participants were then asked to answer questions related to the familiarity, perceptions and responses of the healthy lifestyle and cleanliness media.

Qualitative data were collected through eight focus group discussions and one in-depth interview. Each data collection methods were guided by a guideline that consists of seven open ended questions regarding the opinion of the participants regarding health promotion media in Yogyakarta city. Focus group discussions were conducted in four villages with high socioeconomic status and four villages with low socioeconomic status. The selection of the village was conducted by a discussion with district health office. Two research assistants conducted focus group discussions for 60 min to 90 min at the village hall or one of participant’s houses.

Fig. 2 Healthy behaviour and cleanliness media developed by District Health Office of Yogyakarta city

2.4 Data analysis

Quantitative and quantitative data were analysed descriptively. Quantitative data were analysed using STATA 13 software. Qualitative data were analysed using OpenCode software.

2.4.1 Ethical consideration

Before conducting this study, the researcher sent the protocol to be reviewed by the review board of Faculty of Medicine, Public Health and Nursing, Universitas Gadjah Mada Indonesia. Ethical clearance was obtained in 2016 and was renewed in 2020 following the analysis of the data with the letter from ethical review board of Faculty of Medicine, Public Health and Nursing, Universitas Gadjah Mada, Indonesia Ref. no: KE/FK/0712/EC/2020. Before the data collection, participants were provided with a document that explained the research process, benefit and risk in involving in the research as well as the utilization of the data and the guarantee of data confidentiality. For participants under the age of 17, the document was sent to the parents with the assistance of school-teacher to be signed by the parents. Data collections were conducted after all the participants and parents agree to involve in the research and signed the document.

3 Results

The respondents of this study were 288 people (205 quantitative, 83 qualitative). Participants in quantitative research are spread evenly at 4 levels of age, namely children, adolescents, adults and the elderly. Meanwhile, the majority of respondents’ monthly income (30.24 %) was IDR 120 000 to IDR 279 000. This is because more than 50 % of respondents in this study were students.

The quantitative data showed that healthy lifestyle and cleanliness media produced by District Health Office of Yogyakarta city could not reach all respondents in this study. Most of the media was not known by more than 50 % of respondents. Respondent’s familiarity to the media varies by the type of media. The respondent’s familiarity with the guidebook media, for example, was lower than other media. The media with the highest familiarity was sticker with a percentage of more than 60 %. The detail of quantitative results were presented in Figure 3.

Respondents stated that they had paid attention to the media placed in various health services and public locations. However, booklets were rarely encountered by respondents. According to respondents, booklets were mostly given to cadres and only placed in libraries and not distributed. Qualitative results in this study offered four themes in explaining participants’ perception of health promotion media and the cause of participant’s unfamiliarity to the healthy behaviour and cleanliness media as follow:

Fig. 3 Participants’familiarity to healthy behaviour and cleanliness media developed by District Health Office of Yogyakarta city

3.1 Strategic information and media location

According to participants, the low level of public familiarity to some health promotion media was caused by the lack of strategic placement of the media. From qualitative research, respondents pay little attention to information through posters, billboards and videotrons because the placement is less strategic and difficult to remember.

“Yes maybe, if it’s not legible it is because it is less strategic. Usually it can be read, if a lot of people often stand there ... But if it’s just installed, yes we see it casually. So you must often observe, where people often stand, or often in groups, or wait for what, must often be read there. “-male, elderly

Some participants felt that the health information that placed in public places was mostly related to smoking prevention. While other health issues such as exclusive breastfeeding were rarely found. In addition, participants also hoped that the information in the billboard could be adapted in posters and placed in every neighbourhood in Yogyakarta city.

3.2 Competition with other information

Participants stated that they encountered more information regarding traditional treatments compared to information about medical treatments from reliable sources, such as public health centres or doctors. Provision of information about alternative/traditional medicine was obtained from various ways and channels causing participants to be more familiar with those unreliable information.

“... from the district, inviting health which treats all diseases, there is a stroke, there is a brain disease, and all kinds of diseases in the body. That is from abroad - the foreign country. Then it will be brought to sub-district X ... “

-women, productive age

In addition, participants also stated that the vast amount of outdoor media such as billboards or videotrons could make them missed the health message placed in the same location. Participants highlight that healthy lifestyle and cleanliness media were often missed in the provision of another interesting media.

“I think it’s also (billboards) are still necessary. Inside, in certain places it is still necessary. Short language. If a lot of writing is even illegible. I think like in the park there is universal health coverage (information) and so on, it’s still necessary. Only now our billboards are inferior to advertisements. Little billboards, big ads “ -male, elderly

3.3 Message distribution

Participants stated that they did not get much information about health, especially about healthy behaviour and cleanliness, from reliable sources.

Participants expected information to be delivered directly in person so they can ask questions and interact with the message provider. However, information from primary health care workers was not routinely given. Participants stated that to obtain health message, they need to find it by themself.

“Usually like this (discussion), if we were invited there was guidance/counselling from the public health centre, usually they give material/media. Brochure. But if there was no one directly share (information) to the community, usually community were asked to read by themself ... But we must come (to library)” -women, elderly

Media expert that became one of our participants was also observed the same thing. Placement of the media in certain locations, such as health care centres, caused limited media coverage only for people visiting health services. This hindered the health provider to achieve their goals by developing the media.

“If it’s in, just place it in the health centre, then of course the market, ee, the audience is more limited, it cannot reach all of them ... That is, the market targeted by the health media earlier, in the places of the health center, is ham, half, it means se, some of them already understand, so that fewer and fewer targets are targeted, touched targets. Therefore, as a result the costs that come out, can only be a little “-media expert, male

3.4 Suitability of information channel

Information on healthy lifestyle and cleanliness was conveyed through various channels, both through audio visual or printed media and direct delivery. One of the District Health Office of Yogyakarta city programs that delivered health information through mosque speakers, for example, was of concern to respondents. Difficulty of application and its impact on social conditions in the community were considered by respondents to hinder the program. As a result, the program could not reach the desired target.

“Health information through mosque loudspeakers has been a long time ago, miss. Previously, we actually got it too. But the term is like, commercialized, no, like a campaign, and residents are disturbed ... That there are those who object. Yes then we stop “ -male, productive age.

4 Discussions

The study results showed that most respondents have not been exposed to many messages made, for example, through billboards. The billboard location is less strategic, and too much message content is the subject of evaluation by respondents. Billboards are unique outdoor media because the media market is constantly moving, while the location of static media. The message conveyed through billboards needs to be kept short and concise so that one can understand in a short time.

Placement in accordance with the characteristics of the recipient of the message increases the effectiveness of the message. In addition, a unique display by utilizing the area outside the billboard can attract someone’s attention so they are interested in seeing further messages [21, 22].

While the media where the public has been exposed to a lot is a sticker media that only covers a number of issues from PHBS. The thing done by the respondent when receiving a message is still in the condition of being exposed to the message until it starts to be interested in the message. This needs to be considered by the government in making messages, so that messages do not repeat themselves and meet the needs of the community.

Another interesting thing that emerged in this study is the importance of detailed media planning, according to the target and sequential / sequential. Evaluation results show that the government’s health media that is most widely known by respondents are stickers. This is because the media is in various places. In this case, media access or proximity to respondents has a greater role. Various innovations can be made to bring the media or health information to the public.

Health information planning requires an ongoing cycle after evaluation. This also applies to health information provided through social media and other internet-based media. Sustainable planning provides an opportunity to increase the effectiveness of providing health information to the community [23. In addition, direct information provision also needs to be carried out so that the community has a comprehensive understanding of a health issue [24].

5 Conclusion

The public needs health information that can be accessed easily, quickly, interactively and reliably. Situational analysis and planning are needed in detail by taking into account the characteristics of the target.

All the District Health Office of Yogyakarta city media that were evaluated, the community was more familiar with sticker media than billboards, posters, leaflets and booklets. This is because the media is easy to find and has clear visualizations. The development of media through television and the internet is promising for teens and productive. In the elderly community, health information needs to be brought closer through community meetings and easy access to print media.

This study was funded by District Health Office of Yogyakarta City, Special Region of Yogyakarta, Indonesia in 2017

References

All Tables

All Figures

	Fig. 1 Qualitative respondents
In the text

	Fig. 2 Healthy behaviour and cleanliness media developed by District Health Office of Yogyakarta city
In the text

	Fig. 3 Participants’familiarity to healthy behaviour and cleanliness media developed by District Health Office of Yogyakarta city
In the text