Plan, Implement, and Evaluate - Revision history

Mlabrie21: Mlabrie21 moved page Effective Action Planning and Implementation to Plan, Implement, and Evaluate

2025-01-29T23:07:01Z

Mlabrie21 moved page Effective Action Planning and Implementation to Plan, Implement, and Evaluate

← Older revision	Revision as of 16:07, 29 January 2025
(No difference)

BasilSavitsky: /* Key Information */

2024-12-15T23:03:44Z

Key Information

← Older revision		Revision as of 16:03, 15 December 2024
Line 48:		Line 48:

	Analysts may choose a variety of methods for sharing their data, including Geographic Information Systems (GIS), line graphs, bar charts, tables, and pie charts. Charts and graphs should be developed with the audience in mind -- easy to read, aesthetically pleasing, well-labeled, and include the totals for columns and rows. Only the most important information should be illustrated in order to keep the report simple. It is critical to use care when displaying and illustrating data in order to maintain a balance between accurately displaying data and creating an effective visualization. Communities have a variety of options for data support. Investments in off-the-shelf software systems are available for purchase and can be used to monitor data from various state and local organizations and to track system performance indicators and outcomes over time. If there is limited funding available, communities can use spreadsheet or database software, such as Microsoft Excel or Access.		Analysts may choose a variety of methods for sharing their data, including Geographic Information Systems (GIS), line graphs, bar charts, tables, and pie charts. Charts and graphs should be developed with the audience in mind -- easy to read, aesthetically pleasing, well-labeled, and include the totals for columns and rows. Only the most important information should be illustrated in order to keep the report simple. It is critical to use care when displaying and illustrating data in order to maintain a balance between accurately displaying data and creating an effective visualization. Communities have a variety of options for data support. Investments in off-the-shelf software systems are available for purchase and can be used to monitor data from various state and local organizations and to track system performance indicators and outcomes over time. If there is limited funding available, communities can use spreadsheet or database software, such as Microsoft Excel or Access.

			'''Sustainability'''

			The SPF process requires cultural competency and sustainability to be considered in all five phases. The first theme is addressed in more detail in the SAFE Solutions article titled, “Apply a Health Equity Lens.” The second is detailed in “Understand Funding and Identify Resources.” However, a few notes regarding sustainability are addressed here. Financial resources were mentioned above, regarding the Planning phase. By taking sustainability into account, planning should address the realistic capacity to maintain efforts to be implemented.

			Within the Implementation context, the non-financial aspects of sustainability become apparent. Although, typically sustainability is thought of in terms of monetary resources, it also includes consideration of human capital. The training provided and the skills developed during implementation are vital to the sustained success of any coalition. Accounting for and rewarding the members of the coalition as a resource facilitates the retention of their service.

			The Evaluation phase links to sustainability in two ways. First, the outcome measures create the context to document return on investment (ROI) of funds allocated during the Implementation phase. Second, the evaluation provides information on the way forward. What efforts are worthy of sustaining in the next SPF cycle?

	= Impactful Federal, State, and Local Policies =		= Impactful Federal, State, and Local Policies =

BasilSavitsky: /* Introductory Paragraph */

2024-12-15T22:38:42Z

Introductory Paragraph

← Older revision		Revision as of 15:38, 15 December 2024
Line 4:		Line 4:
	= Introductory Paragraph =		= Introductory Paragraph =

	The last three steps in the SPF approach build upon the Assessment phase in which community-specific needs are identified and sufficient Capacity-Building has occurred to be able to implement solutions. The Planning, Implementation, and Evaluation phases are tightly interwoven. Since all three phases utilize the Assessment data in an integrated way, they are presented together in this single article. The Planning phase can be summarized as using the buy-in and wisdom of the coalition members to prioritize which goals ''can be'' realistically achieved and which actions ''should be'' implemented. Since the Evaluation phase will provide metrics on the ~~effective ness~~ of those actions and progress towards those goals, it is important for planning priorities to be established with evaluation processes and outcomes in mind. If the Planning phase fully engages the coalition membership, there is likely to be more buy-in and accountability during the Implementation phase, as well as a deeper celebration of successful outcomes in the Evaluation phase.		The last three steps in the SPF approach build upon the Assessment phase in which community-specific needs are identified and sufficient Capacity-Building has occurred to be able to implement solutions. The Planning, Implementation, and Evaluation phases are tightly interwoven. Since all three phases utilize the Assessment data in an integrated way, they are presented together in this single article. The Planning phase can be summarized as using the buy-in and wisdom of the coalition members to prioritize which goals ''can be'' realistically achieved and which actions ''should be'' implemented. Since the Evaluation phase will provide metrics on the effectiveness of those actions and progress towards those goals, it is important for planning priorities to be established with evaluation processes and outcomes in mind. If the Planning phase fully engages the coalition membership, there is likely to be more buy-in and accountability during the Implementation phase, as well as a deeper celebration of successful outcomes in the Evaluation phase.

	= Key Information =		= Key Information =

BasilSavitsky: /* Available Tools and Resources */

2024-10-21T23:38:45Z

Available Tools and Resources

← Older revision		Revision as of 16:38, 21 October 2024
Line 60:		Line 60:
	*'''SAFE Project.''' Coalitions can use the SAFE Solutions dashboard to help lead discussions on which strategies to implement within their community. <ref>https://www.yoursafesolutions.us/</ref> The Community Playbook includes a template for building an action plan and for setting S.M.A.R.T. goals. <ref>https://www.safeproject.us/safe-community-playbook-and-safe-solutions/</ref>		*'''SAFE Project.''' Coalitions can use the SAFE Solutions dashboard to help lead discussions on which strategies to implement within their community. <ref>https://www.yoursafesolutions.us/</ref> The Community Playbook includes a template for building an action plan and for setting S.M.A.R.T. goals. <ref>https://www.safeproject.us/safe-community-playbook-and-safe-solutions/</ref>

	'''The National Association of County and City Health Officials (NACCHO)''' has published a report with Joslyn Levy & Associates titled "Specifying Monitoring and Evaluation Measures for Local Overdose Prevention and Response Strategies: A Toolkit." <ref>https://mys.mapyourshow.com/mys_shared/naccho2024/handouts/NACCHO_SpecifyingMonitoring&EvaluationMeasures_Toolkit2024_FINAL.pdf</ref>		*'''The National Association of County and City Health Officials (NACCHO)''' has published a report with Joslyn Levy & Associates titled "Specifying Monitoring and Evaluation Measures for Local Overdose Prevention and Response Strategies: A Toolkit." <ref>https://mys.mapyourshow.com/mys_shared/naccho2024/handouts/NACCHO_SpecifyingMonitoring&EvaluationMeasures_Toolkit2024_FINAL.pdf</ref>

	*'''The National Implementation Research Network''' has public health implementation as one of its four focus themes. <ref>https://nirn.fpg.unc.edu/</ref>		*'''The National Implementation Research Network''' has public health implementation as one of its four focus themes. <ref>https://nirn.fpg.unc.edu/</ref>

BasilSavitsky: /* Available Tools and Resources */

2024-10-21T23:38:20Z

Available Tools and Resources

← Older revision		Revision as of 16:38, 21 October 2024
Line 56:		Line 56:
	= Available Tools and Resources =		= Available Tools and Resources =

	* '''SAMHSA''' provides a summary of best practices in ~~the~~ planning ~~domain~~ in "~~A guide~~ to SAMHSA’s ~~strategic prevention framework~~" <ref>https://www.samhsa.gov/sites/default/files/20190620-samhsa-strategic-prevention-framework-guide.pdf </ref>		* '''SAMHSA''' provides a summary of best practices in planning, implementation, and evaluation in its "Guide to SAMHSA’s Strategic Prevention Framework" <ref>https://www.samhsa.gov/sites/default/files/20190620-samhsa-strategic-prevention-framework-guide.pdf </ref>

	*'''SAFE Project.''' The Community Playbook includes a template for building an action plan and for setting S.M.A.R.T. goals. <ref>https://www.safeproject.us/safe-community-playbook-and-safe-solutions/</ref> ~~Coalitions can use the SAFE Solutions dashboard to help lead discussions on which strategies to implement within their community.~~		*'''SAFE Project.''' Coalitions can use the SAFE Solutions dashboard to help lead discussions on which strategies to implement within their community. <ref>https://www.yoursafesolutions.us/</ref> The Community Playbook includes a template for building an action plan and for setting S.M.A.R.T. goals. <ref>https://www.safeproject.us/safe-community-playbook-and-safe-solutions/</ref>

	* One resource explicitly focused on implementation is the National ~~Implementation Research Network, which~~ has ~~public health implementation as one of its four focus themes~~. <ref>https://~~nirn~~.~~fpg~~.~~unc~~.~~edu/~~</ref>		'''The National Association of County and City Health Officials (NACCHO)''' has published a report with Joslyn Levy & Associates titled "Specifying Monitoring and Evaluation Measures for Local Overdose Prevention and Response Strategies: A Toolkit." <ref>https://mys.mapyourshow.com/mys_shared/naccho2024/handouts/NACCHO_SpecifyingMonitoring&EvaluationMeasures_Toolkit2024_FINAL.pdf</ref>

	* ~~Although it is dated, Durlak and DuPre (2008) is worthy of review because it provides a meta-analysis~~ of ~~over 500 research findings on the implementation process~~. <ref> Durlak, J. A., & DuPre, E. P. (2008). Implementation matters: A review of research on the influence of implementation on program outcomes and the factors affecting implementation. American Journal of Community Psychology, 41(3/4), 327–350. Retrieved from https://~~www~~.~~researchgate~~.~~net/publication~~/~~5529147_Implementation_Matters_A_Review_of_Research_on_the_Influence_of_Implementation_on_Program_Outcomes_and_the_Factors_Affecting_Implementation~~</ref>		*'''The National Implementation Research Network''' has public health implementation as one of its four focus themes. <ref>https://nirn.fpg.unc.edu/</ref>

	* ~~There are many resources that discuss how to improve cultural competence in the areas of substance use and mental health.~~ '''~~SAMHSA~~''' has ~~examined this issue in great detail~~. <ref>https://~~store~~.~~samhsa~~.~~gov~~/~~sites/default/files/d7/priv~~/~~sma14-4849.pdf~~</ref>		*'''The UNC Center for the Business of Health''' has launched the "From Settlement to Solutions" website, which is a comprehensive resource for the use of evidence-based opioid settlement funds, based on community conversations. This North Carolina case study consolidates best practices, research, policy trackers, and tools, providing a centralized hub for quick and easy reference. <ref>https://cboh.kenaninstitute.unc.edu/opioid-project/</ref>

	* Typically, it will take a combination of several strategies to improve cultural competence. Therefore, it is important that there be as much input as possible when considering what needs to be done in a given community. '''~~SAFE Project’s resources for diverse populations~~''' provides ~~links to~~ a ~~suite~~ of ~~resources for a variety of populations~~. <ref>https://www.~~safeproject~~.us/~~resource/resources-for-diverse-populations~~/</ref>		*'''Research Meta-Analysis.''' Although it is dated, Durlak and DuPre (2008) is worthy of review because it provides a review of over 500 research findings on the implementation process. <ref> Durlak, J. A., & DuPre, E. P. (2008). Implementation matters: A review of research on the influence of implementation on program outcomes and the factors affecting implementation. American Journal of Community Psychology, 41(3/4), 327–350. Retrieved from https://www.researchgate.net/publication/5529147_Implementation_Matters_A_Review_of_Research_on_the_Influence_of_Implementation_on_Program_Outcomes_and_the_Factors_Affecting_Implementation</ref>

	= Promising Practices =		= Promising Practices =

BasilSavitsky: /* Key Information */

2024-10-21T23:18:55Z

Key Information

← Older revision		Revision as of 16:18, 21 October 2024
Line 25:		Line 25:
	*If possible include strategies which impact broad systemic and policy changes.		*If possible include strategies which impact broad systemic and policy changes.
	*Strategies should increase awareness, build education, enhance skills, build capacity, improve access, or fill gaps.		*Strategies should increase awareness, build education, enhance skills, build capacity, improve access, or fill gaps.
	*Action plans are living documents and will need to be constantly reviewed and revised to address the new realities and lessons which are learned through the Evaluation phase.		*Action plans are living documents and will need to be constantly reviewed and revised to address the new realities and lessons which are learned through the Evaluation phase. Decision makers need to be willing to experiment and constantly adjust the approaches they take. Even at the local level, aspects of the substance use epidemic change, sometimes quite rapidly. Leaders need to continually collect and analyze data in order to detect these changes and make adjustments.

	''' Implementation'''		''' Implementation'''
Line 36:		Line 36:

	There are two types of evaluations -- process evaluations and outcome evaluations:		There are two types of evaluations -- process evaluations and outcome evaluations:
	*Process evaluation ~~documents~~ accountability and that the implementation was done with fidelity. This focus is primarily on outputs and is often required for purposes of grant funding or communication with stakeholders. Did the coalition do what it said it was going to do? Were the activities within the action plan implemented? The identification of any action steps that were not implemented is likely to lead to staffing or resource issues ~~and warrants examination of~~ leadership, communication, and sustainability.		*Process evaluation ensures accountability and that the implementation was done with fidelity. This focus is primarily on outputs, such as number of classes offered or number of Naloxone kits distributed, and is often required for purposes of grant funding or communication with stakeholders. Did the coalition do what it said it was going to do? Were the activities within the action plan implemented? The identification of any action steps that were not implemented is likely to lead to an examination of staffing or resource issues, leadership, communication, and sustainability.
	*Outcome evaluation measures effectiveness and ~~focus~~ on impact. ~~The~~ employ change detection or pre-post measures which ~~compares~~ current conditions to baseline conditions. This is a process in which measurable progress towards the short-term or mid-term outcomes can be documented. Revision of long-term outcomes can be evaluated at this time as well. It should be noted that impact can also be documented through qualitative data. Often a compelling story can be told that is useful in promoting advocacy efforts. The conditions surrounding substance use are complex and documenting progress may be best served through the use of a narrative that is articulated by a variety of community members most affected by the action plan.		*Outcome evaluation measures effectiveness and focuses on impact. They employ change detection or pre-post measures which compare current conditions to baseline conditions. This is a process in which measurable progress towards the short-term or mid-term outcomes can be documented. Revision of long-term outcomes can be evaluated at this time as well. It should be noted that impact can also be documented through qualitative data. Often a compelling story can be told that is useful in promoting advocacy efforts. The conditions surrounding substance use are complex and documenting progress may be best served through the use of a narrative that is articulated by a variety of community members most affected by the action plan.

	~~A solid plan outlines~~ a series of performance indicators which can be used to track progress towards SMART goals.		Solid action and evaluation plans outline a series of performance indicators which can be used to track progress towards SMART goals. Generally, the performance management process has four components:
			*Identify appropriate performance indicators to determine markers of success.
			*Conduct performance measurement, leveraging available data and collect new data to measure short-term and longer-term outcomes.
			*Monitor and report performance management data, insights, challenges, and successes.
			*Quality improvement uses evidence of limited results or setbacks as learning opportunities to be used to improve strategies and action plans.

	~~Generally~~, the ~~performance management process has four components:~~		The evaluation process guides the coalition in developing its strategies and tracks the effectiveness of each strategy over time. It will be up to each community to decide what data to collect and report, and what data should be made public. The identified lead should determine the frequency of data collection and coordinate collection efforts to regularly monitor data. The data report should educate and drive informed decision-making. For example, data used to track the number and locations of overdoses can provide the community with the knowledge of where overdoses are taking place and what hot spots exist. This allows a community to focus resources where they are needed by adding or expanding services like those related to prevention, harm reduction, and connection to services through peers or other means. Other parts of the data report may include available treatment and recovery housing beds, Naloxone distribution numbers, and the frequency of prescribed MAT in various settings. Continued communication and sharing of data is key. This will lead to greater collaboration between agencies which share data as well as other community stakeholders. Often new partnerships are forged when the data reveals what needs to be addressed.

	*Identify Appropriate Performance Indicators - Determine agreed upon markers of achieving success.		Analysts may choose a variety of methods for sharing their data, including Geographic Information Systems (GIS), line graphs, bar charts, tables, and pie charts. Charts and graphs should be developed with the audience in mind -- easy to read, aesthetically pleasing, well-labeled, and include the totals for columns and rows. Only the most important information should be illustrated in order to keep the report simple. It is critical to use care when displaying and illustrating data in order to maintain a balance between accurately displaying data and creating an effective visualization. Communities have a variety of options for data support. Investments in off-the-shelf software systems are available for purchase and can be used to monitor data from various state and local organizations and to track system performance indicators and outcomes over time. If there is limited funding available, communities can use spreadsheet or database software, such as Microsoft Excel or Access.
	*Conduct Performance Measurement - Leverage available data; collect new data to measure short-term and longer-term outcomes.
	*Monitor and Report Performance Measurement Results - Share cross-sector performance management data, insights, challenges, and successes.
	*Quality Improvement - Use evidence of limited results or setbacks as learning opportunities that can be used to improve strategies and action plans.

	Communities might initially collect only baseline data, but the benefits of tracking data trends over time include accountability, monitoring changes with statistical significance to act more swiftly, influencing policy, and being able to communicate and raise awareness about a particular problem. The identified lead should determine the frequency on how often to collect data and coordinate collection efforts to regularly monitor data.

	It will be up to each community to decide what data to collect and report, and what data should be made public. The data report should continually educate and drive informed decision-making. Data used to track the number and locations of overdoses, for example, can provide the community with the knowledge of where overdoses are taking place and what hot spots exist. This allows a community to focus resources where they are needed by adding or expanding services like those related to prevention, harm reduction, and connection to services through peers or other means. Other parts of the reports may include available treatment and recovery housing beds, Naloxone distribution numbers, number of prescribed MAT in various settings, and number of interventions. What is required is what is needed to first guide strategy and then be able to track the effectiveness of those strategies over time.

	Analysts may choose a variety of methods for sharing their data, including Geographic Information Systems (GIS), line graphs, bar charts, tables, and pie charts. It is critical for an analyst to use care when displaying and illustrating data because it is important to find a balance between creating a visualization that is effective and provides a picture for their audience, but also doing it in a way that accurately displays the data rather than skews the interpretation. Charts and graphs should be easy to read, aesthetically pleasing, well-labeled, include the totals for columns and rows~~, be scaled accurately, and developed with the audience in mind~~. ~~Illustrate~~ the most important information ~~and~~ keep the ~~graphic~~ simple. ~~Research best practices or ask for help if you are not well versed~~ in ~~the creation of charts and graphs.~~

	To maintain a ~~strong~~ data ~~infrastructure, communities~~ have a variety of options. Investments in off-the-shelf software systems are available for purchase and can ~~help~~ to ~~combine and~~ monitor data from various state and local organizations~~, provide a connection~~ to ~~services, and serve as a tool for tracking~~ system performance indicators and outcomes over time. If there is limited funding available, communities can ~~do this using~~ spreadsheet or database software ~~(like~~ Microsoft Excel or Access).

	A targeted data collection and analysis effort will enable decision makers to develop effective approaches to achieve results. Continued communication and sharing of data is key. This will lead to greater collaboration between agencies that have and share data as well as other community stakeholders involved with developing and implementing strategies and programs. These community stakeholders can help "translate" the data from multiple sources to help with decision-making. Often new partnerships are forged when the data reveals what needs to be addressed and who can effectively address those identified needs.

	Another common lesson learned from experience is that decision makers need to be willing to experiment and constantly adjust the approaches they take. Even at the local level, aspects of this epidemic change and sometimes change rapidly. Leaders need to continually collect and analyze data in order to detect these changes and make adjustments.

	= Impactful Federal, State, and Local Policies =		= Impactful Federal, State, and Local Policies =

BasilSavitsky: /* Key Information */

2024-10-21T00:24:02Z

Key Information

← Older revision		Revision as of 17:24, 20 October 2024
Line 35:		Line 35:
	Three verbs which summarize the Evaluation phase are calibrate, celebrate, and communicate. The calibration involves evaluation of what worked well during implementation, what did not work, and what can be learned to launch a new SPF cycle of assessment, capacity-building, planning, and implementation. Celebration uses the documentation of even small wins for coalition members to share successes and to build positive momentum to achieve continued progress. The communication of evaluation results can be used to report outcomes back to funders and to advocate for the coalition mission with local and state decision-makers.		Three verbs which summarize the Evaluation phase are calibrate, celebrate, and communicate. The calibration involves evaluation of what worked well during implementation, what did not work, and what can be learned to launch a new SPF cycle of assessment, capacity-building, planning, and implementation. Celebration uses the documentation of even small wins for coalition members to share successes and to build positive momentum to achieve continued progress. The communication of evaluation results can be used to report outcomes back to funders and to advocate for the coalition mission with local and state decision-makers.

	There are two types of evaluations -- ~~Process~~ evaluations and outcome evaluations:		There are two types of evaluations -- process evaluations and outcome evaluations:

	*Process evaluation documents accountability and that the implementation was done with fidelity. This focus is primarily on outputs and is often required for purposes of grant funding or communication with stakeholders. Did the coalition do what it said it was going to do? Were the activities within the action plan implemented? The identification of any action steps that were not implemented is likely to lead to staffing or resource issues and warrants examination of leadership, communication, and sustainability.		*Process evaluation documents accountability and that the implementation was done with fidelity. This focus is primarily on outputs and is often required for purposes of grant funding or communication with stakeholders. Did the coalition do what it said it was going to do? Were the activities within the action plan implemented? The identification of any action steps that were not implemented is likely to lead to staffing or resource issues and warrants examination of leadership, communication, and sustainability.
	*Outcome evaluation measures effectiveness~~. Here, the~~ focus is on impact. With the most synoptic view, we can reflect upon whether or not the proverbial “ladder is up against the right wall.” If it is, and a major redefinition of strategies is not in order, then we can examine what is or isn’t working, and make course corrections as needed. These adjustments are usually made by change detection or pre-post ~~measure, that~~ compares current conditions to baseline conditions. This is a process in which measurable progress towards the short-term or mid-term outcomes ~~expressed~~		*Outcome evaluation measures effectiveness and focus on impact. The employ change detection or pre-post measures which compares current conditions to baseline conditions. This is a process in which measurable progress towards the short-term or mid-term outcomes can be documented. Revision of long-term outcomes can be evaluated at this time as well. It should be noted that impact can also be documented through qualitative data. Often a compelling story can be told that is useful in promoting advocacy efforts. The conditions surrounding substance use are complex and documenting progress may be best served through the use of a narrative that is articulated by a variety of community members most affected by the action plan.
	~~in the logic models and S.M.A.R.T. goals~~ can be documented. Revision of long-term outcomes can be evaluated at this time as well. It should be noted that impact can also be documented through qualitative data. Often a compelling story can be told that is useful in promoting advocacy efforts. The conditions surrounding ~~health equity~~ are complex and documenting progress ~~in this domain~~ may be best served through the use of a narrative that is articulated by a variety of community members most affected by the action plan.

	A solid plan outlines a series of performance indicators which can be used to track progress towards SMART goals.		A solid plan outlines a series of performance indicators which can be used to track progress towards SMART goals.

BasilSavitsky: /* Key Information */

2024-10-21T00:19:51Z

Key Information

← Older revision		Revision as of 17:19, 20 October 2024
Line 9:		Line 9:

	'''Planning'''		'''Planning'''

	Substance misuse is a complex problem which a community can address by numerous strategies. An action plan requires the coalition to make choices about which solutions to implement. The specific approaches different communities will choose to take varies widely. The by-word for the planning process is prioritization which helps to simplify both the complexities of the task at hand and to focus on achieving results. Realizing that the Planning phases is the mid-point of the five SPF phases provides an opportunity to use two navigational points -- the data-driven and outcomes orientation of SPF. The data-driven component is based upon the Assessment phase and ensures that Implementation choices are grounded in the current needs of the community and not upon previous efforts, which may feel subjectively easier, but be less objectively effective. The outcomes component ensures that the Planning phase identifies strategies can be measured in the Evaluation phase, that they are based upon best practices, and that they align to S.M.A.R.T. goals. This acronym stands for Specific, Measurable, Achievable, Relevant, and Time-Bound. A small number of optimal SMART goals will drive the Implementation phase and can be developed by the coalition by balancing three simple criteria -- ''impact'' and ''capacity'' and ''timing'':		Substance misuse is a complex problem which a community can address by numerous strategies. An action plan requires the coalition to make choices about which solutions to implement. The specific approaches different communities will choose to take varies widely. The by-word for the planning process is prioritization which helps to simplify both the complexities of the task at hand and to focus on achieving results. Realizing that the Planning phases is the mid-point of the five SPF phases provides an opportunity to use two navigational points -- the data-driven and outcomes orientation of SPF. The data-driven component is based upon the Assessment phase and ensures that Implementation choices are grounded in the current needs of the community and not upon previous efforts, which may feel subjectively easier, but be less objectively effective. The outcomes component ensures that the Planning phase identifies strategies can be measured in the Evaluation phase, that they are based upon best practices, and that they align to S.M.A.R.T. goals. This acronym stands for Specific, Measurable, Achievable, Relevant, and Time-Bound. A small number of optimal SMART goals will drive the Implementation phase and can be developed by the coalition by balancing three simple criteria -- ''impact'' and ''capacity'' and ''timing'':

Line 28:		Line 29:
	''' Implementation'''		''' Implementation'''

	A set of action items can be added to achieve ~~each~~ the intended outcome of each SMART goal.		During the Implementation phase of SPF, a set of action items can be added to achieve the intended outcome of each SMART goal. Many community coalitions, especially those with a large number of members, will break into working groups or committees around each SMART goal to delineate details implementation objectives. Naturally, those members who are subject matter experts and work in specific fields can take the lead in implementing specific strategies. It is important for all participants to know what part of the action plan they are responsible for leading. This lays the groundwork of expectations between members and trust that each participant will carry out their portion of the plan. These responsibilities should be clearly spelled out in writing so there is no confusion or misunderstanding. Although one coalition member may be helping to coordinate the activities of other members, it is the responsibility of each member to be accountable and help achieve progress. For example, even coalition members who are not tasked with a specific strategy can still help to track milestones, maintain community momentum, and update key community stakeholders as progress is made. As work proceeds on implementing the plan, a process begins whereby actions are taken, effectiveness is assessed, and modifications to the plan are made. The constant evaluation of progress is an ongoing effort. Often, goals are added and changed, and sometimes changes are made in those responsible for implementing parts of the plan. It is important to have the expectation from the start that almost nothing goes exactly as planned. If focus and prioritization are the by-words for planning, the by-words for implementation are accountability and flexibility.

	Many community coalitions - especially those with a large number of members - will break into working groups or committees around each strategy or objective. Naturally, those members who are subject matter experts and work in specific fields can take the lead in developing a plan and outlining the details for that specific strategy.		'''Evaluation'''

	~~It is important for all participants to know what part of~~ the ~~action plan they~~ are ~~responsible for leading~~. ~~This lays the groundwork~~ of ~~expectations between members~~ and ~~trust that each participant will carry out their portion of the plan. These responsibilities should~~ be ~~clearly spelled out in writing so there is no confusion or misunderstanding. Although~~ a ~~coalition member may be helping to coordinate the activities~~ of ~~members~~, ~~it is~~ the ~~responsibility~~ of ~~each member~~ to ~~be accountable~~ and ~~help~~ achieve progress. ~~For example,~~ coalition ~~members not tasked~~ with ~~a specific strategy can still help to track milestones, maintain community momentum,~~ and ~~update key community stakeholders as progress is made~~.		Three verbs which summarize the Evaluation phase are calibrate, celebrate, and communicate. The calibration involves evaluation of what worked well during implementation, what did not work, and what can be learned to launch a new SPF cycle of assessment, capacity-building, planning, and implementation. Celebration uses the documentation of even small wins for coalition members to share successes and to build positive momentum to achieve continued progress. The communication of evaluation results can be used to report outcomes back to funders and to advocate for the coalition mission with local and state decision-makers.

	~~As work begins on implementing the plan, a process begins whereby actions~~ are ~~taken, effectiveness is assessed, and modifications to the plan are made. The constant evaluation~~ of ~~progress is an ongoing effort. Often, goals are added and changed,~~ and ~~sometimes changes are made in those responsible for implementing parts of the plan. It is important to have the expectation from the start that almost nothing goes exactly as planned.~~		There are two types of evaluations -- Process evaluations and outcome evaluations:

	~~'''Evaluation'''~~		*Process evaluation documents accountability and that the implementation was done with fidelity. This focus is primarily on outputs and is often required for purposes of grant funding or communication with stakeholders. Did the coalition do what it said it was going to do? Were the activities within the action plan implemented? The identification of any action steps that were not implemented is likely to lead to staffing or resource issues and warrants examination of leadership, communication, and sustainability.
			*Outcome evaluation measures effectiveness. Here, the focus is on impact. With the most synoptic view, we can reflect upon whether or not the proverbial “ladder is up against the right wall.” If it is, and a major redefinition of strategies is not in order, then we can examine what is or isn’t working, and make course corrections as needed. These adjustments are usually made by change detection or pre-post measure, that compares current conditions to baseline conditions. This is a process in which measurable progress towards the short-term or mid-term outcomes expressed
			in the logic models and S.M.A.R.T. goals can be documented. Revision of long-term outcomes can be evaluated at this time as well. It should be noted that impact can also be documented through qualitative data. Often a compelling story can be told that is useful in promoting advocacy efforts. The conditions surrounding health equity are complex and documenting progress in this domain may be best served through the use of a narrative that is articulated by a variety of community members most affected by the action plan.

	~~Within an effective action~~ plan~~, communities should identify and outline~~ a series of performance indicators ~~that align with their goal(s) and track progress. Shared accountability ensures that progress is being made towards achieving desired outcomes. The data~~ can be used to ~~report back to key stakeholders in the community on the~~ progress that is being made, but it also can be used to revise any details related to the action plans as needed if strategies aren’t going as intended, so that all involved can collectively improve the desired outcomes.		A solid plan outlines a series of performance indicators which can be used to track progress towards SMART goals.

	~~Accountability and monitoring of progress are an ongoing process. As is the case with many aspects of community response, strategies and actions are constantly adjusted.~~ Generally, the performance management process has four components:		Generally, the performance management process has four components:

	*Identify Appropriate Performance Indicators - Determine agreed upon markers of achieving success.		*Identify Appropriate Performance Indicators - Determine agreed upon markers of achieving success.
	*Conduct Performance Measurement - Leverage available data; collect new data to measure short-term and longer-term outcomes.		*Conduct Performance Measurement - Leverage available data; collect new data to measure short-term and longer-term outcomes.
	*Monitor and Report Performance Measurement Results - Share cross-sector performance management data, insights, challenges, and successes.		*Monitor and Report Performance Measurement Results - Share cross-sector performance management data, insights, challenges, and successes.
	*Quality Improvement - ~~Celebrate even small wins together, share what is working, and build on positive momentum to achieve continued progress.~~ Use evidence of limited results or setbacks as learning opportunities that can be used to improve strategies and action plans.		*Quality Improvement - Use evidence of limited results or setbacks as learning opportunities that can be used to improve strategies and action plans.

	Communities might initially collect only baseline data, but the benefits of tracking data trends over time include accountability, monitoring changes with statistical significance to act more swiftly, influencing policy, and being able to communicate and raise awareness about a particular problem. The identified lead should determine the frequency on how often to collect data and coordinate collection efforts to regularly monitor data.		Communities might initially collect only baseline data, but the benefits of tracking data trends over time include accountability, monitoring changes with statistical significance to act more swiftly, influencing policy, and being able to communicate and raise awareness about a particular problem. The identified lead should determine the frequency on how often to collect data and coordinate collection efforts to regularly monitor data.

BasilSavitsky: /* Key Information */

2024-10-20T23:33:41Z

Key Information

← Older revision		Revision as of 16:33, 20 October 2024
Line 11:		Line 11:
	Substance misuse is a complex problem which a community can address by numerous strategies. An action plan requires the coalition to make choices about which solutions to implement. The specific approaches different communities will choose to take varies widely. The by-word for the planning process is prioritization which helps to simplify both the complexities of the task at hand and to focus on achieving results. Realizing that the Planning phases is the mid-point of the five SPF phases provides an opportunity to use two navigational points -- the data-driven and outcomes orientation of SPF. The data-driven component is based upon the Assessment phase and ensures that Implementation choices are grounded in the current needs of the community and not upon previous efforts, which may feel subjectively easier, but be less objectively effective. The outcomes component ensures that the Planning phase identifies strategies can be measured in the Evaluation phase, that they are based upon best practices, and that they align to S.M.A.R.T. goals. This acronym stands for Specific, Measurable, Achievable, Relevant, and Time-Bound. A small number of optimal SMART goals will drive the Implementation phase and can be developed by the coalition by balancing three simple criteria -- ''impact'' and ''capacity'' and ''timing'':		Substance misuse is a complex problem which a community can address by numerous strategies. An action plan requires the coalition to make choices about which solutions to implement. The specific approaches different communities will choose to take varies widely. The by-word for the planning process is prioritization which helps to simplify both the complexities of the task at hand and to focus on achieving results. Realizing that the Planning phases is the mid-point of the five SPF phases provides an opportunity to use two navigational points -- the data-driven and outcomes orientation of SPF. The data-driven component is based upon the Assessment phase and ensures that Implementation choices are grounded in the current needs of the community and not upon previous efforts, which may feel subjectively easier, but be less objectively effective. The outcomes component ensures that the Planning phase identifies strategies can be measured in the Evaluation phase, that they are based upon best practices, and that they align to S.M.A.R.T. goals. This acronym stands for Specific, Measurable, Achievable, Relevant, and Time-Bound. A small number of optimal SMART goals will drive the Implementation phase and can be developed by the coalition by balancing three simple criteria -- ''impact'' and ''capacity'' and ''timing'':

	*Impact. The Assessment phase ~~identifies various~~ gaps and additional service needs. Since the coalition cannot provide solutions to all problems at once, it is useful to identify those outcomes which are immediately achievable. If certain coalition members are skeptical that any level of change is likely on a certain potential goal, then it may be better to shift focus to goals which will have more buy-in. Some of this may be influenced by what coalition members feel that the community-at-large will be most likely to support. Working on strategies which will have the highest impact helps the coalition to have successes which can build traction for more success.		*Impact. The Assessment phase will invariably identify numerous gaps and additional service needs. Since the coalition cannot provide solutions to all problems at once, it is useful to identify those outcomes which are immediately achievable. If certain coalition members are skeptical that any level of change is likely on a certain potential goal, then it may be better to shift focus to goals which will have more buy-in. Some of this may be influenced by what coalition members feel that the community-at-large will be most likely to support. Working on strategies which will have the highest impact helps the coalition to have successes which can build traction for more success.

	*Capacity. When formulating ~~these~~ plans, it is important that expectations are realistic and that ~~the~~ actions ~~identified~~ can be achieved. ~~Even when action plans are revised due to changing data and lessons learned, achieving progress~~ is important to ~~keep participants energized and motivated so communities may~~ consider planning for small and early wins first. ~~Communities can use the strategies contained in the SAFE Solutions dashboard to help lead discussions on which strategies to implement within their community.~~		*Capacity. When formulating an action plans, it is important that expectations are realistic and that select actions which are prioritized can be achieved by the coalition. It is important for communities to consider planning for small and early wins first, so that tangible progress will keep participants energized and motivated. Part of creating an achievable action plan is identifying and securing any financial and other resources that are necessary. There are a variety of funding sources that support planning and programs. These include local, state, or federal government grants, funding through philanthropic organizations, and support from the business community or fundraising campaigns. The action plan should identify steps to secure financial resources to meet their goals and objectives. More funding is not always feasible, so coalitions may need to consider alternate, innovative avenues in their action plans.
	Part of creating an achievable action plan is identifying and securing any financial and other resources that are necessary. There are a variety of funding sources that support planning and programs. ~~Sources of~~ funding ~~include:~~

	*Local or state government (grants or direct funding)		*Timing. Once the coalition agrees to an action plan, it is important to create timelines to complete each activity. As steps are taken to address both short- and longer-term goals, trust is built between the members working toward a common outcome. The timelines need to be reasonable and achievable. Having a range of timelines helps keep members engaged and have a sense of accomplishment. Some coalitions will have short-term goals that can be achieved in 30 or 60 days, mid-term goals that are several months out, and long-term goals that can be expected to take a year or more.
	*Federal grants
	*Funding through philanthropic organizations
	*Support from the business/corporate community
	*Funding from grassroots and direct fundraising campaigns and events

	What is important is that the action plan develops steps to secure any needed financial resources. Without funding, community groups may be unable to meet their goals and objectives. More funding is not always feasible, so coalitions may need to consider alternate, innovative avenues.

	*Timing.
	Once the ~~group as a whole or sub-group~~ agrees to an action plan, it is important to create timelines to complete each activity. As steps are taken to address both short- and longer-term goals, trust is built between the members working toward a common outcome. ~~As with the actions themselves, the~~ timelines need to be reasonable and achievable. Having a range of timelines helps keep members engaged and have a sense of accomplishment. Some coalitions will have short-term goals that can be achieved in 30 or 60 days, mid-term goals that are several months out, and long-term goals that can be expected to take a year or more.

	The following guidelines are useful in developing an action plan:		The following guidelines are useful in developing an action plan:

BasilSavitsky: /* Available Tools and Resources */

2024-10-20T23:27:43Z

Available Tools and Resources

← Older revision		Revision as of 16:27, 20 October 2024
Line 78:		Line 78:
	* '''SAMHSA''' provides a summary of best practices in the planning domain in "A guide to SAMHSA’s strategic prevention framework" <ref>https://www.samhsa.gov/sites/default/files/20190620-samhsa-strategic-prevention-framework-guide.pdf </ref>		* '''SAMHSA''' provides a summary of best practices in the planning domain in "A guide to SAMHSA’s strategic prevention framework" <ref>https://www.samhsa.gov/sites/default/files/20190620-samhsa-strategic-prevention-framework-guide.pdf </ref>

	*'''SAFE Project.''' The Community Playbook includes a template for building an action plan and for setting S.M.A.R.T. goals. <ref>https://www.safeproject.us/safe-community-playbook-and-safe-solutions/</ref>		*'''SAFE Project.''' The Community Playbook includes a template for building an action plan and for setting S.M.A.R.T. goals. <ref>https://www.safeproject.us/safe-community-playbook-and-safe-solutions/</ref> Coalitions can use the SAFE Solutions dashboard to help lead discussions on which strategies to implement within their community.

	* One resource explicitly focused on implementation is the National Implementation Research Network, which has public health implementation as one of its four focus themes. <ref>https://nirn.fpg.unc.edu/</ref>		* One resource explicitly focused on implementation is the National Implementation Research Network, which has public health implementation as one of its four focus themes. <ref>https://nirn.fpg.unc.edu/</ref>