January 2021 Newsletter

Our Workshops Inform Decision Making
 

"I was impressed with this workshop on so many levels. I have been waiting for someone to put a truthful and accurate Indigenous lens on evaluation. Andrea L.K. Johnston, a First Nations researcher, has figured out methods to capture data using Indigenous culture as a core driver. It teaches Indigenous and non-indigenous agencies to define, capture and evaluate data using creative and logical processes. It teaches us to look at the status quo, educate and evolve private and public systems to affect change. These workshops are invaluable as it informs policy and guides truth and reconciliation Calls to Actions. It is a tool for facilitating far-reaching change in the political, economic and social lives of Indigenous peoples of Canada (2019)."

Irene Compton, Minwaashin Lodge, Culture Program & Economics Unit Manager

Indigenous Evaluation Frameworks - Workshop #3
 

2020 was the inaugural launch of Johnston Research Inc.’s Indigenous Evaluation Frameworks workshop #3. In 2020, we scuessfully hosted two courses, in October 2020, and November 2020, on Workshop #3.  This is the third in a series of three workshops on Honouring Reconciliation in Evaluation (HRE). Workshops 1 and 2 presented the theory and tools for effective Indigenous Evaluation practices. In Workshop 3 we study in-detail several examples of Indigenous evaluation frameworks. The workshop explores how Indigenous Evaluation Frameworks are effective in assessing the results of a program/ intervention/ project and also how they have broader impacts on decolonizing the industry of evaluation practice and methodology. The workshop explores Indigenous Evaluation frameworks that are applicable to single local evaluation practice as well as national and regional efforts.

Our January Workshops are booked and underway as of January 5th, 2021. Workshop 3 will run in Janary from the 19th thru 21st at 1:00PM - 3:00 PM EST. We will conduct our discussions using Slido, as well as Zoom Meeting Breakout Rooms and the Chat Function.

 All three workshops can be purshacsed for a package price.

Workshop 1
 

January 5 - 12:30 - 3:30
March 2 - 12:30 - 3:30
May 11 - 12:30 - 3:30
June 1 - 12:30 - 3:30

Workshop 2
 

January 7 - 12:30 - 3:30
March 4 - 12:30 - 3:30
May 13 - 12:30 - 3:30
June 3 - 12:30 - 3:30

Workshop 3
 

January 19, 20, 21 - 1:00 - 3:00
March 16, 17 18 - 1:00 - 3:00
May 25, 26, 27 - 1:00 - 3:00
June 15, 16, 17 - 1:00 - 3:00

 

Upon the completion of Honouring Reconciliation in Evaluation workshops, you will qualify for the Indigenous Evaluator Certification testing component. This invovles a solo written component and a verbal presentation and discussion session.
 
The fee is $250.00 per session, and $50.00 for subsequent re-takes. You will have 48 hours to complete the written component. And the oral presentation is 8 - 10 minutes presentation and 10 - 12 minutes for discussion.

The steps for registration are as follows:

1. Register in the Johnston Research website SHOP
2. You will receive an email confirmation and a request for you to book a date for the test to start.
3. You will email Johnston Research with the test start date and time.  An email will be sent for this exact time with the preparatory instructions and test questions.
4. You will have 48 hours to complete the written component and 72 hours to complete the oral component (pre-book this for 20-minute phone call, Zoom Meeting, or a video preparation for the presentation and 10- to 12-minute meeting for the discussion.  
5. You will receive your scoring within 48 hours of all components being complete.  
6. If you pass the certification test you will receive a certificate denoting your accomplishment.  If you need to re-take the test this will be explained.

The History of Honouring Reconciliation in Evaluation Workshops
 

In 2016, Andrea L.K. Johnston launched the first training curriculum in Indigenous evaluation practice, titled Honouring Reconciliation in Evaluation.

At Johnston Research Inc. we seek to deconstruct and decolonize the language and assumptions behind evaluation to support the unfolding of a reconciliation process that changes the ways evaluations are operationalized. Andrea has also published a series of workshop manuals on Indigenous evaluation.  
 
The primary core competencies gained from the series of three workshops include:  
1. Cultural Competency in Evaluation Practices
2. Aptitude for Indigenous Evaluation Frameworks 
 
In 2010, we launched the Waawiyeyaa Evaluation Tool,

which is designed to encourage healing through oral tradition and storytelling. Our Waawiyeyaa Evaluation Tool is used across Canada and internationally. Grey Bruce Health Unit is using our tools with local Indigenous communities on an ongoing basis. 

Using Technology to inform Evaluation Practices
 

15-years ago, in 2005, Johnston Research Inc. was a pioneer in the use of technology when evaluating programs for Inigenous Peoples. Johnston was readily using visual and oral computer technology to enhance the incorporation of Indigenous worldviews in program evaluation.  Today, in 2020, the ability of Johnston to have developed advanced Indigenous knowledge-based technology-based tools and methods is absolutely critical.  Johnston Research situates Indigenous worldviews, including methods of communication and transmission of knowledge, within a unique evaluation framework that also considers Western methods of data collection. Examples of the author’s framework are offered in the context of evaluations of Indigenous programs. Based on Johnston Research Inc.'s experiences, we concludesthat it is possible to join the traditional knowledge of Indigenous Peoples with digital technology in program evaluation.  We have upgraded our methodolgoies to adpat and excel evaluation methodolgies in our new realities for 2020 and 2021.  
 
Evaluations need to reflect the transitional nature of people and programs—what is right for today may not be well suited for tomorrow. The core of an evaluation need not worry itself so much with the methods, which are ever evolving, as much as with the evaluation frame of reference. Digital technology provides a venue to transfer evaluation knowledge of design, collection, and reports to those being evaluated. Technological approaches enhance the use of traditional knowledge to convey the importance of evaluation. The goal of integratingIndigenous knowledge, western approaches, and technological oral and visual aids is to evoke full participation in evaluation from program staff and participants. The anticipated outcomes are improved program quality through growth of individuals (both program staff and participants), families, communities, and subsequently the nations.

Case Studies are more Relevant in a COVID-19 Reality
 

Canadian policy decision-making has utilized case studies extensively.  Johnston Research Inc. (JRI) has completed more evaluation-related case studies over a 4-year period and compared such results to those in a previous 15-year period of Johnston Research Inc.'s evaluation work. To understand the growing application of case studies, we interviewed clients and contacts from First Nations that had been case study sites for our government clients, to understand what aspects of case study evaluation research had helped them share their opinions and improve their programs, and what aspects had not.

Evaluators and decision makers often employ frameworks to explain how best to use knowledge acquired in case study research to inform policy.  In an attempt to address doubts of our First Nations partners that their case study participation is being used to influence policy. Third-party government consultants that we interviewed noted that their firm had successfully added case studies as a line of evidence to an evaluation project in the past, where one had originally not been called for in the government request for proposal. Some case studies have had immediate results, such as influencing a decision to continue funding, or making the case for future pilot studies and program changes.  A renewed rigour and standard for valuable and effective case studies is therefore in order and one that is adapted to the realities of COVID-19.

The Inaugural Launch of Indigenous Evaluation Frameworks
 

Working from a place of spirit starts with truth. Truth occurs from many perceptions and dimensions.  Truth is the essence of what evaluation is designed to uncover. Scientific inquiry seeks to uncover the physical truths of an object it studies. However, Indigenous peoples are challenging evaluation to go beyond the physical understanding of whether an intervention is deemed successful or not. Given the complexity of understanding truth, evaluation too must challenge itself to embrace this complexity. By embracing the complexity of truth, evaluation can begin to operate from a place of spirit. It is within the path of spiritual understanding that we can begin to truly understand why and how programs are well-oiled machines and others struggle at every corner.
 
Truth exists in the past, present, and future simultaneously and can reveal knowledge from realms beyond the physical. Spirit brings a unique understanding to every evaluation. Thus, evaluation must reveal these other truths beyond the physical and surface of everyday knowledge. It is these special insights which ignite the spiritual experience of those who are impacted by the evaluation. Reporting must reflect these additional knowledge bases. This article provides a unique Indigenous framework of understanding developed within a training curriculum titled, “Honouring Reconciliation in Evaluation”. This framework defines the assumptions behind the evaluation approach, uncovers the degrees of knowledge and varying roles of an evaluator, defines the varied types of program design, and defines the ways evaluation is managed.

The sharing of our Indigenous evaluation framework from a place of spirit will:

1. define the assumptions behind the evaluation approach,
2. uncover the degrees of knowledge and varying roles of an evaluator,
3. define the varied types of program design, and
4. define the ways evaluations are managed.

Description of the JRI Honouring Reconciliation in Evaluation Workshops
 

1. Wearing an Indigenous Evaluation Lens
   This workshop offers a unique and inspiring experience that features ground-breaking discussion on concrete ways to bring reconciliation into evaluation.
2. Tools for Change and Indigenous-led Measurement
   Through this workshop you will learn to develop and apply tools that are both interventions as well as knowledge-exchange devices.
3. Indigenous Evaluation Frameworks
   Taking reconciliation as a starting point, in this workshop you will examine the key categories that define an evaluation plan or framework from an Indigenous perspective.

Johnston Research Inc’s Other Services
 

• Services for any budget, from $5,000 and up
• A team of highly skilled First Nation and Métis project managers, analysts, and fieldworkers
• 50 years of combined experience conducting: Environmental scans/scoping, needs assessment, process and impact evaluation, performance measurement, feasibility studies, and literature review.
• Research and evaluation expertise on health, education, justice, housing and culture
• Strong Aboriginal values, ethics and the highest technical standards
• A deep respect for community ownerships, leadership, culture and people.
• “JRI’s work over the past two years for NWAC, on four of our evaluation and research projects, has resulted in invaluable insights that have strengthened our deliverables, enhancing our vision of mental wellness, as well as providing instrumental policy and programming recommendations regarding young and at-risk Aboriginal women.”
  
  Dan Peters, Coordinator, Native Women’s Association of Canada

Organizations We Work With
 

What Organizations are saying about JRI
 

We want to thank you for taking your time to participate on the Ways Tried and True Working Group meetings, and contributing to the development of the WTT Framework and identifying Ways Tried and True for sharing through the Best Practices Portal.
Nina Jetha
Manager, Canadian Best Practices Initiative

Despite tight timelines, JRI conducted a survey, analyzed the data and wrote a report that is highly regarded by our nursing colleagues as providing invaluable information in a succinct, clear, easy to read manner.
Fjola Hart Wasekeesikaw
Executive Director, Aboriginal Nurses Association of Canada

Anishnawbe Health Toronto would hire Johnston Research Inc. again for Board of Director's consultations and strategic planning.
Joe Hester
Executive Director, Anishnawbe Health Toronto

From the beginning of the contract, I was impressed with the thoroughness and attention to detail, as shown in the care with which JRI put together their breadth of knowledge and sensitivity to the topic.
Senior Program Advisor
First Nations and Inuit Health Branch, Health Canada