Tables
Midterm Evaluation of the Pandemic Preparedness Strategic Research Initiative
List of tables:
- Table 1: PPSRI program components, in chronological order of due date of full application
- Table 2: Pandemic research allocations managed through PPSRI, 2006/07 to 2012/13
- Table 3: Evaluation issues and questions
- Table 4: Interviews conducted
- Table 5: Survey invitations and responses, by researcher category
- Table 6: Survey respondent characteristics (n = 157)
- Table 7: Researchers' views of conflict of interest (n = 127 applicants)
- Table 8: Researchers' rating of pandemic research priority areas in the next five years (n = 157)
- Table 9: Incentive and disincentive features for applications: Factors in applying or not applying
- Table 10: Researchers' agreement with types of funding strategies
- Table 11: Program uptake and success rates
- Table 12: Impacts of funded projects on research capacity development, by respondent's research area
- Table 13: Number of trainees involved in PPSRI grants
- Table 14: Role of trainees in funded projects Funded applicants, including NPIs, n = 84)
- Table 15: Impacts of funded projects on research capacity development, by respondent's research area
- Table 16: Knowledge translation in PPSRI projects (No. (%) agree or strongly agree)
Table 1: PPSRI program components, in chronological order of due date of full application1
[ back to report ]
| Application deadlines | Funding Opportunities | Objectives2 | Maximum Amount per Grant and Duration |
|---|---|---|---|
| October 2006 | Pandemic Preparedness Operating Grants Funding Opportunity |
|
$250,000 over 2 years |
| October 2006 | CIHR / Regional Partnership Program/Operating Grant: Pandemic Preparedness |
|
Amount differs by region, over 2 years |
| October 2006 December 2006 |
International Opportunities Program - Collaborative Research Project |
|
$25,000 over 1 year |
| CIHR International Opportunity Program – Development Planning Grant | |||
| CIHR International Opportunity Program – Development Planning Grant | |||
| July 2007 | Team Grant: Influenza Transmission and Prevention Funding Opportunity* |
|
$1,500,000 over 3 years |
| December 2006 | Workshop/Symposia Support in collaboration with Knowledge Translation Branch |
|
Workshops: $5,000 Symposia: $10,000 Conferences: $20,000 |
| March 2007 February 2008 |
Application Development Workshop: Team and Operating Grants |
|
--- |
| Application Development Workshop: Influenza research Network | |||
| March 2007 September 2007 September 2008 |
Bridge Funding: Pandemic Preparedness Strategic Research Initiative* |
|
$100,000 over 1 year |
| May 2007 | Applied Public Health Chairs** | In areas relevant to pandemic preparedness:
|
$925,000 over 5 years |
| June 2007 October 2008 |
Knowledge Synthesis Grant |
|
$100,000 over I year |
| February 2008 June 2008 October 2008 |
Meetings, Planning and Dissemination Grant: End of Grant KT Supplement* |
|
$25,000 over 1 year |
| December 2007 April 2008 August 2008 December 2008 |
Meetings, Planning and Dissemination Grant: Infection and Immunity* |
|
$25,000 over 1 year. |
| March 2008 | Operating Grant: Priority Announcement – Pandemic Preparedness – Transmission, Public Health Measures and Compliance* |
|
$900,000 over 3 years |
| November 2007 | Operating Grant: Pandemic Preparedness Research - Influenza Diagnostics Transmission, Ethics Review and Antivirals* |
|
$525,000 over 3 years |
| December 2007 | Catalyst Grants: Mobilization of the Research Community |
|
$100,000 over 1 year |
| January 2008 | Team Grant: Pandemic Preparedness - Influenza Biology, Vaccines, Ethics, Legal and Social Research* |
|
$1,500,000 over 3 years |
| March 2008 | Partners for Health Systems Improvement Funding Opportunity*** | In order to create new knowledge for informed decision making in pandemic planning and policies:
|
CIHR contribution: up to $150,000 over 3 years Required partnerships funding, ratio depends on province/territory – 2:1 or 1:1 |
| March 2008 March 2009 |
China-Canada Joint Health Research Initiative – Grants Program Funding Opportunity |
|
$180,000 over 3 years (including National Natural Science Foundation of China (NSFC) contribution) |
| June 2008 | Catalyst Grant: Pandemic Outbreak Team Leader* |
|
$25,000 for I year |
| October 2008 | Catalyst Grant: Pandemic Preparedness* | Seed money, on a short-term basis, to:
|
$100,000 for I year |
| February 2009 | Influenza Research Network* |
|
$10.8 Million over three years |
1Source: CIHR website, current and archived funding opportunities searches.
2There is no overarching objectives statement for the whole PPSRI; rather, objectives statements were prepared for each of the funding opportunities.
3Operating Grant: Pandemic Preparedness (Archived)
*Adjudication included both Relevance Review and Peer Review.
**Adjudication was by Merit Review.
***Adjudication included both Merit Review and Peer Review.
Table 2: Pandemic research allocations managed through PPSRI, 2006/07 to 2012/13
[ back to report ]
| Year | ||||||||
|---|---|---|---|---|---|---|---|---|
| Funding Source | 2006/07 | 2007/08 | 2008/09 | 2009/10 | 2010/11 | 2011/12 | 2012/13 | Total |
| PPSRI Core Funding | 2,225,000 | 2,225,000 | 5,150,000 | 5,150,000 | 5,150,000 | $19,900,000 | ||
| Internal Partners | 365,833 | 820,000 | 395,000 | 332,500 | 370,000 | 154,167 | $ 2,437,500 | |
| External Partners | 1,464,624 | 1,775,000 | 5,480,000 | 5,160,000 | 4,050,000 | $17,929,624 | ||
| Total | 2,225,000 | 4,055,457 | 7,745,000 | 11,025,000 | 10,642,500 | 4,420,000 | 154,167 | $40,267,124 |
Data provided by III, as of December 2008.
Table 3: Evaluation issues and questions
[ back to report ]
| Issue | Questions |
|---|---|
| 1. Effectiveness of priority setting | |
| 1.1 To what extent were the PPSRI research priority setting processes appropriate, in terms of timeliness, mechanisms, and inclusivity of: a) research areas and b) groups of researchers? 1.2 How successful were the research priority setting processes – to what extent did they arrive at the most appropriate set of priorities for Canadian research in pandemic preparedness? 1.3 To what extent was national and international duplication of effort avoided, and complementarity enabled? 1.4 How necessary, appropriate (in terms of role and composition) and effective was the Task Group? |
|
| 2. Effectiveness of partnership development | |
| 2.1 To what extent has the PPSRI been successful in building national and international partnerships? Which partnerships have been most and least successful? Are there partnerships that should be developed but have not been? 2.2 What have been the impacts of partnerships on: a) coordination and integration of national and international research programming; b) resource leveraging; c) research duplication and complementarity? 2.3 To what extent have the partnership structure and reporting strategy been effective in supporting the ongoing initiatives of partners, including the PPSRI? |
|
| 3. Appropriateness of program design | |
| 3.1 To what extent is the suite of activities and funding programs offered through the PPSRI allowing the achievement of program objectives? Which components are most and least successful? 3.2 Is the overall strategy of strategic competition effective in ensuring that the most promising research is funded? Would an alternative strategy including the enabling "front-runners" (recognized leaders in the relevant fields) to continue to pursue relevant PP research) be more effective? Was this the most effective strategy for short and long-term capacity-building? 3.3 How effective was the communication strategy used to launch the funding opportunities? |
|
| 4. Achievement of desired funding opportunity outputs | |
| 4.1 To what extent have the funding programs generated expected and/or desirable uptake from the relevant research communities? 4.2 To what extent do the sets of funded projects cover the intended field of program objectives? Which objectives streams are more and less well represented across funded projects? 4.3 To what extent will the funded projects result in building research capacity in areas related to pandemic preparedness (e.g., training of students, redirection of research foci, new investigators on teams)? |
|
| 5. Success of PPSRI networking and KT activities | |
| 5.1 To what extent has the PPSRI been successful in facilitating communication and networking among researchers involved in pandemic preparedness research? Have all relevant teams and individuals been provided with networking opportunities, and what has been the uptake? 5.2 To what extent are communication and networking producing the expected results in terms of enhanced collaboration and increased capacity? 5.3 To what extent has the groundwork been put in place for effective knowledge translation to occur (e.g., inclusion of end-users, KT plans?) |
|
Table 4: Interviews conducted
[ back to report ]
| Type | Number |
|---|---|
| III / CIHR staff | 3 |
| Task Group members | 4 |
| Partner and stakeholder organizations | 11 |
| Researchers and peer reviewers | 4 |
| Total | 22 |
Table 5: Survey invitations and responses, by researcher category
[ back to report ]
| Researcher category | No. in population | No. of responses (%) |
|---|---|---|
| Funded applicants: Nominated principal investigators | 35 | 21 (60%) |
| Funded applicants; co-investigators and co-applicants | 162 | 65 (40%) |
| Unsuccessful applicants | 231 | 59 (26%) |
| Non-applicants | 58 | 12 (21%) |
| Total | 486 | 157 (34%) |
Table 6: Survey respondent characteristics (n = 157)
[ back to report ]
| Characteristic | Funded applicants, including NPIs | Unsuccessful applicants | Non-applicants |
|---|---|---|---|
| Disciplines of main research experience (multiple responses allowed) | |||
| Biomedical sciences | 40 (47%) | 18 (31%) | 7 (58%) |
| Clinical health sciences | 23 (27%) | 17 (29%) | 3 (25%) |
| Health systems and services | 25 (29%) | 12 (20%) | * |
| Population and public health | 32 (37%) | 26 (44%) | 5 (42%) |
| Type of institution or organization (multiple responses allowed) | |||
| University | 65 (76%) | 47 (80%) | 10 (83%) |
| College | * | * | * |
| University-affiliated hospital | 35 (41%) | 19 (32%) | 5 (42%) |
| Community-based hospital | * | * | * |
| Community-based/volunteer agency or organization | * | * | * |
| Government-funded agency or research agency | 12 (14%) | 17 (29%) | * |
| Private research organization | * | * | * |
| Other (unclear whether private or public) | * | * | * |
*Ns less than 5 are not shown.
Table 7: Researchers' views of conflict of interest (n = 127 applicants)
[ back to report ]
| No. (%) agree or strongly agree | |
|---|---|
| I felt there was conflict of interest in the way the PPSRI was designed. | 12 (13.5%) |
| I felt there was conflict of interest in the way the PPSRI applications were reviewed. | 11 (14.5%) |
Table 8: Researchers' rating of pandemic research priority areas in the next five years (n = 157)
[ back to report ]
| Priority area | No. (%) indicating high or very high priority |
|---|---|
| Prevention and treatment | 128 (83%) |
| Vaccines and immunization | 125 (81%) |
| Virus biology and diagnostics | 106 (71%) |
| Ethical, legal or social aspects | 76 (50%) |
| Other areas related to pandemic preparedness and influenza research (see Appendix 5) |
74% (average over 4 possible responses) |
Table 9: Incentive and disincentive features for applications: Factors in applying or not applying
[ back to report ]
| No. (%) agree or strongly agree | ||
|---|---|---|
| Applicants (n = 125) Factors in decision to submit) |
Non-applicants (n = 10) Factors in decision to NOT submit) |
|
| Qualifications of me and my co-applicants | 118 (94%) | * |
| Degree of fit of my research with the themes | 116 (93%) | 6 |
| Type of grants offered (e.g., team grants) | 92 (74%) | * |
| Applicants: Thought my/our chances of success were good Non-applicants: Thought my/our chances of success were not good enough |
88 (70%) | 6 |
| Applicants: Timing of RFA was good Non- applicants: Timing of RFA was poor |
84 (67%) | * |
| Applicants: Needed more research funding Non applicants: Already had enough research funding |
69 (55%) | 10 |
| Size of the grants offered | 67 (54%) | * |
| Duration of the grants offered | 67 (54%) | * |
| Program seemed to be targeting specific groups of researchers | 62 (50%) | 8 |
| Past experience with applications to CIHR | 56 (45%) | * |
| Expected involvement of students in the project | 54 (43%) | * |
| Relative prestige compared to other programs available | 48 (38%) | * |
| Other reasons | 20 (16%) | * |
| Was not aware that it existed | Not asked | * |
*Ns of less than 5 are not shown.
Table 10: Researchers' agreement with types of funding strategies
[ back to report ]
| No. (%) agree or strongly agree | |||
|---|---|---|---|
| In designing strategic research initiatives such as the PPSRI, funding agencies may use different strategies to maximize the chances of significant advancement in knowledge. With respect to the PPSRI, to what extent to do you agree with the following strategies? | Funded applicants, including NPIs (n = 86) |
Unsuccessful applicants (n = 59) |
Non-applicants (n = 12) |
| Funding should ensure that recognized leaders in the targeted research areas can continue to pursue relevant research. | 67 (78%) | 32 (55%) | 7 (58%) |
| Funding should ensure that all researchers who can possibly make a contribution have the opportunity to compete for funds. | 73 (85%) | 51 (86%) | 11 (92%) |
| Funding should concentrate on increasing research capacity by targeting researchers and their trainees who are new to the field. | 41 (48%) | 37 (65%) | 6 (50%) |
Table 11: Program uptake and success rates
[ back to report ]
| Application Deadlines | Funding opportunities | No. of applications received* | No. of applications withdrawn | No. of fundable applications | No. of funded applications | Success rate (%) based on: | |
|---|---|---|---|---|---|---|---|
| Fundable applications | Reviewed applications | ||||||
| Aug 2006 | Pandemic Preparedness Operating Grants Funding Opportunity | 60 | 2 | 28 | 26 | 93 | 45 |
| Aug 2006 | CIHR/ Regional Partnership Program/ Operating Grant: Pandemic Preparedness | 1 | 0 | 1 | 1 ** | 100 | 100 |
| Oct 2006 Dec 2006 |
International Opportunities Program - Collaborative Research Project |
2 | 0 | 1 | 1 | 100 |
50 |
| CIHR International Opportunity Program – Development Planning Grant | 3 | 0 | 1 | 1 | 100 | 33 | |
| CIHR International Opportunity Program – Development Planning Grant | 6 | 0 | 6 | 6 | 100 | 100 | |
| Dec 2006 | Team Grant: Influenza Transmission and Prevention Funding Opportunity | 8 | 3 | 1 | 1 | 100 | 20 |
| Dec 2006 | Workshop/ Symposia Support in collaboration with Knowledge Translation Branch | 1 | 0 | 1 | 1 | 100 | 100 |
| Mar 2007 | Bridge Funding: Pandemic Preparedness Strategic Research Initiative | 3 | 0 | 3 | 3 | 100 |
100 |
| Sept 2007 | 4 | 0 | 2 | 2 | 100 | 50 | |
| Sept 2008 | 1 | 1 | 0 | 0 | 0 | 0 | |
| June 2007 | Knowledge Synthesis Grant | 0 | 0 | 0 | 0 | 0 | - |
| Oct 2008 | 1 | 1 | 0 | 0 | 0 | 0 | |
| July 2007 | Applied Public Health Chairs (relevant to PPSRI) | 3 | 0 | 2 | 2 | 100 | 67 |
| Feb 2008 | Meetings, Planning and Dissemination Grant: End of Grant Knowledge Translation Supplement | 0 | 0 | 0 | 0 | 0 | - |
| June 2008 | 0 | 0 | 0 | 0 | 0 | - | |
| Oct 2008 | 0 | 0 | 0 | 0 | 0 | - | |
| Oct 2007 | Meetings, Planning and Dissemination Grant: Infection and Immunity | 0 | 0 | 0 | 0 | 0 | - |
| Feb 2008 | 0 | 0 | 0 | 0 | 0 | - | |
| June 2008 | 1 | 0 | 1 | 1 | 100 | 100 | |
| Mar 2008 | Operating Grant: Priority Announcement – Pandemic Preparedness – Transmission, Public Health Measures and Compliance | 2 | 0 | 0 | 0 | 0 | 0 |
| Nov 2007 | Operating Grant: Pandemic Preparedness Research - Influenza Diagnostics Transmission, Ethics Review and Antivirals | 9 | 0 | 5 | 5 | 100 | 56 |
| Dec 2007 | Catalyst Grants: Mobilization of the Research Community | 14 | 0 | 5 | 5 | 100 | 36 |
| Jan 2008 | Team Grant: Pandemic Preparedness - Influenza Biology, Vaccines, Ethics, Legal and Social Research | 15 | 0 | 13 | 9 | 69 | 60 |
| Mar 2008 | Partners for Health Systems Improvement Funding Opportunity | 1 | 0 | 1 | 1 | 100 | 100 |
| Mar 2008 | China-Canada Joint Health Research Initiative – Grants Program Funding Opportunity | 3 | 2 | 1 | 1 | 100 | 100 |
| June 2008 | Catalyst Grant: Pandemic Outbreak Team Leader | 3 | 1 | 2 | 2 | 100 | 67 |
| Oct 2008 | Catalyst Grant: Pandemic Preparedness | 7 | 2 | 3 | 3 | 100 | 60 |
| Dec 2008 | Influenza Research Network | 1 | 0 | In peer review | - | - | - |
| Total | 149 | 10 | 77 | 71 | 92% | 51% | |
* For partner-led funding opportunities, # of applications received = # of relevant applications received.
** This grant was successful but funded by another source.
Table 12: Impacts of funded projects on research capacity development, by respondent's research area
[ back to report ]
| No. (%) agree or strongly agree1 | ||||
|---|---|---|---|---|
| Vaccines & immunization/ prevention and treatment (n = 56) |
Virus biology and diagnostics (n = 31) |
Ethical, legal or social aspects (n = 28) |
Total (n = 80) |
|
| Because of the PPSRI, my research work involves researchers from areas or disciplines that were not involved with my work before. | 39 (62%) | 21 (72%) | 16 (57%) | 47 (61%) |
| The PPSRI has contributed to a reorientation of my research focus. | 19 (30%) | 11 (36%) | 8 (29%) | 24 (30%) |
1There is some overlap between the three categories of research area, as respondents were asked to choose all that applied to their work.
Table 13: Number of trainees involved in PPSRI grants
[ back to report ]
| No. (21 grants) | Avg, per grant | Projection to all research grants1 (69) | |
|---|---|---|---|
| Undergraduate students | 14 (range 1 to 5) | 1.25 | 89 |
| Master's students | 11 (range 1 to 3) | .75 | 54 |
| PhD students | 10 (range 1 to 5) | 1.05 | 75 |
| Post-doctoral fellows | 12 (range 1 or 2) | .65 | 46 |
| Other types of trainees (research assistant, technician, clinician-scientist, master's practicum) | 6 (range 1 or 2) | .35 | 25 |
| Total | 53 | 2.5 | 173 |
1Excluding workshops.
Table 14: Role of trainees in funded projects Funded applicants, including NPIs, n = 84)
[ back to report ]
| No. (%) agree or strongly agree | |
|---|---|
| My PPSRI project has included interdisciplinary training for students/fellows. | 47 (64%) |
| My PPSRI project has included mentoring of students/fellows in influenza and pandemic preparedness research. | 54 (73%) |
| My PPSRI project has increased the number of trainees in influenza and pandemic preparedness research. | 49 (68%) |
Table 15: Impacts of funded projects on research capacity development, by respondent's research area
[ back to report ]
| No. (%) agree or strongly agree1 | ||||
|---|---|---|---|---|
| Vaccines & immunization/ prevention and treatment (n = 56) |
Virus biology and diagnostics (n = 31) |
Ethical, legal or social aspects (n = 28) |
Total (n = 80) |
|
| The PPSRI has helped me/my team network with other researchers involved in influenza and pandemic preparedness research. | 51 (81%) | 25 (83%) | 17 (62%) | 60 (78%) |
| The PPSRI has helped me/my team collaborate with other researchers involved in influenza and pandemic preparedness research. | 45 (71%) | 23 (73%) | 17 (63%) | 54 (70%) |
| The PPSRI has helped me/my team involve international research collaborators. | 15 (24%) | 8 (28%) | 7 (25%) | 21 (27%) |
1There is some overlap between the three categories of research area, as respondents were asked to choose all that applied to their work.
Table 16: Knowledge translation in PPSRI projects (No. (%) agree or strongly agree)
[ back to report ]
| Vaccines & immunization/ prevention and treatment (n = 62) |
Virus biology and diagnostics (n = 31) |
Ethical, legal or social aspects (n = 28) |
Total1 (n = 80) |
|
|---|---|---|---|---|
| Research users are currently involved in my PPSRI project. | 38 (59%) | 15 (48%) | 19 (68%) | 47 (66%) |
| Research users will eventually become involved in my PPSRI project. | 12 (24%) | 8 (26%) |
* | 14 (21%) |
| My PPSRI project has a knowledge translation plan in place. | 40 (68%) | 18 (58%) | 23 (82%) | 53 (73%) |
1There is some overlap between the three categories of research area, as respondents were asked to choose all that applied to their work.
*Ns of less than 5 are not shown.
[ next section ]
Supplemental content (right column)
- Modified: