Appendix D. Copy of Interview Guide for Funding Agencies Managers/Staff
Funding Agency Interview
This interview is about the CRRAFT application you recently started using. This interview is being conducted as part of a national study of the CRRAFT System. This national study, which is an independent evaluation, is investigating the extent to which the goals of the CRRAFT System can be met and is documenting the best practices in deploying and operating such systems.
Before beginning the interview, we want to thank you for taking the time to speak with us. It should only take about 15 minutes to complete, and your feedback will be an important part of the CRRAFT evaluation. We are interested in knowing what you think is working well with CRRAFT, what needs improvement, and what other functions would be useful additions to CRRAFT.
The interview begins with a series of questions about how CRRAFT has affected your day-to-day operations - has CRRAFT made it easier or harder for you to do your job. The interview ends with the chance for you to give your overall feedback on CRRAFT and to make suggestions for how it could be improved.
All responses will be kept strictly confidential, and results will be reported in summary form only. If you have any questions, please contact Bob Sanchez of SAIC at (xxx) xxx-xxxx.
1. To what extent do you think the CRRAFT system affects the time you spend reviewing and verifying the monthly invoices and reports that are submitted by transportation providers? (mark one answer)
____It takes a lot longer with CRRAFT
____It take a little bit longer with CRRAFT
____The time required is about the same with and without CRRAFT
____It takes a little bit less time with CRRAFT
____It takes a lot less time with CRRAFT
[Ask only if the previous response was takes a little or a lot less time]
1a. About how much time (in hours) does CRRAFT save each month?____hours per month
2. To what extent do you think the CRRAFT system affects whether these monthly invoices and reports are submitted by the submission dates? (mark one answer)
____With CRRAFT, a lot fewer reports are submitted by the submission
date
____With CRRAFT, fewer reports are submitted by the submission date
____There has been little change
____With CRRAFT, more reports are submitted by the submission date
____With CRRAFT, a lot more reports are submitted by the submission date
2a. About what percentage of these reports were submitted by the submission date before and after CRRAFT?
Before CRRAFT, reports were submitted on time about____% of the time
After CRRAFT, reports were submitted on time about____% of the time
3. To what extent do you think the CRRAFT system affects the accuracy of the monthly reports that are submitted? (mark one answer)
____A lot less accurate with CRRAFT
____A little less accurate with CRRAFT
____About the same
____A little more accurate with CRRAFT
____A lot more accurate with CRRAFT
3a. What percentage of the time, before and after CRRAFT, did submitted reports require later revisions to correct problems with the reports?
Before CRRAFT, reports required corrections about____% of the time
After CRRAFT, reports required corrections about____% of the time
3b. How much time, before and after CRRAFT, did you spend per month checking and correcting reports?
Before CRRAFT, I spent____hours per month
After CRRAFT, I spent____hours per month
4. How many unauthorized trips per month do you think were made by transportation providers before and after CRRAFT?
Before CRRAFT, the number of unauthorized trips was____trips per
month
After CRRAFT, the number of unauthorized trips was____trips per month
5. To what extent do you think the CRRAFT system has affected the level of communication between your agency and the transit service providers? (mark one answer)
____CRRAFT results in a lot worse communication
____CRRAFT results in worse communication
____CRRAFT has no significant effect on the extent of communication
____CRRAFT results in better communication
____CRRAFT results in a lot better communication
6. To what extent do you think the CRRAFT system has affected the level of coordination between human service transportation providers? (mark one answer)
____CRRAFT results in a lot worse coordination
____CRRAFT results in worse coordination
____CRRAFT has no significant effect on the level of coordination
____CRRAFT results in better coordination
____CRRAFT results in a lot better coordination
7. What is your overall opinion of CRRAFT? (mark one answer)
____CRRAFT has been very unsuccessful - the costs far outweigh the
benefits
____CRRAFT has been unsuccessful - the costs outweigh the benefits
____CRRAFT has been neither particularly successful or unsuccessful
____CRRAFT has been successful - the benefits outweigh the costs
____CRRAFT has been very successful - the benefits far outweigh the costs
8. What three features of CRRAFT do you find most useful? (Number the three most useful features 1, 2, and 3 with 1 being the most useful)
| Rank | Feature |
|---|---|
| Features for tracking ridership | |
| Features for generating reports | |
| Supporting audit activities | |
| Other: | |
| Other: | |
| Other: |
9. What other features would you most like to see added to CRRAFT?
10. Are there any features of CRRAFT that you would like to see improved or changed? Please explain.
Thanks again for your participation!