Current evaluations and reviews
- Evaluation of Bsafe – a Crime Prevention project that is helping to keep women at severe risk of family violence safe. Evolving Ways is helping to strengthen the evaluation capacity of the project coordinator through the provision of evaluation coaching and mentoring over the life of the project. This involves: clarifying the program logic of the project; facilitation and periodic review of the evaluation plan; support in the design of evaluation tools; facilitation of reflective workshops with stakeholders; and support and advice in regard to analysis and reporting findings.
- Evaluation of Engagement Strategy – Northern Region Sustainable Water Strategy: Commissioned by the Department of Sustainability and Environment’s Office of Water, this evaluation is assessing the effectiveness of the community engagement and consultation process to assist with the process of the Northern Region Sustainable Water Strategy. The evaluation involves three iterations of interviews with stakeholders and the conduct of two case studies. Evaluation mentoring support is also being provided to the Project Officer to better enable the internal components of the overall evaluation framework.
- Evaluation of Industry Development Unit (IDU), Tasmanian Council of Social Services –a longitudinal evaluation of the effectiveness of the IDU in supporting community service organisations to strengthen their capacity to deliver quality services to achieve better outcomes for disadvantaged Tasmanians.
Completed evaluations and reviews
- Evaluation of Armidale Street Beat, a crime prevention project working with young people at risk of antisocial or crime-related activities, by engaging with and encouraging them to access support services and participate in positive environments. The evaluation focuses on impact and on the reflection of key stakeholders on processes and outcomes.
- Development of a monitoring and evaluation framework for Ministry of Education, Afghanistan. This AusAID-funded project helped to strengthen the capacity of Afghan counterparts in the design and processes of monitoring and evaluation. The framework provided the Ministry of Education with a Ministry-wide approach to reporting on progress and the results of its National Education Strategic Plan. As well as helping to improve existing implementation monitoring, the framework introduced a move towards monitoring and evaluating results. A set of Ministry-wide outcome results and indicators were established. A staged approach to implementation of the framework was outlined. The project also identified strategies for strengthening monitoring and evaluation capacity within the Ministry.
- Review of Fire Ready Victoria: This review was commissioned by the Country Fire Authority (CFA) and the Department of Sustainability (DSE). A whole of government strategy, Fire Ready Victoria (FRV), aims to increase the preparedness of Victorians and travellers to the state in the event of a bushfire. The review involved three aspects: determining the extent of achievement of the strategy’s objectives; identifying future improvements; and recommending future evaluation processes. Stakeholders from a diverse range of departments and agencies were positively engaged. A final workshop with stakeholders helped achieve widespread ownership and understanding of the review findings and recommendations.
- Evaluation of two “whole-of-government” strategies for the Department of Premier and Cabinet, Tasmania. Both evaluations consisted of several individual project evaluations and an overall strategy evaluation. One was conducted over 3 years and the other over 2 years, over three iterations. The evaluations were framed within a program logic approach. Through the use of a range of consultation methods, including workshops, narrative case studies, photo experiences, a diverse range of stakeholders were actively involved. The findings helped to inform future direction of the projects and the overall strategies.
- Review of non-educational supports needs of people with a disability in the VET system. This project was conducted for the Department of Education and Training, W.A. It sought improved ways for people with a disability and high support needs to access VET. The project involved extensive consultation with different layers of the education system, people with disabilities and their families and the non-government sector.
- Evaluation of the Victorian Homelessness Strategy (VHS) Pilot and Related Projects. These were 5 statewide evaluations, each with multiple service providers across the state. The evaluations assessed the effectiveness of the implementation and the impact of the projects. The findings were used to help inform government.
- Review of Problem Gambling Services in Tasmania: Evaluation of the (then current) Break Even Gambling Support Services, which were delivered by community sector organisations. Extensive consultation process was undertaken with service providers and problem gamblers and their families. Consultation with problem gamblers included: phone interviews using a Freecall number (invitation to participate occurred through public advertisement in local papers and information in gambling support agencies and gambling venues); face-to-face interviews arranged through each of the funded services; forums with problem gamblers’ groups; and being available at support services for informal discussion with gamblers. A report was presented with recommendations for an improved future service model.
- Review of SAAP IV for the Department of Health and Human Services, Tasmania. This review assessed the effectiveness of the implementation of the state’s SAAP IV. It reviewed each of the state’s separate SAAP components. Consultation occurred with a diverse range of stakeholders including each of the agencies funded to operate the various program components. The findings were used by the government as a base for negotiation with the Commonwealth for SAAP V.
- Evaluation of six capacity-building projects conducted by East Gippsland Primary Care Partnership (PCP) in Victoria. This project took a capacity-building approach to the evaluation, working with PCP and project staff to enhance their evaluation skills whilst evaluating their current projects. Two of these projects were working with Indigenous communities.
- Multidimensional reviews of several disability services for Disability Services, DHS. These reviews incorporated service provision, governance and financial aspects. We assessed each service against the Victorian Disability Standards and within the framework of the State Plan. Methods included file audits, consideration of agency documents and client plans, and consultation with agency staff, DHS, families and users of the services. A range of consultation techniques was used, especially with staff, families and service users.
- Evaluation of the Family Options program for Disability Services, Department of Human Services (DHS). This was a three year, state-wide project, taking an action research approach to inform the implementation of the program, which had been developed to help address critical service and support issues for children with complex needs. Methodology included longitudinal case studies of a sample of clients and their birth and alternative families.
- Review of SAAP services for youth in the South Burnett area of Queensland. This project involved extensive consultation with service providers and young people across the catchment. Strategies to engage young people were developed in consultation with workers, service providers and some young people who used the service. Engagement techniques included group discussions with students at various schools, one-on-one interviews with young people in youth-friendly locations such as youth cafes and skate parks, forums with people during existing programs, informal discussions over coffee at youth refuge.
- Review of HACC services undertaken for the Mitchell Shire. Service improvements were identified, including greater integration with other aged care services operated by Council and other service providers. An action plan was developed.
- Review of Mental Health Services in North East Victoria. This project investigated and recommend future service management focused on the clinical and community-based mental health services in north east Victoria. Extensive consultation was undertaken with clinical mental health staff, community service organisations operating psycho-social services, departmental managers, consumers and carers. The recommended service delivery model focused on integration of services and achieving improved consumer outcomes. It made recommendations about clinical authority, ways to effectively target services, equitable resource distribution, and directions based on current good practice.
- Barriers to SAAP Services. Housing Tasmania commissioned a research project to explore the extent, context, and implications of barriers to access to Supported Accommodation Assistance Program (SAAP) services. The study involved extensive consultation with service providers and consumers.
Organisational Reviews
- Organisational Review of Carpentaria Disability Services (CDS) in Northern Territory. CDS is a major provider of services to people with a disability. The review was undertaken in consultation with key stakeholder groups across NT locations (Darwin, Katherine and Alice Springs). A series of interactive workshops were conducted with key stakeholders after the initial consultations and data collection. These were used to seek feedback on preliminary findings and enable participation in the development of possible solutions to identified issues. An implementation plan was provided as part of the final report.
- Organisational review Bellarine Community Health (BCH) Service. BCH is a major provider of community-based primary health and aged residential services on the Bellarine Peninsula in Victoria. These services are provided over several campuses. The review focused on: the appropriateness of existing organisational structure; the skills and competencies of the workforce to achieve best practice; the balance of full time and part time staff; the effectiveness of communication and team function across all sites; and accountability, supervision and reporting requirements. Extensive consultation occurred with managers, staff, service users and other service providers.
- Organisational review of Glenview Community Care (GCC). GCC is a major community-based primary health and aged residential services in North East Victoria. The review focused on areas of governance, finance, organisational structure, team function, communication, accountability, supervision, and reporting arrangements. Extensive consultation occurred with the Board, managers, staff, service users, the funding body, and the broader community. An implementation plan was developed.
- Organisational review of Upper Murray Family Care (UMFC). UMFC is a major provider of family support services (including foster care, financial service, legal services, and disability services) in North East Victoria and Southern NSW. The review focused on areas of governance, finance, organisational structure, team function, communication, accountability, supervision, and reporting arrangements. Extensive consultation occurred with the Board, managers and staff. A new organisational structure and its implications were developed collaboratively with managers and staff via a series of workshops.
- Review of the Organisational Structure of Deniliquin Council for Social Development. This review proposed improved structural arrangements for the organisation and developed an implementation plan for achieving the recommendations.
|
