Cojocaru, Stefan, 2010, Evaluarea programelor de asistenta sociala, Iasi: Polirom.
ISBN: 978-973-46-1485-1, 264 p., 160×235.
Introducere
Am scris aceasta carte cu convigerea ca este necesara si cu speranta ca va deschide o cale pentru dezvoltarea domeniului evaluarii programelor si serviciilor sociale din Romania. Sunt convins ca este necesara datorita nivelului sarac de publicatii in domeniul acesta si, mai ales, stadiului precar si haotic de aplicare a evaluarii programelor in Romania. Din pacate, in Romania se pune accent in mod deosebit pe monitorizarea programelor, in sensul masurarii actiunilor, a indicatorilor intermediari (outputs) si verificarii permanente a indicatorilor de implementare. Este imperios necesara, dupa parerea mea, dezvoltarea evaluarii programelor in sensul masurarii efectelor, rezultatelor (outcomes) pe care le au acestea asupra grupurilor tinta carora le sunt adresate; evaluarile de impact reprezinta nu doar o forma de masurare a eficientei si eficacitatii programului, ci si o modalitate de imbunatatire a acestora si pentru oferirea unor informatii utile in luarea deciziilor privind politicile publice si alocarea resurselor. Acest lucru nu se datoreaza faptului ca organizatiile implementatoare (guvernamentale si nonguvernamentale) nu valorizeaza astfel de evaluari, ci, in primul rand, omiterii din criteriile de alocare a fondurilor pe diferite proiecte de finantare a activitatii de evaluare; astfel, daca finantatorii nu solicita acest lucru in mod explicit, cu atat mai mult organizatiile solicitante nu introduc astfel de activitati ca etape cheie in derularea programului. Din punctul nostru de vedere, calitatea slaba a serviciilor sociale, medicale si educationale din Romania este si un rezultat al inexistentei practicii evaluarii programelor si serviciilor. Statul, ca principal finantator al acestor tipuri de servicii trebuie sa incurajeze, sa sustina si sa conditioneze alocarea resurselor financiare de includerea evaluarii ca practica generalizata in cadrul serviciilor pe care le finanteaza si sa reglementeze forma prin care aceasta etapa de implementare a programului poate fi bugetata; in multe dintre statele dezvoltate, institutiile publice sunt obligate sa aloce intre 5 si 7 % din bugetul serviciilor pentru evaluarea acestora, aceasta nefiind considerata o cheltuiala in plus, ci mai degraba o forma de cercetare prin care se economisesc resursele. Optimismul personal privind reglementarea domeniului evaluarii programelor si serviciilor publice este alimentat de nevoia de gestionare eficienta a resurselor si mai ales de manifestarea unor restrictii financiare privind implementarea unor noi programe; in ultimii douazeci de ani, in Romania s-au dezvoltat serviciile si, concomitent cu acestea, cheltuielile anuale sunt din ce in ce mai mari, chiar daca calitatea acestor servicii nu s-a imbunatatit in mod semnificativ.
Volumul de fata nu este destinat sa umple un gol in literatura de specialitate din Romania si in practica evaluarii programelor, ci este mai degraba este o modesta caramida pusa in constructia acestui nou domeniu de cercetare; decat sa ne concentram pe ceea ce nu exista, mai constructiv este sa vedem ce avantaje prezinta dezvoltarea domeniului: imbunatatirea programelor si serviciilor sociale, asigurarii informatiilor relevante pentru replicarea, multiplicarea sau inchiderea unor programe, oferirea unor informatii utile pentru redistribuirea si reducerea costurilor, identificarea celor mai eficiente forme de interventie, asigurarea unor date utile si necesare pentru elaborarea politicilor publice pornind de la evidente, legitimarea actiunilor si politicilor publice, dezvoltarea cunoasterii si clarificarea unor programe, adaptarea programelor si serviciilor la nevoile si interesele beneficiarilor, flexibilizarea diferitelor servicii etc.
Recunostinta mea se indreapta spre cateva persoane, care au contribuit in mod esential asupra dezvoltarii carierei mele profesionale in domeniul cercetarii sociologice, evaluarii programelor si managementului proiectelor: domnilor profesori Vasile Miftode si Ioan Marginean, metodologici recunoscuti si persoane remarcabile cu o generozitate rar intalnita, care mi-au oferit oportunitati extraordinare de a lucra impreuna in diferite cercetari si evaluari de programe, domnului profesor Pintilii Penciuc care m-a sprijinit in dezvoltarea competentelor in domeniul protectiei copilului si elaborarii de proiecte sociale, oferindu-mi primul loc de munca in Centrul de Plasament „Bucium”, doamnei profesor Elisabeta Stanciulescu, pentru insistenta didactica de a ne modela in spirit analitic si de a ne invata sa formulam cele mai adecvate intrebari, doamnelor Tania Goldner, Voica Pop si Dana Petcovici, pentru daruirea cu care se implica in orice program social destinat copiilor si parintilor si pentru modelele pe care mi le-au oferit in ceea ce priveste pasiunea pentru lucrul bine facut, domnului Eugen Crai, pentru deschiderea catre noi oportunitati de dezvoltare a serviciilor sociale si incurajarea aplicarii ideilor inovative. Vreau sa le multumesc studentilor si masteranzilor mei, care sunt permanent o sursa de inspiratie si dezbatere, care contribuie semnificativ la crearea unui mediu de invatare stimulativ si provocator.
Le multumesc, si pe aceasta cale, organizatiilor guvernamentale, nonguvernamentale si internationale, care m-au sprijinit in dezvoltarea mea profesionala in domeniul evaluarii programelor si mi-au oferit oportunitatea de evalua o serie programe derulate la nivel national si local, de a exersa diferite strategii de evaluare, de a fructifica pregatirea academica personala de sociolog si experienta practica in domeniul managementului si implementarii programelor de asistenta sociala: Autoritatii Nationale pentru Protectia Drepturilor Copilului, Oficiului Roman pentru Adoptii, celor 47 de Directii Generale de Asistenta Sociala si Protectia Copilului, Agentiei Statelor Unite pentru Dezvoltare Internationala, Programul Natiunilor Unite pentru Dezvoltare, Reprezentantei Unicef in Romania, World Learning, Agentiei Suediei pentru Dezvoltare Internationala, Agentiei Marii Britanii pentru Dezvoltare Internationala, Holt International Children’s Services, SOS Satele Copiilor, Star of Hope Romania, Caritas si Holt Romania. Le multumesc, totodata, colegilor de la Case Western University din Cleveland, Ohio si celor din American Evaluation Association, care mi-au oferit oportunitati de documentare si consolidare a cunostintelor si competentelor in evaluarea programelor.
Stefan Cojocaru, Iasi, noiembrie 2009
Hot to cite: Cojocaru, S. (2010). Evaluarea programelor de asistenta sociala, Iasi: Polirom.
References
Abma, T., 2006, “The practice and politics of responsive evaluation”, American journal of evaluation, vol. 27, pp. 31-43.
Abma, T., Stake, R., 2001, „Stake’s responsive evaluation: core ideas and evolution”, New directions for evaluation, 92, pp. 7-21.
Bamberg, M., 2000, „The evaluation of international development programs: a view from the front”, American journal of evaluation, 21 (1), pp. 95-102.
Banaga, G., 1998, „A spiritual path to organizational renewal”, în Hammond, S., Royal, C., Lessons from the field: applzing appreciative inquiry, Practical Press, Plano.
Barrington, G., 2006, „The evaluation consultant’s lige cycle: theory, practice and implication for learning”, New directions for evaluation, vol. 111, pp. 29-40.
Barth, M.C., 2004, “A low-cost, post hoc method to rate overall site quality in multi-site demonstration”, American journal of evaluation, 25 (1), pp. 79-97.
Beaves, R., Joseph, H., Rohrer, J., Zeitler, R., 1988, „Cost-effectiveness: how should it be determined”, Evaluation and the health professions, vol. 11(2), pp. 213-230.
Bickman, L., 1987, „The functions of program theory”, New directions for evaluation, vol. 33, pp. 5-18.
Bickman, L., Person, K., 1990, „Using program theory to describe and measure program quality”, New directions for evaluation, vol. 47, pp. 61-72.
Biklen, S.K., Bogdan, R., 1986, “On your own with naturalistic evaluation”, New directions for program evaluation, vol. 30, pp. 93-101.
Birckmayer, J.D., Weiss, C.H., 2000, “Theory-based evaluation in practice: what do we learn?”, Evaluation review, 24 (4), pp. 407-431.
Blanchet, A., Gotman, A., 1998, „Interviul de producere a datelor”, De Singly, F., Blanchet, A., Gotman, A., Kaufmann, J.C., Ancheta şi metodele ei. Chestionarul, interviul de producere a datelor, interviul comprehensiv, Polirom, Iaşi, pp. 111-200.
Bledsoe, K., Graham, J., 2005, „The use of multiple evaluation approaches in program evaluation”, American journal of evaluation, 26, pp. 302-319.
Bonnet, D., 2006, „Independent consulting and the American Evaluation Association: twenty years later”, New directions for evaluation, vol. 111, pp. 5-8.
Brisolara, S., 1998, „The history of participatory evaluation and current debates in the field”, New directions for evaluation, vol. 80, pp. 25-41.
Browne, A., Wildavsky, A., 1983, “Should evaluation become implementation”, New directions for program evaluation, vol. 20, pp. 101-103.
Burke, B., 1998, „Evaluating for a change: reflections on participatory methodology”, New directions for evaluation, vol. 80, pp. 43-56.
Byng, R., Norman, I., Redfern, S., 2005, „Using realistic evaluation to evaluate a practice-level intervention to improve primary healthcare for patients with long/term mental illness”, Evaluation, vol. 11(1), pp. 69-93.
Campbell, D., 1986, „Relabeling internal and external validity for applied social scientist”, New directions for program evaluation, vol. 31, pp. 67-77.
Caracelli, V., Greene, J., 1997, “Crafting mixed-method evaluation design”, New directions for evaluation, vol. 74, pp. 19-32.
Carvalho, S., White, H., 2004, „Theory-based evaluation: the case of social funds”, American journal of evaluation, 25(2), pp. 141-160.
Chambers, R., 1997, Whose reality counts? Putting the first last, Intermediate Technology Publications, London.
Chelcea, S., 1975, Chestionarul în invesigaţia sociologică,Editura Ştiinţifică şi Enciclopedică, Bucureşti.
Chelcea, S., 2001, Metodologia cercetării sociologice. Metode cantitative şi calitative, Editura Economică, Bucureşti.
Chelimsky, E., 1978, “Differing perspectives of evaluation”, în Rentz, C. C. şi Rentz, R. R. (eds.), Evaluating Federally sponsored programs: new directions for program evaluation 2, pp. 19-38, Jossey-Bass, San Francisco.
Chelimsky, E., 1986, „What have we learned about the politics of program evaluation”, evaluation practice, vol. 8(1), pp. 5-21.
Chelimsky, E., 1987, „The politics of program evaluation”, New directions for program evaluation, vol. 34, pp. 5-21.
Chen, H., 1997, “Applying mixed methods under the framework of theory-driven evaluations”, New directions for evaluation, vol. 74, pp. 61-72.
Chen, H.T., 1990a, Theory-driven evaluation, Sage Publications, Thousand Oaks.
Chen, H.T., 1990b, „Issues in constructing program theory”, New directions for evaluation, vol. 47, pp. 7-18.
Chen, H.T., 1994a, „Theory-driven evaluations: need, difficulties, and options”, American journal of evaluation, 15(1), pp. 79-82.
Chen, H.T., 1994b, „Curent trends and future directions in program evaluation”, American journal of evaluation, 15(3), pp. 229-238.
Chen, H.T., 2005, Practical program evaluation. Assessing and improving planning, implementation and effectiveness, Sage Publications, Thousand Oaks, California.
Chen, H.T., Rossi, P.H., 1983, “Evaluating with sense: the theory-driven evaluation”, Evaluation Review, vol. 7, pp.283-302.
Clifford, D., Sherman, P., 1983, “Internal evaluation: integrating program evaluation and management”, New directions for program evaluation, vol. 20, pp. 23-45.
Cockerill, R., Myers, T., Allman, D., 2000, „Planning for community-based evaluation”, American journal of evaluation, 21 (3), pp. 351-357.
Coghlan, A., Preskill, H., Tzavaras Catsambas, T., 2003, „An overview of appreciative inquiry in evaluation”, New directions for evaluation, pp.. 5-22.
Cojocaru D., 2003, „Focus grupul – tehnică de cercetare a socialului”, Revista de cercetare şi intervenţie socială, vol. 1, pp.89-93.
Cojocaru, D., 2008, Copilăria şi construcţia parentalităţii. Asistenţa maternală în România, Polirom, Iaşi.
Cojocaru, Ş, 2007b, „Strategii de eşantionare cantitativă în procesul de evaluare a programelor” Revista de cercetare şi intervenţie socială, vol. 19, pp. 115-127.
Cojocaru, Ş, 2009, „Clarifying the theory-based evaluation”, Revista de cercetare şi intervenţie socială, vol. 26, pp. 76-86.
Cojocaru, Ş., 2005a, Metode apreciative în asistenţa socială. Ancheta, supervizarea şi managementul de caz, Polirom, Iaşi.
Cojocaru, Ş., 2005b, „Focus grupul – tehnică utilizată pentru evaluarea nevoilor din comunitate”, Revista de cercetare şi intervenţie socială, vol. 8, pp. 1134-1142
Cojocaru, Ş., 2006, Proiectul de intervenţie în asistenţa socială. De la propunerea de finanţare la planurile individualizate de intervenţie, Polirom, Iaşi.
Cojocaru, Ş., 2007a, „Strategii de construire a eşantionelor calitative utilizate în evaluarea programelor”, Revista de cercetare şi intervenţie socialî, vol. 16, pp. 138-151.
Coleman, H., Unrau, Y, 1996/2005, „Faza 3: Analiza informaţiilor culese”, în Tutty, L.M., Rothery, M.A., Grinnell. R.M.Jr., Cercetarea calitativă în asistenţa socială. Faze, etape şi sarcini, Polirom, Iaşi, pp. 95-123.
Conner, R., 1980, „Ethical issues in the use of control groups”, New directions for program evaluation, vol. 7, pp. 63-75.
Conrad, K, Buelow, J., 1990, „Developing and testing program classification and function theories”, New directions for evaluation, vol. 47, pp. 73-91.
Conrad, K., Conrad, K, 1994, „Reassesing validity threats in experiments: focus on construct validity”, New directions for program evaluation,vol. 63, pp. 5-25.
Conrad, K., Miller, T., 1987, „Measuring and testing program philosophy”, New directions for evaluation, vol. 33, pp. 19-42.
Cook, T., 1993, „A quasi-sampling theory of the generalization of causal relationships”, New directions for program evaluation, vol. 57, pp. 39-82.
Cook, T., 2000, „The false choice between theory-based evaluation and experimentation”, New directions for evaluation, vol. 87, pp. 27-34.
Cook, T., Campbell, D., 1979, Quasi-experimentation: design and analysis isuues for field settings, Houghton Mifflin, Boston.
Cook, T., Shadish, W.Jr., 1982, „Metaevaluation: an evaluation of the congressionaly mandated evaluation szstem for community mental health centers”, în Stahler, G., Tash, W., Innovative approaches to mental health evaluation, Academic Press, Orlando.
Cooksy, L., 2000, „Commentary: auditing the off-the-record case”, American journal of evaluation, 21(1), pp. 122-128.
Cooksy, L.J., Gill, P., Kelly, P.A., 2001, „The program logic model as an integrative framework for a multimethod evaluation”, Evaluation and program planning, vol. 24, pp. 119-128.
Cooperrider, D, 2007, An appreciative interview with Peter Drucker, http://appreciativeinquiry.case.edu/uploads/ACF13FB.doc, septembrie.
Cordray, D., 1986, „Quasi-experimental analysis: a mixture of methods and judgment”, New directions for program evaluation, vol. 31, pp. 9-27.
Cottingham, P., 1991, „Unexpected lessons: evaluation of job-training programs for single mothers”, New directions for program evaluation, vol. 50, pp. 59-70.
Coupal. F., Simoneau, M., 1998, „A case study of participatory evaluation in Haiti”, New directions for evaluation, vol. 80, pp. 69-79.
Cousins, J., 2003, „Utilization effects of participatory evaluation”, în Kellaghan, T., Stufflebeam, D., International handbook of educational evaluation, Kluwer, Norwell.
Cousins, J., Whitmore, E., 1998, „Framing participatory evaluation”, New directions for evaluation, vol. 80, pp. 5-23.
Cronbach, L, 1982, Designing evaluations of educational and social programs, Jossey-Bass, San Francisco.
Crowley, K.M., Yu, P., Kaftarian, S.J., 2000, “Prevention actions and activities make a difference: a structural equation model of coalition building”, Evaluation and Program Planning, vol. 23, pp. 381-388.
Cummings, O., Nowakowski, J., Schwandt, T., Eichelberger, T., Kleist, K., Larson, C., Knott, T., 1988, „Business perspectives on internal/external evaluation”, New directions for evaluation, vol. 39, pp. 59-74.
Daigneault, P.M., Jacob, S., 2009, „Toward accurate measurement of participation: rethinking the conceptualization and operationaliyation of participatory evaluation”, American journal of evaluation, vol. 30, pp. 330-348.
Datta, L., 1997, “A pragmatic basis for mixed-method design”, New directions for evaluation, vol. 74, pp. 33-46.
Datta, L.E., 1994, “Paradigm wars: a basis for peaceful coexistance and beyond”, New directions for program evaluation, vol. 61, pp. 53-70.
Davidson, J., 2000, „Ascertaining causality in theory-based evaluation”, New directions for evaluation, vol. 87, pp. 17-26.
Dennis, M., Boruch, R., 1994, „Improving the quality of randomized field experiments: tricks of the trade”, New directions for program evaluation,vol. 63, pp. 87-101.
Denzin, N.K., 1978, The research act: a theoretical introduction to sociological methods, second edition, McGraw – Hill, NewYork.
Devine, J., Wright, J., Joyner, L., 1994, „Isuues in implementing a randomized experiment in a flield setting”, New directions for program evaluation,vol. 63, pp. 27-40.
Doherty, J.E, Rispel, L.C, 1995, „From conflict to cohesion: involving stakeholders in policy research”, Evaluation and program planning, vol. 18, no. 4, pp. 409-415.
Fetterman, D., 1984, Ethnography in educational evaluation, Sage Publications, Beverly Hills, California.
Fetterman, D., 1986, „Conceptual crossroads: methods and ethics in ethnographic evaluation”, New directions for evaluation, vol. 30, pp. 23-36.
Fetterman, D., 1994, „Keeping research on track”, New directions for program evaluation,vol. 63, pp. 103-105.
Fitz-Gibbon, T.C., Lyons Morris, L., 1996, „Theory-based evaluation”, American journal of evaluation, 17(2), pp. 177-184.
Flaherty, D., 1978, „The Bellagio conference on privacy, confidentiality, and use of government microdata”, New directions for program evaluation, vol. 4, pp. 19-27.
Ford, S., 1987, „Getting mileage out of one naturalistic inquiry”, American journal of evaluation, vol. 8, pp. 12-20.
Frechtling, J., Sharp, L., 1997, User-friendly handbook for mixed method evaluation, National Science Foundation, Division of Research, Evaluation and Communication.
Freedman, J., 1991, „Multisite evaluations of helth care policies and programs”, New directions for program evaluation, vol. 50, pp. 97-107.
Funnell, S., 2000, „Developing and using a program theory matrix for program evaluation and performance monitoring”, New directions for evaluation, vol. 87, pp. 91-101.
Gaventa, J., Creed, V., Morrisey, J, 1998, „Scaling up: participatorz monitoring and evaluation of a federal empowerment program”, New directions for evaluation, vol. 80, pp. 81-94.
Gergen, K., 1999, An invitation to social construction, Sage, Thousand Oaks, California.
Ginsburg, A., Rhett, N., 2003, „Building a better body of evidence: new opportunities to strenghen evaluation utilization”, American journal of evaluation, vol. 24(4), pp. 489-498.
Glaser, B., Strauss, A., 1967, The discovery of grounded theory, Aldine Publishing, Chicago.
Greene, J, 2006, „Stakeholders”, in Mathison, S., Encyclopedia of evaluation, Sage Publication, Thousand Oaks, California, pp. 397-398.
Greene, J., Caracelli, V., 1997, „Defining and describing the paradigm issue in mixed-method evaluation”, New directions for evaluation, vol. 74, pp. 5-17.
Greene, J., Caracelli, V., Graham, W., 1989, „Toward a conceptual framework mixed-method evaluation design”, Educational evaluation and policy analysis, vol. 11, pp. 255-274.
Grinnell, R., Jr., Unrau, Y., 2008, Social work research and evaluation. Foundations of evidence-based practice, Oxford University Press, New York.
Grinnell, R., Jr., Unrau, Y., Gabor, P., 2008a, „Program evaluation”, în Grinnell, R., Jr., Unrau, Y., Social work research and evaluation. Foundations of evidence-based practice, Oxford University Press, New York, pp. 527-536.
Grinnell, R.Jr., Unrau, Y., Williams, M., 2008b, „Group-level designs”, Social work research and evaluation. Foundations of evidence-based practice, Oxford University Press, New York, pp. 180-204.
Guastello, S., Guastello, D., 1991, „How organizations differ: implications for multisite program evaluation”, New directions for program evaluation, vol. 50, pp. 71-81.
Guba, E., 1987, „What hane we learned about naturalistic evaluation”, American journal of evaluation, vol. 8, pp. 23-43.
Guba, E., Lincoln, Y., 1989, Fourth generation evaluation, Sage, Thousand Oaks, California.
Guba, E.G., 1981, „Criteria for assesing the trustworthiness of naturalistic inquiry”, Educational communication and technology journal, vol. 29, pp. 75-91.
Hacsi, T., 2000, „Using program theory to replicate succesful programs”, New directions for evaluation, vol. 87, pp. 71-78.
Hahn, T., Lavery, T., Stevenson, P., 2006, Enhancing and evaluating local juvenile justice szstems in Illinois: an evaluation manual, http://www.jrsa.org/jjec/state_info/reports/illinois-evaluation-manual.pdf, decembrie 2006.
Hakes, J.E., 2001, „Can measuring results produce result: one manager’s view”, Evaluation and program planning, vol. 24, pp. 319-327.
Hamel, J, 2001, „The focus group method and contemporary French sociology”, Journal of sociology, vol. 37(4), pp. 341-353.
Hébert, Y., 1986, „Naturalistic evaluation in practice: a case study”, New directions for evaluation, vol. 30, pp. 3-21.
Hedrick, S., Sullivan, J., Ehreth, J., Rothman, M., Connis, R., Erdly, W., 1991, „Centralized versus decentralized coordination in the adult day health care evaluation study”, New directions for program evaluation, vol. 50, pp. 19-31.
Hedrick, T., 1994, „The quatitative-qualitative debate: posibilities for integration”, New directions for program evaluation, vol. 61, pp. 45-52.
Hellström, T., Jacob, M., 2003, “Knowledge without goals? Evaluation of knowledge management programmes”, Evaluation, vol. 9, pp. 55-72.
Hembroff, L., Perlstadt, H., Henry, R., Hogan, A., Weissert, C., Bland, C., Harris, D., Knott, J., Starnaman, S., 1999, „When (not if) evaluation flexibility is desirable: examples from the CPHPE initiative”, Evaluation and the health professions, vol. 22, pp. 325-341.
Holosko, M., 2008, „Evaluating quantitative reseach studies”, în Grinnell, R., Jr., Unrau, Y., Social work research and evaluation. Foundations of evidence-based practice, Oxford University Press, New York, pp. 423-444.
House, E., 1986, „Internal evaluation”, American journal of evaluation, vol.7, pp. 63-64.
House, E., 1994, „The future perfect of evaluation”, American journal of evaluation, vol 15, pp. 239-247.
House, E., 2001, „Resposive evaluation (and its influence on deliberative democratic evaluation”, New directions for evaluation, nr. 92, pp. 23-30.
House, R., 1994, “Integrating the quantitative and qualitative”, New directions for program evaluation, vol. 61, pp. 13-22.
Huebner, T., 2000, „Theory-based evaluation: gaining a shared understanding between school staff and evaluators”, New directions for evaluation, vol. 87, pp. 79-89.
Hunter, J., 1987, “Multiple dependent variables in program evaluation”, New directions for program evaluation, vol. 35, pp. 43-56.
Iluţ P, 1997, Abordarea calitativă a socioumanului, Polirom, Iaşi.
Isaac, S., Michael, W.B., 1981, Handbook in research and evaluation, 2nd edition, Edits Publishers, San Diego.
Jacobsgaard, M., 2003, „Using appreciative inquiry to evaluate project activities of a nongovernmental organization supporting victims of trauma in Sri Lanka”, New directions for evaluation, pp. 53-62.
Jarosewich, T., Essenmacher, V., Lynch, C.O., williams, J., Doino-Ingersolll, J.A., 2006, „Independent consulting topical interest group: 2004 industry survey”, New directions for evaluation, vol. 111, pp. 9-21.
Johnston, P., Swift, P, 1994, „Effects of randomization on homeless service initiative: a comment”, New directions for program evaluation,vol. 63, pp. 67-71.
Johnston, W.Jr., 1988, „Increasing evaluation use: some observations based on the results at the U.S. GAO, New directions for evaluation, vol. 39, pp. 75-84.
Judd, C., 1987, “Combining process and outcome evaluation”, New directions for program evaluation, vol. 35, pp. 23-41.
Kee, J.E., 2004, „Cost-effectiveness and cost-benefit analysis”, în Wholey, J, Hatry, H., Newcomer, K, Handbook of practical program evaluation, second edition, Jossey-Bass, San Francisco, California, pp. 506-542.
Kidder, L, Judd, C., 1986, Reasearch methods in social relations, Rinenhart and Winston, New York.
Kidder, L., Fine, M., 1987, “Qualitative and quantitative methods: when stories converge”, New directions for program evaluation, vol. 35, pp. 57-75.
King, J., 1998, „Making sense of participatory evaluation practice”, New directions for evaluation, vol. 80, pp. 57-67.
King, R.F., 2005, Strategia cercetării. Treisprezece cursuri despre elementele ştiinţelor sociale, Polirom. Iaşi.
Knott, T., 1988, „The impact of major consumer groups on health care evaluation”, New directions for evaluation, vol. 39, pp. 33-46.
Krogsrud Miley, K., O’Melia, D., DuBois, B., 2004/2006, Practica asistenţei sociale. Abordarea participativă, Polirom, Iaşi.
Krueger R., 1994, Focus group – a practical guide for applied research, Sage Publications, New York.
Lam, J., Wilson Hartwell, S., Jekel, J., 1994, „I prayed real hard, so I know I’ll get in: living with randomization”, New directions for program evaluation,vol. 63, pp. 55-66.
Landsberg, G., 1983, “Program utilization and service utilization studies: a key tool for evaluation”, New directions for program evaluation, vol. 20, pp. 93-100.
Lawrenz, F., Keiser N., Lavoie, B., 2003, „Evaluative site visits: a methodological review”, Amercican journal of evaluation, vol. 24(3), pp. 341-352.
Leone, L., 2008, „Realistic evaluation of an ilicit drug deterrence program: analysis of a case study”, Evaluation, vol. 14(1), pp. 9-28.
Lewis, J., 2001, „Reflections on evaluation in practice”, Evaluation, vol. 7(3), pp. 37-394.
Lincoln, Y., Guba, E., 1985, Naturalistic inquiry, Sage Publications, Beverly Hills, California.
Lincoln, Y., Guba, E., 1986, „But is it rigorous? Trustworthiness and authenticity in naturalistic evaluation”, New directions for evaluation, vol. 30, pp. 73-84.
Lincoln, Y., Guba, E., 2000, „Paradigmatic controverises, contradictions, and emerging confluences”, Denzin, N., Lincoln,Y., Handobok of qualitative research, ed. 2, Sage Poublication, Thousand Oaks, California, pp. 163-188.
Lipsey, M., 1993, „Theory as method: small theories of treatments”, New directions for program evaluation, vol. 57, pp. 5-38.
Lipsey, M.W., 2000, „Meta-analysis and the learning curve in evaluation practice”, American journal of evaluation, 21(2), pp. 207-212.
Lipsey, M.W., 2007, „Peter H. Rossi: formative for program evaluation”, American journal of evaluation, 28(2), pp. 199-202.
Love, A., 1983, “The organizational context and the development of internal evaluation”, New directions for program evaluation, vol. 20, pp. 5-22.
Love, A., 2004, „Implementation evaluation”, în Wholey, J., Hatry, H., Newcomer, K., Handbook of practical program evaluation, Jossey-Bass, San Francisco, pp.63-97.
Love, A.J., Russon, C., 2000, “Building a worldwide evaluation community: past, present and future, Evaluation and Program Planning, vol. 23, pp. 449-459.
Maack, S., Upton, J., 2006, „Collaborative relationships in evaluation consulting”, New directions for evaluation, vol. 111, pp. 57-66.
Mabry, L., 2001, „Responsive evaluation is to personalized assessment …”, New directions for evaluation, nr. 92, pp. 89-102.
Madaus, G., Scriven, M, Stufflebeam, D., 1983, Evaluation models, Kluwer-Nijhoff, Boston.
Malloy, C., Yee, P., 2006, „Client relations: more than just business”, New directions for evaluation, vol. 111, pp. 67-77.
Mark, M., 1986, „Validity tipologies and the logic and practice of quasi-experimentation”, New directions for program evaluation, vol. 31, pp. 47-66.
Mark, M., 1990, „From program theory to test of program theory”, New directions for evaluation, vol. 47, pp. 37-51.
Mark, M., Shotland, L., 1987, “Alternative models for the use of multiple methods”, New directions for program evaluation, vol. 35, pp. 95-100.
Mark. M., Feller, I., Button, S., 1997, „Integrating qualitative methods in a predominantly quantitative evaluation: a case study and some reflections”, New directions for evaluation, vol. 74, pp. 47-59.
Marquart, J., 1990, „A pattern-matching approach to link program theory and evaluation data”, New directions for evaluation, vol. 47, pp. 93-107.
Mathison, S., 1988, „Why triangulate?, Educational researcher, vol 17 (2), pp. 13-17.
Mărginean, I., 2004, Proiectarea cercetării sociologice, Polirom, Iaşi.
Mărginean, I., Cojocaru, Ş. (coord.), 2006, Services to children and families. Impact of Holt programs in Romania. Documentation of outcomes, Expert Projects, Iaşi.
Măţăuan, G., 1999, Evaluarea programelor sociale, Expert, Bucureşti.
McClelland, R., Austin, C.D., 1996/2005, „Faza 4: Redactarea raportului”, în Tutty, L.M., Rothery, M.A., Grinnell. R.M.Jr., Cercetarea calitativă în asistenţa socială. Faze, etape şi sarcini, Polirom, Iaşi, pp. 125-153.
McClintock, C., 1983, „Internal evaluation: the new challenge”, American journal of evaluation, vol. 4, pp. 61-62.
McClintock, C., 1987, „Conceptual and action heuristics: tools for the evaluator”, New directions for evaluation, vol. 33, pp. 43-57.
McClinttock, C., 1990, „Administrators as applied theorists”, New directions for evaluation, vol. 47, pp. 19-33.
McNamara, C, 2002, A basic guide to program evaluation, Authenticity Consulting, LLC, http://managementhelp.org/evaluatn/fnl_eval.htm, noiembrie 2007.
McNamee, S., 2003, „Appreciative evaluation within a conflicted educational context”, New directions for evaluation, pp. 23-40.
Merton RK, Kendall PL, 1946, „The focused interview”, American journal of sociology, vol. 51, pp. 541-557.
Merwin, J., 1983, “Dimensions of Evaluation Impact”, în Hueftle, S. (ed.), The Utilization of Evaluation. Proceedings of the Minnesota Evaluation Center, Minnesota Research and Evaluation Center, Minneapolis.
Miftode, V., 2002, Tratat de metodologie sociologică, Lumen, Iaşi.
Morell, J.A., „Internal evaluation: a synthesis of traditional methods and industrial engineering”, American journal of evaluation, 21 (1), pp. 41-52.
Morris, M., 2000, “Ethical challenges”, American journal of evaluation, 21 (1), pp. 119-120.
Mowbray, C., 1988, “Getting the system to respond to evaluation findings”, New directions for program evaluation, vol. 39, pp. 47-58.
Mowbray, C., Herman, S., 1991, „Using multiple sites in mental health evaluations: focus on program theory and implementation issues”, New directions for program evaluation, vol. 50, pp. 45-57.
Muscatello, d., 1988, „Developing an agenda that works: the right choice at the right time”, New directions for evaluation, vol. 39, pp. 21-101.
Neigher, W., Metlay, W., 1983, ”Values and methods: evaluation and management perspectives”, New directions for program evaluation, vol. 20, pp. 47-60.
Newman, F., Heverly, M.A., Rosen, M., Kopta, S.M., bedell, R., 1983, “Influences on internal evaluation data dependability: clinicians us a source of variance”, New directions for program evaluation, vol. 20, pp. 71-92
Orwin, R., Cordray, D., Huebner, R., 1994, „Judicious application of randomized designs”, New directions for program evaluation,vol. 63, pp. 73-86.
Paillé, P., 1996/2002, „Eşantionare teoretică”, Muchielli, A., Dicţionar al metodelor calitative în ştiinţele umane şi sociale, Polirom, Iaşi, pp. 144-145.
Papineau, D., Kiely, M.C., 1996, „Participatory evaluation in a community organization: fostering stakeholder empowerment and utilization”, Evaluation and program planning, vol. 19, pp. 79-93.
Patton, M.Q., 1980, Qualitative inquiry methods, Sage Publications, Beverly Hills, California.
Patton, M.Q., 1988a, „Reports on topic areas: the evaluator’s responsability for utilization”, American journal of evaluation, vol. 9, pp. 5-24.
Patton, M.Q., 1988b, „The evaluator’s responsibility for utilization”, Evaluation practice, vol. 9(2), pp. pp. 5-24.
Patton, M.Q., 1988c, “Integrating evaluation into a program for increased utility and cost-effectiveness”, New directions for evaluation, vol. 39, pp. 85-94.
Patton, M.Q., 1996, „A world larger than formative ans summative”, Americal journal of evaluation, vol. 17, pp. 131-144.
Patton, M.Q., 2001, Qualitative research and evaluation methods, 3rd edition, Sage Publications, Thousands Oaks, California.
Patton, M.Q., 2002, Qualitative research and evaluation methods, 3rd edition, Sage Publications, Thousand Oaks, California.
Patton, M.Q., 2003, „Inquiry into appreciative evaluation”, New directions for evaluation, pp. 85-98.
Patton, M.Q., 2008, Utilization-focused evaluation, (4th edition), Sage Publications, Tousand Oaks, California.
Pawson, R., Tilley, N., 1997, Realistic evaluation, Sage Publishing, Londra.
Perloff, R., Padgett, V., Brock, T., 1980, “Sociocognitive biases in the evaluation process”, New directions for program evaluation, vol. 7, pp. 11-26.
Peterson, R., 1986, „The anatomy of cost-effectiveness analysis”, Evaluation review, vol. 10(1), pp. 29-44.
Petrosino, A., 2000, „Whether and Why” The potential benefits of including program theory in meta-analysis”, New directions for evaluation, vol. 87, pp. 59-69.
Phelan, P., 1987, “Compatibility of qualitative and quantitative methods: studying child sexual abuse in America”, Education and urban society, vol. 20(1), pp. 35-41.
Philips, 1987, „On what scientist know, and how they know it”, în Shadish, W.Jr., Reichardt, C., Evaluation studies review annual, vol. 12.
Popham, J, 1975, Educational evaluation, Prentice Hall, Upper Saddler River.
Preda, M., 2002, Politica socială românească între sărăcie şi globalizare, Polirom, Iaşi.
Preskill, H., Tzavaras Catsambas, T., 2006, Reframing evaluation through appreciative inquiry, Sage Sage Publications, Thousands Oaks, California.
Raines, J., 2008, „Evaluating qualitative research studies”, în Grinnell, R., Jr., Unrau, Y., Social work research and evaluation. Foundations of evidence-based practice, Oxford University Press, New York, pp. 445-461.
Reichardt, C., Cook, T., 1979, “Beyond qualitative versus quantitative methods”, în Cook, T., Reichardt, C., Qualitative and quantitative methods in evaluation, Research Newbury Park, Sage Publications, California.
Reichardt, C., Gollob, H., 1986, „Satisfying the constraints of causal modeling”, New directions for program evaluation, vol. 31, pp. 91-107.
Reichardt, C., Gollob, H., 1987, “Taking uncertainly into account when estimating effects”, New directions for program evaluation, vol. 35, pp. 7-22.
Reichardt, C., Rallis, S., 1994, “Qualitative and quantitative inquiries are not incompatible: a call for a new partnership”, New directions for program evaluation, vol. 61, pp. 85-91.
Reichardt, C., Rallis, S., 1994b, “The relationship between the qualitative and quantitative research tradition”, New directions for program evaluation, vol. 61, pp. 5-11.
Reiss, A.Jr., Boruch, R., 1991, „The program review team approach and multisite experiments: the spouse assault replication program”, New directions for program evaluation, vol. 50, pp. 33-44.
Reynolds, A., 1998, „Confirmatory program evaluation: a method for strengthening causal inference”, American journal of evaluation, 19(2), pp. 203-221.
Rich, R., 1975, „Selective utilization of social science related information by federal policy-makers”, Inquiry, vol. 13 (3), pp. 239-245.
Riggin, L., 1990, „Linking program theory and social science theory”, New directions for evaluation, vol. 47, pp. 109-120.
Riggin, L., Caracelli, V., 1994, „Mixed/method evaluation: developing quality criteria throught concept maping”, Evaluation practice, vol. 15(2), pp. 139-152.
Rindskopf, D., 1986, „New developments in selection modeling for quasi-experimentation”, New directions for program evaluation, vol. 31, pp. 79-89.
Robbin, A., 1978, „Ethical standards and data archives”, New directions for program evaluation, vol. 4, pp. 7-18.
Rogers, G., Bouey, E., 1996/2005, „Faza 2: Culegera informaţiilor”, în Tutty, L.M., Rothery, M.A., Grinnell. R.M.Jr., Cercetarea calitativă în asistenţa socială. Faze, etape şi sarcini, Polirom, Iaşi, pp. 61-93.
Rogers, P., 2000, „Causal models in program theory evaluation”, New directions for evaluation, vol. 87, pp. 47-55.
Rogers, P., Fraser, D., 2003, „Appreciating appreciative inquiry”, New directions for evaluation, pp. 75-83.
Rogers, P., Petrosino, A., Huebner, T., Hacsi, T., 2000, „Program theory evaluation: practice, promise, and problems”, New directions for evaluation, vol. 87, pp. 5-13.
Rossi, P.H., 1972, „Testing for succes and failure in social action”, în Rossi, P.H., Williams, W., Evaluating social programs, Seminar Press, New York, pp. 11-65.
Rossi, P.H., 1994, “The war between the quals and the quants: is a lasting peace possible”, New directions for program evaluation, vol. 61, pp. 23-36.
Rossi, P.H., Freeman, H.E., 1993, Evaluation. A systematic approach, 5th edition, Sage Publications, Newbury Park, California.
Rossman, G., Wilson, B., 1985, “Numbers and words: combining quantitative and qualitative methods in a single large-scale evaluation study”, Evaluation review, vol. 9, pp. 627-643.
Rotariu, T., (coord), Bădescu, G., Culic, I. Mezei, E., Mureşan, C., 2000, Metode statistice aplicate în ştiinţele sociale, Polirom, Iaşi.
Rotariu, T., Iluţ, P., 1997, Ancheta sociologică şi sondajul de opinie. Teorie şi practică, Polirom, Iaşi.
Rothery, M., Tutty, L.M., Grinnell. R.M.Jr., 1996/2005, „Faza 1: Planificarea studiului” în Tutty, L.M., Rothery, M.A., Grinnell. R.M.Jr., Cercetarea calitativă în asistenţa socială. Faze, etape şi sarcini, Polirom, Iaşi, pp. 37-60.
Salasin, S., 1980, “The evaluator as a agent of change”, New directions for program evaluation, vol. 7, pp. 1-9.
Salomon, G., 1991, “Transcending the qualitative-quantitative debate: the analytic and systemic approaches to educational reasearch”, Educational researcher, vol. 20(6), pp. 10-18.
Sanders, J., 2002, “Presidential adress: on mainstream evaluation”, American journal of evaluation, vol. 23(3), pp. 253-273.
Sandu, D., 2005, Dezvoltare comunitară. Cercetare, practică, ideologie, Polirom, Iaşi.
Saxe, L., Fine, M., 1981, Social experiments: methods for design and evaluation, Sage Publications, Newbury Park, California.
Scheirer, M.A., 1987, „Program theory and implementation theory: implications for evaluators”, New directions for evaluation, vol. 33, pp. 59-76.
Schnoes, C.J., Murphy-Berman, V., Chambers, J.M., 2000, Empowerment evaluation applied: experiences, analysis, and recommendations from a cese study”, American journal of evaluation, 21 (1), pp. 53-64.
Schumacher, J., Milby, J., Raczynski, J., engle, M., Caldwell, E., Carr, J., 1994, „Demoralization and threats to validity in Birmingham’s homeless project”, New directions for program evaluation,vol. 63, pp. 41-44.
Schwandt, T., 2001, „Responsiveness and everyday life”, New directions for evaluation, nr. 92, pp. 73-88.
Schwandt, T., 2007, The Sage dictionary of qualitative inquiry (third ed.), Sage Publication,Tousand Oaks, California.
Schwandt, T.A., 2000, „Meta-analysis and everyday life: the good, the bad, and the ugly”, American journal of evaluation, 21(2), pp. 213-219.
Schweigert, F., 2006, „The meaning of effectiveness in assessing community initiatives”, American journal of evaluation, vol. 27(4), pp. 416-436.
Scriven, M. 1997, „Truth and objectivity in evaluation”, în Chelimsky, E., Shadish, W., Evaluation for the 21st century, Sage Publications, Thousand Oaks, pp. 477-500.
Scriven, M., 1967, „The methodology of evaluation”, Tyler, R.W., Gagne, R.M., Scriven, M. (eds), Perspectives on curriculum evaluation: AERA monograph series on curriculum evaluation, Rand McNalley, Chicago, pp. 39-83.
Scriven, M., 1974, „Maximizing of power of causal investigation: the modus operandi method”, în Popham, W. (ed.), Evaluation in education: current applications, McCutchan, Berkeley, California.
Scriven, M., 1991, „Prose and cons about goal-free evaluation”, American journal of evaluation, 12(1), pp. 55-62.
Scriven, M., 1996, „Types of evaluation and types of evaluator”, American journal of evaluation, 17(2), pp. 151-161.
Shadish, W. Jr., Cook, T., Houts, A., 1986, „Quasi-experimentation in a critical multiplist mode”, New directions for program evaluation, vol. 31, pp. 29-46.
Shadish, W., Jr., Cook, T., Leviton, L., 1995, Foundations of program evaluation. Theories of pratice, Sage, Newbury Park, California.
Shadish, W.Jr., 1987, „Program micro- and macrotheories: a guide for social change”, New directions for evaluation, vol. 33, pp. 93-109.
Shotland, L., Mark, M., 1987, “Improving inferences from multiple methods”, New directions for program evaluation, vol. 35, pp. 77-94.
Sinacore, J., Turpin, R., 1991, „Multiple sites in evaluation research: a survey of organizational and methodological issues”, New directions for program evaluation, vol. 50, pp. 5-18.
Skogan, W., Lurigion, A., 1991, „Multisite evaluations in criminal justice settings: structural obstacles to succes”, New directions for program evaluation, vol. 50, pp. 83-96.
Smart, D.H., Mann, M., 2003, „Incorporating appreciative inquiry methods to evaluate a youth development program”, New directions for evaluation, pp. 63-74.
Smith, L., Kleine, P., 1986, „Qualitative research and evaluation: triangulation and multimethods reconsidered”, New directions for evaluation, vol. 30, pp. 55-71.
Smith, M., 1990, Program evaluation in the human services, Springer Publishing Company, New York.
Smith, M., 1997, “Mixing and matching: methods and models”, New directions for evaluation, vol. 74, pp. 73-94.
Smith, M.F., 1983, Sampling considerations in evaluating cooperative extension programs, Florida Cooperative Extension Service, Gainesville, Florida.
Smith, M.F., 1988, “Evaluation utilization revisited”, New directions for program evaluation, vol. 39, pp. 7-19.
Smith, M.L., 1994, “Qualitative plus / versus quantitative: the last word”, New directions for program evaluation, vol. 61, pp. 37-44.
Smith, N., 1990, „Using Path analysis to develop and evaluate program theory and impact”, New directions for evaluation, vol. 47, pp. 53-57.
Smith, N., 1994, „Clarifying and expanding the application of program theory-driven evaluations”, American journal of evaluation, 15(1), pp. 83-87.
Smits, P., Champagne, F., 2008, „An assessment of the theoretical underpinning of practical participatory evaluation”, American journal of evaluation, vol. 29, pp. 427-442.
Spiegel, A., Bruning, R., Giddings, L., 1999, „Using responsive evaluation to evaluate a professional conference“, American journal of evaluation, vol. 20, pp. 57-67.
Sridharan, S., 2008, „Making evaluations work: a commentary on the case study”, American journal of evaluation, 29(4), pp. 516-519.
Stake, R., 1967, „Countenance of educational evaluation”, Teachers College Records, vol. 68(7), pp. 523-540.
Stake, R., 1975, „To evaluate an art program”, în Stake, R., (ed), Evaluating the arts in education: a responsive approach, Merrill, Columbus, pp. 13-31.
Stake, R., 1976, Evaluating educational programmes: the need and the response, CERI/OEDC, Paris.
Stake, R., 1978, “The case study method in social inquiry”, Educational researcher, nr. 7, pp. 5-8.
Stake, R., 1980, “Program evaluation, particularly responsive evaluation”, în Dockrell W., Hamilton, D., Rethinking educational research, Hodder and Stoughton, London, pp. 72-87.
Stake, R., 1991, “Excerpts from: program evaluation, particularly responsive evaluation”, American journal of evaluation, vol. 12, pp. 63-76.
Stake, R., 1995, The art of case study reasearch, Sage, Thousand Oaks, California.
Stake, R., 2001, “A problematic heading”, American journal of evaluation, vol. 22, pp. 349-354.
Stake, R., 2008, “A letter from Egon”, American journal of evaluation, vol. 29, pp. 320-321.
Stake, R., Easely, J, Anastasiou, K., 1978, Case studies in science education, Center for Instructional Reasearch and Curriculum Evaluation, University of Illinois, Champaign.
Stănciulescu, E., 1996, Teorii sociologice ale educaţiei, Polirom, Iaşi.
Stern, E., 2008, „Evaluation. Critical for Whom and connected to What?”, Evaluation, 14, pp. 249-257.
Stevens, S., 1994, „Common implementation issues in three large-scale social experiments”, New directions for program evaluation,vol. 63, pp. 45-53.
Strauss, A., Corbin, J., 1998, Basics of qualitative research. Techniques and procedures for developing grounded theory, Sage Publications, Tousand Oaks, California.
Stronach, I., 2001, „The changing face of responsive evaluation: a postmodern rejoinder”, New directions for evaluation, nr. 92, pp. 59-72.
Stufflebeam, D., 1983, „The CIPP model for program evaluation”, în Madaus, G.F., Scriven, M.S., Stufflebeam, D.L., Evaluation models: viewpoints on educational and human services evaluation, Kluwer, Hingham, pp. 117-141.
Stufflebeam, D., 2001, „Evaluation models”, New directions for evaluation, nr. 89, pp. 7-98.
Stufflebeam, D., 2008, „A tribute to Egon Guba”, American journal of evaluation, vol. 29, pp. 325-327.
Suchman, E., 1967, Evaluative research: principles and practice in publice service and social action programs, Russel Sage Foundation, New York.
Taylor-Powell, E., 1996, „Analyzing quantitative data”, Program development and evaluation, Cooperative Extension, University of Wisconsin Extension, Madison, Wosconsin, pp. 1-6.
Taylor-Powell, E., 1998, „Sampling”, Program development and evaluation, Cooperative Extension, University of Wisconsin Extension, Madison, Wisconsin, pp. 1-10.
Taylor-Powell, E., Steele, S., Douglah, M., 1996, „Planning a program evaluation”, Program development and evaluation, Cooperative Extension, University of Wisconsin Extension, Madison, Wisconsin, pp. 1-20.
Torres, R., Preskill, H., Piontek, M., 1997, „Communicating and reporting: practices and concerns of internal and external evaluators”, American journal of evaluation, vol. 18, pp. 105-125.
Treasury Board of Canada, Secretariat, 2007, Program evaluation methods. Measurement and attribution of program results, http://www.tbs-sct.gc.ca/eval/pubs/meth/pem-mep_e.pdf, decembrie 2007.
Trochim, W., 1986, „Editor’s notes”, New directions for program evaluation, vol. 31, pp. 1-7.
Tzavaras Catsambas, T., Webb, L., 2003, „Using appreciative inquiry to guide an evaluation of the International Women’s Media Foundation Africa Program”, New directions for evaluation, pp. 41-51.
United Way of America, 1996, Measuring program outcomes: a practical approach, Alexandria, Virginia, SUA.
Van den Berg, R., 2005, “Results evaluation and impact assessment in development co-operation”, Evaluation, vol. 11(1), pp. 27-36.
Viola, J., 2006, „I want to be an independent consultant: considerations before taking the plunge”, New directions for evaluation, vol. 111, pp. 23-27.
Watkins, J., Mohr, B., 2001, Appreciative inquiry: change at the speed of imagination, Jossey-Bass, San Francisco.
Weiss, C.H., 1972, Evaluation research: methods of assessing program effectiveness, Prentice Hall, Englewood Cliffs.
Weiss, C.H., 1997, „How can theory-based evaluation make greater headway”, Evaluation review, Vol. 21 (4), pp. 501-524.
Weiss, C.H., 2000, „Which links in with theories shall we evaluate”, New directions for evaluation, vol. 87, pp. 35-45.
Westat, J. F., Frierson, H., Hood, S., Hughes, G., Katzenmeyer, C., 2002, The 2002 user friendly handbook for project evaluation, The National Science Foundation, Directorate for Education and Human Resources, Division of Research, Evaluation and Communication, Arlington.
Westat, J.F., 2002, The 2002 user friendly handbook for project evaluation, National Science Foundation, Division of Research, Evaluation and Communication.
Weston, T., 2004, “Formative evaluation for implementation: evaluating educational tehnology applications and lessons”, American journal of evaluation, vol. 25 (1), pp. 51-64.
Whitney, D., Trosten-Bloom, A., 2003, The power of appreciative inquiry, Berrett-Koehler, San Francisco.
Wholey, J., 1987, „Evaluability assessment: developing program theory”, New directions for evaluation, vol. 33, pp. 77-92.
Williams, D., 1986, „When is naturalistic evaluation appropiate”, New directions for evaluation, vol. 30, pp. 85-92.
Yeh, S., 2000, „Improving educational and social programs: a planned variation cross-validation model”, American journal of evaluation, vol. 21 (1), pp. 171-184.
Yin, R., 1994, “Evaluation: a singular craft”, New directions for program evaluation, vol. 61, pp. 71-84