Research Institute’s CRIS as a Source of Data for Assessing Research Results Sergey Parinov, CEMI RAS Socionet project How we can develop CRIS to provide … • complex, detailed and accurate data for better assessing research results and researchers by: – Higher Attestation Commission (VAK) experts – Research Foundations, e.g. Russian Foundation for Basic Research to evaluate proposals – Managers of research organizations to make right motivations of scientists • CRIS has to be a part of research e-infrastructure What we can develop in CRIS and in research e-infrastructure: • Tools for electronic depositing of research results to give experts full and accessible set of research results • Tools and services for linking relative research materials and maintaining networks of such relations to give experts complexity of data • Tools and services for better research results usage and its monitoring to give experts more accurate and realistic data for research assessments Full and accessible data on research results • CRIS provides a tool for electronic depositing by researchers of all their research results (as articles) • Research e-infrastructure provides an integration mechanism to build an unified information space from local CRISs’ data • Interactions between local CRISs and integration mechanism can based on OAI-PMH protocol and CERIF data format • Current problem: lack of motivation for researchers Electronic depositing tools • There are many systems, which support OAI-PMH protocol (Eprints, Dspace, Socionet Personal Zone, etc.) and few of them supporting CERIF format (e.g. SPZ) • Using Socionet Personal Zone (spz.socionet.ru) services a researcher can: – Deposit his/her single materials in thematic series of Socionet Open Archive – Create and maintain any number of different types own series (preprints, postprints, personal and institution profiles, news, comments, projects, thesis, etc.) collecting any number of materials/articles Institutional Repository (IR) Tools • Using Socionet Personal Zone a research institute can integrate all types series created by different people from their staff as IR with OAI-PMH/CERIF features • Many people from the institute can create and maintain their thematic collections of research materials and institute’s admin can integrate it as IR • By this way research institutes of Social Science Section of RAS built 21 IR, and as a result Russia moved to 14 position in an international rating IRs in Russia (October 2008) ОА_Вологодский научно-координационный центр ЦЭМИ РАН ОА_Центр египтологических исследований РАН (дата: 2008-01-16 ) Ригин Василий Александрович (дата: 2007-12-10 ) Давыдова Алла Борисовна ОА_Институт экономики и организации промышленного производства СО РАН (дата: 2007-12-04 ) Колобова Елена Анатольевна ОА_Отделение международных экономических и политических исследований (Филиал Института экономики РАН) ) Соколова Татьяна Владимировна ОА_Институт Европы РАН (дата: 2007-12-04 (дата: 2007-11-26 ) Слесаренко Мария Альбертовна ОА_Институт философии Российской Академии Наук ОА_Институт государства и права РАН (дата: 2007-11-26 ) Гаджикурбанова Полина Аслановна (дата: 2007-11-26 ) Лазуткина Ирина Николаевна ОА_Институт мировой экономики и международных отношений Российской Академии Наук Владимировна ОА_Институт проблем региональной экономики (дата: 2007-11-26 ) Хилькевич Евгения (дата: 2007-11-26 ) Жук Надежда Петровна ОА_Институт социально-экономических исследований Уфимского научного центра РАН ОА_Сочинский научно-исследовательский центр Российской академии наук ОА_Институт народнохозяйственного прогнозирования ОА_Институт экономики Российской Академии наук (дата: 2007-11-26 ) Климова Нина Ивановна (дата: 2007-11-26 ) Кизилова Ольга Викторовна (дата: 2007-11-26 ) Ковалев Владимир Петрович (дата: 2007-11-25 ) Романюк Эвелина Игоревна ОА_Институт аграрных проблем Российской академии наук (дата: 2007-11-25 ) Осовин М.Н. ОА_Институт экономических проблем Кольского Научного Центра РАН ОА_Санкт-Петербургский экономико-математический институт РАН (дата: 2007-11-25 ) Емельянова Елена Евгеньевна (дата: 2007-11-25 ) Гузий Л.И. ОА_Социологический институт Российской академии наук (статус государственного учреждения) Викторовна ОА_Институт США и Канады Российской Академии Наук (дата: 2007-11-25 ) Русакова Инна (дата: 2007-11-24 ) Соколова М.Е. ОА_Отделение международных экономических и политических исследований (Филиал Института экономики РАН) ) Соколова Т.В. ОА_Центральный экономико-математический институт Российской академии наук ОА_Институт проблем рынка РАН (дата: 2007-11-24 ) Когаловский М.Р. (дата: 2007-11-24 (дата: 2007-11-24 ) Ляпичева Н.Г. Russia in IRs international rating (September 2008) Страна 1. United States 2. United Kingdom 3. Germany 4. Brazil 5. Japan 6. Canada 7. France 8. Sweden 9. Australia 10. Spain 11. Italy 12. India 13. Netherlands 14. Russian Federation кол-во ОА 225 108 86 55 46 44 40 35 34 32 31 28 23 20 Source: http://roar.eprints.org/index.php?action=browse Leading Russian Research Institutes by IR’s characteristics Institute Name 1. Институт экономики и организации промышленного производства СО РАН 2. Центральный экономико-математический институт РАН 3. Институт философии РАН 4. Институт проблем рынка РАН 5. Институт народнохозяйственного прогнозирования РАН 6. Вологодский научно-координационный центр ЦЭМИ РАН 7. Институт экономических проблем Кольского Научного Центра РАН 8. Институт экономики РАН 9. Отделение международных экономических и политических исследований (Филиал Института экономики РАН) 10. Институт США и Канады РАН 11. Институт аграрных проблем РАН 12. Институт социально-политических исследований РАН Number of materials in IR Number of series in IR 11323 13 2356 15 838 712 281 24 8 6 158 4 147 6 139 100 7 8 96 74 59 8 6 4 Example of series structure of IR (for IEIE SB RAS) Series Title Авторефераты диссертаций, принятых к защите Авторефераты защищенных диссертаций Журнал "Регион: экономика и социология" Каталог изданий ИЭОПП СО РАН Монографии, сборники, учебники сотрудников ИЭОПП СО РАН по региональной тематике с 1990 г. Новости ИЭОПП СО РАН Организационные профили ИЭОПП СО РАН Отчеты о научной и научно-организационной деятельности института в целом, подразделений и исследователей ИЭОПП СО РАН Препринты сотрудников ИЭОПП СО РАН по региональной тематике с 1990 г. Публикации Григория Ханина Публикации сотрудников ИЭОПП СО РАН по региональной тематике с 1990 г. Сотрудники ИЭОПП СО РАН Труды сотрудников ИЭиОПП Number of materials 1 23 449 246 139 15 7 7 183 41 611 17 9767 Example OAI-PMH{CERIF} support for IR at Socionet Complexity of data on research results • CRIS provides a tool to make thematic links between relative materials located at any part of unified information space • Research e-infrastructure provides a service to support such links and tools to maintain networks of such relations • Basic information objects for linking are: – a research article or a material – personal profile of a researcher – institution profile Example of types of linking for a research article Links as a graph Example of types of links for a personal profile Example of types of links for an institution profile Needed development • Adding to CERIF a set of specifications for global thematic links between information objects: – how to provide global unified ID for objects from local CRIS – open format for specifying links between objects – open list of links types Accurate and realistic data for research results usage assessment • CRIS provides a tool to use (cite) research results in advanced and improved form located in any other CRIS • Research e-infrastructure provides a service to support such advanced citations • A focus on building a new advanced model to make electronic citations in deposited research articles/materials Electronic citation tool • To make citation as a one of thematic links between fragments of articles located in any CRIS • Each citation link includes a set of quality attributes of usage type and a field for notes • Making a citation an author specifies linked fragments of texts, selects usage type and can fill in a note Quality attributes of electronic citation Making a citation an author should select one or many of quality attributes to specify how (s)he uses the cited research result. Suggested usage types: • • • • • • «grounds for receiving my results», which means direct scientific use of cited result by the author; «proof of cited result», i.e. the result of the author proves the cited one; «cited result proves result, obtained by the author previously», i.e. the author states his/her priority with regard to independently obtained cited result; «similar or related result», meaning that the author in a certain sense repeated the cited result; «illustration of my conclusions», implying certain logical link between the result of the author and the cited one; «object for criticism», means that the author doubts the cited result. Electronic citation output: new data for research assessment • who and how uses certain research results as the basis for own scientific argument; these cases mean direct utilization of results and increase indicator of its using; • which results prove or are proved by other results, which should enhance the indicator of the proved results’ credibility; • which results repeat the existing ones, which should increase the degree of both results credibility; • which results use as general illustrations than means a case of weak usage of results; • who criticizes which results Needed development • Adding to CERIF a “citation” type of links with a set of quality attributes and a “note” field • Provide an open list of quality attributes for citation links