Methodology- quantitative and qualitative investigation of internet searching
The following document incorporates discussion and agreements from the previous meeting 10th May. Quantitative Strand Qualitative strand Informing framework and background Informing framework and background Research proposal Research proposal Multi-disciplinary: Information studies, HCI Multi-disciplinary: HCI, information studies, cognitive science cognitive science Methodological theory/ framework Methodological theory/ framework Quantative and statistical analysis Grounded theory- iterative theory development Research Questions Research Questions What is the link between an individual's cognitive style There are none. The research questions will emerge and choice of internet search strategy? iteratively. It is envisaged that the pilot stage (see below, Timetable) will provide a major `break-point' where the focus for both strands can be refined narrowed and perhaps tightly integrated together, should the data warrant. Hypotheses Hypotheses To be developed more clearly as a result of the pilot Field dependent- field independent None, theorising to emerge from the data Global- analytic (individuals with a global cognitive style tend to make less use of analytic search techniques, and tend to perform broader searches) Verbaliser- imager (individuals with a verbaliser cognitive style may be more prone to disorientation when searching on the internet, imagers may be less "linguistically flexible" - i.e. less skilled at generating as opposed to recognising alternative verbal concept descriptions) (Note: these will be stated more clearly as a result of identifying the dimensions to be examined through the computer test- each dimension of cognitive style will be tested for a relationship with types of search strategy) Analysis tools Analysis tools Correlation and factor analysis (drawing on the dimensions Coding methods used in grounded identified in the computer test and search strategies identified)theory, computer supported data analysis (possibly Atlas) Procedure- general It is felt important that the project explicitly has a pilot stage for both strands of the investigation. This will allow for the methodological issues and research questions for the quantitative and qualitative investigations to be propely developed in the context of the practice of the research investigation, as well as allowing the exploring of more specific themes and hypotheses shown by the pilot stage to be of value. Procedure Procedure Participants- one hundred volunteers drawn from the Masters intake of Participants- in discussion with Nigel it the Librarianship and Information Management , to be contacted by was agreed that there was flexibility in the Nigel Ford as agreed previously, investigated in groups of ten in the number of people to be interviewed, the on-line searching lab, at the same time, Nigel to arrange. important factor was that the develop- mental theory building process be thoroughly pursued. Nigel to contact students. Suggest ten for pilot. Data types and collection Data types and collection Data collection is via electronic record of searches, leading to Unstructured interviews, tape recorded quantitative analysis on the basis of terms, concepts, combinations (data to be theorised from day one). and strategies, as revealed in this data, i.e. not high level concepts Pilot stage to consist of non-system or information about search strategies (which might come more from the interviews so as not to contrain or cue qualitative strand). The issue of before and after testing seems to participants due to system contraints. add a large time cost without a concomitant gain in research findings- why should searching behaviour be so transient that before and after interviews would materially add to the research? Stimulus material Stimulus material Pre-existing search schedules, one or two to be selected Non-system based, unstructured, taking as starting point recollection of recent searches done by the individuals where available Additional data collection for both strands Cognitive Styles Test (to be administered after investigative event, done by whichever investigator meets the student) User Profile (e.g. age, gender etc., to be done after investigation) User Expertise Profile (instrument to be developed by principal investigators, in consulation with grant administrators, could be test of relevant knowledge. To be done after the investigation) (Note: research profile mentions measures 1, item c, `linguistic skills' these are apparently currently under development, internet perceptions and attitudes- existing measure. The principal investigators need clarification on these measures- they do seem to constitute a very large additional strand to the research which could substantially interfere with meeting the time scheduling requirments gathering more data than can usefully be analyzed and adversely affecting participation rates. Suggested timetable Pilot investigations- four months (June-September) Investigations with participants, acquiring theoretical background, some form of internal report (which could lead to a paper reporting preliminary findings) including the planning of the next stage. Note that the principal investigators plan to take some holiday time during this period). Identification and submission for future research funding 2000- 2001, as per David's comment Main- six months (October-March) Report and final published outcomes- one and a half months (April-May)