"Strategies in Qualitative Research", the Second International Conference on Software Development by "Qualitative Solutions and Research". Organised by the Institute of Education, University of London

The Second International Conference on "Strategies in Qualitative Research—Issues and Results from using QSR NVivo and NUD*IST", organised by the Institute of Education, was held on Friday the 29th and Saturday the 30th of September, 2000. I have volunteered to write a brief report on the proceedings. [1]

My overall impression of the conference was that it was a great success, bringing together a wide range of people from different disciplines and with varying levels of experience of qualitative research and the associated computer aids to qualitative data analysis. [2]

From the moment of my arrival the atmosphere in the conference was friendly, open, interested and interesting. This welcoming ambience continued right throughout the conference and made for a refreshing change. It was enhanced by good wine and lovely food, leading to great conversation and information sharing. In fact, in a post-conference meeting held by four delegates (those protagonists can ensure my silence by sending me lots of money) in the pub afterwards, everyone commented on the lack of elitism and competitiveness which are all too often the hallmarks of conferences like this. On the contrary, everyone seemed to be open and honest about their difficulties, willing to share suggestions or take advice, and above all, had an enthusiastic and enquiring attitude to proceedings. I personally was delighted to meet such a nice group of people! [3]

Another refreshing aspect of the conference was the fact that Lyn and Tom RICHARDS of QSR International really engaged with the questions and concerns voiced about QSR software, and their responses were honest and professional. Risking a plug, the QSR sponsored dinner was free and delicious, and there was lots of it. Great idea. [4]

The conference had a truly international flavour to it. Although the majority of delegates were from the UK, (perfectly understandable seeing as the conference was located in London!), people also attended from the United States, Canada, Australia, Portugal, Israel, Spain, Belgium, Sweden, France, Norway, Switzerland, Japan, and last but definitely not least, one particularly interesting and attractive delegate from the Republic of Ireland. Let's hope that this trend is encouraged and continues into the future. [5]

Although the session was entitled "Programming Progress", the focus of debate centred on methodological issues in qualitative data analysis generally. This proved to be a fascinating discussion, and introduced a 'thread' which ran throughout the rest of the conference. [6]

Clive discussed the problems associated with researchers claiming to used a "grounded theory" approach, when in fact they are doing something very different. He referred to some research he had done into a number of articles that were supposed to be using grounded theory. In fact only a very small minority of these had indeed used a grounded theory approach. The majority had employed a technique that Lyn RICHARDS has previously referred to as "pattern analysis"—a concept she explained in more detail in the parallel session held on Saturday. Clive emphasised the importance of raising the methodological sophistication of researchers to complement the capacities of QDA software. [7]

Pat raised the question of whether technology has replaced traditional ethnographic skills, and Sylvain echoed Clive's concern about standards in qualitative research at the moment, and felt strongly that qualitative research must be grounded in it's historical and philosophical context if full understanding is to take place, and before researchers turn to qualitative software to aid them. He went on to argue that the problems associated with QDA software also rests with the training of people to use the software, pointing out that "making sense of data can never be handled by computer" alone. [8]

Debate after the speakers was interesting and challenging. Many people continued the methodological issues raised and the debate centred on these problems and the effect of qualitative software on them. The general consensus was that the software itself was not the problem but it had exposed a pre-existing weakness within qualitative methodology, which needed to be addressed. [9]

Tom RICHARDS re-affirmed a need he felt for research training and practice to be made more explicit, accountable and grounded in the philosophical context, and for the methods used and represented in publications to be made more explicit. Software cannot function to replace good methodological approaches to research and analysis. In this context, he felt it essential that CAQDAS¹⁾ must be grounded in it's own historical narrative. [10]

He then went on to outline the development of NUD*IST, from N1 produced in 1982 to the launch of N5 that day. In order to justify the launch of N5 alongside NVivo, he described N5 as better able to cope with large masses of data than Nvivo²⁾. [11]

Overall, what emerged was the continuity of three things that were always central goals through all the versions of NUD*IST—the symmetry of documents and nodes, and the insistence that nodes are things, to be played with, ordered, reviewed, and browsed live; the emphasis on searching that is cumulative—i.e. the results of searches are more data—as well as restricting searches to particular data; and the goal of growing the software in response to researcher demand and research change. [12]

Junko OTANI (London School of Economics and Political Science/United Nations University, Institute for Advanced Studies)

The "innovative uses of software" session contained three papers which illustrated the variety of research and data types where NVivo is used. Clive SEALE described the analysis of newspaper articles, Silvana di GREGORIO the use of NVivo in literature review and Junko OTANI the experience of older people following the Kobe earthquake in Japan. Each paper was noted for the useful detail about how NVivo was used. Clive illustrated how useful Word macros are for preparing data and concordance software for highlighting less obvious themes. Silvana showed how literature reviews can be developed using proxy documents and memos in NVivo. Junko discussed her decision to translate her interviews from Japanese into English and the consequences of that decision. [13]

For Lyn a highlight was the session that qual-software³⁾ members were waiting for—on coding and how to control it. Sarah, who started it all with the famous "my head hurts" message, placed the pressures to over-code in a political context. She showed a disturbing fit between the contribution of qualitative software to the problem of "coding fetishism" and external pressures from both academic and non-academic sources; that contributed to an over-emphasis on categorisation. Pressure to show rigor and thoroughness can, she argued, dominate thinking about relationships with data. Harriet MEEK, from Illinois, combined roles of researcher and therapist to discuss the place of the unconscious in qualitative research, relating the problems of overcoding to other ways of "getting stuck", and providing a range of solutions. Anja DECLERCQ from Belgium gave a dramatic account of cutting through grip of clerical duty, reducing excessive coding to get on with analysis. She vividly illustrated her story of the late stages of a project with before and after accounts of her interpretation of a passage: we shared the excitement of "seeing" what mattered when coding was not an end in itself but a means to emerging ideas. [14]

Pat BAZELEY looked at the effects of the development of the software had on a particular project. The project was started in N3, moved to N4 and finally to NVIVO. When the project was started in N3 she discovered that it was easier to work with fewer codes. She reluctantly weeded down the number of codes developed from 40 to 12. In order to discern patterns in the data she had to manually construct matrix tables from the information N3 gave her. This was a tedious process.

Lyn RICHARDS offered a paper "Two Types of Analysis? The Perils of Pattern Analysis" when another presenter had to withdraw at the last minute. She decided to pick up Clive SEALE's comment at the Opening Plenary that in his survey of people using computers in qualitative analysis, many people said that they were doing grounded theory but very few actually were. Lyn pointed out that people need a label to describe the kind of qualitative analysis they are using and the term 'grounded theory' has been used as it was a label people recognised. There is not a label for the kind of research common in policy studies—which look for patterns among different sub-populations. Lyn has coined the term "pattern analysis" to describe this kind of research. She argues that it is a perfectly legitimate form of qualitative analysis—in keeping with the objectives of that kind of research. The problem occurs when people try to dress up that kind of research into something which is not—by using the term "grounded theory". [16]

Catherine and Sebastien reported on the use of N4 in two different Human Resource projects in France. They commented that in France there is a cultural emphasis on automating the analysis process. So they had difficulty in persuading their colleagues of the value of N4. They focussed their talk on the links between N4 and other software. In one study, with Decision Explorer and in the other study, with Excel/SPSS. In one study, they were frustrated at N4's inability to do a global matrix which could be the subject of a cluster analysis. They devised a way to do this via Excel. (However, it was pointed out that NVIVO can do global matrices.) In the other study, they had to manually calculate the strength of the relationship between links between codes and display them in Decision Explorer. The following discussion focussed on the difference in strategy between Pat's use of mixing quantitative and qualitative methods and Catherine and Sebastien's use of mixing methods. Pat focussed on the qualitative analysis first to inform what quantitative analysis she needs to do. This she fed back into further exploration in the qualitative data. Catherine and Sebastien's strategy was to use cluster analysis first to direct what they should look at in the qualitative analysis. [17]

Overall, the session could have been better described as 'New Things'. Both papers were quite narrowly focussed but each in their own way groundbreaking Clare's paper discussed her recently submitted CD multimedia thesis. On the whole she used her own software and codes to increase the reader's contact, for example between her own multimedia or other source data and her conclusions. She explained the way she structured her thesis in this respect and suggested that although NVivo could be the software structure behind such a presentation of results, it had some way to go before a project could easily be read and navigated by the inexpert (in NVivo) reader. [18]

Sylvain presented a new procedure for checking coder reliability in the team environment whilst using Nudist. It was based on the use of a combination of customised command files, run on identical, closed coding schema/index systems (or parts of) and their application to the same data files by different coders. Simple statistical analysis after running the command files allowed the similarities/differences between coders to be rated. It was suggested that QSR integrate the procedure as a formalised tool within Nudist software. [19]

During the Closing Plenary those who chaired the parallel sessions summarised the proceedings. Clare TAGG noted that not much reference had been made to projects using multi-media research techniques. It was suggested that this should be encouraged for the next conference. She also said that there were plans to publish the papers presented at the conference, on a CD-Rom version and in the International Journal of Social Research Methodology—Theory and Practice (as a special issue) and invited speakers to submit to one or the other. [20]

Silvana di GREGORIO commented that cultural and language differences could contribute to the further development of software and, also, in qualitative analysis techniques. In particular, Junko OTANI's study showed that the structure of Japanese meant that coding had to proceed differently than in English to be meaningful. She pointed out the difference between high context specific and low context specific languages. This could have implications for the tools that can be used to analyse such languages. And these new tools could also raise issues for English language researchers and challenge assumptions about coding practices. [21]

I would like to thank the organisers of the conference (Colm CROWLEY, Judy IRESON and all at the Conference Office) for a really refreshing and enjoyable experience. I'd also like to thank Lyn RICHARDS for encouraging Harriet, Anja and myself to present papers at the conference. It was a great experience. Last but not least, thanks to Ann LEWINS for running the "qual-software" list which has brought so many researchers together in e-mail if not in flesh, and has certainly helped and encouraged me since I first subscribed. [22]

1) The CAQDAS Networking Project aims to provide practical support and information in the use of a range of software programs which have been designed to assist qualitative data analysis. The website address is: http://www.soc.surrey.ac.uk/caqdas/. <back>

3) The qual-software e-mail discussion group seeks to create an instant forum for users and developers to air problems, offer opinions, argument and advice on the variety of packages in use. The current website address is qual-software (revised link, FQS, Nov. 2002). Further information will be available from the CAQDAS website. <back>

Delaney, Sarah (2000). Conference Report: "Strategies in Qualitative Research", the Second International Conference on Software Development by "Qualitative Solutions and Research" [22 paragraphs]. Forum Qualitative Sozialforschung / Forum: Qualitative Social Research, 1(3), Art. 51, http://nbn-resolving.de/urn:nbn:de:0114-fqs0003519.

Forum Qualitative Sozialforschung / Forum: Qualitative Social Research (FQS)

ISSN 1438-5627

Creative Commons Attribution 4.0 International License