A Look At Structured And Unstructured Observation

Published Date: 23 Mar 2015

At the first step of this assessment I need to outline what is involved in structured observation. The two main strategies that researchers usually can use to record their observations of events are the structured and unstructured observation. The former involves the recording of events of predefined types occurring at particular points in time, or within particular intervals. Structured observation typically produces quantitative data (information about the frequency of different sorts of events or of the proportion of time spent on different types of activity). This form of observation typically involves different threats to validity. Among the dangers with structured observation is that the predefined categories used will turn out not to be clearly defined, so that there is uncertainty in particular instances about which category is appropriate. There may also be relevant events that do not seem to fit into any of the categories. This, however, is only gained at the cost of the information being collected on different cases or at different times often not being comparable (Research Methods in Education, Handbook, p. 44).

Furthermore, structured observation is easy to describe but difficult to appreciate without actually engaging in the process. Very simply, it involves placing an observer in a social setting to observe all activities defined as of interest to the research. In essence, the method is derived from participant observation in social anthropology and the distinction which is sometimes made between 'participant' and 'non-participant' observation does not fully hold in practice: some degree of participation is inevitable. As William Howard Russell, the Victorian war correspondent for the Times said "I stand and look around, and say thus does it appear to me and thus I seem to see" so does the structured observation. The 'structure' of structured observation is imposed by the aims of the research in the same way as such aims impose structure upon any method of data-collection. Just as is the case when open questions are used in interviews or self-completed questionnaires the researcher using structured observation recognizes that not all of the structure can be determined in advance and that some structure must be imposed on the data after they have been collected (Roberts, 1975, p. 309).

Researchers undertaking structured observational research usually look to use low-inference categories - in other words, categories that can be applied to instances with a minimum of contestable judgement on the part of the observer - in the hope of incurring only small elements of error and uncertainty. For example, low-inference categories for observing a meeting might include such things as 'Asks a question', 'Expresses agreement' and 'Makes a proposal' "(E891 Educational Enquiry, Study Guide, p. 145). Furthermore, it is almost sure that some data obtained from structured observation contain errors, especially if observation is carried out under considerable pressure of time, leading to mark being placed in the wrong boxes. However structured observation as a quantitative research has also been guided by at least some of the assumptions of positivism - from laboratory experiments, through structured observational studies of classroom teaching, to large-scale social surveys of the attitudes of teachers, students, parents, education managers and others. Indeed, over the course of the twentieth century, a great deal of educational research was influenced by a positivist approach concerned, for example, with identifying the relative effectiveness of different teaching strategies and techniques (Dunkin, 1974, p. 6).

Part 2

Coming to the second part of the assignment, I will try to introduce according to the best of my knowledge, the methodological philosophy of positivism. In concern to the tenets of logical empiricism, scientific progress in any discipline begins with the untainted observation of reality. This fact is expected to provide the researcher with an image of the real world from which cognitively generates an a priori model of the process to be investigated. The word 'positivism' is nowadays used in such a wide range of ways that it has become almost meaningless, except that it is usually employed disparagly to dismiss views or forms of research of which the speaker disapproves. The original meaning of the term contained some important elements. Widely, positivism can be characterised historically as a way of thinking about knowledge and enquiry that takes natural science, as it developed after the seventeenth century, as the model, and which seeks to apply the scientific method to new fields. Even though the term positivism was not invented until the nineteenth century, this idea was a central strand of eighteenth-century Enlightenment thinking, although it was by no means the only one and was certainly not accepted by all Enlightenment thinkers (E891 Educational Enquiry, Study Guide, p. 78).

One of the main elements of positivism is the idea that it is the task of research to identify standard repeatable patterns between cause and effect, identifying particular pedagogical strategies that reliably bring about a desirable educational outcome. However, there are questions about whether such patterns exist, what character they have if they do, and how we can know them. Another feature of positivism is the idea that research must follow an explicit procedure, so that the idiosyncratic effects of who is doing the research can be eliminated and the replicability of the findings checked. Trying to build on this, the concept of evidence-based policy-making and practice is often promoted on the grounds that it is 'transparent', since it is guided by explicitly specified knowledge whose validity is open to inspection even though this idea is subject to dispute.

In contrast, the positivist philosophy, suffers from several limitations, especially when applied to social sciences. First, this approach, generalizes a universal statement of truth from observations of a certain number of positive instances. The strict inductionist approach is often inappropriate because speculation and creation of an a priori hypothesis are essential for a systematic procedure of theory building. Furthermore, the empiricist approach is based on the notion of pure observation, which is impossible in research, especially in social sciences, since observations are always subject to measurement errors. Finally, this approach assumes that knowledge is derived from an objective interpretation of assumptions, without any of the subjective biases or a priori knowledge of the scientist coming into play.

In addition to the above, positivists have tended to believe that the success of natural science in modern times has stemmed from scientists' refusal to go beyond what can be supported by empirical evidence. It is easy to forget how radical an orientation this was in earlier centuries, and perhaps still is in some quarters. It challenges religious claims to knowledge about the world, various kinds of speculative philosophy that do not pay close attention to what is warranted by empirical evidence, and even any appeal to what is 'obvious' to common sense. (E891 Educational Enquiry, Study Guide, p. 79).

(567 words)

Part 3

The third component of my essay is the strengths and weaknesses of structured observation in concern of positivism. Although positivism has been a recurrent theme in the history of western thought from the Ancient Greeks to the present day, it is historically associated with the nineteenth-century French philosopher, Auguste Comte, who was the first thinker to use the word for a philosophical position. In his study of the history of the philosophy and methodology of science, Oldroyd (1986) says: "It was Comte who consciously 'invented' the new science of society and gave it the name to which we are accustomed. He thought that it would be possible to establish it on a 'positive' basis, just like the other sciences, which served as necessary preliminaries to it. For social phenomena were to be viewed in the light of physiological (or biological) laws and theories and investigated empirically, just like physical phenomena. Likewise, biological phenomena were to be viewed in the light of chemical laws and theories; and so on down the line" (Silverman et al, (2000), p.18). Furthermore, Comte's position was to lead to a general doctrine of positivism which held that all genuine knowledge is based on sense experience and can only be advanced by means of observation and experiment. Firstly, Positivism here implies a particular stance concerning the social scientist as an observer of social reality and second the end-product of investigations by social scientists can be formulated in terms parallel to those of natural science. This means that their analyses must be expressed in laws or law-like generalizations of the same kind that have been established in relation to natural.

As naturally believed, positivists often had high hopes that science, and especially a science of human social life, would pave the way for substantial social and political progress, by undermining beliefs and practices that were based solely on superstition or tradition, and replacing them wherever possible with ones founded on scientific evidence. Historically, there is no automatic connection between positivism and the use of quantitative methods of enquiry even though positivism is mainly considered as a quantitative method. However, to a large extent, positivists have, adopted experimental physics as their model. As a result to this, it has been a strong tendency for them to insist that it is essential to use the experimental method, and the forms of statistical analysis modelled on it, to engage in the careful measurement of phenomena, and to look for causal or statistical relationships among variables. These commitments strongly imply the use of quantitative data (E891 Educational Enquiry, Study Guide, p. 89). Another characteristic of positivist philosophy is the view that, to develop knowledge, it is essential to follow special or transparent procedures or methods. The logic behind is that it helps to eliminate the biases that can arise through the influence of the personal and social characteristics of the researcher. In addition, can achieve what is sometimes referred to as procedural objectivity. It also allows others to replicate the research, which in some regard is necessary in order to test whether the knowledge produced is sound, or whether it has been distorted by error or bias by the researcher.

Furthermore, positivism is the idea that research should follow a set of explicit procedures, so that the idiosyncratic effects of who is doing the research can be eliminated and the replicability of the findings checked. Building on this, the concept of structured observation policy-making and practice is often promoted on the grounds that it is 'transparent', since it is guided by explicitly specified knowledge whose validity is open to inspection. The link between positivism and the notion of structured observation does not necessarily mean that the idea that educational research can and should be designed to make a significant contribution to educational policy-making and/or practice. Indeed, one sign that they can have this commitment is that positivism has influenced various forms of action research. This often requires enquiry to be integrated into educational practice, rather than being detached from it in the way that much ordinary research is (E891 Educational Enquiry, Study Guide, p. 219). As we know, structured observations can be made of many aspects of change in learning and teaching , e.g. of learning and teaching activities (lectures, seminars, lab classes), documents and other teaching material presented to students, learning resources, learning environments, interactions between participants. However, as in all methods so in this one strengths and weakness can be distinguished. Structured observation can provide good insights into how the different participants are behaving and interacting. In addition, may enable you to see things that are taken for granted by participants in the learning and teaching context. Their perceived lack of importance by participants may mean that they would not be picked up by other methods that explore participant perceptions.

In addition to the above, the task of the educational investigator is very often to explain the means by which an orderly social world is established and maintained in terms of its shared meanings and how do participant observation techniques assist the researcher in this task. As Bailey mention some inherent advantages in the participant observation approach:

Observation studies are superior to experiments and surveys when data are being collected on non-verbal behaviour.

In observation studies, investigators are able to discern ongoing behaviour as it occurs and are able to make appropriate notes about its salient features.

Because case study observations take place over an extended period of time, researchers can develop more intimate and informal relationships with those they are observing, generally in more natural environments than those in which experiments and surveys are conducted.

Case study observations are less reactive than other types of data-gathering methods. For example, in laboratory-based experiments and in surveys that depend upon verbal responses to structured questions, bias can be introduced in the very data that researchers are attempting to study.

(Silverman et al, (2000), p.18).

In contrast to the above, firstly, structured observation neglects the significance of contexts-temporal and spatial-thereby overlooking the fact those behaviours may be context specific. In their concern for the overt and the observable, researchers may overlook unintended outcomes which may have significance; they may be unable to show how significant are the behaviours of the participants being observed in their own terms. Furthermore, structured observations as a quantitative method in concern with positivism can be time consuming. Getting a representative picture of the implementation over the duration of a pilot or embedding phase of a change in learning and teaching will involve attending more than one learning and teaching activity or event. Continuing, its activities may affect the behaviour of those involved in it and hence what you observe. Participants may be concerned about what you are actually evaluating. Academic staff may be concerned the quality of their teaching is being evaluated and students may be concerned their academic performance is being assessed. The thinking that underlies participants' observed actions cannot be observed. And last, structured observations are therefore used with other methods that seek insight into this thinking. Being able to make sense of the context of evaluation in a limited amount of time with limited resources may require some knowledge of the academic discipline and its culture.

(1210 words)prepi na afereso 110 lexis

Part 4

At this part of my assignment, I will introduce the methodological philosophy of interpretivism. Interpretivism was introduced from German philosopher Max Weber. According to Max Weber from whom the interpretivist tradition is derived, the enterprise of social science could not be treated as similar to that of the natural science. He stressed on 'social action' which means the study of 'meaning' which the individual attaches to his/her actions. Interpretivism's starting point is its insistence on differentiating between the nature of the phenomena investigated by the natural sciences and the nature of those studied by historians, social scientists and educational researchers. Mainly, it argues that people in contrast atoms, chemicals or most non-human forms of life interpret their environment and themselves in ways that are shaped by the particular cultures in which they live. These distinctive cultural orientations shape what they do, and when and how they do it (E891 Educational Enquiry, Study Guide, p. 81).

Interpretivist does not reject the idea of scientific or objective knowledge, but they question the notion that the methods employed by natural science used also in the study of society or social sciences. He stressed on 'social action' which means the study of 'meaning' which the individual attaches to his or her actions. Furthermore Interpretivist criticize Positivists for neglecting the fact that they are studying people who need to be explored in the ways they really think and act in different kinds of situations. Social institutions cannot be treated as separate entities or divorced from the subjective understanding or meaning that people have of them and society cannot be studied on the principle of causality as positivists stress may make a great deal of sense in the natural world but according to the interpretivist, cannot be rigidly applied in the social world. People do not just react to external stimuli like biologically programmed living organisms. They actively interpret and control the situation and control their behavior, acting on the basis of their interpretations of what is going on, what is the best course of action. Many different responses are possible. There are three different interpretations of a single event, i.e.; there is no consistent cause and effect relationship. Whatever the response, an observer cannot make sense of your response without interpreting the meaning you attributed to your teacher's behavior, for it is this meaning that explains your response, not the observable event on its own.

Interpretivists argue that all research methods involve complex forms of communication: therefore, coming to understand other people necessarily relies both on researchers' background cultural knowledge and skills, and on their willingness to suspend prior assumptions and allow understanding of other people's orientations to emerge over the course of enquiry. Thus quite different ways of life and associated beliefs about the world can be located at different points in history and also coexist (peacefully or in conflict) at any one time. Furthermore, this is not just a matter of differences between societies; there is also significant cultural variation within the large, complex societies in which most of us now live. Interpretivists argue that we cannot understand why people do what they do, why particular institutions exist and operate in characteristic ways, without grasping how people interpret and make sense of their world - in other words, the distinctive nature of their beliefs, attitudes and so on.

(554 words)

Part 5

The third component of my essay is the strengths and weaknesses of structured observation in concern of interpretivism. As we know structured observation involves a researcher watching and listening to actions and events within a particular context over a period of time, and then making a record of what he or she has witnessed. A distinction is sometimes drawn between participant and non-participant structured observation, indicating that the role of an observer may vary a good deal. He or she may play a participant role in the setting or the events being observed, or may play no such role other than observer. The primary concern behind this distinction is reactivity - in other words, the extent to which, and the ways in which, the behaviour of the people studied is shaped both by the fact that they are being studied in a given way and by the particular characteristics and participant role of the researcher (E891 Educational Enquiry, Study Guide, p. 121). Generally speaking, qualitative researchers use relatively structured observation as a supplement to other sources of data. Furthermore, researchers undertaking structured observational research generally seek to use low-inference categories - in other words, categories that can be applied to instances with a minimum of contestable judgement on the part of the observer - in the hope of incurring only small elements of error and uncertainty. For example, low-inference categories for observing a meeting might include such things as 'Asks a question', 'Expresses agreement' and 'Makes a proposal'. As a result, this is one of the reasons why interpretivism has encouraged a shift towards qualitative method.

Qualitative methods are usually taken to mean unstructured or structured observation, ethnography, focus groups, and etc. that involve researchers in actively 'listening' to what the researched say. The popularity of the term 'paradigm' is traceable to Kuhn's work on The Structure of Scientific Revolutions; 7 it can be defined as a 'total matrix of beliefs' about theories, research questions and research data (Oakley, 1999, p.155). These observations and experiences are one way of representing the conflict between different ways of achieving knowledge about the world that amongst social researchers are known as 'qualitative' and 'quantitative' methods. A commonly accepted alliance has developed between research method and research subject, according to which 'qualitative' methods are often used to privilege the experiences of oppressed social groups. What I argue is that this division of methodological labour is, firstly, socially and historically constructed, and, secondly, problematic in terms of the potential of 'qualitative' methods to produce an emancipator social science with trustworthy knowledge claims. However, this qualitative method as all the other research methods has strengths and weaknesses points. Taking the advantages strengths at the beginning, I can definitely mention that usually the data is based on the participants' own categories of meaning and the research is only useful for studying a limited number of cases in depth. Not only that, another major advantage of the method is that the researcher can describe complex phenomena something that you can rarely find in any other method.

Structured observation is one of the most straightforward ways to gather information always in concern of interpretivism and get a picture of what is happening in our school or classroom. It is often a good way to begin to explore a situation you want to know more about. It can also be useful to add information to other sources of data you may be collecting for your action enquiry. However, it is important to be aware that as an observer you can often affect the situation you are trying to observe. Generally the role of the observer can be 'pure' (unnoticed, part of the wallpaper) or participatory (e.g. participate in what is going on in the situation observed). The latter use qualitative, structured approaches of observation; the former might use a mixture of both quantitative and qualitative approaches. Whilst the 'pure' observer uses an instrument (e.g. proforma) for the observation, the participant-observer is the instrument. One very common example could be the finding of the class teacher in finding out how children solve a multiplication problem. As a 'pure' observer she or he will use an observation checklist, ticking boxes as she or he observes the pupil on a pre-determined problem-solving activity. Then, as the 'instrument' himself or herself, she or he may ask the pupil what he or she did, why he did it, and may even set him another, but similar, task, to see if he uses the same strategy. By doing so, the teacher will influence the outcome, but in the context of teaching and learning this may be a valid method of structured observation.

Taking the above simple example someone can definitely determine not only the strengths and but also the weaknesses of the method used. From the point of strength, the researcher Can conduct cross-case comparisons and analysis and provides understanding and description of people's personal experiences of the phenomena. Furthermore, the researcher can study dynamic processes, and determine how participants interpret constructs. In addition, qualitative researchers are especially responsive to changes that occur during the conduct of a study and may shift the focus of their studies. In contrast, biases can be developed. Data analysis is often time consuming and the results are more easily influenced by the researcher's personal biases and idiosyncrasies. Meaning that all perceptual processes involving the taking in of information by observation and its subsequent internal processing are subject to bias. Our own interests, experiences, and expectations are likely to influence what we pay attention to and do make a conscious effort to distribute your attention widely and evenly. Finally, It is more difficult to test hypotheses and theories with large participant pools but knowledge produced might not generalize to other people or other settings (i.e., findings might be unique to the relatively few people included in the research study.

(979 words)

Dunkin, M.J. and Biddle, B.J. (1974) The Study of Teaching, New York, Holt, Rinehart and Winston.

Coolican, H. (1990) Research Methods and Statistics in Psychology, London, Hobber and Stoughton.

E891 Educational Enquiry, Media Guide, (2007), The Open University.

E891 Educational Enquiry, Study Guide, (2007), The Open University.

Oakley, A., Peoples way of knowing: gender and methodology. In: Critical issues in social research,Hood, S, Mayall, B. & Oliver, S., pp.154-170. Open University Press, 1999.

McNamara, C., (1999), PhD. General Guidelines for Conducting Interviews, Minnesota.

Ochs, E. (1979) 'Transcriptions as theory' in Ochs, E. (ed.) Developmental Pragmatics, New York, Academic Press.

Research Methods in Education, Handbook, (2003), The Open University.

Stenhouse, L.(1975) An introduction to Curriculum Research and Development, London, Heinemann.

Tripp, D. (1993) Critical Incidents in Teaching, London, Routledge.

Roberts, N. (1975) "Draft definitions: information and library needs, wants, demands and uses: a comment." Aslib Proceedings, 27, 308-313

Silverman, David (2000). Doing Qualitative Research: A Practical Handbook. Sage

4 A brief summary of the second methodological philosophy you have selected (around 500 words). 5 An assessment of the strengths and weaknesses of structured observation from this second point of view (around 1000 words). 6 A conclusion exploring the implications of the comparative assessment you have carried out (around 1000 words).