Content-Type: text/html Question Order Running head: IMPACT OF QUESTION ORDER ON THE THIRD-PERSON EFFECT Impact of Question Order on the Third-Person Effect Michel Dupagne and Michael B. Salwen University of Miami Bryant Paul University of California, Santa Barbara Paper submitted for consideration to the Communication Theory and Methodology Division for the 1999 convention of the Association for Education in Journalism and Mass Communication, April 1, 1999. Corresponding author: Michel Dupagne, School of Communication, P.O. Box 248127, University of Miami, Coral Gables, FL 33124-2030; Phone: (305) 284-3500; Fax: (305) 284-3648; E-mail: [log in to unmask] Abstract A nationwide telephone survey was conducted to investigate the impact of question order on the perceptual and behavioral hypotheses of the third-person effect. Key questions included estimated effects of media issues on self, perceived effects on others, and support for restrictions on the media. Four question-order conditions (restrictions-others-self, restrictions-self-others, others-self-restrictions, self-others-restrictions) were tested with three issues (television violence, televised trials, and negative political advertising). In line with past research, the order of the self, others, and restrictions questions did not affect the perceptual hypothesis. However, the sequencing of the self, others, and restrictions questions affected support for the behavioral hypothesis in some conditions. The results suggest that, consistent with a saliency effect, placement of self and others questions prior to the restrictions question might heighten respondents' willingness to endorse restrictions on the media and increase support for the behavioral hypothesis. Impact of Question Order on the Third-Person Effect The third-person effect, conceived by sociologist W. Phillips Davison (1983) as an intriguing observation, has developed into a programmatic line of communication and public opinion research. The effect hypothesizes that (1) people exposed to persuasive mass media messages will perceive these messages to wield greater influence on people other than themselves (the perceptual hypothesis, which goes by such names as third-person perception, perceptual bias, and self-others discrepancy); and (2) people who exhibit third-person perception will be more likely to support restrictions on these media messages (the behavioral hypothesis) (e.g., McLeod, Eveland, & Nathanson, 1997; Rojas, Shah, & Faber, 1996; Salwen, 1998). The perceptual hypothesis has received considerable empirical support. For instance, Perloff (1996) recently reported that 15 of 16 studies were consistent with this hypothesis (see also Lasorsa, 1992; Perloff, 1993). On the other hand, the few studies that tested the behavioral hypothesis have reported mixed or qualified support (Gunther, 1995; McLeod et al., 1997; Perloff, 1993, 1996; Rucinski & Salmon, 1990; Salwen, 1998). Methodologically, typical third-person effect studies have respondents estimate the impact of at least one media message on themselves (i.e., self effects) and their perceptions of the message's impact on other people (i.e., others effects). Question order is a concern in all research (e.g., Bradburn, 1983; Converse & Presser, 1986; Schuman & Presser, 1981), but it is a special concern in third-person effect studies because respondents are asked to directly compare the effects of media messages on themselves to those on other people (Price & Tewksbury, 1996). Researchers have long recognized that in making self-others comparisons people might characterize their responses in a self-serving manner so that they appear smarter and less susceptible to harmful media effects than other people (Brown, 1986; Glynn, Ostman, & McDonald, 1995; Gunther, 1991; Lasorsa, 1989; Perloff, 1993). It is therefore apparent that the order of the self and others effects questions might affect the outcome. In one of the early third-person effect studies, Lasorsa (1989) argued that back-to-back self-then-others questions could lead to an underestimation of third-person perception by encouraging respondents to move "the answer to the second question closer to that of the first" (p. 377; see also Lasorsa, 1992). Conversely, the others-then-self question order could artificially increase the third-person gap if respondents systematically use the others question as a baseline for answering the self question. In the survey research literature, this type of order effect is known as the "consistency" (Bradburn, 1983; Bradburn & Mason, 1964) or "carryover" effect (Tourangeau, Rasinski, Bradburn, & D'Andrade, 1989). David and Johnson (1998) theorized that this phenomenon may occur because respondents cognitively assign a high rating or anchor to the others question, as a result of a general perception of greater media effects on others, and then mark down the media effect on self. They referred to this process as an anchoring bias. A number of researchers have acknowledged this problem and attempted to address it by alternating the self and others questions (David & Johnson, 1998; Gunther, 1995; Mason, 1995; Park, 1997; Price, Tewksbury, & Huang, 1998; Salwen 1998; Salwen & Driscoll, 1997; Tiedge, Silverblatt, Havice, & Rosenfeld, 1991). With the exception of David and Johnson (1998),1 these researchers reported no significant question-order effects on third-person perception. Brosius and Engel (1996) went so far as to flatly state that "Methodological artifacts due to question order can therefore be excluded" (p. 144). But Price and Tewksbury (1996) recognized that reversing the self and others effects questions only partly resolved the methodological concerns associated with question order in third-person effect studies. They argued that possible question-contrast effects (i.e., the self-serving comparisons that people make when they contrast themselves to others) could not be addressed by reversing the sequence of the questions. In addition to designing self-then-others and others-then-self conditions, Price and Tewksbury also included self-only and others-only conditions in experimental studies where respondents were not asked to contrast media effects on them to those on other people. After testing a series of issues in two experiments and finding no consistent differences, they declared third-person perception to be "a robust observation, occurring in every measurement condition and in response to four different stimuli" (p. 137). In recent years, more researchers have stressed the importance of testing the behavioral hypothesis. McLeod et al. (1997) claimed that the perceptual hypothesis "becomes more meaningful if it is linked with real-world consequences as hypothesized by Davison" (p. 154). Studies that include a behavioral component typically incorporate a measure of support for message restrictions. For example, respondents might be asked their support for the creation of an oversight body to restrict unfair or misleading campaign messages (Rucinski & Salmon, 1990; Salwen, 1998). But despite growing scholarly interest in the behavioral hypothesis, research has not yet addressed the impact of question order when third-person effect studies involve both self-others questions and a behavioral question. In this situation, the issue of question-order becomes more complicated as researchers who previously had to deal with the sequencing of two central concepts (i.e., self effects and others effects) now have to consider a third behavioral evaluation. As Salwen (1997) noted, the placement of the behavioral question in a third-person effect study poses methodological challenges: It may be that in responding to the self and others effects questions, respondents pause and reflect on questions concerning media influence in society and on the particular issues under study. This self-reflection about media influence may affect respondents' behavioral intentions about the issues. If so, this can have consequences for the behavioral component of the third-person effect, and it underscores the need for methodological studies that examine the placement of the behavioral questions before and after administering the sets of self and others questions in study designs. (p. 28) This study investigated whether the sequencing of the self, others, and restrictions questions affects the perceptual and behavioral outcomes of the third-person effect. Absence of question-order effects in this study would strengthen the overall robustness of the perceptual and behavioral hypotheses. The presence of question-order effects, however, would warn of the need to test for question-order effects in third-person effect studies. Method A telephone survey was conducted with a random sample of 721 adults in the continental United States during the weekday evenings from March 31 to April 11, 1997.2 There were up to five callbacks. Calls were made from a central location at a university research facility. Excluding ineligibles, faxes, and nonworking numbers, the response rate was 58%. Each respondent was randomly assigned to evaluate one of three issues: television violence (n = 236), televised trials (n = 244), or negative political advertising (n = 241). To increase the reliability of the findings through repeated tests, we used multiple issues in this study (see Price & Tewksbury, 1996). The issues were selected based on the pretest below and assessments by the authors. Within the issue conditions, each respondent was randomly assigned to one of four question-order variations: restrictions-others-self (n = 182), restrictions-self-others (n = 181), others-self-restrictions (n = 181), or self-others-restrictions (n = 177). Therefore, there were a total of 12 conditions in this study. With regard to third-person perception, the survey assessed two dimensions of media effects: power and immorality. In February 1997, a pretest was conducted with 165 undergraduate students to develop reliable third-person effects scales. The six pretest issues were: televised trials, X-rated videos, press coverage of war, negative political advertising, hate speech parades, and violent and misogynic music lyrics. Factor analyses using varimax rotation yielded two four-item dimensions: power effects of the media (persuasive, powerful, significant, and strong) and immoral effects of the media (corrupting, immoral, indecent, and vulgar). Cronbach's alphas ranged from .78 to .89 for the power effects on others and from .72 to .93 for the power effects on themselves. Cronbach's alphas ranged from .71 to .85 for the immoral effects on others and from .75 to .86 for the immoral effects on themselves. Based on these pretest data, scales of media power (powerful, persuasive, significant, and strong) and immoral (immoral, indecent, vulgar, and corrupting) effects on self and on others were constructed. The scales ranged from 1 to 5, where 1 meant not at all [adjective] on [you/others] and 5 meant very [adjective] on [you/others] (see Appendix for question wording). Paired t tests between responses to self and others questions were used to test the perceptual hypothesis. To measure support for media restrictions, respondents were asked to report their endorsement for government restrictions on the three issues (see Appendix). This restrictions measure, based on a variation of a similar index used by Rucinski and Salmon (1990), appraised legal restrictions to overcome the undesirability associated with expressing support for censorship. Consistent with the third-person effect literature, the behavioral hypothesis was tested by correlating the support for restrictions measure with third-person perception. Results Question Order and Means of Self, Others, and Restrictions Measures We first conducted a series of one-way analyses of variance to identify significant differences in mean scores of self, others, and restrictions measures across question-order conditions by issue and effect (Table 1). Only the means of the self question for the power (F(3, 228) = 3.15, p < .05) and immoral (F(3, 227) = 4.94, p < .01) effect scales in the television violence issue were significantly different from one another. The Scheff post-hoc test uncovered a significant mean difference in self responses for immoral effects between the restrictions-others-self condition and the restrictions-self-others condition, as well as between the restrictions-self-others condition and the others-self-restrictions condition (Table 1). There were no significant differences in support for restrictions scores among the four question-order conditions for all three issues. The two-way ANOVAs revealed no significant interactions between question order and issue on the self, others, and restrictions measures for both power and immoral scales. Question Order and Third-Person Perception Scores The one-way ANOVAs also indicated no significant differences in third-person perception scores (i..e., obtained by subtracting the mean scores of others from those of self) among the four question-order conditions for the televised trials issue. But both F values of the power (F(3, 225) = 2.97, p < .05) and immoral effects (F(3, 224) = 4.69, p < .01) for television violence were statistically significant, indicating that the size of the third-person perception gap varies significantly across question-order conditions for this issue. In the case of immoral effects, respondents in the restrictions-self-others (M = 0.72, SD = 1.28) and self-others-restrictions (M = 0.74, SD = 1.40) conditions had a significantly lower third-person perception gap than those in the others-self-restrictions condition (M = 1.42, SD = 1.28) . In the case of power effects, however, the Scheff test yielded no significant differences among mean values. As for negative political advertising, the F value of immoral effects was statistically significant, F(3, 220) = 2.81, p < .05, but again the Scheff results were insignificant. There were no significant interactions between question order and issue on third-person perception for both power and immoral scales. Question Order and Perceptual Hypothesis From a theoretical point of view, the most important aspect of this study remains whether question order affects support for the third-person effect. The answer was clearly negative for the perceptual hypothesis across all three issues (Table 3). With the exception of immoral effects for the negative political advertising issue in the restrictions-self-others condition, all paired t tests between self and others mean scores were statistically significant at p < . 05, indicating support for the perceptual hypothesis across question-order conditions. Question Order and Behavioral Hypothesis But the results were more ambiguous when we examined the impact of question order on support for the behavioral hypothesis (Table 4). Eighteen of the 24 correlation coefficients were statistically insignificant, indicating a lack of support for the behavioral hypothesis.3 Explained variances in the restrictions measure by third-person perception range from 0.04% to 18%. For television violence, three (restrictions-others-self, restrictions-self-others, others-self-restrictions) of the four conditions yielded nonsignificant correlations between support for restrictions and power or immoral effect perceptions. Only the self-others-restrictions condition for television violence produced significant correlations for both power and immoral effects. For televised trials, correlations were insignificant in the restrictions-self-others and self-others-restrictions conditions but significant in the restrictions-others-self and others-self-restrictions conditions. For negative political advertising, all correlation coefficients were insignificant except for power effects in the others-self-restrictions condition.4 However, when we tested for significant differences between all 36 paired correlations,5 we found that only two pairs, restrictions-others-self with self-others-restrictions (Z = -2.19, p < .05) and others-self-restrictions with others-self-restrictions (Z = -2.11, p < .05) in the television violence condition, were significantly different from one another. To provide a clearer picture of the question-order variations, we collapsed the four conditions into two conditions (restrictions first and restrictions last). Although four correlation coefficients were statistically significant, indicating support for the behavioral hypothesis, we found no significant differences between the six pairs (Table 5). Discussion Consistent with previous research (e.g., Price & Tewksbury, 1996), this study confirmed the robustness of the perceptual third-person effect across issues, even when a third behavioral question was factored into the design. Alternating the order of perceptual and behavioral questions did not affect support for third-person perception. But the results concerning the behavioral hypothesis were much less clear-cut: Respondents in some question-order conditions were more likely to endorse restrictions on media messages than in other conditions. Initially, these results revealed several significant correlation coefficients, but not a systematic pattern. When we collapsed the four question-order conditions into restrictions first and last conditions, the findings then suggested that the positioning of the restrictions measure affected support for the behavioral hypothesis. Four of the six correlations in the restrictions last condition were significant. Why would asking the restrictions question after the self and others questions result in greater support for the behavioral hypothesis? One explanation lies in the saliency effect (Bradburn & Mason, 1964). Drawing attention to a controversial or undesirable message, by asking perception questions on self and others, could increase respondents' likelihood to support message restrictions. Respondents have more time to ponder issues before asserting their position on the restrictions question. This interpretation is consistent with the results of Schwarz and Hippler (1995), who alternated attitudinal and behavioral questions. They found that German respondents reported a higher level of donation "for the suffering population of Russia" (p. 97) when this intended behavior question preceded attitudinal questions about taxation and welfare spending in Germany than when it was asked after the attitudinal questions. The behavioral hypothesis results also underscored the fact that not all media effects are equal and might lead to different outcomes when subjected to question-order variations. It is clear from Table 5 that the power dimension of third-person perception was a significantly better predictor of restrictions than the immoral dimension for televised trials and negative political advertising. In hindsight, this finding is not surprising because television violence has the clearest moral dimension, while televised trials and negative political advertising are issues involving news and public affairs topics reported by the media; hence the greater relevance of the power dimension for these issues. We should note that this study did not examine whether placement of the restrictions question between the self and others questions affects third-person effect outcomes. This additional permutation is an area for future research. Perhaps placing the restrictions question as a buffer item between the self and others questions or separating the self-others questions from the restrictions question with unrelated buffer questions might alleviate or reduce the question-order effects on the behavioral hypothesis we observed in this study. Bishop, Oldendick, and Tuchfarber (1984) found that question-order effects cannot eliminated or minimized by simply interposing a series of questions on unrelated topics between the questions about the respondent's representative and the question about the respondent's interest in government and public affairs (see also Bishop, 1987). On the other hand, Schwartz and Schuman (1997), replicating the Bishop studies, found that introducing a single related buffer item (about the representative's public relations work) did greatly reduce the question-order effects reported by Bishop and his collaborators (Bishop, 1987; Bishop et al., 1984). As more researchers test the behavioral hypothesis of the third-person effect, they must be aware of the ramifications that question-order variations raise for behavioral outcomes. Unlike its perceptual counterpart, the behavioral hypothesis might be affected by question order. Certainly more research is needed to test this proposition. If question-order variations affect behavioral outcomes, then researchers need to investigate what can be done to minimize these artifacts. Notes 1David and Johnson (1998) found no significant difference between the others and self questions (i.e., no third-person perception effect) for one (eating disorder likelihood) of their three outcome undesirability measures (the other two being ideal body weight and self-esteem) when the self question was asked last. The authors concluded that "Although the role of question order might not be discernible for low undesirable outcomes, it plays an important role in high undesirability outcomes" (p. 52). 2The sample was drawn from the most recent Select Phone CD-ROM national telephone directories database. The last digit of each selected telephone number in the database was randomly changed so that unlisted numbers had a chance to be included. 3Regression analyses, with the support for restrictions measure as the dependent variable and either the power or immoral dimension of third-person perception as the independent variable, produced the same results. 4In the third-person literature, education is sometimes cited as a predictor of third-person effects because education allows people to perceive themselves as more knowledgeable and less vulnerable to harmful media messages than other people (e.g., Gunther 1995; Rucinski & Salmon, 1990; Salwen, 1998; Tiedge et al., 1991). Controlling for education and number of children did not substantially alter the pattern of the zero-order correlation findings. Number of children was also included as a control, because respondents with children might be more inclined to support restrictions on media messages perceived as harmful to children, such as television violence (Cooper, 1996). 5Because there is no statistical test to determine whether there is a significant difference among three or more correlation coefficients using the same variables, i.e., the equivalent of an F test for correlation coefficients, we used a bivariate test for assessing interactions between the correlation coefficients (see Blalock, 1960). Appendix: Question Wording Television Violence Others Questions: "Some people claim that violence on television has various effects on society. I am going to mention some possible effects that people have said television violence might have on society. Using a 1-to-5 scale, where 1 means not at all and 5 means very, please tell me how well you think that each word I mention describes the effects of television violence on society." The items were: powerful, persuasive, immoral, strong, indecent, significant, vulgar, and corrupting. Self Questions: "Again using the 1-to-5 scale, this time tell me how well you think the word describes the effects of television violence on you." The items were: powerful, persuasive, immoral, strong, indecent, significant, vulgar, and corrupting. Support for Restriction Question: "Using a 1-to-5 scale, where 1 means you strongly disagree and 5 means you strongly agree, do you think that a government commission should be created with the legal power to ban what it finds to be excessive violence on television?" Televised Trials Others Questions: "Some people claim that live television coverage of courtroom trials has various effects on society. I am going to mention some possible effects that people have said televised trials have on society. Using a 1-to-5 scale, where 1 means not at all and 5 means very, please tell me how well you think that each word I mention describes the effects of televised trials on society." The items were: powerful, persuasive, immoral, strong, indecent, significant, vulgar, and corrupting. Self Questions: "Again using the 1-to-5 scale, this time tell me how well you think the word describes the effects of televised trials on you." The items were: powerful, persuasive, immoral, strong, indecent, significant, vulgar, and corrupting. Support for Restrictions Question: "Using a 1-to-5 scale, where 1 means you strongly disagree and 5 means you strongly agree, do you think there ought to be a law banning the news media from televising live trials?" Negative Political Advertising Others Questions: "Some people claim that negative political advertisements, in which candidates for public office attack their opponents by name, have various effects on society. I am going to mention some possible effects that negative political advertisements might have on society. Using a 1-to-5 scale, where 1 means not at all and 5 means very, please tell me how well you think that each word I mention describes the effects of negative political advertisements on society." The items were: powerful, persuasive, immoral, strong, indecent, significant, vulgar, and corrupting. Self Questions: "Again using the 1-to-5 scale, this time tell me how well you think the word describes the effects of negative political advertisements on you." The items were: powerful, persuasive, immoral, strong, indecent, significant, vulgar, and corrupting. Support for Restrictions Question: "Using a 1-to-5 scale, where 1 means you strongly disagree and 5 means you strongly agree, would you support a law banning negative political advertisements in which candidate for public office attack their opponents by name?" References Bishop, G. F. Context effects on self-perceptions of interest in government and public affairs. In H. J. Hippler, N. Schwarz, & S. Sudman (Eds.), Social information processing and survey methodology (pp. 179-199). New York: Springer-Verlag. Bishop, G. H., Oldendick, R. W., & Tuchfarber, A. (1984). What must my interest in politics be if I just told you "I don't know"? Public Opinion Quarterly, 48, 510-519. Blalock, H. M., Jr. (1960). Social statistics. New York: McGraw-Hill. Bradburn, N. M. ( 1983). Response effects. In P. H. Rossi, J. D. Wright, & A. B. Anderson (Eds.), Handbook of survey research (pp. 289-328). New York: Academic Press. Bradburn, N. M., & Mason, W. M. (1964). The effect of question order on responses. Journal of Marketing Research, 1, 57-61. Brosius, H. B., & Engel, D. (1996). The causes of third-person effects: Unrealistic optimism, impersonal impact, or generalized negative attitudes towards media influence? International Journal of Public Opinion Research, 8, 142-162. Brown, J. D. (1986). Evaluations of self and others: Self-enhancement biases in social judgments. Social Cognition, 4, 353-376. Converse, J. M., & Presser, S. (1986). Survey questions: Handcrafting the standardized questionnaire. Beverly Hills, CA: Sage. Cooper, C. A. (1996). Violence on television: Congressional inquiry, public criticism and industry response, a policy analysis. Lanham, MD: University Press of America. David, P., & Johnson, M. A. (1998). The role of self in third-person effects about body image. Journal of Communication, 48(4), 37-58. Davison, W. P. (1983). The third-person effect in communication. Public Opinion Quarterly, 47, 1-15. Glynn, C. J., Ostman, R. E., & McDonald, D. G. (1995). Opinions, perception, and social reality. In T. L. Glasser & C. T. Salmon (Eds.), Public opinion and the communication of consent (pp. 249-277). New York: Guilford. Gunther, A. C. (1991, August). The third-person effect and support for restrictions on pornography. Paper presented at the annual meeting of the Association for Education in Journalism and Mass Communication, Boston, MA. Gunther, A. C. (1995). Overrating the x-rating: The third-person perception and support for censorship of pornography. Journal of Communication, 45(1), 27-38. Lasorsa, D. L. (1989). Real and perceived effects of "Amerika." Journalism Quarterly, 66, 373-378, 529. Lasorsa, D. L. (1992). Policymakers and the third-person effect. In J. D. Kennamer (Ed.), Public opinion, the press, and public policy (pp. 163-175). Westport, CT: Praeger. Mason, L. (1995). Newspapers as repeater: An experiment on defamation and third-person effect. Journalism & Mass Communication Quarterly, 72, 610-620. McLeod, D. M., Eveland, W. P. Jr., & Nathanson, A. I. (1997). Support for censorship of violent and misogynic rap lyrics: An analysis of the third-person effect. Communication Research, 24, 153-174. Park, E. (1997, August). Individualism/collectivism, cultural variations in self-concept and their implications for the false-uniqueness hypotheses: The cases of the third-person effect and optimistic illusion. Paper presented at the annual meeting of the Association for Education in Journalism and Mass Communication, Chicago, IL. Perloff, R. M. (1993). Third-person effect research 1983-1992: A review and synthesis. International Journal of Public Opinion Research, 5, 167-183. Perloff, R. M. (1996). Perceptions and conceptions of political media impact: The third-person effect and beyond. In A. N. Crigler (Ed.), The psychology of political communication (pp. 177-197). Ann Arbor: The University of Michigan Press. Price, V., & Tewksbury, D. (1996). Measuring the third-person effect of news: The impact of question order, contrast and knowledge. International Journal of Public Opinion Research, 8, 120-141. Price, V., Tewksbury, D., & Huang, L. N. (1998). Third-person effects on publication of a holocaust-denial advertisement. Journal of Communication, 48(2), 3-26. Rucinski, D., & Salmon, C. T. (1990). The 'other' as the vulnerable voter: A study of the third-person effect in the 1988 U.S. presidential campaign. International Journal of Public Opinion Research, 2, 345-368. Rojas, H., Shah, D. V., & Faber, R. J. (1996). For the good of others: Censorship and the third-person effect. International Journal of Public Opinion Research, 8, 163-186. Salwen, M. B. (1997, August). Perceptions of media power and fairness in campaign '96: The third-person effect and support for press restrictions. Paper presented at the annual meeting of the Association for Education in Journalism and Mass Communication, Chicago, IL. Salwen, M. B. (1998). Perceptions of media influence and support for censorship: The third-person effect in the 1996 Presidential election. Communication Research, 25, 259-285. Salwen, M. B., & Driscoll, P. D. (1997). Consequences of third-person perception in support of press restrictions in the O.J. Simpson trial. Journal of Communication, 47(2), 60-78. Schuman, H., & Presser, S. (1981). Questions and answers in attitude surveys: Experiments on question form, wording, and context. New York: Academic Press. Schwarz, N., & Hippler, H. J. (1995). Subsequent questions may influence answers to preceding questions in mail surveys. Public Opinion Quarterly, 59, 93-97. Schwarz, N., & Schuman, H. (1997). Political knowledge, attribution, and inferred interest in politics: The operation of buffer items. International Journal of Public Opinion Research, 9, 191-194. Tiedge, J. T., Silverblatt, A., Havice, M. J., & Rosenfeld, R. (1991). Discrepancy between perceived first-person and perceived third-person mass media effects. Journalism Quarterly, 68, 141-154. Tourangeau, R., Rasinski, K. A., Bradburn, N., & D'Andrade, R. (1989). Carryover effects in attitude surveys. Public Opinion Quarterly, 53, 495-524. Table 1 Means and Standard Deviations of Self, Others, and Restrictions Measures across Question-Order Conditions by Issue and Effect R-O-S R-S-O O-S-R S-O-R Total M SD M SD M SD M SD F M SD Television Violence Power Self 2.09 1.14 2.60 1.38 2.05 1.18 2.53 1.20 3.15* 2.34 1.24 Others 3.63 1.17 3.67 1.13 3.55 1.08 3.47 1.13 0.38 3.58 1.13 Immoral Self 2.27a 1.39 3.07ab 1.50 2.23b 1.34 2.78 1.32 4.94** 2.59 1..42 Others 3.65 1.27 3.78 1.24 3.65 1.19 3.52 1.27 0.44 3.64 1.24 Restrictions 3.03 1.51 3.23 1.58 3.25 1.64 2.90 1.54 0.66 3.10 1.56 Televised Trials Power Self 2.80 1.24 2.64 1.23 2.58 1.26 2.59 1.16 0.40 2.66 1.22 Others 3.52 1.07 3.79 0.88 3.61 1.04 3.55 1.06 0.82 3.61 1.03 Immoral Self 2.34 1.53 2.12 1.12 2.05 1.33 2.45 1.29 1.17 2.24 1.34 Others 2.94 1.41 2.80 1.22 2.55 1.30 2.83 1.28 0.98 2.73 1.29 Restrictions 2.90 1.67 3.13 1.48 3.11 1.64 3.05 1.64 0.24 3.05 1.60 Negative Political Advertising Power Self 2.47 1.03 2.43 1.09 2.44 1.03 2.47 0.99 0.03 2.47 1.03 Others 3.45 1.03 3.26 1.02 3.24 1.00 3.26 0.96 0.58 3.30 1.00 Immoral Self 2.59 1.27 3.06 1.36 2.80 1.35 3.12 1.30 2.04 2.92 1.33 Others 3.24 1.22 3.22 1.32 3.43 1.11 3.47 1.14 0.63 3.34 1.21 Restrictions 3.07 1.69 2.87 1.59 3.45 1.76 2.98 1.74 1.29 3.09 1.70 Note. The four question-order conditions are: R-O-S = Restrictions-Others-Self; R-S-O = Restrictions-Self-Others; O-S-R = Others-Self-Restrictions; and S-O-R = Self-Others-Restrictions. Common superscripts within rows indicate significant differences between groups by the Scheff method at p < .05. *p < .05. **p < .01. Table 2 Differences in Third-Person Perception Scores across Question-Order Conditions by Issue and Effect Restrict.-Others-Self Restrict.-Self-Others Others-Self-Restrict. Self-Others -Restrict. Total M SD M SD M SD M SD F M SD Television Violence Power 1.52 1.29 1.03 1.37 1.48 1.35 0.93 1.31 2.97* 1.24 1.35 Immoral 1.31 1.19 0.72a 1.28 1.42ab 1.28 0.74b 1.40 4.69** 1.05 1.32 Televised Trials Power 0.74 1.57 1.10 1.30 1.02 1.12 0.95 1.14 0.78 0.95 1.29 Immoral 0.56 1.25 0.58 1.31 0.51 0.83 0.31 0.82 0.65 0.49 1.07 Negative Political Advertising Power 0.96 1.30 0.83 1.06 0.80 1.26 0.74 0.82 0.40 0.83 1.12 Immoral 0.68 1.06 0.12 1.10 0.54 1.06 0.34 1.10 2.81* 0.42 1.09 Note. Common superscripts within rows indicate significant differences between groups by the Scheff method at p < .05. *p < .05. **p < .01. Table 3 Testing the Perceptual Third-Person Hypothesis across Question-Order Conditions: Paired t Tests Between Others and Self Mean Scores Restrict.-Others-Self Restrict.-Self-Others Others-Self-Restrict. Self-Other s-Restrict Total t df t df t df t df t df Television Violence Power 9.01** (58) 5.62** (55) 8.16** (54) 5.46** (58) 13.91** (228) Immoral 8.31** (56) 4.20** (54) 8.40** (56) 4.04** (58) 11.98** (227) Televised Trials Power 3.50** (54) 6.27** (54) 7.09** (60) 6.35** (57) 11.22** (228) Immoral 3.41** (58) 3.21** (52) 4.95** (63) 2.74** (50) 6.95** (226) Negative Political Advertising Power 5.49** (54) 6.03** (59) 4.82** (57) 6.66** (54) 11.16** (227) Immoral 4.78** (55) 0.84 (56) 3.72** (53) 2.36* (56) 5.71** (223) *p < .05. **p < .01. Table 4 Testing the Behavioral Third-Person Hypothesis across Question-Order Conditions: Zero-Order Correlations Between Support for Restrictions and Power and Immoral Effects of Third-Person Perception Restrict.-Others-Self Restrict.-Self-Others Others-Self-Restrict. Self-Other s-Restrict. Total r n r n r n r n r n Television Violence Power .02a (58) .08 (52) .03b (55) .41**ab (59) .14* (224) Immoral .19 (56) .10 (51) .18 (57) .38** (59) .22** (223) Televised Trials Power .43** (53) .08 (52) .31* (61) .12 (58) .26** (224) Immoral .10 (55) .19 (51) .25* (64) -.13 (51) .11 (221) Negative Political Advertising Power .23 (54) -.12 (60) .38** (58) .17 (55) .18** (227) Immoral -.02 (54) -.07 (57) .23 (54) .05 (57) .06 (222) Note. Common subscripts indicate significance at p < .05 between paired correlation coefficients. *p < .05. **p < .01. Table 5 Testing the Behavioral Third-Person Hypothesis with Combined Question-Order Conditions: Zero-Order Correlations Between Support for Restrictions and Power and Immoral Effects of Third-Person Perception Restrictions First Restrictions Last r n r n Z Television Violence Power .03 (110) .23* (114) 1.48 Immoral .12 (107) .30** (116) 1.43 Televised Trials Power .30** (105) .22* (119) 0.63 Immoral .14 (106) .08 (115) 0.42 Negative Political Advertising Power .07 (114) .30** (113) 1.71 Immoral -.02 (111) .15 (111) 1.25 *p < .05. **p < .01.