andrew_gelman_stats andrew_gelman_stats-2012 andrew_gelman_stats-2012-1471 knowledge-graph by maker-knowledge-mining

1471 andrew gelman stats-2012-08-27-Why do we never see a full decision analysis for a clinical trial?


meta infos for this blog

Source: html

Introduction: Peter Thall writes: Some years ago, after I gave a talk at Columbia that you attended, you told me that you would like to see a decision-theoretic analysis formulated and carried out to completion by Donald Berry, who had been quite vocal for some time about the importance of such a “fully Bayesian” analysis. I do not work with Berry. But, in recent years I have begun to do utility-based clinical trial design. The trial described in the attached paper [by Thall and Hoang Nguyen] enrolled its first child very recently. While the methodology is not terribly sophisticated, I consider this to be one of the most ethical trials that I have designed. The utility was elicited from the two trial PIs. When we had the pre-trial start-up meeting, a third oncologist looked hard at the utility table, and he said that he agreed completely with the numerical utilities. I doubt that this trial will cure this type of brain tumor, but I do think that the design gives the children a better


Summary: the most important sentenses genereted by tfidf model

sentIndex sentText sentNum sentScore

1 But, in recent years I have begun to do utility-based clinical trial design. [sent-3, score-0.532]

2 The trial described in the attached paper [by Thall and Hoang Nguyen] enrolled its first child very recently. [sent-4, score-0.624]

3 While the methodology is not terribly sophisticated, I consider this to be one of the most ethical trials that I have designed. [sent-5, score-0.443]

4 The utility was elicited from the two trial PIs. [sent-6, score-0.638]

5 When we had the pre-trial start-up meeting, a third oncologist looked hard at the utility table, and he said that he agreed completely with the numerical utilities. [sent-7, score-0.553]

6 I doubt that this trial will cure this type of brain tumor, but I do think that the design gives the children a better chance than they would get otherwise. [sent-8, score-0.6]

7 Still, I think we can improve this methodology by adding some refinements, and we are working on them now. [sent-9, score-0.232]

8 I indeed have been long interested in seeing a formal analysis balancing the goals of medical research, reducing future mortality and morbidity, saving cost, and reducing the risk to experimental subjects. [sent-10, score-0.93]

9 The risks to present patients are balanced by potential future gains for the lifetime of the new procedure. [sent-11, score-0.604]

10 It’s hard to find an example where the costs and benefits are quantified. [sent-13, score-0.157]


similar blogs computed by tfidf model

tfidf for this blog:

wordName wordTfidf (topN-words)

[('thall', 0.461), ('trial', 0.343), ('utility', 0.169), ('reducing', 0.165), ('methodology', 0.16), ('refinements', 0.14), ('morbidity', 0.14), ('nguyen', 0.14), ('balancing', 0.132), ('elicited', 0.126), ('oncologist', 0.126), ('enrolled', 0.118), ('tumor', 0.118), ('future', 0.116), ('terribly', 0.115), ('completion', 0.115), ('begun', 0.11), ('berry', 0.11), ('formulated', 0.108), ('lifetime', 0.108), ('donald', 0.108), ('cure', 0.106), ('saving', 0.106), ('attended', 0.101), ('balanced', 0.1), ('tradeoffs', 0.1), ('mortality', 0.099), ('gains', 0.099), ('carried', 0.099), ('numerical', 0.095), ('patients', 0.093), ('risks', 0.088), ('ethical', 0.086), ('sophisticated', 0.086), ('meeting', 0.085), ('trials', 0.082), ('attached', 0.082), ('agreed', 0.082), ('brain', 0.082), ('child', 0.081), ('hard', 0.081), ('clinical', 0.079), ('formal', 0.078), ('peter', 0.078), ('costs', 0.076), ('adding', 0.072), ('table', 0.07), ('importance', 0.07), ('children', 0.069), ('goals', 0.069)]

similar blogs list:

simIndex simValue blogId blogTitle

same-blog 1 1.0 1471 andrew gelman stats-2012-08-27-Why do we never see a full decision analysis for a clinical trial?

Introduction: Peter Thall writes: Some years ago, after I gave a talk at Columbia that you attended, you told me that you would like to see a decision-theoretic analysis formulated and carried out to completion by Donald Berry, who had been quite vocal for some time about the importance of such a “fully Bayesian” analysis. I do not work with Berry. But, in recent years I have begun to do utility-based clinical trial design. The trial described in the attached paper [by Thall and Hoang Nguyen] enrolled its first child very recently. While the methodology is not terribly sophisticated, I consider this to be one of the most ethical trials that I have designed. The utility was elicited from the two trial PIs. When we had the pre-trial start-up meeting, a third oncologist looked hard at the utility table, and he said that he agreed completely with the numerical utilities. I doubt that this trial will cure this type of brain tumor, but I do think that the design gives the children a better

2 0.12798595 411 andrew gelman stats-2010-11-13-Ethical concerns in medical trials

Introduction: I just read this article on the treatment of medical volunteers, written by doctor and bioethicist Carl Ellliott. As a statistician who has done a small amount of consulting for pharmaceutical companies, I have a slightly different perspective. As a doctor, Elliott focuses on individual patients, whereas, as a statistician, I’ve been trained to focus on the goal of accurately estimate treatment effects. I’ll go through Elliott’s article and give my reactions. Elliott: In Miami, investigative reporters for Bloomberg Markets magazine discovered that a contract research organisation called SFBC International was testing drugs on undocumented immigrants in a rundown motel; since that report, the motel has been demolished for fire and safety violations. . . . SFBC had recently been named one of the best small businesses in America by Forbes magazine. The Holiday Inn testing facility was the largest in North America, and had been operating for nearly ten years before inspecto

3 0.11699782 1510 andrew gelman stats-2012-09-25-Incoherence of Bayesian data analysis

Introduction: Hogg writes: At the end this article you wonder about consistency. Have you ever considered the possibility that utility might resolve some of the problems? I have no idea if it would—I am not advocating that position—I just get some kind of intuition from phrases like “Judgment is required to decide…”. Perhaps there is a coherent and objective description of what is—or could be—done under a coherent “utility” model (like a utility that could be objectively agreed upon and computed). Utilities are usually subjective—true—but priors are usually subjective too. My reply: I’m happy to think about utility, for some particular problem or class of problems going to the effort of assigning costs and benefits to different outcomes. I agree that a utility analysis, even if (necessarily) imperfect, can usefully focus discussion. For example, if a statistical method for selecting variables is justified on the basis of cost, I like the idea of attempting to quantify the costs of ga

4 0.11418144 1200 andrew gelman stats-2012-03-06-Some economists are skeptical about microfoundations

Introduction: A few months ago, I wrote : Economists seem to rely heavily on a sort of folk psychology, a relic of the 1920s-1950s in which people calculate utilities (or act as if they are doing so) in order to make decisions. A central tenet of economics is that inference or policy recommendation be derived from first principles from this folk-psychology model. This just seems silly to me, as if astronomers justified all their calculations with an underlying appeal to Aristotle’s mechanics. Or maybe the better analogy is the Stalinist era in which everything had to be connected to Marxist principles (followed, perhaps, by an equationful explanation of how the world can be interpreted as if Marxism were valid). Mark Thoma and Paul Krugman seem to agree with me on this one (as does my Barnard colleague Rajiv Sethi ). They don’t go so far as to identify utility etc as folk psychology, but maybe that will come next. P.S. Perhaps this will clarify: In a typical economics research pap

5 0.1074053 399 andrew gelman stats-2010-11-07-Challenges of experimental design; also another rant on the practice of mentioning the publication of an article but not naming its author

Introduction: After learning of a news article by Amy Harmon on problems with medical trials–sometimes people are stuck getting the placebo when they could really use the experimental treatment, and it can be a life-or-death difference, John Langford discusses some fifteen-year-old work on optimal design in machine learning and makes the following completely reasonable point: With reasonable record keeping of existing outcomes for the standard treatments, there is no need to explicitly assign people to a control group with the standard treatment, as that approach is effectively explored with great certainty. Asserting otherwise would imply that the nature of effective treatments for cancer has changed between now and a year ago, which denies the value of any clinical trial. . . . Done the right way, the clinical trial for a successful treatment would start with some initial small pool (equivalent to “phase 1″ in the article) and then simply expanded the pool of participants over time as it

6 0.084363751 2135 andrew gelman stats-2013-12-15-The UN Plot to Force Bayesianism on Unsuspecting Americans (penalized B-Spline edition)

7 0.082003511 53 andrew gelman stats-2010-05-26-Tumors, on the left, or on the right?

8 0.078500263 322 andrew gelman stats-2010-10-06-More on the differences between drugs and medical devices

9 0.075207606 48 andrew gelman stats-2010-05-23-The bane of many causes

10 0.07493645 1117 andrew gelman stats-2012-01-13-What are the important issues in ethics and statistics? I’m looking for your input!

11 0.074860282 2049 andrew gelman stats-2013-10-03-On house arrest for p-hacking

12 0.07400848 2328 andrew gelman stats-2014-05-10-What property is important in a risk prediction model? Discrimination or calibration?

13 0.072926715 695 andrew gelman stats-2011-05-04-Statistics ethics question

14 0.068054758 922 andrew gelman stats-2011-09-24-Economists don’t think like accountants—but maybe they should

15 0.067002513 2293 andrew gelman stats-2014-04-16-Looking for Bayesian expertise in India, for the purpose of analysis of sarcoma trials

16 0.066803031 350 andrew gelman stats-2010-10-18-Subtle statistical issues to be debated on TV.

17 0.066618674 2210 andrew gelman stats-2014-02-13-Stopping rules and Bayesian analysis

18 0.062481076 1042 andrew gelman stats-2011-12-05-Timing is everything!

19 0.062335543 2312 andrew gelman stats-2014-04-29-Ken Rice presents a unifying approach to statistical inference and hypothesis testing

20 0.061758865 2115 andrew gelman stats-2013-11-27-Three unblinded mice


similar blogs computed by lsi model

lsi for this blog:

topicId topicWeight

[(0, 0.117), (1, -0.018), (2, -0.024), (3, -0.017), (4, -0.012), (5, -0.0), (6, -0.01), (7, 0.015), (8, -0.007), (9, -0.003), (10, -0.029), (11, -0.025), (12, 0.025), (13, -0.013), (14, 0.008), (15, 0.01), (16, 0.063), (17, -0.021), (18, 0.01), (19, 0.034), (20, -0.021), (21, 0.007), (22, 0.005), (23, 0.02), (24, -0.024), (25, 0.013), (26, -0.031), (27, -0.044), (28, 0.03), (29, -0.007), (30, -0.056), (31, 0.002), (32, 0.017), (33, 0.03), (34, 0.014), (35, -0.046), (36, 0.022), (37, 0.01), (38, 0.049), (39, -0.005), (40, -0.006), (41, -0.023), (42, -0.012), (43, 0.004), (44, 0.024), (45, -0.05), (46, 0.019), (47, 0.006), (48, 0.018), (49, 0.006)]

similar blogs list:

simIndex simValue blogId blogTitle

same-blog 1 0.93442446 1471 andrew gelman stats-2012-08-27-Why do we never see a full decision analysis for a clinical trial?

Introduction: Peter Thall writes: Some years ago, after I gave a talk at Columbia that you attended, you told me that you would like to see a decision-theoretic analysis formulated and carried out to completion by Donald Berry, who had been quite vocal for some time about the importance of such a “fully Bayesian” analysis. I do not work with Berry. But, in recent years I have begun to do utility-based clinical trial design. The trial described in the attached paper [by Thall and Hoang Nguyen] enrolled its first child very recently. While the methodology is not terribly sophisticated, I consider this to be one of the most ethical trials that I have designed. The utility was elicited from the two trial PIs. When we had the pre-trial start-up meeting, a third oncologist looked hard at the utility table, and he said that he agreed completely with the numerical utilities. I doubt that this trial will cure this type of brain tumor, but I do think that the design gives the children a better

2 0.73717213 1364 andrew gelman stats-2012-06-04-Massive confusion about a study that purports to show that exercise may increase heart risk

Introduction: I read this front-page New York Times article and was immediately suspicious. Here’s the story (from reporter Gina Kolata): Could exercise actually be bad for some healthy people? A well-known group of researchers, including one who helped write the scientific paper justifying national guidelines that promote exercise for all, say the answer may be a qualified yes. By analyzing data from six rigorous exercise studies involving 1,687 people, the group found that about 10 percent actually got worse on at least one of the measures related to heart disease: blood pressure and levels of insulin, HDL cholesterol or triglycerides. About 7 percent got worse on at least two measures. And the researchers say they do not know why. “It is bizarre,” said Claude Bouchard, lead author of the paper , published on Wednesday in the journal PLoS One . . . Dr. Michael Lauer, director of the Division of Cardiovascular Sciences at the National Heart, Lung, and Blood Institute, the lead federal

3 0.73406231 411 andrew gelman stats-2010-11-13-Ethical concerns in medical trials

Introduction: I just read this article on the treatment of medical volunteers, written by doctor and bioethicist Carl Ellliott. As a statistician who has done a small amount of consulting for pharmaceutical companies, I have a slightly different perspective. As a doctor, Elliott focuses on individual patients, whereas, as a statistician, I’ve been trained to focus on the goal of accurately estimate treatment effects. I’ll go through Elliott’s article and give my reactions. Elliott: In Miami, investigative reporters for Bloomberg Markets magazine discovered that a contract research organisation called SFBC International was testing drugs on undocumented immigrants in a rundown motel; since that report, the motel has been demolished for fire and safety violations. . . . SFBC had recently been named one of the best small businesses in America by Forbes magazine. The Holiday Inn testing facility was the largest in North America, and had been operating for nearly ten years before inspecto

4 0.69914025 1239 andrew gelman stats-2012-04-01-A randomized trial of the set-point diet

Introduction: Someone pointed me to this forthcoming article in the journal Nutrition by J. F. Lee et al. It looks pretty cool. I’m glad that someone went to the effort of performing this careful study. Regular readers will know that I’ve been waiting for this one for awhile. In case you can’t read the article through the paywall, here’s the abstract: Background: Under a widely-accepted theory of caloric balance, any individual has a set-point weight and will find it uncomfortable and typically unsustainable to keep his or her weight below that point. Set-points have evidently been increasing over the past few decades in the United States and other countries, leading to a public-health crisis of obesity. In an n=1 study, Roberts (2004, 2006) proposed an intervention to lower the set-point via daily consumption of unflavored sugar water or vegetable oil. Objective: To evaluate weight-loss outcomes under the diet proposed by Roberts (2004, 2006). Design: Randomized clinica

5 0.69480479 399 andrew gelman stats-2010-11-07-Challenges of experimental design; also another rant on the practice of mentioning the publication of an article but not naming its author

Introduction: After learning of a news article by Amy Harmon on problems with medical trials–sometimes people are stuck getting the placebo when they could really use the experimental treatment, and it can be a life-or-death difference, John Langford discusses some fifteen-year-old work on optimal design in machine learning and makes the following completely reasonable point: With reasonable record keeping of existing outcomes for the standard treatments, there is no need to explicitly assign people to a control group with the standard treatment, as that approach is effectively explored with great certainty. Asserting otherwise would imply that the nature of effective treatments for cancer has changed between now and a year ago, which denies the value of any clinical trial. . . . Done the right way, the clinical trial for a successful treatment would start with some initial small pool (equivalent to “phase 1″ in the article) and then simply expanded the pool of participants over time as it

6 0.68745077 1766 andrew gelman stats-2013-03-16-“Nightshifts Linked to Increased Risk for Ovarian Cancer”

7 0.68727523 67 andrew gelman stats-2010-06-03-More on that Dartmouth health care study

8 0.67436206 284 andrew gelman stats-2010-09-18-Continuing efforts to justify false “death panels” claim

9 0.67174762 179 andrew gelman stats-2010-08-03-An Olympic size swimming pool full of lithium water

10 0.66447628 48 andrew gelman stats-2010-05-23-The bane of many causes

11 0.66426438 646 andrew gelman stats-2011-04-04-Graphical insights into the safety of cycling.

12 0.6583876 53 andrew gelman stats-2010-05-26-Tumors, on the left, or on the right?

13 0.65579349 1163 andrew gelman stats-2012-02-12-Meta-analysis, game theory, and incentives to do replicable research

14 0.64719373 1905 andrew gelman stats-2013-06-18-There are no fat sprinters

15 0.64712834 1480 andrew gelman stats-2012-09-02-“If our product is harmful . . . we’ll stop making it.”

16 0.64338422 21 andrew gelman stats-2010-05-07-Environmentally induced cancer “grossly underestimated”? Doubtful.

17 0.63751745 732 andrew gelman stats-2011-05-26-What Do We Learn from Narrow Randomized Studies?

18 0.63611007 350 andrew gelman stats-2010-10-18-Subtle statistical issues to be debated on TV.

19 0.6353721 514 andrew gelman stats-2011-01-13-News coverage of statistical issues…how did I do?

20 0.63425249 2367 andrew gelman stats-2014-06-10-Spring forward, fall back, drop dead?


similar blogs computed by lda model

lda for this blog:

topicId topicWeight

[(2, 0.024), (14, 0.225), (16, 0.077), (21, 0.051), (24, 0.222), (29, 0.012), (61, 0.012), (86, 0.036), (91, 0.022), (94, 0.019), (95, 0.039), (99, 0.151)]

similar blogs list:

simIndex simValue blogId blogTitle

same-blog 1 0.87941164 1471 andrew gelman stats-2012-08-27-Why do we never see a full decision analysis for a clinical trial?

Introduction: Peter Thall writes: Some years ago, after I gave a talk at Columbia that you attended, you told me that you would like to see a decision-theoretic analysis formulated and carried out to completion by Donald Berry, who had been quite vocal for some time about the importance of such a “fully Bayesian” analysis. I do not work with Berry. But, in recent years I have begun to do utility-based clinical trial design. The trial described in the attached paper [by Thall and Hoang Nguyen] enrolled its first child very recently. While the methodology is not terribly sophisticated, I consider this to be one of the most ethical trials that I have designed. The utility was elicited from the two trial PIs. When we had the pre-trial start-up meeting, a third oncologist looked hard at the utility table, and he said that he agreed completely with the numerical utilities. I doubt that this trial will cure this type of brain tumor, but I do think that the design gives the children a better

2 0.87852973 1770 andrew gelman stats-2013-03-19-Retraction watch

Introduction: Here (from the Annals of Applied Statistics ). “Thus, arguably, all of Section 3 is wrong until proven otherwise.” As with retractions in general, it makes me wonder about the rest of this guy’s work. Dr. Anil Potti would be pooping in his pants spinning in his retirement .

3 0.85357773 1724 andrew gelman stats-2013-02-16-Zero Dark Thirty and Bayes’ theorem

Introduction: A moviegoing colleague writes: I just watched the movie Zero Dark Thirty about the hunt for Osama Bin Laden. What struck me about it was: (1) Bayes theorem underlies the whole movie; (2) CIA top brass do not know Bayes theorem (at least as portrayed in the movie). Obviously one does not need to know physics to play billiards, but it helps with the reasoning. Essentially, at some point the key CIA agent locates what she strongly believes is OBL’s hidding place in Pakistan. Then it takes the White House some 150 days to make the decision to attack the compound. Why so long? And why, even on the eve of the operation, were senior brass only some 60% OBL was there? Fear of false positives is the answer. After all, the compound could belong to a drug lord, or some other terrorist. Here is the math: There are two possibilities, according to movie: OBL is in a compound (C) in a city or he is in the mountains in tribal regions. Say P(OBL in C) = 0.5. A diagnosis is made on

4 0.8052516 130 andrew gelman stats-2010-07-07-A False Consensus about Public Opinion on Torture

Introduction: John Sides reports on this finding by Paul Gronke, Darius Rejali, Dustin Drenguis, James Hicks, Peter Miller, and Bryan Nakayama, from a survey in 2008:: Gronke et al. write (as excerpted by Sides): Many journalists and politicians believe that during the Bush administration, a majority of Americans supported torture if they were assured that it would prevent a terrorist attack….But this view was a misperception…we show here that a majority of Americans were opposed to torture throughout the Bush presidency…even when respondents were asked about an imminent terrorist attack, even when enhanced interrogation techniques were not called torture, and even when Americans were assured that torture would work to get crucial information. Opposition to torture remained stable and consistent during the entire Bush presidency. Gronke et al. attribute confusion of beliefs to the so-called false consensus effect studied by cognitive psychologists, in which people tend to assume th

5 0.79126793 1809 andrew gelman stats-2013-04-17-NUTS discussed on Xi’an’s Og

Introduction: Xi’an’s Og (aka Christian Robert’s blog) is featuring a very nice presentation of NUTS by Marco Banterle, with discussion and some suggestions. I’m not even sure how they found Michael Betancourt’s paper on geometric NUTS — I don’t see it on the arXiv yet, or I’d provide a link.

6 0.78510457 1584 andrew gelman stats-2012-11-19-Tradeoffs in information graphics

7 0.77037251 824 andrew gelman stats-2011-07-26-Milo and Milo

8 0.75813925 755 andrew gelman stats-2011-06-09-Recently in the award-winning sister blog

9 0.75812864 2346 andrew gelman stats-2014-05-24-Buzzfeed, Porn, Kansas…That Can’t Be Good

10 0.75786841 1051 andrew gelman stats-2011-12-10-Towards a Theory of Trust in Networks of Humans and Computers

11 0.75743067 1696 andrew gelman stats-2013-01-29-The latest in economics exceptionalism

12 0.75046563 433 andrew gelman stats-2010-11-27-One way that psychology research is different than medical research

13 0.74976707 1376 andrew gelman stats-2012-06-12-Simple graph WIN: the example of birthday frequencies

14 0.74929309 1455 andrew gelman stats-2012-08-12-Probabilistic screening to get an approximate self-weighted sample

15 0.748276 1479 andrew gelman stats-2012-09-01-Mothers and Moms

16 0.74794871 953 andrew gelman stats-2011-10-11-Steve Jobs’s cancer and science-based medicine

17 0.74614263 482 andrew gelman stats-2010-12-23-Capitalism as a form of voluntarism

18 0.74573493 1092 andrew gelman stats-2011-12-29-More by Berger and me on weakly informative priors

19 0.74558663 1757 andrew gelman stats-2013-03-11-My problem with the Lindley paradox

20 0.74542487 1706 andrew gelman stats-2013-02-04-Too many MC’s not enough MIC’s, or What principles should govern attempts to summarize bivariate associations in large multivariate datasets?