Saturday, June 1, 2013

Peer Review – Not Worth The Paper

Amazing:
The present investigation was an attempt to study the peer-review process directly, in the natural setting of actual journal referee evaluations of submitted manuscripts. As test materials we selected 12 already published research articles by investigators from prestigious and highly productive American psychology departments, one article from each of 12 highly regarded and widely read American psychology journals with high rejection rates (80%) and nonblind refereeing practices.

With fictitious names and institutions substituted for the original ones (e.g., Tri-Valley Center for Human Potential), the altered manuscripts were formally resubmitted to the journals that had originally refereed and published them 18 to 32 months earlier. Of the sample of 38 editors and reviewers, only three (8%) detected the resubmissions. This result allowed nine of the 12 articles to continue through the review process to receive an actual evaluation: eight of the nine were rejected. Sixteen of the 18 referees (89%) recommended against publication and the editors concurred. The grounds for rejection were in many cases described as “serious methodological flaws.” A number of possible interpretations of these data are reviewed and evaluated.
(via WUWT)

No comments:

Post a Comment

Comments are most welcome! But please:

- No SPAM whatsoever, no supplements, no pharmaceuticals, no herbs or any other advertisements

- Absolutely no quack-doctors pushing their quack-BS websites (and if you are a quack, I will call you out)

- Be critical if you want to, but try to be coherent

Comments are moderated, because I am tired of Gerwyn-V99-The-Idiot and his moronic sockpuppets, and tired of the story of the two dogs, but I will try to publish everything else.

If you are not Gerwyn (and want to tell me something other than the story of the two dogs), then relax and write something! :-)

Labels

5-AZA A. Melvin Ramsay Acne Advocacy Alan Light Alternative medicine is an untested danger Ampligen Andrew Wakefield Anecdote Anthony Komaroff Antibiotics Antibodies Anxiety Aphthous Ulcers Apnea Asthma Autism Autoimmune Disease Behçet’s Ben Katz Bertrand Russell Biology Blood sugar Bruce Carruthers Caffeine Calcium Cancer Capitalism Cardiology Carmen Scheibenbogen CBT/GET CDC Celiac Disease Cereal Grains CFIDS Chagas Charité Charles Lapp Christopher Snell Chronix Clinician Coconut Milk Cognition Common Sense and Confirmation Bias Conversion Disorder Coxiella Burnetii Coxsackie Criteria Crohn's Cushing's Syndrome Cytokine Daniel Peterson Darwinism David Bell Depression Diabetes Diagnostic Differential Disease Diseases of Affluence DNA DNA Sequencing Dog DSM5 EBV EEG Eggs Elaine DeFreitas Elimination Diet Enterovirus Epstein-Barr ERV Etiology Evolution Exercise Challenge Faecal Transplant Fame and Fraud and Medical Science Fatigue Fatty Acids Fibromyalgia Francis Ruscetti Fructose Gene Expression Genetics Giardia Gordon Broderick Gulf War Illness Gut Microbiome Harvey Alter Health Care System Hemispherx Hemolytic Uremic Syndrome Herpesviridae High Blood Pressure Historic Outbreaks HIV HPV Hyperlipid Ian Hickie Ian Lipkin Immune System Infection Intermittent Fasting It's the environment stupid Jacob Teitelbaum Jamie Deckoff-Jones Jo Nijs John Chia John Coffin John Maddox José Montoya Judy Mikovits Karl Popper Kathleen Light Kenny De Meirleir Lactose Lamb Laszlo Mechtler LCMV Lecture Leonard Jason Leukemia Life Liver Loren Cordain Low Carb Low-Dose Naltrexone (LDN) Luc Montagnier Lucinda Bateman Ludicrous Notions Lumpers and Splitters Lyme Mady Hornig Mark Hasslett Martin Lerner Mary Schweitzer MCS ME/CFS Medical Industry Medicine is not based on anecdotes Michael Maes Migraine Milk and Dairy Mitochondria MMR Money and Fame and Fraud MRI Multiple Chemical Sensitivity Multiple Sclerosis Mutton My Symptoms n-1 Nancy Klimas Narcolepsy Neurodermitis Neuroscience NK-Cell Nocebo NSAID Nutrition Obesity On Nutrition Pain Paleo Parathyroid Pathogen Paul Cheney PCR Pharmaceutical Industry Picornavirus Placebo Polio Post Exertional Malaise POTS/OI/NMH PTSD PUFA Q Fever Quote Rare Disease Research Retrovirus Rheumatoid Arthritis Rituximab RNA Robert Gallo Robert Lustig Robert Silverman Robert Suhadolnik Rosario Trifiletti Sarah Myhill Sarcasm Science Sequencing Seth Roberts Shrinks vs. Medicine Shyh-Ching Lo Simon Wessely Sinusitis Sjögren's Somnolence Sonya Marshall-Gradisnik Speculation Stanislaw Burzynski Statins Stefan Duschek Study Sucrose Sugar Supplements Symptoms T1DM T2DM There is no such thing as Chronic Lyme There is no such thing as HGRV Thyroid Tinitus To Do Toni Bernhard Tourette's Treatment Tuberculosis Vaccine Video Vincent Lombardi Vincent Racaniello Virus Vitamin B Vitamin D VP62 When Evidence Based Medicine Isn't Whooping Cough Wolfgang Lutz WPI XMRV You fail science forever