{"id":926,"date":"2008-02-17T17:40:17","date_gmt":"2008-02-18T01:40:17","guid":{"rendered":"http:\/\/steve.cooleysekula.net\/blog\/?p=926"},"modified":"2008-02-17T17:40:18","modified_gmt":"2008-02-18T01:40:18","slug":"smash-lab-and-the-scientific-method","status":"publish","type":"post","link":"https:\/\/steve.cooleysekula.net\/blog\/2008\/02\/17\/smash-lab-and-the-scientific-method\/","title":{"rendered":"Smash Lab and the Scientific Method"},"content":{"rendered":"<p>Recently, a new show has appeared on &#8220;The Discovery Channel&#8221; called &#8220;Smash Lab&#8221;. The premise of the show is simple: four smart people &#8211; an engineer, an &#8220;ideas guy&#8221;, a scientist, and a designer &#8211; get together and try to approach real-world problems with innovative technology. For instance, using carbon-fiber wrap to hurricane-proof a mobile home, or using softened concrete to slow down a run-away highway vehicle. I&#8217;m impressed by all of the problems so far posed; the hurricane-proofing of mobile homes was particularly interesting, given how many of these homes are in the path of hurricanes along the coastal United States.<\/p>\n<p>However, several things about the show have bothered me, as a scientist. The pilot episode exemplifies my concerns, though I will say that I&#8217;ve become more impressed with the discipline of the team as the show has progressed. In the first episode, the team tries to slow down run-away cars and buses using an easy-crumble concrete. This concrete is already used on some airport runways to slow down and stop run-away planes. The concrete crumbles more easily, absorbing the energy of a collision gradually to reduce the instantaneous forces on passengers inside the vehicle.<\/p>\n<p>The team tried several ideas, including changing normal concrete road barriers into softened barriers, or putting a surface of the crumbly concrete in the median so that a vehicle crossing the median slows and stops before hitting on-coming traffic on the other side of the highway. Despite their effort, the ideas were all miserable failures. That&#8217;s fine &#8211; science is about failure, and learning from failure, to achieve success. However, the team seemed to declare victory at the end. Why? Well, they all failed to stop a car. However, they were able to slow-down a bus crossing the median on the crumbly surface.<\/p>\n<p>What bothers me about this is that the team redefined success at the end of the experiment, allowing them to declare a victory. Cars are far more common on U.S. highways than buses, and so therefore the probability of a fatal accident from a run-away car is far higher than from a bus. The failure of the experiment to stop a car without killing the passengers, or without actually stopping the car, amounts to a failure in the bulk of the cases in which this technology could be tested. Succeeding in stopping a bus is good, and dramatic, but hardly more important than stopping a car. <\/p>\n<p>The team should have admitted defeat. In fact, they&#8217;ve done so in a later episode when they failed to fully protect a mobile home from a hurricane, or even when they failed to save a car on railroad tracks from a deadly train strike. That&#8217;s good science. But in the pilot, the lead episode of the show, they redefined success at the end so they had something good to claim.<\/p>\n<p>Failing to meet the goals of an experiment can be just as useful as finding success. Perhaps collapsable concrete is a bad technology, one which cannot or should not be adapted to solve the problem of a run-away car. Declaring some measure of victory, using a smaller part of the overall problem as the basis of the claim, can prolong the life of a failed technology. It would be better to spend innovation on a better idea than try to pump up a bad one. That&#8217;s an important aspect of science. <\/p>\n<p>I&#8217;m growing to like Smash Lab. The earthquake-proofing of a house with ball-bearings was swank, something I think should be adapted to normal house construction. But the concrete barrier should have been something abandoned by the team as a bad idea. It&#8217;s a shame they couldn&#8217;t proudly accept defeat, instead of redefining success just to achieve it.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Recently, a new show has appeared on &#8220;The Discovery Channel&#8221; called &#8220;Smash Lab&#8221;. The premise of the show is simple: four smart people &#8211; an engineer, an &#8220;ideas guy&#8221;, a scientist, and a designer &#8211; get together and try to approach real-world problems with innovative technology. For instance, using carbon-fiber wrap to hurricane-proof a mobile [&hellip;]<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_jetpack_memberships_contains_paid_content":false,"activitypub_content_warning":"","activitypub_content_visibility":"","activitypub_max_image_attachments":3,"activitypub_interaction_policy_quote":"anyone","activitypub_status":"","footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":false,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2}},"categories":[6],"tags":[],"class_list":{"0":"post-926","1":"post","2":"type-post","3":"status-publish","4":"format-standard","6":"category-science","7":"czr-hentry"},"jetpack_publicize_connections":[],"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/steve.cooleysekula.net\/blog\/wp-json\/wp\/v2\/posts\/926","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/steve.cooleysekula.net\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/steve.cooleysekula.net\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/steve.cooleysekula.net\/blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/steve.cooleysekula.net\/blog\/wp-json\/wp\/v2\/comments?post=926"}],"version-history":[{"count":0,"href":"https:\/\/steve.cooleysekula.net\/blog\/wp-json\/wp\/v2\/posts\/926\/revisions"}],"wp:attachment":[{"href":"https:\/\/steve.cooleysekula.net\/blog\/wp-json\/wp\/v2\/media?parent=926"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/steve.cooleysekula.net\/blog\/wp-json\/wp\/v2\/categories?post=926"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/steve.cooleysekula.net\/blog\/wp-json\/wp\/v2\/tags?post=926"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}