Skip to main content

Amazon's A-B Testing and Government Applications

One of the benefits of scientific research is that by being empirical or experimentally driven it avoids circular and endless discussions on what works or should work. You can just check it. You test to see what works. Jeff Bezos described in a Stanford lecture how Amazon utilizes this testing in it's site live to verify improvements. The ability to test which option is best increases efficiency as it cuts down not only on inefficient options but also on the time that would have been spent discussing the pros and cons of each approach. At Amazon this approach is called A-B testing. Where one option "A" is tested against option "B" and the results are seen immediately. This data-driven approach is what makes science edge out over other disciplines, and it's one that seems sorely lacking on the social sciences, where argument rather than data still reigns king. It doesn't matter that "trickle down economics" didn't have it's intended effect if the data is analyzed, what matters is that the argument sounds right and wins out over it's opposition.

I think it's high time that this data-driven approach be brought to our public institutions like government. In Amazon's elegant A-B testing approach (possibly with the addition of a C control) would be fantastic to test approaches with real data as opposed to talking heads on congress or the media. Think about simple things such as tax laws. Imagine if instead of it being driven by mere legislators it was goal driven and experimentally tested. Many laws fail in its intended purpose because debate or rationally doesn't drive human behavior. We are emotional creatures and not driven by cool dispassionate reason. Society's glorification of reason is a offspring of the Enlightenment the period that saw the birth of the nation of the United States. The Enlightenment which held reason above the then wide authority of the church, found liberty and practicality in its look at rationality. But now we're hitting the limits of such view. We are seeing the failure of reason. We need to use experimentation more. Forget about what "should" work and see what actually does work. What's great is that this is being used by businesses now. We don't have to invent it. Amazon does it with it's A-B testing and gets real time results. Can't we do it with laws too? How much easier would it be to vote on which tax law to approve or which ballot initiative if the data was already in? It may be hard to convince someone that changing something can be beneficial without this data but far more dangerous are things that sound rationally right but experimentally fail to accomplish their set goals, like the supposed "benefit" of trickle down economics.

Labels:

Comments

Post a Comment

Popular posts from this blog

What Medieval Economics can teach us about tariffs.

As a teen, I used to play Dungeons and Dragons (D&D) with my friends. This started an interest in the medieval period that led to me taking a medieval history class in college just to understand the period more. Over the years I've also read great books like " Dungeon, Fire and Sword " about the crusades (I recommend the book) and yet with all that knowledge it wasn't until recently that it occurred to me I had a completely wrong understanding of economics in the Medieval Period. "Viking helmets, sword and footwear" by eltpics is licensed under CC BY-NC 2.0 In my D&D games, players who are adventures battling monsters and creatures would need equipment and on the trips to town, they'd get resupplied with their adventuring necessities. I'd run these moments referencing my imagination of what it must have been and fantasy books I'd read. There be an inn with a raucous bar, a gruffly black-smith, if a city also a weapon and armor sm...
Post a Comment
Read more

Great iPhone Apps

As a companion to my blog on Windows utilities, here are two paid apps on the iPhone that I consider so fantastic that are must buys in my opinion. -Easy Calendar ( $1.99 ) The iPhone Calendar is one of its weakest features in my opinion. I miss the clear Black Berry calendar on my pearl whenever I had to use it. This app makes the calendar not only easy to use but way more useful, I see my week laid out for me with an easy ability to push things to other days (rather than having to re-enter the appointment). This app has completely re-made the way I organize things. I'm way more organized and rarely miss appointment now. This app is a steal at it's prize. No other app adds such simple functionality to the iPhone like this one does. It's like my secret organizer helper. -Sleep Cycle ( $.99 ) I tried out this app because it was recommended on Tim Ferriss's books . I had seen this app before when it came out and thought it was intriguing, but it was way expensive. N...
1 comment
Read more

Indie Games

I've played a few really great indie games recently and would like to share a bit about them. None of these games are brand-new and all are available in both Mac and PC versions. 1. Aquaria Aquaria is a gem of a game for those that loved the original metriod games. In Aquaria you play a young mermaid creature that decides to explore her world beyond her home waters. In doing that you guide her through many adventures that reveal a bit about her world. The game is visually beautiful and the game mechanics, though simple, are very nice. You can play the whole game with a mouse if you wish though gamepads are supported too. In the game you access special abilities by singing different songs. It is a neat concept.  The game was made by an indie outfit of mainly two people out of Canada. But it feels much more than that. It's very big like an underwater version of Castlevania: Symphony of the Night, with multiple treasures to collect and many secrets to uncover. It is available for ...
Post a Comment
Read more