Showing posts with label BookReview. Show all posts
Showing posts with label BookReview. Show all posts

Monday, April 11, 2011

Book Review: Final Jeopardy

Final Jeopardy: Man vs Machine and the Quest to Know Everything by Stephen Baker

I found the Watson exhibition very exciting. I was therefore eager to read Baker's new book, Final Jeopardy, that accounts the inception of IBM's Jeopardy Grand Challenge and the software team that completed it by creating Watson. Although light on technical details, the book provides a good overview of the primary challenges. It also discusses the non-technical issues that the Watson and Jeopardy teams struggled with in staging the man-machine competition. Overall, a very good and enjoyable book. If you enjoyed Baker's Numerati, you'll probably enjoy this book too.

The next challenge is to create a computer that can write Jeopardy questions rather than just answering them.

Thursday, November 11, 2010

Book Review: The Cuckoo's Egg

The Cuckoo's Egg Tracking: a Spy Through the Maze of Computer Espionage by Cliff Stoll

In 1986, Cliff Stoll's boss asked him to investigate a $0.75 accounting error for the use of their lab's computer. He quickly discovered that a hacker had penetrated their computer system and was attempting to do the same to the Milnet computers it was connected to. The situation quickly cascaded into a multi-national search for a malicious hacker-spy involving multiple "three letter" government agencies. At the center of it all was Cliff, an astronomer turned system administrator turned digital sleuth. In The Cuckoo's Egg, Cliff provides a detailed account of his adventure and eventual success.

I really enjoyed The Cuckoo's Egg. Although I was vaguely aware of the story, I only recently learned of the book. I was immediately hooked and struggled to put it down.

The Cuckoo's Egg provides a detailed description of 1980's computing, a subject for which I have an irrational fondness. It's a great reminder of how innocent a time that was and how far technology has come.

Timeless, though, were Cliff's creativity and persistence. I wish more people today put as much effort into solving problems, even apparently small ones. Cliff's story remains an inspiration.

Cliffs political retrospection added an unexpected dimension to the story. His initial mental model of government agents was comic book-esque. During the pursuit, he gradually realized that they were just normal people with similar values. Cliff's willingness to alter his political views was also encouraging.

PDF versions of the book are available online. The book was also summarized in the NOVA episode The KGB, The Computer, and Me albeit without much of the detail that made the story interesting.

If you like computer history, cyber-security, and mystery stories then you will likely enjoy The Cuckoo's Egg.

Friday, November 5, 2010

Book Review: Fermat's Enigma

Fermat's Enigma by Simon Singh

In 1637, Pierre de Fermat, a renown amateur-but-genius mathematician, was reading Diophantus's Arithmetica and wrote the following margin note:

I have discovered a truly marvelous proof that it is impossible to separate a cube into two cubes, or a fourth power into two fourth powers, or in general, any power higher than the second into two like powers. This margin is too narrow to contain it.

In other words, although there are many three integer solutions to Pythagoras's Theorem,

X^2+Y^2=Z^2

There are no three integer solutions for higher powers,

 X^3+Y^3=Z^3
 X^4+Y^4=Z^4
....

Unfortunately, no written record of Fermat's proof has ever been found. Worse, Fermat had a reputation for pranking his fellow mathematicians by claiming to have secretly solved impossible problems. For 350 years, it was uncertain if a proof ever existed. But that didn't stop a lot of people from trying, including some of the best mathematicians in history.

In this book, Simon Singh provides a thorough account of the many efforts to prove Fermat's Last Theorem. Particular attention is given to Andrew Wiles's successful solution in 1994, the result of a seven year solitary effort that shocked the mathematics world.

The book is structured very well. Singh expertly interweaves the history and mathematics behind Fermat's conjecture in an easy to understand and engaging manner. Singh describes the complicated mathematics involved just enough to appreciate Wiles's solution without going into too much detail. The narrative flows evenly and holds the reader's attention well.

Wiles's story is incredible. He was first fascinated by Fermat's Last Theorem as an adolescent. After earning a PhD in mathematics, Wiles found himself uniquely positioned to pursue a proof. He made the bold decision to both work in secret and devote all of his time to developing a proof. For seven years, Wiles worked night and day in isolation until he finally succeeded. After a fatal flaw was found during peer review, he spent an additional year fixing the proof. Wiles's focus, dedication, and determination are truly inspiring.

Fermat's Last Theorem is great book if your into math, history, and solitary geniuses overcoming the odds.

Tuesday, September 21, 2010

Book Review: On Writing Well

On Writing Well by William Zinsser

Clarity. Simplicity. Brevity. Humanity. Those are the four attributes of good writing that Zinsser promotes and teaches in this classic book on writing.

The book is structured into four parts. Part one, Principles, covers fundamental topics like simplicity, clutter, style, words, and usage. In part two, Methods, Zinsser teaches how to structure a coherent story. Part three, Forms, provides advice on writing interviews, travel stories, technical articles, business communications, and other types of writing. Part four, Attitudes, discusses common feelings and decisions during the writing process. Throughout the book, Zinsser uses examples to illustrate and reinforce his points.

I really liked this book and agree strongly with Zinsser's values. A lot of modern writing is long-winded, complex, and content-free. Simple and clear writing is not only more effective but also more enjoyable. I've always tried to use a simple, direct writing style. I'm eager to apply the book's advice to further improve my writing.

I was greatly encouraged by many of Zinsser's comments on the writing process itself. For example, I consider myself a slow writer. I often spend a lot of time revising my writing to get it "just right". Even simple things like emails and blog posts seem to take an excessive amount of time. I frequently feel insecure about this so I was glad to read the following,

Writing is hard work. A clear sentence is no accident. Very few sentences come out right the first time, or even the third time. Remember this in moments of despair. If you find that writing is hard, it's because it is hard.

Similarly, I was inspired by the following comment in the chapter "Enjoyment, Fear, and Confidence",

Living is the trick. Writers who write interestingly tend to be men and women who keep themselves interested. That's almost the whole point of becoming a writer. I've used writing to give myself an interesting life and a continuing education. If you write about subjects you think you would enjoy knowing about, your enjoyment will show in what you write. Learning is a tonic.

I started this blog to learn by writing about my many interests. I find that explaining a topic often leads to deeper insights. I hope that writing and blogging will help me to continue learning and leading an interesting life.

Tuesday, May 25, 2010

Book Review: The Quants

The Quants by Scott Patterson

In The Quants, Patterson provides an intriguing account of Wall Street's most successful quantitative analysts (aka quants) and the role they played in the subprime crisis.

The first few chapters introduce the main players and provide a brief introduction to quantitative finance. Patterson begins by describing how Ed Thorp applied his mathematics background and experience pioneering Black Jack card counting techniques to invent various hedging techniques and start the first arbitrage hedge fund. From there, Patterson lightly introduces other important concepts like Brownian Motion, Random Walk Theory, Efficient Market Hypothesis, and statistical arbitrage. The introduction winds down with the October, 1987 market crash which is used as the context to introduce the "fat tail" contrary point of view personified by Benoit Mandelbrot, and Nassim Nicholas Taleb - a not so subtle foreshadow.

The "middle" of the book discusses the background, career, and substantial success of primarily five high-profile quants: Pete Muller, Ken Griffin, Cliff Asness, Boaz Weinstein, and Jim Simmons. Other Wall Street personalities are also mentioned but to a lesser extent. This part of the book more or less establishes that the above quants are very smart, and very rich.

The last part of the book provides a blow-by-blow account of the sub-prime crisis. All of the quants appeared to be caught off guard, perplexed by the market's "irrational" behavior, and unshure of how to adjust their models to prevent further losses. Throughout the ordeal, many of the quants are forced to question the very foundations of their mathematical models and prior success - was it all just luck?

Over all, I thought this book was OK but felt it tried to cover too much ground as a quantitative finance primer, homage to quants, historical account of the sub-prime crisis, and financial mystery-thriller. Since my interest lies more in the technical details, I was a disappointed with those portions of the book and uninterested in the dramatized historical account. Perhaps I simply had the wrong expectations of the book.

It's also possible that my expectations were set artificially high by Poundstone's excellent book Fortune's Formula which provides a detailed historical and technical account of the events that gave rise to the quantitative finance industry. If you're interested in this topic, then I highly recommend Fortune's Formula.

While reviewing the book to write this review, one passage caught my eye on page 250 regarding a study performed by MIT Professor Andrew Lo and his student Amir Khandani:

There was also the worry about what happened if high-frequency quant funds, which had become a central cog of the market, helping transfer risk at lightning speeds, were forced to shut down by extreme volatility. "Hedge funds can decide to withdraw liquidity at a moment's notice," they wrote, "and while this may be benign if it occurs rarely and randomly, a coordinated withdrawal of liquidity among an entire sector of hedge funds could have a disastrous consequences for the viability of the financial system if it occurs at the wrong time and in the wrong sector."

There is some evidence indicating that the withdrawal of high-frequency liquidity was a contributing factor to the May 6, 2010 flash crash. I doubt the story of the quants is over just yet.

Wednesday, April 14, 2010

Book Review: Daemon & FreedomTM

Daemon and FreedomTM by Daniel Suarez

I haven't enjoyed a science fiction, techno-thriller this much since reading Neal Stephenson's Cryptonomicon. I liked Daemon so much that I finished the sequel, FreedomTM, before I got the chance to write a review (or do anything else for that matter).

I tried a couple of times to summarize the basic plot without revealing too much but failed. So I think I'll just say that if you're into computers, AI, hacking, MMORPG's, augmented reality, sustainable technologies, and overthrowing corporate social control then you'll probably like these books. My only criticism is that they are a bit too graphic in places for my taste (mostly violence but some sex).

One of the most refreshing things about the book is that the author is an IT specialist so the technology stuff isn't too bogus. In fact, even the "far-fetched" technology in the book is actually just an exaggeration of the current state of the art.

Preview chapters are available online for both Daemon and FreedomTM if you would like to read a sample before buying. I actually listened to the audiobook version of both books via iTunes which worked out quite well - the reader's voices enhanced the overall experience, especially the Daemon's computer-generated, English-accented female voice.

One of my favorite quotes from the book was:

"Technology. It is the physical manifestation of the human will. It began with simple tools. Then came the wheel, and on it goes to this very day. Civilizations rise and fall based on technological innovation. Bronze falls to iron. Iron falls to steel. Steel falls to gunpowder. Gunpowder falls to circuitry."

I don't think there is any doubt that circuitry, more specifically digital information, is becoming the dominant source of power. Why destroy a nation when you can simply crash its infrastructure and delete its data? Daemon and FreedomTM certainly drive this point home.

The future suggested by Daemon and FreedomTM is both frightening and exciting. Although a work of fiction primarily intended to entertain, I think some valuable lessons and cautions can be drawn from the story. Good stuff.

Thursday, February 11, 2010

Book Review: The Tinkertoy Computer

The Tinkertoy Computer by A.K. Dewdney.

After reading The Planiverse, I picked up a couple of Dewdney's other books. Published in 1993, this book is a compilation of some of his articles from the periodicals Scientific American and Algorithm.

The book contains 23 chapters organized into four themes. Of them, the following were my favorites:

Theme One: Matter Computes

  • Chapter 1: The Tinkertoy computer - an account of a tinkertoy computer built by Daniel Hillis and others at MIT designed to play Tic-Tac-Toe.
  • Chapter 2: The Rope-and-Pulley Wonder - methods for building boolean logic blocks out of ropes and pulleys.
  • Chapter 6: Dance of the Tur-mites - Turing machines and cellular automata.

Theme Two: Matter Misbehaves

  • Chapter 8: Star Trek Dynamics - implementation details of a 1970s era computer game.
  • Chapter 9: Weather in a Jar - the Lorenz attractor and simple models demonstrating the behavior.
  • Chapter 11: Designer Fractals - iterated function systems and their use for creating fractal patterns.

Theme Three: Mathematics Matters

  • Chapter 13: Mathematical Morsels - a summary of mathematical puzzles by Ross Honsberger.
  • Chapter 14: Golygon City - an introduction to golygons.
  • Chapter 15: Scanning the Cat - a simple algorithm for reconstructing 2-D images from 1-D shadows.
  • Chapter 16: Rigid Thinking - rigidity theory, and flexible nonconvex surfaces.
  • Chapter 17: Automated Math - an algorithm for determining the rules for numerical sequences.

Theme Four: Computers Create

  • Chapter 19: Chaos in A Major - the use of logistic maps to create chaotic music.
  • Chapter 23: Latticeworks by Hand - algorithms for creating lattices.

As you can tell, I more or less enjoyed the entire book. This wasn't surprising given that I bought the book because it touched upon a number of topics that I find very interesting: complexity theory, fractals, math puzzles, physics simulations, geometric patterns, and algorithms.

I was, however, pleasantly surprised by the nostalgia invoked by the simple programs presented in the book. The short, simple BASIC programs reminded me of the many, many hours I spent programming 8bit computers during my adolescence. I still recall the feeling of awe that resulted from seeing simple programs like these produce seemingly "magical" results. Computing was much simpler then but no less rewarding - hopefully short but powerful programs like these aren't becoming a lost art.

Wednesday, January 20, 2010

Book Review: The Simplicity Cycle

A couple of weeks ago I came across a link to the book The Simplicity Cycle by Dan Ward. It's available as a free download so I grabbed a copy and finally got the chance to read it.

The book begins with the argument that projects follow a curve in the two-dimensional space formed by the qualities "goodness" and "complexity". Initially, all projects start off at the origin with no complexity or goodness. As they progress, complexity and goodness increase together as the initial problems are understood and suitable solutions created.

The book's primary thesis is that eventually all projects reach an inflection point where further increases in complexity yield less goodness, not more. To improve goodness beyond this point, the focus must switch from increasing complexity to reducing it. These transitions from simple, to complex, and back to simple again form the "simplicity cycle" which, when successful, results in "an elegant, graceful, and streamlined solution" capable of representing "tremendous complexity" while being "at once profound and breathtakingly simple". Inspiring stuff.

Not surprisingly, the author asserts that increasing complexity after the inflection point results in an undesirable outcome. For software, this could mean an application with too many features, options, or ways to accomplish tasks. For decision making, this could mean having too much information to draw an effective conclusion.

Unfortunately, the non-linear relationship between complexity and goodness can go unrecognized - from page 26:

One pitfall that designers, engineers, and academicians may fall prey to is the belief that continuing to increase complexity … will continue to produce increases in goodness. It just isn't the case.

In some cases, this mistaken belief can be due to a fascination with complexity itself - here goodness doesn't mean utility to the consumer but rather intellectual gratification to the producer. Also quoting from page 26:

This is genesis-gone-wild, cancerous growth. It is the product of “over-learning” and smugness, where people fall in love with complexity.

In other cases, the complexity is mastered but without achieving the deep insight needed to reduce the subject to its fundamental problems and solutions - to my mind a kind of mechanistic expertise. Quoting from page 30:

It generally means we are over-thinking a problem or over- engineering a solution. Think of it as achieving “the complexity on the other side of understanding,”

…

Here we find the learned academician who everyone assumes is brilliant because nobody can understand a word he says. In fact, his academics may simply be complicated and have very limited goodness. All those extra squiggles are not very useful, no matter how complex.

The book admits the difficulty of knowing when the inflection point has been reached. Guessing too late results in over complicatedness as has been discussed. However, guessing too soon results in premature optimization - an equally bad outcome as it fails to reach optimal goodness. Unfortunately, the author asserts that a method for reliably identifying the inflection point doesn't exist.

The book makes the important point that the complexity phase cannot simply be skipped. Quoting from on page 46:

However, the simplicity in this region is built upon an essential foundation of earlier complexity. We can’t just jump from simplistic to simple, skipping the complex entirely. The initial increase in complexity is as crucial to maximizing goodness as the later decrease in complexity.

The book concludes with examples of good and bath paths through the complexity vs. goodness space. I found these helpful for reflecting on how the simplicity cycle relates to past experiences.

This book was a pleasant surprise. Although short and free, I found it thought provoking and insightful. In particular, the "simplicity cycle" concept matches well with my experiences. When developing software, I often find that after writing a fair amount of code common patterns emerge that allow for a simpler design. Conversely, I've witnessed first hand the disastrous outcome of projects that fail to simplify after the inflection point. Although these experiences have given me a healthy fear of complexity, this book provided a context for that fear and a framework for managing it.

My only criticism of the simplicity cycle concept is that it may encourage the kind of over generalization that Joel Spolsky warns against in his essay "Don't Let Architecture Astronauts Scare You". Quoting from Joel's essay:

When you go too far up, abstraction-wise, you run out of oxygen. Sometimes smart thinkers just don't know when to stop, and they create these absurd, all-encompassing, high-level pictures of the universe that are all good and fine, but don't actually mean anything at all.

These are the people I call Architecture Astronauts. It's very hard to get them to write code or design programs, because they won't stop thinking about Architecture. They're astronauts because they are above the oxygen level, I don't know how they're breathing.

The point I take away from this is that simplification is not the same thing as abstraction - simplification remains focused and actionable while abstraction becomes vague and unactionable. Unfortunately, I think many mistake generalization for simplification but now that I'm consciously aware of the difference I'll be less likely to fall into the trap myself.

Wednesday, January 6, 2010

Book Review: Organizing Genius

Organizing Genius: The Secrets of Creative Collaboration by Warren Bennis & Patricia Ward Biederman

I first read this book a few of years ago and recently reviewed it in preparation for a new role at work. As before, I found it to be an extremely insightful resource on the attributes of great, innovative teams.

The majority of the book provides accounts of the following "great" groups:

  • The Walt Disney Studio
  • Xerox PARC
  • The Apple Macintosh Team
  • The 1992 Clinton Campaign Team
  • Lockheed's Skunk Works Group
  • Black Mountain College
  • The Manhattan Project

As stated in the introduction, the authors attempt to systematically examine these groups in the hope of identifying their "collective magic". In the final chapter they summarize their findings into the following 15 points.

  1. Greatness starts with superb people.
  2. Great Groups and great leaders create each other.
  3. Every Great Group has a strong leader.
  4. The leaders of Great Groups love talent and know where to find it.
  5. Great Groups are full of talented people who can work together.
  6. Great Groups think they are on a mission from God.
  7. Every Great Group is an island - but an island with a bridge to the mainland.
  8. Great Groups see themselves as underdogs.
  9. Great Groups always have an enemy.
  10. People in Great Groups have blinders on.
  11. Great Groups are optimistic, not realistic.
  12. In Great Groups the right person has the right job.
  13. The Leaders of Great Groups give them what they need and free them from the rest.
  14. Great Groups ship.
  15. Great work is its own reward.

Generally speaking I agree with all of these points. The closest I've come to working in a Great Group was my first job building a big-iron ccNUMA machine. That group and experience had many of the elements listed above and a decade later I recognize how rare of an opportunity that was. I suspect others from the team feel the same way based on the reminiscing we do whenever any of us cross paths.

Clearly the leaders of Great Groups are responsible for creating an appropriate environment for the team to flourish. In my role as the leader of an advanced development engineering team I've tried my best to follow this guidance with I think moderate success. As my role and responsibility expands I need to place greater focus on creating the right environment - to that end this book will be a valuable resource.

Tuesday, December 29, 2009

Book Review: The Planiverse

The Planiverse: Computer Contact with a Two Dimensional World by A.K. Dewdney

Written in 1984, this is a fictional story of a computer science professor and his students making contact with a two-dimensional universe - The Planiverse - through a simulation program developed as a class project. More specifically, a telepathic connection is established with one of the universe's inhabitants called YNDRD otherwise known as "Yendred". The professor and students accompany Yendred on a journey and in the process discover the workings of the two-dimensional world.

Essentially, the book can be decomposed into two concurrent streams:

  • The story of Yendred's journey across his world in search of a mystic - Drabk - said to possess "knowledge of the beyond".
  • A series of expositions on the scientific, technological, and social aspects of Yendred's two-dimensional universe.

Basically, Yendred's journey provides the context and segues for the expositions. This structure reflects the book's derivation from two prior publications - the monograph Two-Dimensional Science and Technology and book Symposium on Two-Dimensional Science and Technology. Material from these prior works formed the basis for the expositions around which the fictional Yendred plot was wrapped to create a coherent, entertaining, and intellectually stimulating story.

Although I thought the Yendred story was only "OK", I really enjoyed the expositions - clearly a lot of thought was given to how a two dimensional world would work. For example, some of the scientific exposition topics were:

  • Thermodynamics and the extremely low melting point that two-dimensions lead to.
  • The mechanics of two-dimensional turbulence.
  • Electromagnetism and the lack of magnetic forces.
  • The "Global" weather patterns of a two-dimensional "planet"
  • Energy diminishing according to the inverse of distance (instead of the inverse-square as in three dimensions).
  • The biological structure of two-dimensional organisms.
  • Two-dimensional chemistry and the limited number of possible elements.

The technical expositions discussed the design of two-dimensional objects such as:

  • Buildings that avoided obstructing surface travel.
  • Doors that allowed privacy and structural integrity while remaining passable.
  • Functional steam engines, foundries, space rockets, and fishing boats.
  • Balloons for travel and the shipment of freight.
  • Gears capable of varying torque in the absence of axles.
  • Subterranean elevators.
  • Electronic circuits suitable for constructing rudimentary computers.
  • A wind powered generator for recharging batteries - the only viable source of electricity as wires create impassable obstacles.

The social expositions discussed topics such as:

  • How the world's inhabitants "passed" each other while traveling (they walk over each other according to social conventions).
  • How traveler's deal with surface events like a sports game (they wait until it's done).
  • Two dimensional warfare and its influence on politics.

In summary, if you enjoy thinking differently about science, and technology then I think you'll enjoy reading this book. The ability to think about problems from different perspectives is an important and powerful skill - I think reading books like The Planiverse is one way to help develop that skill.

Thursday, October 22, 2009

Book Review: Coders At Work

Coders At Work: Reflections on the Craft of Programming by Peter Seibel

I really enjoyed this book. Peter Seibel did an outstanding job in selecting a group of interviewees that are both legendary and represent a wide range of programming domains. In addition, Peter's questions were similar enough to allow comparisons between responses but maintained a conversational flow that prevented the interviews from feeling formulaic. Ehud Lamm's quote from the font cover perhaps says it best, "reading this book may be the next best thing to chatting with these illustrious programmers in person".

I read the interviews out of order based on my interests. All were good but my favorite ones were (in no particular order):

One striking observation was how many of the interviewees fit into Malcolm Gladwell's definition of an Outlier. Nearly all of them had opportunities to get a significant amount of programming experience at a young age and serendipitously found jobs that provided the right environment for them to succeed.

I also found interesting the "organic" approach most of the interviewees took to programming. None seemed to rely on formalized best practices but instead used their intuition to tailor their approach based on the task at hand. To me this suggests that you just can't codify great programming which matches my experiences with the great programmers that I have known.

Finally, it's notable how many of the people interviewed either starting out hacking Lisp or were heavily influenced by it. Of course this may be due to selection bias given that the author, Peter Seibel, is a a Lisp hacker himself and wrote the outstanding book Practical Common Lisp. As a Lisp fan, I don't mind the potential bias; it's a feature, not a bug!

Friday, October 9, 2009

Book Review: Fortune's Formula

Fortune's Formula: The Untold Story of the Scientific Betting System that Beat the Casinos and Wall Street by William Poundstone

[Read in August of 2009 but was delayed in writing the review.]

I absolutely loved this book, in fact I more or less devoured it as it involved three topics that I find very interesting:

How can a book involving these three topics be anything but good!

OK, enough gushing, the book is essentially about the following three people:

  • Claude Shannon: Bell Labs super-genius most famous for creating the field of Information Theory but who also invented the use of boolean binary logic in digital computers, and made material contributions to the fields of Mendelian genetics, cryptography, and computational logistics.
  • John L. Kelley: Bell Labs scientist famous amongst geeks for programming an IBM 704 to sing the song Daisy Bell which inspired HAL-9000's song at the end of the movie 2001: A Space Odyssey. Kelly is also famous for using Shannon's Information Theory to create the Kelly Criterion method for optimal betting or investing given inside information.
  • Edward O. Thorpe: M.I.T. professor famous for writing the book Beat the Dealer which proved card counting could be used to win at Black Jack. Thorpe is also famous for pioneering the use of computers in hedge fund investing (a.k.a quantitative finance). Thorpe's fund, Princeton Newport Partners, achieved an impressive annualized return of 15.1% over its 19 year duration.

The story more or less goes thusly:

  • Shannon invents Information Theory
  • With Shannon's help Kelley uses Information Theory to create the Kelly Criterion for determining an optimal betting strategy given inside information.
  • After meeting at M.I.T., Shannon and Thorpe research ways of using wearable computers to win at roulette. Thorpe goes on to use the Kelly Criteria to first make optimal bets while card counting and later make profitable investments for his hedge fund.

The book focuses on how the interaction between these three men gave rise to much wealth. Along the way Poundstone discusses related topics such as Efficient Market Theory, the Random Walk Hypothesis, and statistical arbitrage. Poundstone includes just enough mathematics to make the story interesting to technical readers without alienating other audiences.

It must be noted that the book offers a much richer story including the influences of organized crime at various stages of history.

All in all, a great book that I highly recommend to anyone interested in these topics.

Book Review: Labyrinths of Reason

[Read in August of 2009 but was delayed in writing the review.]

Labyrinths of Reason: paradox, puzzles, and the frailty of knowledge by William Poundstone.

Ouch, my head hurts. How do we really know we're not just brains-in-vats living in a simulated reality?

This is more or less the central theme of the book which guides the reader through various thought experiments designed to probe the depths of meaning, understanding, and knowing. Along the way Poundstone discusses various topics such as:

I could go on but doing so would still do the book an injustice. It's a great book that covers a lot of interesting topics. Well worth reading if you are interested in these kinds of things but be prepared to get a few headaches from excessive thinking. I'm planning to re-read it perhaps a year from now to try to better absorb the material.

Book Review: Prisoner's Dilemma

[Read in August of 2009 but was delayed in writing the review.]

Prisoner's Dilemma: John Von Neumann, Game Theory, and the Puzzle of the Bomb by William Poundstone.

A book ostensibly about Game Theory, I felt that it was more of a montage of:

The Game Theory content was fascinating and informative covering various kinds of games, strategies, and complications stemming from repeated games. Good stuff.

I found the Von Neumann biography captivating as it provided a deeper insight into his personal nature than I had read before. Clearly he was an incredibly intelligent man but he also clearly had a number of personal challenges. While this material makes Von Neumann appear more "human", it's not particularly pleasant to read about. Also, I thought the account of his death from cancer was too detailed and grim.

Personally, I have no interest in the history of the RAND corporation or the cold war so I found these parts of the book difficult to get through. But others may find this material more interesting.

All in all, not a bad book if you're interested in these topics but I wouldn't recommend this for "feel good" reading.

Sunday, September 27, 2009

Book Review: Complexity

Complexity: A Guided Tour by Melanie Mitchell

[Read in July of 2009 but was delayed in writing the review.]

I came across this book during a bookstore trip and decided to purchase it as it included topics related to a couple of recent posts and previously read book, Linked: The New Science of Networks. I'm glad I did as it made me realize that many of the things that I am interested in fall under the domain of Complex Systems.

The book is structured as five parts and nineteen chapters as summarized below:

PARTCHAPTERTHEME
1BACKGROUND AND HISTORY
1What is Complexity?
2Dynamics, Chaos, and Prediction
3Information
4Computation
5Evolution
6Genetics, Simplified
7Defining and Measuring Complexity
2LIFE AND EVOLUTION IN COMPUTERS
8Self-Reproducing Computer Programs
9Genetic Algorithms
3COMPUTATION WRIT LARGE
10Cellular Automata, Life, and the Universe
11Computing with Particles
12Information Processing in Living Systems
13How to Make Analogies (if You Are a Computer)
14Prospects of Computer Modeling
4NETWORK THINKING
15The Science of Networks
16Applying Network Science to Real-World Networks
17The Mystery of Scaling
18Evolution, Complexified
5CONCLUSION
19The Past and Future of the Sciences of Complexity

Part 1, nearly a third of the entire book, provides a thorough introduction to Complex Systems which are defined by the author as having the following properties:

  1. Complex collective behavior (i.e. the whole is greater than the sum of the parts)
  2. Signaling and information processing
  3. Adaptation to environmental changes

Example complex systems cited were insect colonies, the brain, the immune system, economies, and the world wide web.

Chapter 2 was an enjoyable introduction to dynamical systems and chaos theory which I had only a cursory awareness of. The simple "rabbit population" example using logistic maps was a great aid in understanding the concepts of fixed/periodic/strange attractors, and a sensitive dependence on initial conditions (aka. the Butterfly Effect). New to me were the concepts of the period doubling route to chaos and Feigenbaum's Constant (which is just plain odd).

Chapters 3 and 4 covered concepts related to information and computation including: entropy, Maxwell's Demon, statistical mechanics, Shannon's information theory, Hilbert's problems, Godel's incompletness theorem, and Turing machines. Overall the treatment was good and a sufficient introduction for readers unfamiliar with these concepts.

Chapters 5 and 6 discussed the topics of evolution and genetics. I found the discussion on evolution interesting as I don't recall learning about the feud between the early Darwinians, who believed in continuous small variations, and Mendelians, who believed in discrete large variations. I also don't recall learning about the Modern Synthesis or the continued challenges in the form of punctuated equilibrium. Interesting stuff.

Chapter 7 discussed various ways of defining and measuring complexity as:

  • size
  • entropy
  • algorithmic information content
  • logical depth
  • thermodynamic depth
  • computatoinal capacity
  • statistical complexity
  • fractal dimension
  • degree of hierarchy

While no single measure was identified as the measure, all were interesting to consider.

Chapters 8 to 10 discussed cellular automata, genetic algorithms, and artificial life. While the treatment was good, it felt light-weight after having just read The Recursive Universe. That said, Chapter 10 did provide a nice overview of Wolfram's work on cellular automata that augmented the prior material I had read on this subject.

Chapter 11 discussed the use of cellular automata for majority classification tasks. The specific task discussed was the determination of the dominant color in a one-dimensional vector of white and black pixels. The authors used genetic algorithms to evolve a set of CA rules that reliably performed this task by creating diagonal vectors that carried local majority-voting decisions which eventually intersected to produce a majority-vote for the entire original vector. The authors seemed unable to at first understand how the evolved CA worked but I thought it obvious as clearly any solution must involve the horizontal communication of local-majority votes in order to reach a global decision. It seems obvious (to me) that such horizontal communication would manifest as diagonal vectors when the CA evolutions are graphed vertically. I thought the use of particle equations to explain the phenomina was overkill but still interesting.

I enjoyed the author's account in Chapter 13 of her work on the CopyCat program which was designed to process analogies. The problem appears hard and the program was quite clever. I must admit I am extermely jealous that she got to work so closely with Douglas Hofstadter.

Chapters 15 to 16 discussed real-world network theory which included topics such as small-world phenomina, scale-free networks, clustering, preferential association, and network resiliance. Overall the treatment was good but mostly a review after having just read (actually listened to) Barabasi's book Linked, which I highly recommend reading.

Chapters 17 and 18 discussed network theory in the contexts of metabolic scaling and evolution which was very interesting. Some of this material was a review of Stuart Kauffman's work documented in his book Origins of Order. I previously read another of Kauffman's books, At Home in the Universe, which touched on some of the same topics but perhaps I'll add Origins to the list of potential future readings.

Chapter 19 concluded the book with an overview of the state of complexity science and the need for a unifying theory. While the field has accomplished many great things, it appears that a lot of difficult work remains which is perhaps why this is such an appealing topic.

In summary, Complexity is a great book that covers a lot of interesting topics. On a personal level, I am thankful to have read this book because, as I mentioned, it helped me realize that complexity science is the meta-topic that unifies many of my long term interests and therefore serves a guide for future research.

Saturday, September 5, 2009

Book Review: Outliers

Outliers by Malcolm Gladwell

An interesting book asserting that rather than just latent talent, an individual's success is do to:

  • timing: some people are born at just the right time to take advantage of historical watershed moments (e.g. the PC revolution) or age-based selections (e.g. birthday cut-offs for joining sports teams, schools, etc).
  • practice opportunities: Gladwell asserts that the "universal" requirement for achieving expertise is 10,000 hours of practice. Gladwell further asserts that successful individuals have often been given abnormal opportunities to obtain that amount of practice in a short period of time and at an early age.
  • environment: the amount of nurture and support that a person receives from his family and community has a significant effect on their success. This includes parents teaching their children how to be assertive, and actively guide their own lives.
  • culture: cultural values and behaviors can have a profound effect on an individual's level of success.

To some degree, Outliers reminded me of other recent readings:

  • In the Black Swan, Taleb asserted that individual success in "scalable" fields was due primarily to luck and a rich-get-richer effect. In Outliers I think Gladwell provides a compelling explanation for that phenomenon in his focus on lucky opportunities for obtaining expertise.
  • The StudyHacks blog ran a post on how one person successfully entered the music industry by selecting a single nightclub to perform at and then focused all their energy on becoming the best performer at that venue. To me this resonated strongly with Gladwell's assertion that opportunities for obtaining 10,000 hours of practice are one of the keys to success.

So, there appears to be supporting opinions for some of Gladwell's assertions. Personally, I suspect that he is on the right track.

I enjoyed the first half of the book but found the second halves multi-generational discussion weaker as I suspect a "lucky event" can be found in everyone's family history if you go back a few generations.

Being a computer geek, I enjoyed the brief biographies on both Bill Joy and Bill Gates. I had no idea that Gates had so much programming experience before going to college. By all appearances both Bills had rare opportunities to become expert programmers at just the right age to ride the PC technology wave.

Some of the excerpts that I dog-earned were:

  • Page 11: … the values of the world we inhabit and the people that we surround ourselves with have a profound effect on who we are.
  • Page 42: (regarding the assertion that 10,000 hours of practice are required to become an expert at any particular skill) … ten thousand hours is an enormous amount of time. It's all but impossible to reach that number all by yourself by the time you're a young adult. … In fact most people can only reach that number only if they get into some kind of special program … or if they get some kind of extraordinary opportunity that gives them the chance to put in those hours.
  • Page 149: Those three things - autonomy, complexity, and a connection between effort and reward - are, most people agree, the three qualities that work has to have if it is to be satisfying.
  • Page 267: … success follows a predictable course. It is not the brightest who succeed. … Nor is success simply the sum of decisions and efforts we make on our own behalf. It is, rather, a gift. Outliers are those who have been given opportunities - and who have had the strength and presence of mind to seize them.

Upon reflection, I reduced (perhaps too far?) the book's message down to the following three points:

  1. Pick a meaningful skill and practice it as much as possible.
  2. Maximize your exposure to opportunities that require the chosen skill to be successful and provide more practice.
  3. Aggressively pursue the opportunities that you come across to extract the most value from them.

Over all a good book, and worth the time to read it.

Monday, August 17, 2009

Struggling with Book Reviews

When I started this blog, I thought it would be a good idea to write book reviews as I finished readings. I've discovered two problems with this goal:

  1. It takes a long time to write a worthwhile book review.
  2. Due to the voracity of my reading appetite, I have been unable to delay starting a new book until I have finished writing a review for the previous book.

The result, I am now behind in writing two reviews and close to finishing a third book. So much for posting book reviews anywhere as frequently as Eli Bendersky.

I can think of five solutions:

  1. Write shorter reviews.
  2. Force myself to write reviews before starting a new book.
  3. Only write reviews for selected books.
  4. Don't worry about it and write reviews when the time permits.
  5. Stop writing reviews.

Of these, only options 2 and 3 are acceptable. Part of my rational for writing reviews is to obtain a deeper understanding of the material through extended contemplation, review, and summarization. This motivation rules out options 1 and 5. Option 4 is more or less a formalization of the current situation which I already know isn't working; I'll just keep on reading and never get around to writing the reviews. This, again, leaves options 2 and 3.

So, going forward I will attempt a hybrid approach of:

  1. Writing reviews before starting new books.
  2. Only writing in-depth reviews of selected books which deserve the most reflection.

Hopefully this new approach will lead towards fulfilling my goal of getting more out of the books that I read.

Sunday, July 12, 2009

Book Review: The Recursive Universe

The Recursive Universe by William Poundstone

What a delightful book! I was made aware of it by Cosma Shalizi's commentary that I linked to in the A New Kind of Science post. It sounded interesting so I bought a used copy. I'm happy I did so!

The book takes the novel approach of using Conway's Game of Life to discuss complexity theory, specifically how simple rules can manifest into complex systems. Particular emphasis is placed on Von Neumann's interest in self-reproducing machines and cellular automata.

The book is structured in chapter pairs with the first discussing a particular aspect of complexity theory and the second showing how Conway's Life can provide deeper insight. A brief summary of the chapter pairs are:

ChaptersTheme
1 & 2introduction to complexity, reductionism, information theory, and the Game of Life
3 & 4entropy, Szilard's thesis on information and entropy, and the limits of empirical knowledge.
5 & 6information, structure, meaning, and unlimited growth
7 & 8recursion, the challenges of predicting complex systems using recursive calculations, and self-reproduction.
9 & 10the evolution of the cosmos and random Life initial states
11 & 13self-reproduction, the information theory of life, and Life computers.

Before reading this book I had a cursory knowledge of the Game of Life but I was unaware of the sophisticated constructs possible. The Life computers presented in Chapter 12 are fascinating and I can't imagine how much time was required to design them.

I was also unaware of how much attention Life received when it was first created; it seems that many of the bright minds of the time spent considerable time playing the game. I found the historical aspects of this interesting as well but then I have a fondness for computing of this era.

While discussing this book with others I was surprised to find out that an acquaintance of mine was on Gosper's team at MIT that discovered the first Glider Gun. I always enjoy it when I find a personal connection like this to a period of history before "my time".

While looking for additional materials to augment the book I found the following useful references:

  • Two excerpts (part 1 and part 2) of a BBC documentary featuring interviews with Conway.
  • A Game of Life news website
  • Golly, a feature rich cross platform Life implementation
  • Hashlife, an algorithm devised by Gosper that uses quadtrees to efficiently represent deterministic Life constructs.

All in all an entertaining book that is also very thought provoking. I only wish I had copious amounts of spare time to play the Game of Life myself!

Monday, June 22, 2009

Book Review: The Art of the Start

The Art of The Start
by Guy Kawasaki

A great and inspiring book. I particularly appreciated the no nonsense advice and strong focus on fundamentals. My bias towards the latter has always made me feel like a "pseudo-MBA" so Guy's advice increased my confidence in holding similar opinions.

I particularly enjoyed the material on bootstrapping. I have always found exciting the kind of action-based, goal-oriented bootstrapping that Guy describes which likely explains why I have spent the majority of my career in small, advanced development teams building prototypes of new technologies and products.

In summary, a great book that I highly recommend to anyone involved in starting new ventures, internal or external.