24.2.06

Idiomatic

  • crash and burn.
  • flip it up on deck.
  • catch it on the first bounce.
  • ping me.
  • you're yankin' my chain.
  • that dog don't hunt.

If you're reading this in the 'States, you probably know what I mean. But if you grew up in the Punjab, and learned your English from an Anglican Church missionary from Hull, those phrases don't mean dick. Which also doesn't mean dick.

I had this driven home in a very dangerous way in the last few weeks.

"Ad hoc testing" is a pretty simple phrase. Ad hoc is Latin for, literally, "to this". Figuratively, I've always thought it meant "impromptu". That's pretty precise, and not subject to interpretation. You'd think.

When we say "ad hoc testing", we mean testing without a script or plan. Trying to break software. Some folks call it "fault method" testing.

One of my QA managers has had his teams doing periodic "ad hoc testing" during the last 5 months of this release. The idea was to run both the test cases we have, and to just kick the tires. When we went into Beta, we found boatloads of bugs that shouldn't have been missed in QA. Hmm. Not good. We sniffed around a little, and discovered a very fundamental communication disconnect.

We said "do ad hoc testing."

They heard "do ad hoc testing."

We thought we meant "do impromptu testing, exercising various divers parts of the product, in mean-spirited ways, to see if you can break the software."

They thought we meant "run test cases randomly selected from the thousand or so test cases we have written, and which we have already run."

We wanted them doing exploratory work, exercising code paths that were unlikely to have been hit thus far in the project. They ended up doing a whole lot of regression testing.

If you know anything about software, you know that these are very different things.

I hate to be trite, but communication is tough. I've turned some of the text above blue, just to visually highlight where I used imprecise language or idiom. It's really hard to write in a precise way, that is not subject to multiple interpretations.

Throw in a bad speaker phone and nine and a half time zones and the problem can be crippling.

I don't have any non-obvious ideas on how to fix this, though I'm still running a background thread on this, and I expect to post more on this later.

Trip Planner

I am planning a trip to AsiaPac.

With a Vice President of Engineering, and an Executive Vice President of Product Development. Who have neither of them traveled in AsiaPac before. Visiting two of our staffing vendors. And 50 of our contractors. And a bunch of potential customers. And some sage people in the biz. In 3 cities. In 2 countries. Covering 18,575 miles. On 7 different airlines. In 4 different hotels. Over the span of 11 days. It is like herding cats. It gives me a headache.

And it throws into stark relief some interesting points about doing this outsourcing thing in Asia.

Some thoughts that are front of mind:
  • Visas are stupid. More on this later.
  • When it comes to visas, vendors are stupid. More on this later too.
  • Bangalore India is a boom town. Good luck getting a decent hotel room with less than 6 weeks notice.
  • Vendors are a critical in-country support mechanism. All global staffing vendors should become vertically integrated and offer trip-planning as a value-added service for busy software executives. More on this later.
  • Traveling alone is a lot easier than traveling with your boss. And his boss.
  • Traveling in India, as a software executive, is best treated as an amusement park ride. Buy your ticket, stand in line, get on, and go for a ride. You have little control. That's okay. Become comfortable with it. More on this later.
  • Getting shots before a trip to Asia is probably a good idea. Who knew? This fact will likely freak out the average software executive who has never traveled in Asia. More on this later.
  • Expedia is better than Travelocity. Faster, more comprehensive, and better at finding flights between cities in Asia.
  • As an aside to that point, trusting Expedia, or our own travel agents, makes me very nervous. God knows what our connections and flight transfers are going to be like...