work related stuff

Paul the Octopus and misunderstanding chance

Tuesday, July 20th, 2010

One girl on Youtube bemoans the fact she cannot understand how Paul the Octopus manages to pick the winning world cup team eight out of eight times.  It goes to show truly dumb people are and how desperately they want to believe that there are some who can foretell the future and even control it.  Paul, for all his football foretelling has decided to retire. With the world cup over (and the death threats hopefully) he is sitting back to bask in his watery glory.  He even has his own spoofs:


With all the television glare and spotlights that were on this cephalopod it seems amazing that it could continue to choose the winner time after time.  Surely it must have been some sort of special power?

No, it’s dumb blind chance.  While that statistic does seem a little abnormal, eight for eight, it is hardly shocking.   Consider the millions of sperm that the one that made you up had to compete with to create you.  Now that is an amazing round of chance.

Paul the octopus merely illustrated just how bad people are at understanding that chance.  For example, if you flipped a coin 100 times and it has come up heads 99 times, what are the chances it would come up heads 1 last time?  The answer of course is 50/50; all things being equaled.  I write “all things being equaled because that is hugely important and a subject of a large amount of research.

First off, look at the way Paul chose the winners.  Some one put two pieces of mussel into two separate containers. Whichever piece was chosen by Paul was predicted the winner.  But what if the pieces were not evenly sized, or the person’s thumb rubbed off some fish oil from the first piece and transferred it to the second, making it smell better and become more preferable piece?  The possibilities are endless, which is why most research is done as a double blind study meaning neither the researchers conducting the experiment, nor the subjects know what it is about.  This attempts to negate any influence on the results, intended or not.

Also, consider the fact there were probably dozens of “predicting” animals in countries all around the world.  We didn’t even catch a whiff of Paul until he’s already gotten four or five correct and were then shown the other matches he got right.  No one hears of “Frank the World Cup predicting chicken” and I would argue chickens are as likely to be prognosticators as octopi.  No one hears of him because he chose poorly and is now finger-lickin good.

People like the idea of prognostication because it would imply there is a plan to foretell, and that everything goes according to plan.  When a child dies, “it’s God’s plan”.  To say, it’s blind random luck is a scary proposition because we cannot prepare or control it.  Unfortunately not a single medium, psychic, or fortune teller has ever come forward and proven their own powers, let alone a lowly octopus, despite a million dollar reward!

So the next time you’re tempted to believe some stupid animal has ESP consider if this creature was so smart, how come it couldn’t predict getting caught and spending it’s life in a cage?

Share

Ze frank and funny stuff

Thursday, March 11th, 2010

Ze Frank is a visionary, freak, guy who makes fun things.  I won’t go into detail but encourage you to watch this TED talk if you don’t know who he is.  It’s a little old, but still fucking hilarious.

Anyway I stumbled across this and loved it. I know the contest is over, but I still want to participate.

Share

When social media goes astray

Tuesday, February 9th, 2010

Recently in the Toronto news there has been a fair amount of traffic around the issue of social media and the TTC.  The media has managed to make a mountain of a molehill and managed to distract the union and it’s head Bob Kinnear from the issue at hand.  That however isn’t what interests me.   What I find fascinating is the use of social media and social networking tools in this debate.

It started with this photo:

This photo ended up in all the papers and  resulted in the operator making an apology and explaining that he was on a new medication.  A perfectly reasonable excuse in my opinion except for the fact that he didn’t contact his union.

If I had trouble staying awake at work I would immediately go and talk to my boss, explain the situation and go home.  If I did need a nap I would take it in a lounge or employee area where I was out of the way and certainly out of the public eye.

The interesting thing about this picture however is how it made the rounds and media explosion ensued.  First media was talking about Twitter and Twitpic and  all the different ways people can share images.

Next this video appeared on the internet of a driver taking a coffee break in the middle of his route. Apparently this poor guy is now suspended pending an investigation.

The description reads: “TTC driver taking a coffee break in the middle of the shift while leaving the bus with passengers behind – The driver did it every week night in a period of 2 weeks (total of 10 times)!”

The head of the Union’s response is,

“We have heard from many operators who now fear taking a few minutes for a needed washroom break because they don’t want to be subjected to ridicule or embarrassment,” Mr. Kinnear added. “I invite any journalist here today to go online and take a few minutes to research the health effects of chronic urinary retention. Let me give you a head start on the most common problems: urinary tract infections, kidney infections, kidney failure, bladder cancer and prostate problems.”

Are you kidding me?  You’re actually going to defend this by talking about urinary tract infections?? That’s probably not the best way to handle this.  A more appropriate response would have been:

“We try to ensure our drivers have ample time to use the facilities at the end points of their streetcar runs, but clearly it is not enough. We want to ensure our drivers and employees are comfortable as well as our customers as a result we have asked drivers to make an announcement when they need to stop for any length of time.  We will do our utmost to ensure streetcars stay on schedule.”

Of course, that would require streetcars to have a schedule but I digress.  This stopping issue wouldn’t be a problem except it has happened many times and now with cellphone cameras and Youtube anyone can be a reporter:

The problem with reporting however is that there is a bias, and no journalistic ethics need be applied.  This kind of guerrilla journalism isn’t about reporting on events or distributing information it is about pushing an agenda. Every photographer makes a choice when he or she chooses to point the camera.  And that isn’t to say this media blitz is all one-sided either.  All the streetcars have cameras in them now.  The CBC has a video posted of a driver needing to fight a passenger off of the bus.  And the TTC employees have posted their own Youtube videos:

Personally I applaud the TTC putting cameras on the streetcars.  It not only ensures the safety of the drivers but the passengers as well.  And no one deserves to get assaulted while at work no matter how late they are! While I support the TTC I suggest the footage should be kept off of the internet.

A Facebook group called “Toronto Transit Operators against public harassment” which describes itself as “a group where Operator’s can give suggestions on how to fight back to the recent photo and video harassment from passengers just looking to make trouble for us.” cropped up not long after these videos appeared.

At one point they were reportedly advocating a work to rule policy to combat what Union boss Kinnear described as, “ an entitlement to film our operators in the performance of their duties”.  That Facebook group started out public but quickly became private after the public lashed back on the site.

What is interesting is there is another Facebook group for “Employees of the TTC” and it is open to the public.  And the public is beginning to lash back again.  This is a social media disaster for the union and the TTC.  First off you have to have a strategy and a clearly defined purpose when deciding to engage in social media.  The last thing you need is a mouthy employee to write something rash which further damages your already battered reputation.  You also don’t want to add fuel to the fire of the malcontents

The Union, if it had any brains at all would ask it’s members to kindly stop attacking the public, because right or wrong, if you argue with a troll it only gets stronger!

That isn’t to say there hasn’t been adult and measured discussions but if the Union, or the TTC decide they want to hash it out in the social media space they had better get a game plan together.  The public has been in this space for years and they had best catch up before they try to go troll hunting.

Share

Fizzbuzz

Monday, January 18th, 2010

Jeff Atwood, who writes the blog Coding Horror tweeted about issues in interviewing programmers who cannot program. Which he had posted about a couple of years ago. (I guess he was tweeting because the issue has not been resolved).

Write a program that prints the numbers from 1 to 100. But for multiples of three print “Fizz” instead of the number and for the multiples of five print “Buzz”. For numbers which are multiples of both three and five print “FizzBuzz”.

Jeff was responding to several other authors who had noted the same issue with finding qualified programmers.

When I was a student at Sheridan College, we had a great teacher named John.  John looked exactly like Gandolf the Grey;  if Gandolf was fond of the drink, smoked like a chimney and repeatedly told Frodo, “that’s a ‘you understood’”.  As luck would have it Lord of the Rings came out the year I was in John’s class so us students would constantly rib each other “YOU SHALL NOT PASS!”.  Good times.

One thing that became clear to me fairly quickly as a former teacher is that there is a basic level of understanding that we assume people have.  John’s ‘you understood’ was his way of stating he expected us to know that basic level of information.  His frustration however was people in the class who clearly did not understand.  I recall John’s lament that some students in his “C#” class couldn’t even turn on the computer without instructions.

One thing that became apparent in the class is that there is never “one solution”. The Fizzbuzz problem for example could be solved in a variety of ways, in a number of different languages and while the syntax would change the concepts would not.

Those basic concepts are the key to everything.

Programming consists of three structures, or rules.  I am sure if I was a ComSci student I would know the proper terms but I am an artist so just bear with me. The three structures are the loop, the decision and the step.

A loop is: repeat doing this step until this criteria is met.

A decision is:  If X is true then do this otherwise do that.

A step is : Do this, then do that.

Everything in life can be broken down into these component parts. Everything.  For example if you wanted to go to the store you would start with a decision, “Am I at the store?” if so then stop, go to store.  Walking is a loop, “While not at store, keep walking”.  It could even be broken down more, stand up then get keys, then lock door, then…and so on.

For the Fizzbuzz problem you need to run a loop that counts from 1 to 100.  Then you need to add decision statements that when a certain criteria is met something else happens.  That’s it, simple.

Programming isn’t about languages it’s about how you think.  Languages are merely syntax with which you express those thoughts.  Eloquent programming is how well you combine the two.

Share

More thinking of email

Saturday, January 16th, 2010

Here is what I would like to see with email marketing.  This is an example of the way a system would work based on a few purchases.  I am not sure how hard it would be to set up, but I think it would be really cool and effective.

Share

Limited social networking

Friday, January 15th, 2010

What would happen if you created a social networking site, but limited people to 5 friends?

The problem with Facebook, anyone can tell you, is people from your past contacting you (and you wished they wouldn’t) or people who are really only acquaintances friending you and blasting you with inane Farmville requests. And the truth is that if you were good enough friends to stay in touch with these people you would have. Of course there are lots of stories of people connecting with old friends, re-igniting old love affairs and finding long lost paramours. and while it is fun to catch up you don’t really take an active interest in their lives. But what if you could only connect to 5 people?

I think a number of things would happen:

First, “friending” someone would mean something. Every time you friend someone you are spending what I like to think of as social capital. There is an expense that does into friending someone which diminishes the value of your friendship. This is sort of like inflation. Inflation isn’t the cost of things going up, but rather the value of a dollar going down.

If I have 5 friends and I friend you, it means something more than if I have 1000 friends. You are one of five so it is a pretty exclusive group and I obviously care enough to select you. You can see this affect on Twitter with people who follow 5,000 others. They are “friend collectors” who think it is a big deal, they can’t possibly be reading all those tweets (and holding down a job). They will follow anyone and their dog in the hopes of getting followed back. But if someone I respected only followed 10 people then I would look at those 5 closely since that person I know made a conscious choice to follow these people.

The other effect is that companies would stay away. Who on earth is going to “friend” the GAP or BMW or RCA records when they only get five friends! A company would only be able to friend 5 as well so they couldn’t mass market.

Lastly you would have to think long and hard about whom you friended. Personally I wouldn’t friend anyone I see all the time since there wouldn’t be a point. I wouldn’t friend co-workers because I see them everyday. I would friend people who I don’t talk to very often but use social networks to keep track of. I would friend people who I want to listen to because they are interesting or provide value. Especially since they may not friend me back. I might not be one of their 5.

While I realize the marketing and money-making aspects of this sort of social network are limited I think it would be a very interesting social experiment.

Share

Thoughts on email marketing

Thursday, January 14th, 2010

holtrefrewfailEvery so often I feel stabby… okay fairly often. But one of the things that makes me most stabby is bad junk email. Advertisers seem to think they still live in the age of television. That they must pump a message out to as many people as possible and that the message must be the same. If find this extremely frustrating given the vastness of data available at our fingertips.

For example this showed up in my inbox today.

While the woman is attractive (and the $280 shirts arguable). I am neither a woman, straight, nor an Yves Saint Laurent shopper. While I have shopped at Holt Renfrew, provided them with my personal details and handed over my email address I have done so with the expectation of some customization in the email.

You may recall, dear reader, my previous posting on this topic. Holt Renfrew has tripped on the same hurdle that Shoppers Drug Mart did. At least they didn’t pretend to customize the email instead they just blasted it without regard to everyone on the list. Since the email is of no relevance or interest to me it was deleted. If Holt Renfrew does this too often I will simply remove myself from the list.

The shame is that email is very cheap, so little or no thought is given to blasting out this sort of advertising. If it cost them $3 per email I bet they would be a lot more selective about who gets it. There would also be a follow up strategy for those people who respond. The data is available to make marketing emails meaningful and so each customer could receive an offer that targets them.

chapters

Now compare this email to the one that was sent by Chapter/Indigo. This email is also un-targeted. However, rather than make an offer I am not interested in, they simply inform me that they are having a sale.

In this case, while not something I am interested in per se, it might be about something I am interested in. By keeping the email simply about a sale Chapters/Indigo hits the massive market they are after. However, if it is too vague, and vague too often, then I will unsubscribe from this as well.

It is a shotgun approach to marketing.

Amazon gets a little better at this, but there is no follow up or modification of the targeting. They clearly appreciate the value of data and customization. Amazon sends me emails based on the types of books I have purchased before, however that still segments me into a group even if I don’t respond.

I get an email for business type books, I get another one for gay books, I get another one for music, I get another one for fiction all because I have purchased one of each of these books on Amazon at sometime in my life.

The problem is the system seems to be is stupid. Just because I have purchased a baby book on Amazon in the past, doesn’t mean I have a baby or want additional baby books. If I don’t respond to the twenty other offers you have sent then don’t send it again because it was probably a one-time thing.

I know the data is out there, I know the development can be done, now we just need someone to put it all together and rock the market with some kick-ass, relevant marketing.

Share

In desperate need of some user testing

Wednesday, December 9th, 2009

You know who’s could use some user testing?  The Canadian government.  I was attempting to help Zuimei fill in some forms for immigration and I can’t save the fucking things!! Seriously I can’t even re-print them as PDFs.  Why?  What could I possibly do with it? It’s not like it’s a pipe bomb.  Yes someone could hack my computer and steal it, but so what?  They get all that information and more if they hack my computer anyway!

Not to mention the form is three pages long of the same tedious questions which I have filled in a dozen times before, but I don’t have copies of because I can’t save any.  But don’t both looking to their website to complain, they don’t have an email address, but you can call between 8-4pm not when you actually need help but while you are at work.  Way to encourage productivity, asshats!

Share

Don’t waste your effort

Monday, December 7th, 2009

shoppersShoppers sent me this email with the headline: “Shoppers Optimum PLUS Bonus Offers – Just for you!

The problem is, it isn’t just for me.  It has nothing to do with me.  I have never bought cosmetics in my fucking life.  Nor is it personalized in any way.  There is no “Hey Dave,” or “Dear Mr. Hamel”

Here is a little tip to anyone who sends this sort of shit out.  Stop it!

Stop wasting your time and mine.  You’re just pissing me off and I will retaliate by forwarding all my spam to you with an auto-filter.

On the other-hand, since you have my personal details, and you have my purchasing records feel free to send me offers I might actually be interested in.

  • Do guys buy cosmetics?  No.
  • Might they be interested in cologne?  Perhaps.
  • Might Dave Hamel, who purchases a new tooth brush every 3-4 weeks religiously be interest in cologne? perhaps.
  • Might Dave Hamel, who purchases a new tooth brush every 3-4 weeks religiously be interest in a toothbrush?
    DING DING DING DING! We have a marketing winner!

Now some marketing genius might note that since I already buy tooth brushes they don’t need to give me a discount. Perhaps not Einstein, but sending me toothbrush offers gets me in the store, sending cosmetics offers does not.

Share

I’m just like Grissom on CSI

Thursday, December 3rd, 2009

I hate it when people ask, “So what do you do for a living?”

“I’m a product manager at the CBC for web analytics”  At about this time the person I am talking to begins to blank out and wait for their turn to speak.  My father has resorted to just saying “He works for CBC…on computers.”

It isn’t that what I do is uninteresting, or that difficult to understand.  It’s just that you have to have a certain bend of mind to appreciate it.  Chris Berry, over at Eyes on Analytics has been able to boil analytics to 7 axioms. As a result it is easy to understand for other web analytics people, but it is still too intellectual and abstract for the general public in my opinion.

csi-evidencebagThinking of popular culture references I have likened my job, and that of analysts to the TV show CSI.  Like CSI there are two very distinct groups of  individuals involved.  There are the field agents and the research people.  The field agents, like myself, collect the evidence.  I only collect evidence.  I do not interpret what the evidence means.  I attempt to ensure proper collection protocol is followed so that the “chain of evidence” is intact.  This ensures that should someone question the evidence later on my ass is covered.  That doesn’t mean I can’t do the research part of it.  Like in the TV show you will often see Grissom collect some evidence and then return to the lab and analyze it.  I do that as well, however, my strength lies in knowing what to collect and the best way to collect it.  I look to my “Hodges” to analyze the evidence.

Let me give you an example.  If you wanted to collect data on podcasts, what is the best way to go about it?  There are a number of options available.  You could provide links to MP3 files on your site and track clicks.  But you would miss out on iTunes distribution and RSS subscriptions. You could provide a link to RSS subscriptions but you wouldn’t know how many actively used it or deleted it later on.  CSi lab-rat Greg

You could collect server side log files, but then you would miss out on the rich meta-data; “ntl_show1_sept122009.mp3″ doesn’t mean much does it?  My job is to figure out how to get the best out of all methods and ensure that it is accurate.  Once the collection is properly set up.  I don’t really care what the results are.  I have moved on to the next collection.

The analysts are like the lab techs at CSI.  They take the evidence that is collected and figure out what it means.  Also, like the lab techs on TV they are encouraged to distance themselves from the numbers.  Allowing their emotions to impact their stated results jeopardizes the integrity of the department.

In web analytics, like CSI, they use fancy graphics to illustrate what has happened.  Can anyone other than a tech actually read a DNA sequence?  Hell no, but you can see when the little lines match on the DNA profiles and you see when the fingerprint overlays the other one if they match or not.

CSI has taken some very complicated forensics and made them into short, 20 second rock videos of science. Like showing how the molecules in heroin combine to form new compound which then glom onto synapses in place of dopamine.  Our analysts use these graphics to illustrate how the consolidated video player has increased the behavior of video watching and increased page views as a result.  Complicated stuff but simple when viewed in a chart.

So there you have it, next time someone asks what I do for a living I will just reply, “I’m just like Grissom on CSI.”

Share