The mobile supercomputer

Automobile crossing rope bridge

Automobile crossing rope bridge (Photo credit: The Field Museum Library)

Maybe it’s my fading memory, but I seem to remember that winters were much colder during my school years. It could be that I spent a lot more time standing around in the snow waiting for buses, but the cold used to seep up through my shoes and into my bones. You didn’t need to look out of the window to see whether it was a cold and frosty morning. The starter motors of the reluctant cars made a characteristic whining noise in a gradually slowing rhythm as the last dying remnants of the battery was eaten away.

In the early 1980s, the ignition systems in cars were mechanical in nature. This meant they had the annoying habit of wearing out at the most inconvenient moments. Not only that, but there wasn’t much adjustment available. It didn’t matter whether it was 30 degrees and sunny or -20 degrees with inches of snow on the ground, the components in the ignition system worked (or rather didn’t) in exactly the same way.

The only tool available to the driver was a little knob called a choke which pulled out of the dashboard and controlled the strength of the fuel mixture. On a cold and frosty morning a richer mixture was required. As the engine heated up, the choke could be pushed gradually back in returning the mixture to normal.

Ford assembly line, 1913.

Ford assembly line, 1913. (Photo credit: Wikipedia)

Electronics were not the only reason cars were unreliable. The assembly lines on which they were produced had not advanced significantly since Henry Ford came up with the idea. Although many parts were pressed out of steel using a massive die, almost everything was assembled by hand which meant that fit and finish were inconsistent. Some cars were more reliable than others and there was a suspicion that quality of assembly went significantly downhill towards the end of the working week. If you were unlucky enough to have bought an unreliable car, people would refer to it as a “Friday afternoon car”. The metals used in car construction were nowhere near the quality of those used today. In addition, galvanisation had yet to take off and few car manufacturers used sufficient rust protection. Even if your pride and joy was in fine fettle, the dreaded tinworm could have nibbled its way through crucial parts of your car’s anatomy.

Construction techniques have advanced and cars have undoubtedly made massive leaps forward in terms of comfort, reliability, efficiency and safety but the basic form factor has remained the same for about a hundred years. The biggest leap forward has been in terms of the sophistication of the electronic control systems watching over the engine, brakes and suspension. It is not uncommon for a premium car to have 20 – 30 micro controllers and 100 million lines of code buried under the considerable bonnet (or hood if you’re American).

Just to put those numbers in perspective,  according to the Mythical Man Month (required reading for anyone in software) it is estimated that developers on average produce 10 lines of code per working day. I’m assuming that car manufacturers must find more productive programmers otherwise writing the software for a car would take approximately 50,000 man years. Of course not everything is written from scratch and the same code must get reused between different components and different cars. Still, it’s an incredible amount of software and not only that, the quality seems very high which is a comfort when you stamp your feet on the brake pedal in the rain.

I’m just glad I don’t have to listen to that infernal racket on a cold and frosty morning.

Getting from A to B

'This Is Design' at the Design Museum

‘This Is Design’ at the Design Museum (Photo credit: kieranmcglone)

During my childhood, before we undertook any long journey, my dad used to spend the evening beforehand doing his homework. He would sit at the dining room table with his trusty road atlas open in front of him. Working methodically, he would trace a route from where we were to where we ultimately wanted to be, noting down any major place names on the way.

During the journey, we would look out for direction signs to place names from Dad’s list. A medieval traveller would probably recognise the idea. If you want to get from Falmouth to London, you follow the milestones for Truro and then for Bodmin and so on. The system worked well, mainly because Britain has some of the clearest and best road signage in the world. Thanks to the efforts of Jock Kinnear and Margaret Calvert, the original designers of our modern road signs, roads are easy to identify and it is very easy to pick out direction signs for major towns.

With the advent of a piece of software called Autoroute, we were able to automate the route finding process. After firing up the software and choosing the start and finish points, the system would churn away for a moment before offering the fastest route between the two. If you were lucky enough to own a printer, you could print out a map and step by step directions to take with you. Eventually web sites became available offering route finding which negated the need to install any software.

Of course such levels of prior preparation are not strictly necessary. Armed with a trusty navigator and a road atlas, you could navigate on the go. It’s definitely better if I navigate and my wife drives rather than the other way around. During one trip where the roles were reversed, we were driving down a road beside a river heading for a town on the coast. I had this nagging feeling that we were on the wrong side of the river and every time we neared a bridge or a ferry, I asked my wife to confirm which side we were on. Each time, she insisted we were on the correct side and it was only when we physically ran out of road that she accepted that we were indeed on the wrong side.

When the US military opened up their network of Navstar satellites to public use, portable devices became available which could automatically pinpoint their location anywhere on Earth. As long as a satnav box can find enough satellites, because of the doppler effect, there will be a delay in communications with each one allowing the triangulation calculation to be made.

Smartphones now equip us with a phenomenal array of navigational tools. We can find out where we are, which direction we are facing and how to get to where we want to be. There are virtual reality apps which overlay labels on our screens to show exactly where nearby points of interest are. We can search for a nearby station or restaurant. We can even do all this using our voices alone.

Early explorers who navigated huge distances purely by the position of the Sun would probably find it highly amusing that we still get lost even with all these tools to help us.

A little of what you fancy…

Figure 1 from United States patent #1,773,079 ...

Figure 1 from United States patent #1,773,079 issued to Clarence Birdseye for the production of quick-frozen fish. (Photo credit: Wikipedia)

My wife regularly asks me a question such as what do you fancy for dinner tomorrow night, which seems a bit like asking me where I want to go on holiday the year after next. I simply don’t know. I can tell you what I feel like now or whether I liked what I just ate but asking me what’s going to tickle my culinary fancy tomorrow is a bit of a stretch.

I can’t imagine there were too many such conversations in the Neanderthal household. Back in those days, what you ate came down to what you could grow or catch. If you fancied something meaty it came down to whether you could run faster than this evening’s dinner. Once the nasty business of killing was out of the way, you had to peel your meal – removing any fur or feathers. Before fire was discovered, having rare meat was not a choice, it was a necessity. I don’t think I’d have lived too long unless a met a particularly feisty cave girl.

With bartering came a lot more choice. Instead of doing everything yourself, you had the option of sharpening your neighbour’s axe in exchange for a chicken or hiring out your feisty cave girl for something more exotic in return. No-one really moved around that much, so communities were still restricted to what lay within easy reach.

With more mobility came more choice still. Knowing that rarity breeds value, smart people with orchards went to where there were no orchards and exchanged their goods. As transportation technology evolved, foodstuffs could be moved further and further. Unfortunately, most food has a shelf life and perishability determined how far they could travel. Salt became the preservative of choice or food was cured or pickled in some way.

People eventually worked out that keeping foods cold helped to keep them for longer. In the beginning, there were no artificial cryogenics available, so large blocks of slowly melting ice in cool rooms had to suffice. Once the humming white box in the corner had been developed, there was no stopping us. Everything was frozen from vegetables to meat and a whole new selection of sweets became available for the first time. Legend has it a certain Captain Birdseye realised on a polar fishing expedition that food frozen quickly tasted so much better than the stuff that was left in the icebox to cool down on its own.

Of course, now that the other side of the planet can be reached in a mere 24 hours, pretty much any delicacy from anywhere in the world is available in a choice of high street supermarkets all year round. Ecologically, this is a disaster. There is every chance that if you choose the right (or wrong depending on your point of view) choice, the carbon footprint of your evening meal could be several thousand tonnes. All this explains why our fridge and freezer are rammed full of a multiplicity of ingredients – hence my wife’s insistent question!

Feel the power

English: One of the Maid of the Mist tour boat...

English: One of the Maid of the Mist tour boats approaching the Horseshoe Falls on the Canadian side of Niagara Falls. Français : Un bateau d’excursion approche de la Horseshoe Falls, du côté canadien des chutes du Niagara. (Photo credit: Wikipedia)

An experience I will never forget is seeing Niagara Falls for the first time. Although I heard it first, a kind of unrelenting thunder as the constant torrent of water crashed over into the basin below. As we approached, the noise grew and the falls only seemed more epic in scale. We saw them from several angles. Obviously, we had to approach them by boat on the Maid of the Mist. Although a hugely enjoyable trip, unfortunately to anyone wearing glasses, the visual fidelity is ruined by the ever present mist.

We heard a number of facts and figures whilst we were there, but I think the thing that impressed me most was the fact that the flow of water over the falls was virtually halved because of the hydroelectric power stations operating at the top of the falls. The fact that the sheer natural power we were witnessing was only operating at half strength astonished me. How much more impressive would the falls be if the power stations relaxed their grip on the river Niagara?

In power generation, it pays to think big. Watching an episode of a children’s educational program all about a hydroelectric power station under construction in Snowdonia, it struck me as ambitious in scope. The whole idea was to let the water from a lake at the top of a mountain fall through a huge turbine in the middle of a mountain in order to generate power. During the night, the water would be pumped back up to the lake using cheap off peak electricity.

I happened to visit the Dinorwig power station some time after construction was complete. Although there is a lot to do in Llanberis, a brief respite from the rain was very welcome as we took the coach deep into the heart of “Electric Mountain”. The fact that the drive into the mountain takes several minutes gives some idea of the scale of the operation. Eventually, we disembarked in the very heart of the cathedral like generating chamber. The huge turbines make such a racket, the very floor shakes.

More conventional power stations can also be a site to see. On a visit to Dungeness nuclear power station, I remember being impressed by the scale, but less impressed by the 1960s era control equipment. Once he had grasped the fundamental operation of the plant, my brother dismissed it as “just a giant kettle” and proceeded to tell us how bored he was every five minutes. I found it much more interesting, but I have to say it paled in comparison to the mother nature powered installations I would come to see.

There is something enticing about the idea of energy for nothing – certainly in these days of rising energy costs. There are some who say that the new three bladed wind turbines spraining up over our landscape are ugly. I like them, both aesthetically and philosophically. Those simple white structures standing like sentinels around the countryside whir away generating power from the primal force of the wind. I hope they build many more.

There are massive reserves of natural energy lying completely untapped. Research is going on into harnessing the power of the sea through tidal and wave machines. Scientists are developing large kites to fly in the jet stream where the wind is so much more powerful than on the surface. Just How long will it be before the world’s deserts are covered in arrays of solar panels silently generating all the power we will ever need?

A brief history of warfare

This image was selected as a picture of the we...

This image was selected as a picture of the week on the Malay Wikipedia for the 44th week, 2009. (Photo credit: Wikipedia)

Over time, the human race has devoted a lot of energy to finding creative new ways to hurt or kill each other. Back in the dragging women back to the cave by their hair days, sticks and stones were the order of the day. Plentiful and easily fashioned, these devices would do the job but it would be messy and time consuming. Not only that, but if both of you are similarly armed, regardless of the victor, it’s highly likely you will both be hurting afterwards. Sooner or later, one bright caveman realised that if you took a very small, sharp stone and attached it to a stick, it could be thrown some distance with accuracy. Once the spear had been invented, cavemen no longer had to fight at such close quarters.

Sharpened flints were all well and good, but they were a bit crude. When metals were discovered, weapons could be much more strong and finely constructed. The sword became the order of the day. Some of them were sharp and some of them were heavy, but they were all effective. In response to this, metalworkers developed armour and shields. In order to breech the armour, bows and arrows and crossbows came about. Nothing struck fear into the heart of a warrior in plate mail armour than a crossbowman.

For a time, occupiers built castles which were a hardy defence to most of the weapons of the day. With the advent of gunpowder and cannons, the balance of power changed yet again. The walls could be easily breached and deadly missiles could rain down into the interior of the castle. Muskets and rifles reduced the skill level required of the average foot soldier and increased his range.

During world war I, there were a number of advancements. Aeroplanes were used for reconnaissance and later for bombing missions. Once the bombers became enough of a nuisance, fighters were developed. The most famous of which being Baron von Richthofen in his glorious red Fokker DR1 triplane. Trench warfare was the order of the day. The only way to advance was to assemble a large number of men and go “over the top”. With the advent of the machine gun, such tactics were stopped in their tracks. A well aimed machine gun operated by a handful of men could take out hundreds of soldiers. In order to counter this, the tank was developed. Because it was bulletproof and had caterpillar tracks, the tank could advance with impunity.

By the time world war II started, aircraft could fly much further and could carry a lot more. It is hard to believe now, but at times during world war II, it was routine for London and Berlin, both European capital cities, to have many tons of high explosives dropped on them on a nightly basis. When you think that the slightest innocent casualty in a war today causes an outcry, it’s a sobering thought. With the advent of the V1 and V2 rockets, missile technology was well and truly here to stay. When the nuclear bombs dropped on Japan, the scene was set for the cold war.

Fast forward to the first gulf war and the tales of cruise missiles flying down streets and navigating through towns were absolutely mesmerising. By the time we got to the second gulf war, laser guided missiles meant that explosives could be delivered with pinpoint accuracy. With all this technology, sometimes the most effective weapons are the most simple and Improvised Explosive Devices (or IEDs) have been used to murderous effect by the Taliban in Iraq and Afghanistan.

Weapons get more sophisticated by the day. Bullets can now go round corners and there is enough destructive power in the world’s nuclear arsenal to lay waste to our wonderful planet several times over. It is no wonder that Albert Einstein said that he had no idea what weapons would be used in world war III, but World War IV will be fought with sticks and stones.

The synergy of the network

A segment of a social network

A segment of a social network (Photo credit: Wikipedia)

One of the concepts I found challenging to grasp many moons ago during a course in business and finance was synergy. Maybe it was because I was only 16 at the time and the sum total of my possessions added up to one Casio calculator and a dog-eared biro but when he said that the whole was greater than the sum of its parts – I struggled to see what he meant. Of course I now understand that if you deliver two tons of metal, a few bits of rubber and some plastic to Massey Ferguson, you get a very different product compared to the same shipment arriving at Bentley with a commensurate difference in value.

Almost every mobile phone is pretty much the same form factor and made of similar materials and yet we place very different value on different brands. The whole perfume industry relies on people forgetting the inconvenient fact that the product they are selling is nicely scented alcohol served up in a nobby bottle as they hand over a small fortune.

Those who know me well will know that I enjoy playing games. Not the sort that appear on a computer screen because I spend far too much of my life staring at pixels as it is. I enjoy social games where the participants are vaguely humanoid. Some being more vague than others. The most satisfying games I play are also the most difficult to explain. Games which rely on the collective imaginations of the players concerned can result weaving amazing stories. The reason these games work is synergy once again.

The idea of a social network is not new. In the early 1930s, a self-published psychologist named Dr. Jacob Levi Moreno introduced the sociogram, the first formal attempt to map out the relationships within a group of people. Moreno’s sociogram — a cluster of individual points, or “nodes,” connected by straight lines — became a powerful tool for identifying social leaders, outsiders, and what he called the “sociometric star,” the person to whom all others are connected. [Source: Psybernet]

Social networks are built on synergy.

Facebook made its début on the markets this week amid a flurry of law suits and accusations. If Facebook were a country, it would be the third biggest with only China and India boasting larger populations. Something like 1 in 5 couples meet through social media. Opinions vary as to how much time people spend on social networks, but whichever estimate you believe, it is a very large number. Each individual’s contribution to the network is not worth much, but taken together, the value of all the contributions is much higher. Whether that justifies Facebook’s valuation I don’t know but I certainly didn’t buy any shares.

After one of those conversations one sunny lunchtime at the local watering hole where everyone walks away thinking they are going to change the world, we decided to get Yammer up and running. Yammer is a bit like Facebook for companies. My colleague installed it and sent me an invitation. When I signed up, I was asked to invite some other people. After 6 months or so, half the company was online after no promotion and no backing from the company. It’s fair to say that Yammer has revolutionised the way that we collaborate and communicate within the company.

There is a massive proliferation of different social networks available. Where they overlap, usually a winner emerges and the others die off. Where they are complementary, they are linking together. Already, a post you make on WordPress or a fresh pin on Pinterest can automatically appear on Twitter & Facebook. One day, they will become seamless and it won’t matter which social network(s) you are signed up to. Then we will really see some synergy.

News travels fast

 

English: The Fall of Nelson, Battle of Trafalg...

English: The Fall of Nelson, Battle of Trafalgar, 21 October 1805. (Photo credit: Wikipedia)

In today’s connected world, it is hard to believe that not so very long ago, events took a long time to become widely known. News was originally spread by word of mouth which meant that it travelled only as fast as the people who carried it. With the advent of literacy and language, people began to use the written word to communicate with the wider world around us.

Military communications relied on various methods throughout the ages. A company runner was often sent across a battlefield carrying instructions between different units. Sometimes he even survived the trip. Semaphore signals using flags or lanterns were somewhat safer and are still in use today between ships in the same formation.

There is a plaque in Kensington marking how the news of Nelson’s death was broken. After he was killed in the battle of Trafalgar just off the coast of Cadiz, the ship carrying his body pickled in a barrel sailed to Falmouth where the news was sent by rider to London. Even after riding through the night changing horses at every opportunity – it was days before the public knew about Nelson’s death. As time went on, despatch riders exchanged their horses for motorcycles and advances in radio and telecommunications rendered them pretty much obsolete altogether.

In the wild west, news was propagated by the pony express – literally men on ponies riding from town to town spreading news of anything noteworthy. As the railroads crept across continental America, telegraph lines were built alongside and before too long, a message given to a telegraph operator in one town could be relayed to the other side of the country in a matter of hours.

The first recognisable newspapers came about in Venice around the 17th century. Costing one gazetta (a small coin of the time), these handwritten sheets gave the reader an inkling of what was happening in the world. During the industrial revolution, great advances were made in technology and it was possible to buy a printed newspaper for the first time. Many of the newspapers we recognise today (such as the Times or the New York Post) started at around this time.

In order to populate the newspapers with stories, they relied on correspondents. They were so-called because they would send in the stories via letter. Any such letters from far away climes would travel on packet steamers across the oceans to deliver their stories to the newspaper office ready for publishing. The further away the correspondent, the longer the delay.

When I was growing up, if you wanted news you either read a newspaper or tuned in to the television at 6PM or 10PM.

Today, there are whole networks and channels devoted to bringing the news into your life 24 hours a day. There are hundreds of sites all over the internet dedicated to providing the very latest news. It can be a matter of seconds before a story becomes world news. Satellite technology means that correspondents can report direct from very remote locations live as events unfold.

Not only that, but smartphones have become so sophisticated now that every user is a potential correspondent. Nowadays, we get breathtaking footage of disasters as they unfold – often in high-definition. Revolutions that might have once been quietly suppressed by brutal regimes are now headline news. There have been many high-profile cases where people have attempted to stand Canute-like against an unwelcome story by taking out injunctions. With Twitter, the news seems to sweep over them like an angry wave.

If only more of the news was good news!

 

A special thing…

 

English: Untidy Desk

English: Untidy Desk (Photo credit: Wikipedia)

It didn’t occur to me at the time, but when I walked into the Rose and Crown one Saturday afternoon clutching a thick tome all about Active Server Pages (ASPs), my life was to change yet again. The place was nearly empty save for two gentlemen sat on stools at the other end of the bar. I ordered a drink, opened up my book and started reading. Despite concentrating on the vagaries of Internet programming, I could not help but overhear snippets of their conversation. Apparently, they had been out on a company bash the night before and were a little the worse for wear.

Before too long, one of them looked over and enquired about my book – “What’s that – a computer book?” or something equally eloquent. After a few pleasantries were exchanged, the conversation turned to my professional life as they asked what I did for a living. Although I had enjoyed 6 excellent years at Pentyre, the work had started to dry up and I was intrigued when the two men started to talk about the company they worked for. Although their description of the company did not sound that exciting – what intrigued me was the passion they felt for their work.

I agreed to come along for an interview to find out more and a few days later, I was back in the Rose and Crown, the chosen venue. Arrayed in front of me was pretty much the entire company. As I sat there nervously, I was bombarded with questions from my would be colleagues. All of them shared the passion I had seen in the first two men. The company was called jBASE and had recently been acquired by another larger software house; Temenos (a Greek word meaning “a special thing”).

They liked me and I liked them and I readily accepted their offer of employment. Before too long, on my first day, I turned up at their offices. I had been given no directions, but managed to find my way to the top floor where I found a locked door. Before too long, someone else came along. Another recent joiner. Neither of us had the key, so we stood there chatting. Eventually, the door was unlocked and we were led into the office. The place was an absolute tip. There were computers everywhere. Some of them on people’s desks, some piled up haphazardly and a number of them atop a pool table which bowed disconcertedly under the strain.

There was not an inch of clear desk space in the building and I was led to my own cluttered desk. I was introduced to my new boss. I could barely see him behind piles of ageing computer manuals and printouts. As I logged into my machine – an email popped up. “Hi – my name’s Jason – I am sat opposite you!”. It was a sign of things to come as the only sounds in the office were the tapping of keyboards and the loud hum of fans straining to substitute for air conditioning.

Although it sounds dysfunctional – it was an amazing company to work for. In the early days we were an autonomous company, but as time went on we became assimilated into our parent company Temenos. Although Temenos was a larger company, they had much in common with jBASE. Passion was evident throughout the organisation. Being very entrepreneurial in nature, process and procedures have always lagged somewhat behind the relentless drive for growth. By any conventional measure, Temenos has been a phenomenally successful company and I have enjoyed working there immensely.

By far the most dynamic organisation I have worked for, Temenos is not for everyone. If you are looking for a job where you are told exactly what to do – you had better look elsewhere. If you want to become a force for transformation in the banking industry, look no further.

 

Beam me up Scotty!

 

Abstract icon of Enterprise NX-01 of Star Trek...

Abstract icon of Enterprise NX-01 of Star Trek Enterprise (Photo credit: Wikipedia)

After the big comfy armchair that was BP, my second employer “Pentyre” was more like a roller coaster. After the comfort of a blue chip company, I was brought down to Earth with a bump when I was summoned in to an all staff meeting the week after I joined. The entire company easily fitted into a small room. I was one of 7 software developers. The MD explained that a customer had reneged on a bill and the company was in real trouble. Some of the directors were going to forego salary for a couple of months and hopefully, everything was going to be OK. Had I made the mistake of my life ?

I very nearly ended up missing out on working at Pentyre altogether. I had already accepted a job with another company, but there was a recruitment consultant who just wouldn’t take no for an answer. He insisted I visit Pentyre to see what they had to offer. So after work one evening, I turned up outside their offices for an interview. First appearances weren’t too promising – a converted factory with a tatty sign outside. I was shown up the stairs into a demonstration suite. There were various devices around the place; pagers, phones, cameras, alarms, flashing lights.

I was interviewed by the MD himself. An unassuming middle aged man called Malcolm, impeccably dressed, short with wispy white hair. He gave me the potted history of the company, which didn’t take long. After a long career in IBM, he had taken his terms and used his severance money to start up the company. He then took me through a demonstration of what their software could do. It was a dazzling display as he made the various devices do their stuff with just a click with his mouse. The inner geek in me was hooked.

He then took me on a tour of the building. At the back of the building was an area that looked a bit like Q’s workshop out of the Bond movies. There were machines everywhere in various states of assembly. On the benches there were oscilloscopes and multimeters. Propped up against one wall was something called a protocol analyser. The last time I had heard of anything like it was during an episode of Star Trek. Dominating the middle of the room was a train set. I looked at Malcolm quizzically and he nonchalantly explained that the reason it was there was to test the train radio system they were developing for the London underground.

I was mesmerised. I simply had to work for this company. As we went back up the stairs to talk turkey, it was obvious I was hooked. Malcolm asked what it would take for me to go and work there. A brief exchange later, the deal was done. I started work there a few days later.

It was an amazing place to work. The nice thing about working as part of a small company is that every single person really makes a difference. Every few months or so, there was a new assignment – usually involving some brand new technology. My first job was all about pagers. Back then, if you had a large site, the only way to keep in touch with your workforce was to give them a pager. I also developed a building management system, some modelling software for a steelworks and CCTV systems for prisons and nuclear reactors.

My time at Pentyre taught me the power of small teams working together without constraints. The productivity was amazing. There was no demarcation; you sold, designed, built, tested, installed and supported every bit of software that went out the door. Not all the technology was all it was cracked up to be. We worked on a project to detect faces in crowds. I couldn’t get the face recognition software to recognise me standing perfectly still at less than two paces. Voice recognition was similarly inaccurate being unable to determine the difference between “Chicken Tikka Massala” and “Land Rover” even when spoken slowly and deliberately.

The technology failure that has tickled me to this day was DCOM. Launched with some fanfare, DCOM (or Distributed Component Object Model) was Microsoft’s attempt at a computing model for distributed computing. In order to test it, we set up two machines. On the first, we coded a simple button with the label “Sausage” which would then send a message to the second machine which would respond with the on screen message “sizzle”. It was the simplest test imaginable and we were used to getting such things working.

Even so, after a whole morning of messing about with various different settings, we simply couldn’t get it to work. Frustrated, we went off to lunch. When we returned – there was the “sizzle” message on the second machine – we obviously hadn’t left it long enough!

 

Information overload

Big Data: water wordscape

Big Data: water wordscape (Photo credit: Marius B)

Information is the most valuable tool we have. Without reliable information, decisions can only be made on hunches. One of the main benefits of computers was that they were supposed to help us deal with information, but there are some unfortunate side effects. Partly because of our hunger for ever more power and partly because of progress in making bigger and better computers, they have steadily grown ever since they were invented in a phenomenon is widely referred to as Moore’s law.

Not only that, but devices have become cheaper and cheaper. The Sinclair Spectrum was priced at £179 at launch 30 years ago, a sum probably equivalent to double that now. That was a machine with no screen, 48K of memory and no storage. Nowadays you could have a tablet, or a phone or even a couple of netbooks all with power that would completely dwarf the humble spectrum. As computers have become more affordable, they have proliferated.

And not just consumer devices. It now makes perfect sense to use computational devices in almost every setting thanks to the cheapness and the ingenuity of the Chinese. IBM told me at impact that there are 9.5Bn connected devices in the world today growing to 20Bn in 2015. All of these devices are producing data at an alarming rate. Storage companies fall over themselves to tell you how fast this data is growing, but take it from me – it’s exponential.

The other side effect of computers is that the average human being now has the attention span of a hyperactive goldfish. Because the answer is available from Google in 0.2 nanoseconds, why would you want to read a report or a book? Twitter delivers a constant stream of news in 140 character long chunks. This means that we are no longer happy to do lots of analysis to get our answers, we want to know instantly.

So how do we make sense of this muddle?

I have always been a fan of infographics as a mechanism for presenting complex information. Ingeniously through pictures, infographics helps the reader to understand the big picture. Spatial and relative relationships are easily picked out, but detail is not. Newspapers use info graphics to great effect – especially when trying to explain concepts like exactly how much money we all owe thanks to the financial meltdown. This is a great site to see some really good examples; http://www.coolinfographics.com/

Big Data was a much vaunted concept at IBM Impact too. If you want to process the huge amount of data available today, then traditional methods are just not going to work. Reading all the data into a relational database and then running a query will mean you need a huge building to house the storage, a power station to feed the computers and half a century to wait for the result. The only way to process this data is as a stream – a bit like the water coming out of a firehose. Then you need to use something called complex events processing to look for relationships between the data.

One of the most interesting concepts in dealing with the information overload is the semantic web. The idea is that computers need to make sense of all this data themselves and answer any questions we have. This is the technology behind the Siri voice response software in the latest iPhone. There is even a search engine. It’s not perfect by any means – try searching for “Who is the richest man in France” or my personal favourite “Who is the sexiest woman” 🙂 But what is interesting is how often it does get it right.

One day – the characters in Star Trek the next generation talking to their computers will look positively antiquated – and I for one can’t wait.