Skip to main content

Posts

Showing posts from September, 2013

An ounce more to the Big Data chaos !

Having built 2 products that use the Big Data “idea” and “tools”, I am qualified to add to the already existing chaos. Now, what triggers me to do this? Over the weekend, I was trying to explain one of those products to a couple of brilliant architects and thinkers. That’s when I experienced how it would be to be caught up in the belly of a Tsunami wave. Every word and every picture was ripped, rolled and mauled for the next 2 hours. I could quickly infer that the reason for the mayhem was that we did not have a common reference architecture of a typical Big Data solution in our minds. We even needed a totally new vocabulary that does not ring any old conflicting bells.  During the discussion, my brain was madly racing to bring some “order” on those areas. I will present it all here. You tell me if it brings more order or even more chaos. Basics first! Why do we need a reference architecture? It is basically to communicate a complex concept to others in the least conflicting mann