big data the falsehood of the more the merrier

recently google and apple (siri) released new vesions of speech recognition in google now and ios6. these represent the best of today's big data. traditionally big data has been thought of as a big hard drive full of stuff that can be sorted through and processed. however as this big pile of data grows the only people who are able to sort it have many hundreds of processor cores. this takes energy as the book breakpoint by jeff stibel points out that large internet based companies have their severs based in cheap places to get electricity. cnet in their review of ios maveric claim that the catch or the storage of internet fies for quick reference on the macs can be overbearing. Worse is the concern that having even anonymous data can have legal implications because people with unique conversations would stand out in a crowd. Particular phrases such as idioms from cultural minorities can distinguish a person's confersation.

what can be gleaned from this predicriment is a feature set must be in place. data without a feature set is useless. recently peter norvig of google gave a talk to brown university about memoization or a way that the computer can know the content of images although it may not know the name of these items the computer found to be similar.

In surfaces and essances the book makes reference to how words are boxed and unboxed in a conceptualizer and a formater. Consider all the meanings of the word band. This can connotate everything from a marching band to a wedding band to a bandaid that filters air to a wound so it does not get infected. Which one of these is a medaphore? We can never tell which usage is the origional and which ones are the likening to the origional's fossel of the medaphore. With zachman's framework we come close to determining the usage of phrases.

In the later part of the last century stock traders worked on algorithms to determine whether stocks would go up or down. A key advantage was that stocks are quantified or exist in numerical form. However this does not subtract from the marvel of predicting what would happen next. Lessons from the stock market predictions can be applied to word and concept formation. Humans tend to repeat language behaviors if they were effective or energy efficient or economical. Language would change if it is so removed from the reciever that the hearer does not understand. http://m.cnet.com/news/troubleshooting-enhanced-dictation-in-os-x-mavericks/57611137 http://mobile.bloomberg.com/news/2013-06-05/states-hospital-data-for-sale-puts-privacy-in-jeopardy.html