Big data 4 HLS Conference

This post is also available in: עברית (Hebrew)

Top experts from Israel and abroad met today in the Israel Air Force Center in Herzliya for the Big Data 4 HLS Conference, organized by i-HLS.

The experts have presented their vision on how to improve the extraction of intelligence from the enormous amounts of data that are transferred around the world.

David Tayouri, cyber intelligence department manager at Israel Aerospace Industries (IAI) said that the big data tools should have defined targets. He further said “another big challenge is to seen the context between many data sources.”

Tayouri added that big data intelligence should be able to forecast developments. “The Arab spring events in Egypt and other Arab countries should have been foreseen by a good Big Data system.”

The experts emphasized several very important lessons already learned in the big data intelligence world.

They said that we are only starting to get to a point where we are truly able to focus on the quality of big data. Wikipedia has over 70,000 active contributors to clean up its big data and to keep the environment clean over time. As an open community, Wikipedia has become the standard of showing how the quality and improvement of big data can actually occur.

Register to iHLS Israel Homeland Security

This evolution is still only at its starting point. Experts say that automation efforts designed to make data more useful are not enough. “With mass of data flowing in the social networks, bogus identities can be an obstacle.”

The IAI expert said the in the framework of an experiment, a bogus identity in one of the social networks brought a hundred ’friending’ in a mere 48 hours.

Another key issue with Big Data is the challenge to keep its purity and context.

Experts underscore that this challenge can be met by a combination of data scanning, file detection, data replication, data integration and data recovery. Regardless of volume, velocity and variety, Big Data must be effectively stored, transferred, transformed and analyzed without threatening the original data. This means that companies must figure out how to bring their storage, transfer, recovery and scrubbing activities together into an integrated big data resiliency department.

The i-HLS’s Big data 4 HLS Conference was widely attended, complete with expert participants from Lockheed Martin, Oracle, EMC, IBM, ThetaRay, Mellanox and Expert System also participated.

One of the experts said that HLS can benefit from Big Data as in recent security events there were “signs” that something is going to happen and the tools were not efficient enough to create a warning.