This post is also available in: עברית (Hebrew)
Advances in unmanned aircraft, micro-technologies, biometrics, robotics and processing hardware have resulted in an unprecedented flood of business intelligence as well as operational intelligence data.
Forces in the field have access to more information about their enemies and their environment than ever before.
Intelligence analysts face a veritable embarrassment of riches. This means that analysts are faced with the task of deriving meaning from huge bodies of data before the information contained in the data goes operationally stale. Advances made by and solutions developed in industry to solve the Big Data problem can be leveraged by government acquisition managers to produce timely and cost effective solutions for the civilian and military components of the Intelligence Community, according to wso2.com.
Potentially useful information can be obtained by collating all data and appropriately mining it.
In this sense, big data technologies enable the derivation of intelligence from internally captured information which can be treated in a reasonable amount of time with a view to identify patterns of interest, according to computerweekly.com.
This is particularly interesting in regard to analysing activity on the network over extended periods of time, which can yield information that is not readily apparent otherwise. Think of identifying potential correlations that are not known in advance and factoring that into overall correlation.
One of the companies that offer a big data fusion platform is Zoomdata. When you have mobile application usage data in Hadoop, but you’d like to enrich that data with some customer demographic information stored in an Oracle database. Or suppose you have a stream of sensor readings and you want to perform calculations across that real-time stream and include historical data. Or you might have product reviews indexed in Elasticsearch that you’d like to correlate with product purchase history in an enterprise data warehouse. All of these scenarios require data blending across multiple sources to get the right insights, and get them fast.
Zoomdata Fusion makes multiple data sources appear as one without physically moving the data to a common data store. Business users can fuse sources without having to wait for a data architect to set it up. And once defined, a fused source can be used like any other source in Zoomdata.
According to the company’s website, all the interactive visualizations are available for a fused source. The platform automatically determines when and how to access the different sources to produce a given visualization without the end user having to worry about how it works. Fused sources can also be used within dashboards and embedded applications, providing users with seamless access to disparate data sources.
iHLS is organizing a Big Data Fusion Conference and Exhibition on February 13th, 2017. Among the Topics discussed at the conference: Big Data Analytics for the Intelligence Mission, big data in Law Enforcement, big data integration, big data cyber security and more.