The Easy Way to Big Data

This post is also available in: עברית (Hebrew)

Yanai Milstein,  Informatica Business Unit Manager, Aman Group

In the data systems we’ve known for so many years, the heart of these systems is the information stored within the data. So many technological developments today have resulted in too much information: Not just the transactional information which we’ve been managing for a while now – information which is created in social media, websites and many other devices which are putting up logs every day/hour/minute and even second.

The cost of maintaining this transactional data is high, which is why systems that take care of a lot of information have been developed – Big Data systems. Settling for cheap systems’ capabilities has created many limitations in data management and drawing conclusions from it.

Today, developing Big Data systems, which have a very cheap infrastructure, is complicated and entails relatively expensive personnel which has capabilities which are hard to find in general and in Israel in particular.

In order to bridge the gap of recruiting relatively expensive and rare personnel, Informatica has developed a solution which allows organizations to switch to Big Data systems without a learning curb with the same set of capabilities they have already had.

Informatica has recognized this problem early on and developed a response allowing for a simple, fast, and high quality solution. The company has developed a Big Data Edition version to its old and quality power center engine, so that today you could work in Informatica’s familiar workplace on Hadoop. In fact, this smart way of work allows to work with simple and familiar GUI interfaces, as Informatica is generating the code backstage. Together with lowering dependence on difficult and expensive development, connectors were added to the relevant worlds of content such as social media, as well as noSQL DBs and even implementation of the capabilities of more Informatica tools, such as a Hadoop data tube, which became critical in collecting so much data due to a multitude of anomalies and duplications of data. The obvious conclusion is that if there is no treatment of the data quality in Big Data projects, it will be extremely hard to eventually create insights based on the data.

Informatica’s solution concept, called Vibe, is presented in the next chart:

This is how an organization can have a Big Data solution without risk, while keeping the organization’s assets and knowledge, with excellent Time-To-Market.

For more details and registration for the Big Data conference, click here.