Traditional Culture Encyclopedia - Weather forecast - What are the tools for deep analysis of big data?

What are the tools for deep analysis of big data?

1, disco

Disco was originally developed by Nokia, which is a distributed computing framework. Like Hadoop, Disco is based on MapReduce. It includes a distributed file system and a database that supports billions of keys and values.

Supported operating systems: Linux and OS X.

2、HPCC

As an alternative to Hadoop, HPCC, a big data platform, promises to be very fast and extremely scalable. In addition to the free community edition, HPCCSystems also provides paid enterprise edition, charging module, training, consulting and other services.

Supported operating systems: Linux.

3. Lighting

Lumify, which belongs to Altamira Technology Company (famous for its national security technology), is an open source platform for big data integration, analysis and visualization. You only need to Try the demo version in try, Lumify and io, and you can see its actual effect.

Supported operating systems: Linux.

4. Panda

Pandas project includes data structures and data analysis tools based on Python programming language. It allows enterprises to use Python as an alternative to R in big data analysis projects.

Supported operating systems: Windows, Linux and OS X.

rainstorm

Storm is now an Apache project that provides real-time processing of big data (unlike Hadoop, which only provides batch task processing). Its users include Twitter, American Weather Channel, WebMD, Alibaba, Yelp, Yahoo Japan, Spotify, Group, Flipboard and many other companies.

Supported operating systems: Linux.