"Big data adoption in enterprises soared from 17% in 2015 to 59% in 2018, reaching a Compound Annual Growth Rate (CAGR) of 36%.
Amazon Web Services (AWS) S3, Spark SQL, Hive, and HDFS are the most popular big data access methods with AWS S3 is growing most quickly in 2018.
Apache Spark MLib and Tensorflow are the most-adopted big data analytics and machine learning technologies in enterprises today.
Cloudera, Amazon EMR, Hortonworks, and MAP/R are the most popular big data distributions by enterprises in 2018..."
"In this special guest feature, Amnon Drori, Co-founder and CEO of Octopai, discusses how companies can gain visibility and control over their data lineage by leveraging metadata and how this will make GDPR compliance a manageable task instead of an impossible pursuit. Amnon has over 20 years of leadership experience in technology companies. Before co-founding Octopai he led sales efforts at companies like Panaya (Acquired by Infosys), Zend Technologies (Acquired by Rogue Wave Software), ModusNovo and Alvarion, and also served as the Chief Revenue Officer at CoolaData, a big data behavioral analytics platform. Amnon studied Management and Computer Science at the Open University of Tel Aviv..."