Big Data
May 30, 2019
Written by Todd Goldman
Have you ever been frustrated with your business executives and their lack of understanding about data, where it comes from, how it should be used? Well, there is some hope on the way.


Big Data
Jan 08, 2019
Written by Todd Goldman
We have all been uncomfortable with the “big data” term for some time now. It is time for a new and better term. Agile Data!


Big Data
Dec 19, 2018
Written by Todd Goldman
Five top thoughts and predictions for 2019 from big data and data engineering industry veterans Ramesh Menon and Todd Goldman. Read on to know if the Kardashians made our top 5 list.


Big Data
Dec 05, 2018
Written by Todd Goldman
In 1955 the first Fortune 500 list appeared and today, only 53 remain on the list. None of this is lost on the Fortune 500’s oldest company, which has stayed young by becoming a digital pioneer.


Big Data
Nov 29, 2018
Written by Todd Goldman
Data silos prevent companies from getting a complete picture of their overall business. Big data technologies can help in theory, but for many organizations, they lack the skills necessary to put that ...


Big Data
Nov 01, 2018
Written by Todd Goldman
Uber, Netflix and Airbnb have all published some of the tools they have built to make big data work for them. The question is, will this work for you?


Big Data
Oct 09, 2018
Written by Todd Goldman
On Wednesday October 3rd, Cloudera and Hortonworks announced, to the surprise of many, that they were merging. And while the timing may have been a surprise, the fact that there is industry consolidation ...


Big Data
Oct 03, 2018
Written by Amar Arsikere
In the not too a distant future, the business world will be split into two camps - companies which have an agile analytics capability and those companies that get eaten by the first group


Big Data
Sep 20, 2018
Written by Todd Goldman
The bottom line take away from Strata 2018 as compared to 2014?  Less traffic, more real business.


Big Data
Jul 23, 2018
Written by Todd Goldman
While most ( 63% ) of the surveyed companies have employed a CDO (where virtually none of them had just four years ago), many of them could not seem to agree on what the role of CDO should be.


Straight from the Infoworks blog, our big data articles archive is a collection of key concepts, industry insights, and news happening in the world of big data.

For companies at the enterprise level, big data is one of the most substantial technological innovations to emerge over the last decade. Big data refers to the volume of both structured and unstructured data. It is so large, traditional software and database techniques make it extremely difficult to process. Another way to define big data pertains to what some call “the five V’s”: velocity, volume, value, variety, and veracity.

Those working with big data employ advanced data analysis methods such as predictive analytics and user behavior analytics. Since big data can help businesses make more intelligent and accurate decisions, leveraging this data in certain ways has the potential to deepen relationships with customers, gain a competitive advantage in the marketplace, perform risk analysis, bolster data safety efforts, and create new revenue streams.

Many experts on data storage estimate that the volume of data generated will increase at an exponential rate over the next few years. Therefore big data’s role and the techniques necessary to extract the most value out of it will become increasingly important.

Because traditional relational databases often struggle to meet the processing demands of big data, organizations often turn to NoSQL databases and Hadoop instead. Some of the common complementary tools include YARN, MapReduce, Apache Spark, HBase, Apache Hive, Kafka, and Pig. More recently, IT and analytics teams are embracing data lake warehousing as a repository for incoming streams of raw data.

Want More Big Data Content?

This blog archive is the best place to find articles that share exclusive insights and all of the crucial aspects you need to know about big data. The Infoworks blog also dives into data ingestion best practicesdata engineering articlesnew announcements from the team at Infoworksdata lake newsand DataOps articles. Stay up to date with our blog by subscribing to our email newsletter!

If you would like to learn more about enterprise data operations and orchestration, be sure to check out the Infoworks DataFoundry!