After data is ingested into a data lake, data engineers need to transform this data in preparation for downstream use. Challenges in data preparation tend to be a broad collection of issues that add up ...

Industry veteran, David Dorman, joins big data innovator, Infoworks.io as we scale up to meet explosive market demand

Read how an old fashioned brick and mortar retailer is automating their data engineering processes to deliver greater analytics agility.

We have all been uncomfortable with the “big data” term for some time now. It is time for a new and better term. Agile Data!

Five top thoughts and predictions for 2019 from big data and data engineering industry veterans Ramesh Menon and Todd Goldman. Read on to know if the Kardashians made our top 5 list.

In 1955 the first Fortune 500 list appeared and today, only 53 remain on the list. None of this is lost on the Fortune 500’s oldest company, which has stayed young by becoming a digital pioneer.

Data silos prevent companies from getting a complete picture of their overall business. Big data technologies can help in theory, but for many organizations, they lack the skills necessary to put that ...

“Agile” was officially used to describe the iterative method of engineering by a group of software developers in their “Agile Manifesto”. Now it is making its way into the data engineering world ...

Uber, Netflix and Airbnb have all published some of the tools they have built to make big data work for them. The question is, will this work for you?