It is 20+ years since ETL tools came out and we are still revisiting the same argument but in a newer context. For big data, either on premise or in the cloud, should I hand code or should I use tools ...

Today we officially unveiled Infoworks’ Autonomous Data Engine (ADE) V2.4, the latest release of our end-to-end automated software platform for agile data engineering--both on-premises and in the cloud.

Amazon is coming for your business.  The good news? There is no reason that big data can’t also be used by your organization to become an agile industry powerhouse.

According to the latest Harvey Nash / KPMG CIO Survey, big data and analytics remain “the number one skill in short supply” for the fourth year in a row.

Besides being ETL experts, which have been around for decades now, what are the MODERN skills a data engineer is expected to have and what is data engineering? 

There are many "gotchas" in populating a data lake. Read on to find out the magic behind automating away many of the most difficult challenges.

There are a variety of tools and frameworks for data ingestion, and most will appear to be suitable in a proof-of-concept. Don't be deceived!

The main characteristic of DataOps is to strongly advocate automation and monitoring at all steps of data pipeline construction, from data integration, testing, releasing to deployment and infrastructure ...

More people are questioning the future of Hadoop. Here’s just a sample of what’s being said: “We are more consistently hearing that core Hadoop software modules are dated/commoditized.” StreetInsider; ...