17. Ancient Data Warehousing

Although it only now has become a common term as the core of business intelligence, the practice of data warehousing has been with us for over five-hundred years. Since the early Italian renaissance, merchants have kept databases of their business transactions wherein each transaction was related to the critical dimensions that characterized its type and the effect that it had on the business.

More specifically, each transaction, representing a transfer of financial resources from one place to another, was related to the source and destination of the transfer. Each transactions was related to the place from which it was withdrawn and the place to which it was deposited in what has come to be known as double-entry bookkeeping. The record of the withdrawal was referred to as the “credit” entry and the record of the deposit was referred to as the “debit” entry.

Like all data warehouses, each of transactions was also related to the date of its occurrence, allowing the merchant to sort and sum the transactions to measure the activity of the business during given periods of time. Furthermore, the financial state of a business could be determined by summing the deposits to a given account, then summing the withdrawals from the same, and finding the account’s “balance,” or state, by subtracting the withdrawals from the deposits.

This process of relating transactions to its critical factors (“dimensions”) and summing the transactions according to these critical factors is exactly how a modern data warehouse is used. The data warehouse, the central focus of the field of business intelligence, is universally implemented as a multidimensional database. The multidimensional database, like the bookkeeper’s journal, is made up of chronologically ordered records that represent business transactions with each transaction related to the customers, products, accounts, dates, and other “dimensions” of its existence. The data warehouse is, in effect, a journal of business transactions in the same way that the accountant’s book of original entry (his “journal”) is.

So, what is the difference between a traditional bookkeeping journal and a modern data warehouse? Only the existence of the SQL language (or some equivalent database query language). The modern query language, allows the user to sum and sort transactions by any combination of its many dimensions, including the transactions date and its debit and credit accounts.

Because the renaissance bookkeeper did not have modern database automation, he needed to first sort the transactions into individual databases (called “ledger accounts”) and then sort them again into rigid time frames (called “reporting periods”). Because of these once necessary and arduous sorting tasks, the business intelligence of times past was slow, expensive, error-prone, and untimely. And because we have not integrated financial reporting and analysis into common business intelligence practices, financial information has continued to be untimely to this day.

16. Flow, Measurement, and Analysis

There are three simple ideas that will revolutionize financial information in the twenty-first century. All financial information is derived from the fundamental data that is recorded by double-entry bookkeepers and reported by accountants in various GAAP reports. By going to the original meaning of fundamental double-entry data, more financial information will be produced and financial resources can be more wisely allocated.

1. Financial data has for over five-hundred years been stored in what is now called a data warehouse. The records of financial transactions in a traditional bookkeeping journal are fundamentally the same as a data warehouse, differing only because of the primitive forms of recording that existed before automation. We need to update the journal according to modern data warehouse techniques.
2. Financial data is far more intuitive and easy to understand in its original intent and has become complicated and obscure because that original intent has been lost by modern accountants. The most significant cause of this obscurity is the so-called accounting equation, which was developed with a primitive numbering system, is mathematical nonsense, and serves to make the simple concepts of finance nearly incomprehensible.
3. The primary thing that double-entry bookkeeping is doing is keeping track of the flow or movement of financial resources from one financial space to another. The GAAP reports report balances or changes in balances in those financial spaces rather than the flow. This is primarily due to the lack of automation during the development of traditional accounting. In the 1980’s, the financial world moved toward the tracking of flow with the addition of the Cash Flow Statement. This is an improvement in the right direction, but it is just a start to the real financial analysis that comes from studying the flow of all of the resources.

I have dealt with these ideas in my two books, Banking the Past and The Tao of Financial Information. Banking the Past addressed the first idea while The Tao of Financial Information addressed the last two. In following blog posts, I will summarize the powerful solutions offered in those two works. By returning to the foundation of financial information, we can profoundly increase the intelligence that we use in allocating our resources.