Tanner's BlogNavigate back to the homepage

Budgeteer - A Budget-Balancing Tool

Tanner Nielsen
June 25th, 2019 · 7 min read

You can gain some useful insights by visualizing your budget, but creating a chart like the one above this isn’t always worth the effort. That’s why I created a tool called Budgeteer that makes it easy make these charts without tedious work. In this post, I’d like to talk a little bit about how to use the tool as well as some of the math behind it.

  • Click here if you just want to learn how to use the tool
  • Click here if you’re interested in the underlying math

Motivation

Before I continue I must give credit to Steve Bogart who created the original SankeyMATIC tool that this project is based on. It’s an excellent tool and may even suit your needs better than Budgeteer for simple use cases.

Problems with SankeyMATIC

However, what I didn’t like about SankeyMATIC (and other tools like it) is that modelling flows is a bit inflexible. For example, consider the following:

SankeyMATIC problem 1

The code to generate this diagram with SankeyMATIC is simple:

1Income [10] Rent
2Income [10] Savings
3Income [10] Spending

However, this code doesn’t capture the logic of these flows; it only describes results. What would be much better is something like this:

1Income = supply(30)
2Rent.consumes(10).from(Income)
3Income.supplies(10).to(Savings)
4Income.suppliesRemaining().to(Spending)

There’s a much different intent communicated here:

  • It emphasizes that “Income” is a fixed supply with a specific amount
  • It describes “Rent” as “consuming” income as opposed to “being supplied by” income
  • It suggests that “Spending” is lower priority than rent and savings as it just gets “the leftovers”

This “leftovers” feature would be very nice for making complicated flows. Calculating differences is easy for trivial flows like this, but it becomes unwieldy with more complicated flows like the one shown at the top of this post.

Enter Budgeteer

In a nutshell, this more expressive syntax and auto-calculated differences is what Budgeteer provides. Budgeteer does not replace SankeyMATIC, but rather builds directly on top of it; it acts as a middleman, translating a more expressive JavaScript-based API into the code that SankeyMATIC understands.

Technically, Budgeteer is a separate, standalone TypeScript package that can operate outside of SankeyMATIC, but it can only be used programmatically. Budgeteer + SankeyMATIC is the website that integrates it into a graphical tool like SankeyMATIC. See the repository for the website if you want to learn more.

With that lengthy intro out of the way, let’s jump into using the Budgeteer Website!

Using the Budgeteer Website

If you know how to use SankeyMATIC, you already know most of Budgeteer. The only substantial change is how your code translates into a diagram, which is what I’ll focus on.

Budgeteer’s Language

Budgeteer understands JavaScript, which is great if you already know JavaScript, but not so great if you don’t. To mitigate this, I designed the API to read like spoken English as much as possible. Additionally the code editor on the website will help you out a lot as you type:

Editor code completion

Main Concepts

Budgeteer has just a few main concepts. Understanding them before making a diagram is helpful, but if you’d rather learn by example, skip to the examples section.

Nodes

Each point where flows connect on the chart is a “node.” There are three types of nodes:

  1. Supplies - Nodes with a fixed supply that only give resources to other nodes
  2. Consumers - Nodes that only consume from other nodes
  3. Pipes - Nodes that both consume from and supply other nodes

Nodes that can consume from other nodes (and thus receive supply) are called supplyable. Nodes that can supply other nodes (and thus be consumed) are called consumable.

This means (somewhat confusingly) that supply nodes are consumable, consumer nodes are supplyable, and pipe nodes are both consumable and supplyable.

Knowing this terminology isn't required for using the tool, but may be helpful if you start digging into the technical side of the API.

Node Relationships

There are three types of relationships a node can establish with another:

  1. A.supplies(<amount>).to(B) or B.consumes(<amount>).from(A)

    One node supplies a fixed amount to another.

  2. A.suppliesAsMuchAsNecessary().to(B) or B.consumesAsMuchAsNecessary().from(A)

    One node supplies only as much as the other needs.

  3. A.suppliesAsMuchAsPossible().to(B) or B.consumesAsMuchAsPossible().from(A)

    One node gives whatever it can to the other.

Examples

The default example code on the Budgeteer Website pretty much includes all of budgeteer’s features. Feel free to skip these examples that’s enough for you to get the gist.

Basic Use: Supplies and Consumers

Supplies and consumers are the basic building blocks of any model in budgeteer. Here’s an example:

1let snackMoney = supply('Snack Money', 3.00);
2
3consumer('Chips').consumes(1.50).from(snackMoney);
4consumer('Gatorade').consumes(1.50).from(snackMoney);

Snack money example

If you prefer to think of snack money as a supply rather than an object of consumption, you could also write it this way, which results in the exact same diagram:

1supply('Snack Money', 3.00)
2 .supplies(1.50).to(consumer('Chips'))
3 .supplies(1.50).to(consumer('Gatorade'));

Variable Supply and Consumption

You may encounter some situations where you’d rather leave a value unspecified. Here’s an example of how you might do that:

1let time = supply('Hours of the day', 24);
2
3consumer('Sleep').consumes(8).from(time);
4consumer('Morning Routine').consumes(1).from(time);
5consumer('Commute').consumes(0.5).from(time);
6consumer('Work').consumes(8).from(time);
7
8time.suppliesAsMuchAsPossible().to(consumer('Free time'));

Variable supply example

Notice how “Free time” is not supplied with a specific amount but rather with “as much as possible,” which happens to be 6.5 in this case. Now suppose you decide to start biking to work which takes twice as long. That brings your commute up to an hour and your free time down to 6. Rather than update both values, you can just update the one that changed (your commute), and the free time will automatically adjust.

Using Pipes

Some models require going beyond basic supplies and consumers, which is where pipes come in. Pipes are useful for pooling or grouping resources:

1let combinedIncome = pipe('Combined Income');
2
3supply('My Income', 2000).suppliesAsMuchAsPossible().to(combinedIncome);
4supply('Spouse Income', 2000).suppliesAsMuchAsPossible().to(combinedIncome);
5
6consumer('Rent').consumes(1500).from(combinedIncome);
7consumer('Food').consumes(500).from(combinedIncome);
8consumer('Other bills').consumes(1200).from(combinedIncome);
9consumer('Savings').consumesAsMuchAsPossible().from(combinedIncome);

Resource pooling example

Pipes are especially useful with the asMuchAsNecessary relationship. Here’s a more complex, but practical example:

1const SALARY = 80_000;
2const WORKERS_PER_DEPARTMENT = 50;
3const DEPARTMENT_SALARIES = SALARY * WORKERS_PER_DEPARTMENT;
4
5let revenue = supply('Company Revenue', 25_000_000);
6let expenses = pipe('Total Expenses');
7let profit = consumer('Total Profit');
8
9revenue
10 .suppliesAsMuchAsNecessary().to(expenses)
11 .suppliesAsMuchAsPossible().to(profit);
12
13expenses
14 .suppliesAsMuchAsNecessary().to(makeDepartment('A'))
15 .suppliesAsMuchAsNecessary().to(makeDepartment('B'))
16 .suppliesAsMuchAsNecessary().to(makeDepartment('C'));
17
18// since this is just JavaScript, you can use functions to speed things up!
19function makeDepartment(name) {
20 let department = pipe(`Department ${name}`);
21 let departmentExpenses = pipe(`Dpt. ${name} Expenses`);
22
23 department
24 .supplies(DEPARTMENT_SALARIES).to(consumer(`Dpt. ${name} Salaries`))
25 .suppliesAsMuchAsNecessary().to(departmentExpenses);
26
27 departmentExpenses
28 .supplies(1_000_000).to(consumer(`Dpt. ${name} Expense 1`))
29 .supplies(1_000_000).to(consumer(`Dpt. ${name} Expense 2`))
30 .supplies(1_000_000).to(consumer(`Dpt. ${name} Expense 3`));
31
32 return department;
33}

"As much as necessary" relationship example

Notice how neither the company’s total expenses or profit, nor the departments’ total expenses are specified — instead, Budgeteer figures out what the values should be behind the scenes. This is by far the most useful addition that Budgeteer brings to SankeyMATIC.

Complete API Reference

That’s enough examples for now. This article is meant to provide a basic overview of the Budgeteer API. If you would like a more complete, technical reference, check out the budgeteer repository.

Exporting Your Chart

The original SankeyMATIC tool had both PNG and SVG export options. Unfortunately, PNG rendering didn’t seem to work on my copy of the code and frankly, it wasn’t worth it for me to figure it out. So you’ll have to use SVG, but hey, SVG is better anyway.


Appreciating the Underlying Math

Trying to figure out the math of balancing these flow networks is what originally plunged me into this project. The problem is deceivingly simple, which is why I originally thought I could just hack up some JavaScript to spit out the SankeyMATIC code for my personal use. However, after several evenings after work spent on trying to develop a good algorithm, I realized it was a trickier problem than I had realized, so I decided to take a different approach.

In college, I was briefly acquainted with constraint solvers. If you aren’t familiar with constraint solvers, they essentially just take a bunch of variables and constraints, and produce a set of values for the variables that satisfy the constraints. After wrestling with the flow balancing problem for awhile, it became clear that a constraint solver (kiwi.js in my case) would be a good tool for the job.

But the whole reason I went down this rabbit hole was to develop an alternative to SankeyMATIC’s rigid and cumbersome language. Just using a constraint solver wasn’t the answer, because specifying variables and constraints is way more cumbersome and difficult to read. So instead, Budgeteer acts as a translator:

Budgeteer process flow

This highlighted section above is where all the interesting stuff happens, so that’s what I’ll be talking about.

Definitions

In constraint-solving land, everything is a variable. This means that the amount of resources at each node gets its own variable, and the amounts transferred between it and every other node all get their own variables too… That’s a lotta variables. To keep things straight, let’s setup some definitions:

SymbolDefinition
B_i
The numeric balance at node
i
T^i_j
The numeric amount transferred from node
i
to node
j
C_i
The set of nodes that consume from node
i
S_i
The set of nodes that give supply to node
i

Visual Definitions

If you prefer to think visually, this may help you:

\begin{matrix} a & \overrightarrow{T^a_b} & b \\ \downarrow T^a_c & & \downarrow T^b_d \\ c & \overrightarrow{T^c_d} & d \end{matrix}

Given the previous information, the following statements would also be true:

S_a = \emptyset, C_a = \{b, c\}\\ S_b = \{a\}, C_b = \{d\}\\ S_c = \{a\}, C_c = \{d\}\\ S_d = \{b, c\}, C_d = \emptyset

Turning Flows into Constraints

With definitions out of the way, we can start to reason about how budgeteer code will translate to constraints. For example, what does it mean to define a supply node, or a consumer, or a pipe with constraints? Let’s start with supplies:

Creating Supplies

1let x = 1000;
2let s = supply('Supply', x);

In the context of balancing budgets we want to make sure that our supply is not overdrawn, so our constraints will look like the following:

B_s \geq 0, B_s = x - \sum_{i \in C_s} T^s_i

This defines the balance for the supply,

s
, to be the initial amount,
x
, minus the sum of transfers to each node that consumes from the supply, additionally stipulating that it not dip below 0. In other words, what the supply has left is what it started with minus the amount that the other nodes took from it.

Creating Consumers

1let c = consumer('Consumer');

The balance for a consumer is simply the sum of transfers coming in from its suppliers:

B_c = \sum_{i \in S_c} T^i_c

Creating Pipes

1let p = pipe('Pipe');

Pipes have both suppliers and consumers. In the context of balancing flows, we want the inputs and outputs to cancel out, which means we want the balance to be 0:

B_p = 0, B_p = (\sum_{i \in S_p} T^i_p) - (\sum_{i \in C_p} T^p_i)

This defines the balance for the pipe,

p
, to be the sum of transfers from each node that supplies it, minus the sum of transfers to each node that consumes from it, which should cancel out to 0. In other words, the pipe should be given the same amount from its suppliers that it gives away to its consumers.

Transferring a Fixed Amount

1let s = supply('Supply', 1000);
2let c = consumer('Consumer');
3let x = 500;
4
5c.consumes(x).from(s);

With those constraints specified upfront, establishing relationships is actually pretty straightforward.

s \in S_c, c \in C_s, T^s_c = x, T^s_c = -T^c_s

Here we are just saying that

s
is a supplier of
c
,
c
is a consumer of
s
, and that the amount transferred between them is
x
.

Transferring a Variable Amount

1let s = supply('Supply', 1000);
2let p = pipe('Pipe');
3
4s.suppliesAsMuchAsPossible().to(p);
5// or
6s.suppliesAsMuchAsNecessary().to(p);

Transferring a variable amount is nearly identical to transferring a fixed amount:

s \in S_p, p \in C_s, T^s_p \geq 0, T^s_p = -T^p_s

Since we don’t have a specific value, we just say that the transfer between the two nodes should be larger than 0. However, you may be wondering what the difference between “as much as possible” and “as much as necessary” is then.

The answer by using “weak constraints.” So far, all the constraints we considered are absolutely required. If the constraint solver can’t find a set of variables that satisfies every last constraint, it will throw an error. However, you can also specify constraints that the solver will try its best to satisfy, but if it falls short it won’t throw an error.

With this in mind, we can specify an additional “weak constraint” for the suppliesAsMuchAsPossible relationship:

T^p_s = \infty

Obviously, this can’t be satisfied, but it will cause the constraint solver to make

T^p_s
as large as it possibly can without breaking the other constraints. Likewise, we can specify the following weak constraint for the suppliesAsMuchAsNecessary relationship:

T^p_s = 0

Again, this can’t be satisfied, but it will cause the constraint solver to make

T^p_s
as small as possible.

Summary

That’s all of the math! Here’s a summary of how the various pieces translate:

Budgeteer codeRequired constraintsWeak Constraints
s = supply(..., x)
B_s \geq 0, B_s = x - \sum_{i \in C_s} T^s_i
N/A
c = consumer(...)
B_c = \sum_{i \in S_c} T^i_c
N/A
p = pipe(...)
B_p = 0, B_p = (\sum_{i \in S_p} T^i_p) - (\sum_{i \in C_p} T^p_i)
N/A
c.consumes(x).from(s)
s \in S_c, c \in C_s, T^s_c = x, T^s_c = -T^c_s
N/A
p.consumesAsMuchAsPossible().from(s)
s \in S_p, p \in C_s, T^s_p \geq 0, T^s_p = -T^p_s
T^p_s = \infty
p.consumesAsMuchAsNecessary().from(s)(same as above)
T^p_s = 0

More articles from Tanner's Blog

Using the NPM API to Get Latest Package Versions

The official npm API provides a simple way to programmatically retrieve the latest version of any package, along with other metadata you…

February 18th, 2019 · 1 min read

Creating an Engraved Leather Effect with CSS

I love the look of gold-engraved leather. You see it all the time on portfolios, diplomas, etc., and I think the reason is because it…

January 25th, 2019 · 13 min read
© 2019–2020 Tanner's Blog
Link to $https://github.com/tannerntannern