Session context and daily totals

[YZ]

Hi, I don't understand how the Session context and Daily total token counters work.

For a given day, should the Daily total = sum(Session context)? Because it seems the daily total is always much higher.

[rmoriz]

Correct me if I'm wrong:

The Context is kind of the input to the model in addition to your prompt. Models are limited in taking context, so this number increases with the complexity of your code base (very simplified) and your prompt. 

To my knowledge a big context also increases the token number on each request, so whenever possible keep your context small/relevant to your current prompt.

Tokens are the unit of the model workload, units of text, like words.