Loss Vs. Cost

[!def] Loss vs. Cost
Cost is the average of all the loss values for current batch/dataset

  • AKA empirical risk