Followup:

I just made the same thing again and used only one tbsp of stevia and it came out better I think. The stevia does seem to get sweeter as it sets and the flavors blend.