Finally, if the bursa becomes infected, the front of the knee becomes swollen and very tender and warm to the touch around the bursa. You may run a fever and feel chills. An abscess, or area of pus, may form on the front of the knee. If the infection is not treated quickly, the abscess may even begin to drain, meaning the pus begins to seep out.