Troilism is a name for sexual activity involving 3 people.
So basically it's another word for a threesome. However the distinction is sometimes made in that troilism refers specifically to cuckold style scenarios in which two of the participants are romantic partners and the third is an outside party. Typically one member of the romantic couple observes (rather than joins in with) their partner and the third person engaging in sexual activity.
Thumbnail image via Flickr