The pitch of a sound is primarily determined by its frequency, with higher frequencies producing higher pitches and lower frequencies resulting in lower pitches.