The past participle of “go” is “gone” so it’s not “I should have went to the party” but “I should have gone to the party.”