Penguin bones from the La Meseta Formation (Seymour Island, Antarctic Peninsula) are the only record of Eocene Antarctic Sphenisciformes. Being an abundant component of the youngest unit of the formation (Telm7), they are not so common in earlier strata. Here, I present the oldest penguin remains from the La Meseta Formation (Telm1-Telm2), often bearing close resemblance to their counterparts from younger units. Addressing the recent findings in fossil penguin systematics, I suggest there is too weak a basis for erecting new Eocene Antarctic taxa based on non-tarsometatarsal elements of penguin skeletons, and considering Oligocene species part of the studied assemblage. Finally, I conclude if the common ancestor of extant Sphenisciformes lived in the Eocene Antarctic (as suggested recently), penguins referred to Delphinornis seem to be prime candidates to that position.