Is Kenkou Zenrakei Suiei-bu Umishou hentai?
No
Rated PG-13 (Teens 13 or older) on MyAnimeList and not tagged as Hentai.

TV · 2007 · 13 episodes · PG-13 - Teens 13 or older
Comedy, Ecchi, School, Shounen, Sports
Kaname Okiura, a student of Prefectoral Umineko Shougyou High ("Umishou" for short), joined the school's swimming club in order to learn how to swim, but the club is filled with weirdos, let alone who can teach him swimming. Then, a sunny, happy-go-lucky girl named Amuro Ninagawa who transferred from Okinawa joined the club. Her extraordinary underwater speed and unorthodox swimming style (plus her personal habit of nude swimming—a powerful magnet to teenage boys) surprised every club member, especially Okiura, because she reminds him of a mermaid-like creature he saw only once in his early childhood. (Source: ANN)
View on MyAnimeList