Is Aozora Shoujo-tai hentai?
English title: 801 T.T.S. Airbats
No
Rated R+ (Mild Nudity) on MyAnimeList and not tagged as Hentai.

OVA · 1994 · 7 episodes · R+ - Mild Nudity
Action, Comedy, Military, Romance, Shounen
When aviation mechanic (and anime fanboy) Takuya Isurugi is transferred to the 801st Tactical Training Squadron, he gets more than he bargained for. Moderated by hard-headed veteran ace Mitsuru Konishi, the "Airbats" are an all-female aerial acrobatic team consisting of loose cannons Miyuki Haneda and Arisa Mitaka, karaoke freak and gambling genius Sakura Saginomiya, and junk food lover Yoko Shimorenjaku. Both Haneda and Mitaka do not get along with each other, and their rivalry worsens when they both fall for Isurugi. But with the entire JASDF having doubts about the team, the Airbats must work as a team or face total disbandment.
View on MyAnimeList