Source: © ValuePress Co., Ltd.
Virtual Bishōjo Nem shows artistic potential of VIVE Facial Tracker in world’s first music video
- Tags:
- album / Katakiri Rekka / Music Video / Virtual Bishōjo Nem / Virtual Stargazer / VIVE / VIVE Facial Tracker / Vtuber
Related Article
-
Visually impaired Vtuber Cocco Hitomi’s 2nd single “cute girl” tops Brunei music chart
-
Virtual cat singer MiMi Kanade gets human form and catchy theme song by Hironobu Kageyama
-
Japanese Voices: YuNi no All Night Nippon i – Episode 9
-
hololive production OFFICIAL SHOP now ships to the US, Canada and Mexico
-
Metaverse talents specializing in feminized kawaii voice sing at the Babiniku Kohaku 2021 concert
-
Amazing new app lets avatar users walk around in the real world
Some of our readers may recall Virtual Bishōjo Nem バーチャル美少女ねむ, the self-professed world’s first independent Vtuber, whom we had the pleasure of interviewing last year. Active since 2017, Virtual Bishōjo Nem contributed to the Vtuber boom. She actively promotes the World Bishōjo Project which posits that humanity can achieve an ideal society if everyone takes on a bishōjo avatar. Her range of activities include Vtuber evangelist, virtual economy critic, cryptocurrency investor, blogger, novelist, and singer, among other things.
Since last year, she has also played an active role as HTC's official VIVE ambassador. Therefore, it may come as no surprise that she was one of the first Vtubers to benefit from, test, and promote the VIVE Facial Tracker, an attachment which, when used in conjunction with a VIVE VR headset, allows tracking of true-to-life facial expressions and mouth movements, tracking up to 38 facial movements with near-zero latency. The VIVE Facial Tracker went on sale in Japan on April 9th, 2021.
Virtual Bishōjo Nem's music video "Virtual Stargazer"
Now, in an impressive demonstration of the technology's potential in the realm of artistic self-expression, Virtual Bishōjo Nem has released the world's first music video to fully leverage the VIVE Facial Tracker in order to convey a virtual performer's singing expressions in an appealing way.
Video capture used with permission from Virtual Bishōjo Nem
The new song, entitled "Virtual Stargazer," is the title track for an exciting compilation album of 14 virtual singers produced by Ark-Z which is slated to be released at the M3 doujin music summit on April 25th. In advance of the album's release, Virtual Bishōjo Nem released the music video for the track on her official YouTube channel yesterday, April 19th, 2021.
This is the pioneering Vtuber's third original song, after でぃーぷ☆らーにんぐ (Deep Learning) in 2019 and ココロコスプレ (Kokoro Cosplay) in 2020.
An upbeat track about "the gaze, the feelings, and the expressions" she wants to convey through the virtual world, "Virtual Stargazer" and the music video showcasing it represent a collaborative effort involving numerous creators and featuring technical innovations.
The video uses actual footage recorded in VR with no visual editing whatsoever.
Video capture used with permission from Virtual Bishōjo Nem
In addition to singing the song (with voice modulation from her trusty Roland M-100FX), Virtual Bishōjo Nem created the draft for the original lyrics...
Video capture used with permission from Virtual Bishōjo Nem
Video capture used with permission from Virtual Bishōjo Nem
...which were then polished and completed by track maker Maggg-Nolia, who was also in charge of the composition.
Video capture used with permission from Virtual Bishōjo Nem
Cinematography and camera operation are provided courtesy of orange (Neos East - Japan). Active in promoting the next generation VR SNS "Neos VR," orange is known for their camera skills in the VR world, including the development of "CINE SWITCHER," a tool that automatically switches the camera in 3D space.
Video capture used with permission from Virtual Bishōjo Nem
Avatar tech and special effects are provided by VIVE ambassador υμβραν (pronounced "umbran"). A kawaii avatar setting evangelist, υμβραν uses VIVE Pro Eye and VIVE Facial Tracker to promote kawaii avatar expressions using face tracking in VR.
Video capture used with permission from Virtual Bishōjo Nem
One of the surprises in the video is a rap part in which Virtual Bishōjo Nem shows off some impressive dance moves. In fact, the motion acting and choreography is provided by VR dancer yoikami. The world's leading expert in avatar dance technology, yoikami won the XR Avatar Dance Contest this year at SXSW (South by Southwest), one of the world's largest festivals for music, film, and interactive technologies.
Video capture used with permission from Virtual Bishōjo Nem
Nem's starry costume is provided by 私 Watakushi (meaning "I" in Japanese). A VRoid modeler who wishes to remain anonymous, Watakushi has an established reputation for cute, glittery designs, and has been creating models for famous VTubers with the "VRoid" avatar creation tool.
Video capture used with permission from Virtual Bishōjo Nem
The world within Neos VR providing the backdrop for the action in the video was created by Cid (Neos East - Japan), using assets based on the 昭和町 Showa-machi world.
Video capture used with permission from Virtual Bishōjo Nem
Finally, the video would not have been possible without the cooperation of volunteers within Neos VR.
Video capture used with permission from Virtual Bishōjo Nem
Video capture used with permission from Virtual Bishōjo Nem
Virtual Bishōjo Nem used the VIVE Pro Eye, the VIVE Facial Tracker and the new 3.0 version of VIVE Trackers.
Video capture used with permission from Virtual Bishōjo Nem
Not only was Nem able to create detailed facial expressions (52 points) thanks to the VIVE Facial Tracker but when combined with eye-tracking (2 points) and full body tracking (10 points), there were a total of 64 tracking points. The video thus represents a full-scale shooting challenge that approaches the limits of VIVE's tracking technology, which is an impressive feat for an independent VTuber.
Video capture used with permission from Virtual Bishōjo Nem
Video capture used with permission from Virtual Bishōjo Nem
Virtual Bishōjo Nem links
"Virtual Stargazer" album
Video capture used with permission from Virtual Bishōjo Nem
The concept of this album is "bringing together 14 virtual singers and up-and-coming composers who are attracting attention as shining 'stars'". The word "stargazer" refers to the anticipated audience who will become observers and appreciators of these new stars who are helping to lead the way in the virtual music scene.
Guest artists Virtual Bishōjo Nem and Katakiri Rekka
In addition to Virtual Bishōjo Nem, the album also features singer-songwriter 片霧烈火 Katakiri Rekka as guest artist, singing vocals in the album's opening track "HELIX OF LIGHT" to music composed by album producer Ark-Z
Active in the music scene as a vocalist, songwriter, and voice actor, mainly for doujin audio and PC game theme songs. She made her major debut in 2004, and attracted attention for her first TV anime vocal performance, "why, or why not", the ending theme of the TV anime Higurashi When They Cry. In 2019, she celebrated her 20th anniversary with a live tour in Tokyo, Osaka, and Nagoya. She also made her debut as a Vtuber "Kitakore Nyawawa" on February 22, 2020.
Album Details
Song List
Producers
In charge of total album production for "Virtual Stargazer," and contributing composition and arrangement to numerous tracks is Ark-Z.
Active as a composer and DJ, Ark-Z has been mainly focusing on trance and dance music genres. Since around 2016, he has contributed tracks to Japanese mobile music games, as well as to YouTubers since 2020. Happy to use "anything that moves my soul," Ark-Z incorporates not only trance but also game music, anime songs, and more into his creative activities.
Cooperating with production is 戸塚エイジ Eiji Tozuka (LINK BOX/nerd tune).
In 2016, he made his international debut as a guest at an event in Mexico. In 2017, he assisted in Gammer's Osaka show, and in 2019, he assisted in Darren Styles' Nagoya show. He launched "nerd tune," an all-genre party with a focus on anime songs, and invited many famous composers. He launched the label "LINK BOX," which was ranked No.1 on iTunes Electro.
Participating artists
Composition
Vocals