Hours

15

Expertise

Metaverse

Mentor

Brian Felsen

Timesheet

Timesheet 2022 - Jackie Lee

Day ONE

March 17, 2022

End Date

June 12, 2022

Presence

Active

Telegram

Link

https://medium.com/@jackylee0424

MIT CS Ph.D. ⚛️

3️⃣Blue Metaverse: March 2022 Demo

⚛️Jackie Lee - Metaverse, WebXR, Oculus

https://open.harmony.one/6c2afdfd8164469bbae7d5b6ac21d868

https://twitter.com/JackieLeeETH

https://www.linkedin.com/in/jackylee0424/

(added free keys for Oculus Quest apps)

Join our TGI-Metaverse weekly showcase Telegram group, see event detail here:

TGI-metaverse weekly showcase

TGI-metaverse weekly showcase We will use this telegram group to coordinate our weekly metaverse showcases You are invited to the group TGI-metaverse weekly showcase. Click above to join.

t.me

jackylee0424 - Overview

You can't perform that action at this time. You signed in with another tab or window. You signed out in another tab or window. Reload to refresh your session. Reload to refresh your session.

github.com

June 2022 deliverables

[NFT NYC, 6/15-24] WebXR FPS + treasure hunt 3D game template dev, Skullape NFT game dev support (Harmony Grantee), verifiable in-game activity prototype. 80/90/30%

July 2022 deliverables

[time off 7/1 - 7/12, Taiwan trip, 7/13-7/27] Skullape NFT game launch dev support (Harmony Grantee), Skullape NFT game DAppRadar submission, WebXR NFT 3D avatar dev. 100/100/70%

Aug 2022 deliverables

Skullape NFT game launch support (Harmony Grantee), WebXR FPS NFT game platform dev, 1k users. 0/0/0%

Sep 2022 deliverables

WebXR FPS game template platform growth, Skullape NFT game dev support (Harmony Grantee), tgi-metaverse event growth. 0/0/0%

Bio

Jackie Lee, Ph.D (MIT Media Lab ‘11 in Affective Computing) is a hands-on software and hardware builder navigating the boundary between what is possible and what can be possible. Jackie has been creating and inventing technologies to understand human emotions (since his MIT time) and visualize abstract ideas (since ‘17 when ScienceVR was founded). He has been exploring the next generation of learning with storytelling, simulation, and immersive experiences focusing on topics like science and history. “I see the future before my eyes.” - one of ScienceVR users commented. ScienceVR connects the source of knowledge directly to the end user with enhanced immersion. However, the most limiting factor of growing VR usages has been its hardware usability.

Jackie lives and breathes in the metaverse (VR/WebXR) since the pandemic. In 2020, the world became virtual and remote mostly powered by internet-connected personal workstations. This phenomenon shifted Jackie’s mindset about virtual workspaces and digital lifestyles. Why not taking advantage of the most prevailing infrastructure - the web browsers (available on both desktop and mobile) to deliver learning experiences? Jackie and the ScienceVR team have been prototyping such virtual experiences into 30+ virtual events for about 20-30 attendees participating in talks, escape room games, treasure hunts, theater performances, and meditation exercises in 2021. Each experience forms a mini informal social circle centering around a specific topic in history and science.

Jackie’s crypto journey started in summer ‘13 (plz do not ask him what happened from ‘13 to ‘20). Since 2021, it’s becoming more obvious that the virtual worlds need to be built on top of economics of ownership. This was when Jackie fully dived into web3 metaverse and became a believer of a digital lifestyle, i.e., a person can learn, create, and earn in a purely digital world regardless the person’s background, prior knowledge, age, and ethnicity. To understand how to draw web3 users into the metaverse, Jackie started collecting NFTs for getting into NFT communities and learning how web3 communities are bounded.

Jackie found the Harmony communities are bounded in a deeper way. So here he is.

Related links:

• https://open.harmony.one/6c2afdfd8164469bbae7d5b6ac21d868
• https://twitter.com/JackieLeeETH
• https://www.linkedin.com/in/jackylee0424/
• (added free keys for Oculus Quest apps)

Visualize Stories & Amplify Engagement in VR/XR

ScienceVR has been working on visualizing stories as interactive learning games in virtual environments. https://twitter.com/sciencevr/status/1145043465794801664?s=20&t=npS_jsYaIwQgvYVqQnHH9g ScienceVR is a 2x recipient of Epic Games EpicMegaGrants. ScienceVR released Faraday's Magnets on Oculus Quest Store (App Lab) https://www.oculus.com/experiences/quest/3939484836074053/ https://twitter.com/sciencevr/status/1440726313799536645?s=20&t=npS_jsYaIwQgvYVqQnHH9g ScienceVR worked with the James Clerk Maxwell Foundation on visualizing physics in VR.



mango-splash-b69.notion.site

Jackie's works at ScienceVR



youtu.be

Here are 3 metaverse initiatives focusing on different aspects of shaping a web3 metaverse: emotional bounding (Blue Metaverse), tool enablement (creator toolkit), and community-based viral growth (MetaverseDAO).

1. Blue Metaverse (for emotional bounding)

What is Blue Metaverse? Or what is “metaverse”? I think anyone asking this question may need to put his/herself into a variety of metaverse. One’s metaverse definition likely represents one’s digital lifestyle.

Why Blue Metaverse? Why it needs a specialized focus on social and emotional bounding? Since metaverse is intrinsically social and spatial, most metaverse experiences are shaped by people and virtual environments. An interesting and memorable metaverse experience emerges when people become friends with shared interests while they share these precious moments. Blue Metaverse aims at emotional bounding formed during these moments. To catalyze emotional bounding within virtual environments, we need key human initiators who are able to trigger deep emotional resonance and metaverse interactivity to facilitate personalized experiences.

Blue Metaverse (in the next year) consists of digital festivals (rich immersive experiences) where people connect, find alignment, and form emotional bounding.

• in 6 weeks (mid May)
• Prototyping weekly metaverse small events (curated interactive experiences for 10-20 people, e.g., Metaverse Fridays)
• designing metaverse interaction focusing on emotion bounding and social interaction
• in 3 months (July)
• Setting up monthly metaverse medium events (interactive experiences for up to 100 people)
• Prototyping integration projects with Harmony partners (i.e., musicians, game studios, NFT collections)
• end of 2021 (Dec)
• Aligned and converging with the Harmony’s DAO-verse

Open questions about metaverse games vs. experiences:

• The criteria of categorizing games and experiences will be based on emotional journey of storytelling instead of interactivity (because an experience can be very interactive like a transitional game).
• The economics of games and experiences would be very different from the start. For experiences, creators can issue membership NFTs to define exclusive access of the experiences but do not degrade others’ experiences. For games, NFTs may be able to significantly influence gameplay that may also influence others’ experiences.

2. Metaverse Creator Toolkit (for more custom interactivity and a metaverse marketplace)

Metaverse is an enhanced social tool to provide rich expressions embodied within the virtual (2D/3D) environments. In other words, there will be more ways for more people to express themselves and more ways to be seen in the metaverse than in the real world. A toolkit is needed to empower custom expressions, especially for creators who have their own audiences but little knowledge of web3 and metaverse. Creators who provide storytelling and emotional experiences play key roles for engaging other metaverse users as well as supplying their creative works. There are existing web3 metaverse places for showcasing creative works such as Decentraland etc... However, most of them provides gallery-like passive experience and there are unfulfilled opportunities to provide more interactivity for engaging audiences with a custom emotional journey. This toolkit will evolve into a metaverse marketplace.

Metaverse Creator Toolkit (webxr) allows creators and developers to build and create custom interactive experiences with custom virtual places to catalyze emotional bounding between creators and their communities. Yuga Lab is planning to build a metaverse SDK (and using Unreal Engine rig as a snapshot).

• in 6 weeks (mid May)
• Prototyping emotional bounding activities and social interactions
• Supporting weekly metaverse activities (e.g., virtual TGI events)
• Streamlining metaverse games and experiences infrastructure with Harmony testnet (webxr and unreal engine pixel streaming)
• in 3 months (July)
• Integrating tokenomics and marketplace
• end of 2021 (Dec)
• Shipping a cross-chain metaverse in-game/in-experience marketplace (app store)

3. MetaverseDAO (for web3 metaverse communities)

MetaverseDAO provides a cross-metaverse governance at the toolkit (for new creator’s single/episodic metaverse experience) and at the protocol level (for existing metaverse). MetaverseDAO adoption should be viral because a successful experience within one community may enable community members to start their own community. In one year or so, Blue Metaverse and Metaverse Creator Toolkit will gradually converge into MetaverseDAO operation.

• in 6 weeks (mid May)
• Working with Harmony metaverse-related projects to specify avatar and wearable NFT interoperability and have two projects implement prototypes.
• Defining cross-metaverse features (e.g., cross-chain avatar protocol, cross-chain ownership/license)
• in 3 months (July)
• Working with Harmony DAOs to use Metaverse Creator Toolkit for creating their own townhall spaces.
• end of 2021 (Dec)
• Launching MetaverseDAO governance token to self-sustain and support metaverse infrastructure.

References:

• Jackie’s WebXR demos (plz use desktop Chrome for the best experience). The tech stack is built based on custom client fork of Mozilla Hubs with web3 integration of ENS as usernames and NFT avatars.
• ScienceVR’s virtual social event places with custom interactivity (selected rooms)

Lewis Carroll's Logical Garden | ScienceVR

Join others in VR at Lewis Carroll's Logical Garden, right in your browser.



hubs.sciencevr.com



Mary Shelley's Gothic Mansion | ScienceVR

Join others in VR at Mary Shelley's Gothic Mansion, right in your browser.



hubs.sciencevr.com



Apollo 11 Moon Museum | ScienceVR

Join others in VR at Apollo 11 Moon Museum, right in your browser.



hubs.sciencevr.com


• Blue Metaverse prototypes based on web3 metaverse toolkit (users can join from ETH mainnet and Harmony mainnet/testnet). Supporting .crazy.one names on Harmony mainnet.

Blue To Fly | Blue Metaverse

Join others in VR at Blue To Fly, right in your browser.



www.bluemetaverse.one



ONE Desert - Level 1 | Blue Metaverse

Join others in VR at ONE Desert - Level 1, right in your browser.



www.bluemetaverse.one


• WebXR community spaces with NFT room keycards and ENS sign-in

#7 Mutant Lab | Metaverse Club

Join others in VR at #7 Mutant Lab, right in your browser.



metaverseclub.io



#12 WAGMI Party | Metaverse Club

Join others in VR at #12 WAGMI Party, right in your browser.



metaverseclub.io


• Jackie’s GDC reel

Blue Ape Yacht Club



www.youtube.com


• Jackie’s virtual events with Caitlin Krause and Sam Hirst

Mary Shelley Gothic event



youtu.be


• Jackie’s Toolkit for interpersonal affect based on skin conductance

Jackie Chia-Hsun Lee - Founder - ScienceVR | LinkedIn

View Jackie Chia-Hsun Lee's profile on LinkedIn, the world's largest professional community. Jackie Chia-Hsun has 7 jobs listed on their profile. See the complete profile on LinkedIn and discover Jackie Chia-Hsun's connections and jobs at similar companies.

www.linkedin.com

Michael Faraday + VR

"All this is a dream. Still examine it by a few experiments. Nothing is too wonderful to be true, if it be consistent with the laws of nature; and in such things as these, experiment is the best test of such consistency." Michael Faraday Sept.

medium.com

Faraday's Magnets on Oculus Quest

Transport yourself back in time to 1855 into the lecture hall of Michael Faraday, the experimental physicist who made vital discoveries around the understanding of electromagnetism. Joined by Scottish mathematical physicist James Clerk Maxwell, you will be able to visualize and interact with the magnetic forces in action like never before.

www.oculus.com

ScienceVR

We turn human knowledge into immersive experiences.

hubs.sciencevr.com

jackie

Dedicated to research, development and education for Harmony. See https://harmony.one/newsletter!

talk.harmony.one

Cultural Self Assessment