Breaking News
Trending Tags
Beranda » Software » The Future of Mixed Reality: Blending the Virtual and the Real

The Future of Mixed Reality: Blending the Virtual and the Real

  • account_circle Lili Cheng
  • calendar_month Selasa, 28 Jan 2025
  • print Cetak

At Microsoft Ignite 2023, we are announcing Copilot in Microsoft Dynamics 365 Guides, which combines the power of generative AI with mixed reality to help frontline workers complete complex tasks and resolve issues faster with less disruption to the flow of work.

Copilot in Dynamics 365 Guides assists workers in industrial settings who deal with complex equipment and processes. New technicians need to ramp up quickly while learning how to operate and service that equipment. When equipment stops functioning, workers must act quickly to diagnose the problem, implement a fix, and then document their work. Instead of workers needing to search through volumes of digital documents or paper manuals, Copilot enables workers to ask for relevant information using natural language and human gestures, such as looking and pointing. Copilot uses generative AI to search for information from technical documentation, service records, training content, and any other data sources that customers curate. Copilot then summarizes the information to provide interactive guidance through content and holograms overlaid on the equipment in operation or maintenance.

Mixed reality together with AI presents a human-first interface that promises to transform real-world operations. Now, Copilot can assist industrial workers in real-time with speech and holograms.

Copilot in Dynamics 365 Guides capabilities

Here are the capabilities we plan to unlock with Copilot in Dynamics 365 Guides:

Point and Ask Guidance

Humans have always learned from and interacted with their environment in a hands-on manner, asking questions of others as they work. Copilot in Dynamics 365 Guides builds on that natural way of interacting to help workers better understand the world around them. Workers can point to a component on an asset and ask Copilot questions, such as “What is the torque limit for these bolts?” New workers can ask general questions, such as “What is the function of this component?” without needing to interrupt a more experienced coworker. Copilot recognizes what the user is pointing at and provides answers. 3D models and spatial maps provide the foundation for the technology to identify what the worker is looking at and then project a hologram to show instructions. Workers can ask more complex questions, such as “Which direction does this part fit?” or “Show me where the sensor module is on this machine,” and Copilot will display holograms to show where the part belongs.

Spatial Content Generation

Copilot in Dynamics 365 Guides accelerates the out-of-the-box value of mixed reality by significantly reducing the upfront investment needed to create spatial content. Copilot simplifies the creation, management, and delivery of mixed reality content using customer-defined data sources, enabling companies to adopt mixed reality much faster.

Step-by-Step Assistance

Powered by Microsoft Azure OpenAI Service, large language models allow Copilot in Dynamics 365 Guides to do far more than answer one-off questions. Workers can have progressive conversations, such as “Walk me through the steps to disassemble this filtration unit,” or “I disconnected the motor, what’s next?” Copilot follows along with the process and conversation using customer’s curated knowledge base to articulate answers with speech, text, or 3D holograms, eliminating ambiguity and reducing the need for rework.

Komentar (0)

Saat ini belum ada komentar

Silahkan tulis komentar Anda

Email Anda tidak akan dipublikasikan. Kolom yang bertanda bintang (*) wajib diisi


Rekomendasi Untuk Anda

  • Bantuan Karhutla Rp 40 Miliar Dipertanyakan, Netizen Sorot Harga Beras, Mie Instan Hingga Masker Anak

    Bantuan Karhutla Rp 40 Miliar Dipertanyakan, Netizen Sorot Harga Beras, Mie Instan Hingga Masker Anak

    • calendar_month Jumat, 23 Okt 2026
    • account_circle Kata Netizen
    • visibility 34
    • 0Komentar

    PONTIANAK, KN.ID — Penggunaan anggaran bantuan penanganan kebakaran hutan dan lahan (karhutla) senilai Rp40 miliar yang disebut berasal dari bantuan Presiden untuk Pemerintah Provinsi Kalimantan Barat menjadi sorotan publik. Sejumlah item pengadaan yang tercantum dalam rincian anggaran menuai pertanyaan netizen, mulai dari harga bahan kebutuhan pokok, perlengkapan bantuan, hingga masker untuk anak-anak yang terdampak kabut […]

  • Pelajar Asal Pontianak Nathan Alexandro Raih Gold NYAA 2026, Terima Penghargaan Langsung dari Presiden Singapura

    Pelajar Asal Pontianak Nathan Alexandro Raih Gold NYAA 2026, Terima Penghargaan Langsung dari Presiden Singapura

    • calendar_month Sabtu, 31 Okt 2026
    • account_circle Kata Netizen
    • visibility 54
    • 0Komentar

    SINGAPURA, KN.ID – Prestasi membanggakan ditorehkan pelajar asal Pontianak, Kalimantan Barat. Nathan Alexandro Tjhe (17) berhasil mengharumkan nama Indonesia setelah meraih penghargaan Gold National Youth Achievement Award (NYAA) 2026 yang diserahkan langsung oleh Presiden Singapura, Tharman Shanmugaratnam, pada Senin (26/10/2026).Nathan menjadi satu-satunya pelajar asal Indonesia di antara 31 penerima penghargaan yang terpilih secara nasional oleh […]

  • Kuasa Hukum Unus Sebut Pengambilan Air di Lahan SHM Bisa Masuk Unsur Pencurian

    Kuasa Hukum Unus Sebut Pengambilan Air di Lahan SHM Bisa Masuk Unsur Pencurian

    • calendar_month Kamis, 8 Okt 2026
    • account_circle Kata Netizen
    • visibility 89
    • 0Komentar

    PONTIANAK, KN.ID- Kuasa HukumUnus meminta dugaan pengambilan air oleh PT TAA di atas lahan yang berstatus Sertifikat Hak Milik (SHM) milik kliennya tetap diproses secara hukum. Kuasa hukum menilai, pembayaran ganti rugi tanam tumbuh (GRTT) yang dilakukan perusahaan tidak serta-merta menghapus hak Unus sebagai pemegang SHM atas tanah tersebut. Menurut kuasa hukum, GRTT hanya berkaitan […]

  • Inspirational Tales of Gadgets Changing Lives for the Better

    Inspirational Tales of Gadgets Changing Lives for the Better

    • calendar_month Rabu, 21 Feb 2024
    • account_circle Kata Netizen
    • visibility 299
    • 0Komentar

    As the timeline of technology perpetually accelerates, 2023 emerges as a testament to human creativity and ingenuity. The realm of gadgets is no longer restricted to mere utility; it’s about amplifying human potential and redefining boundaries. With each passing day, these handheld marvels become an even more integrated part of our daily lives, intertwining with […]

  • Dewi Pertiwi Kalimantan Barat Resmi Dibentuk, Feny Albani Pimpin DPW Periode 2026–2031

    Dewi Pertiwi Kalimantan Barat Resmi Dibentuk, Feny Albani Pimpin DPW Periode 2026–2031

    • calendar_month Minggu, 11 Okt 2026
    • account_circle Kata Netizen
    • visibility 63
    • 0Komentar

    JAKARTA KN.ID — Dewi Pertiwi Kalimantan Barat resmi mendeklarasikan kepengurusan wilayah sebagai bagian dari penguatan organisasi perempuan di tingkat daerah. Dalam kepengurusan periode 2026–2031, Feny Albani dipercaya menjabat Ketua Dewan Pengurus Wilayah (DPW) Dewi Pertiwi Kalimantan Barat. Deklarasi dan pelantikan tersebut berlangsung di The Ballroom at Djakarta Theater, Jakarta Pusat, Kamis (1/10/2026), bersamaan dengan peluncuran […]

  • Stories of Resilience: Failed Gadgets That Paved the Way for Future Successes

    Stories of Resilience: Failed Gadgets That Paved the Way for Future Successes

    • calendar_month Kamis, 15 Feb 2024
    • account_circle Kata Netizen
    • visibility 354
    • 0Komentar

    As the timeline of technology perpetually accelerates, 2023 emerges as a testament to human creativity and ingenuity. The realm of gadgets is no longer restricted to mere utility; it’s about amplifying human potential and redefining boundaries. With each passing day, these handheld marvels become an even more integrated part of our daily lives, intertwining with […]

expand_less