Elevated Unmanned Smart MRT Customer Service with LLM AI ChatBot on Edge System for Efficient Multilingual Communication and Cost Savings

The ASRock Industrial iEPF-10000S Series Robust Edge AIoT Platform, featuring Intel's 13th Gen CPU and NVIDIA GeForce RTX® 4090 graphics card, serves as an advanced AI inference edge system utilizing Large Language Models (LLM) and Automatic Speech Recognition (ASR) speech-to-text technology. This sophisticated setup plays a pivotal role in implementing the AI voice and visual customer service system in Taiwan’s MRT stations. The system ensures efficient, reliable, and inclusive smart customer support, harnessing generative AI powered by ASRock Industrial's advanced AI inference system. This integration is designed to enhance seamless intelligent service and multilingual communication across public transportation.

Challenge

At the heart of Taiwan’s bustling cities, the Mass Rapid Transit (MRT) stations serve as vital hubs, sustaining the nation's dynamic economic landscape and fostering productivity by facilitating the seamless movement of people worldwide. Catering to both local residents and international visitors, the MRT offers convenient services for efficient and smooth transportation. Despite these strengths, current multilingual language support of on-site customer service is limited, resulting in communication barriers and inefficiencies. This limitation hampers Taiwan’s potential for global exposure through socio-economic development and tourism, hindering progress in regional integration, investment attraction, overseas tourism, and more. 

Taiwan grapples with a dual challenge involving a shortage of multilingual talent and rising labor costs. The complexity is compounded by the need for proficiency in multiple languages concurrently, leading employers to enlist several language specialists simultaneously, causing a substantial increase in human resource expenses. Providing MRT employees with multilingual proficiency for bilingual customer services becomes a protracted and potentially costly endeavor. Furthermore, the challenge of securing ad-hoc sign-language support remains prevalent in most MRT stations, leaving inclusivity challenges unresolved for minority groups.

In response, AI ChatBots have begun integrating into customer service and support. However, the current landscape of AI voice customer service systems utilizing Large Language Models (LLMs) poses substantial challenges in terms of computing power when operating on edge systems for real-time multilingual translation and communication. The majority of AI LLMs are exceptionally large, depending on the robust computing capabilities of cloud servers rather than edge computing. This reliance on cloud computing renders it impractical to execute offline, high-speed, real-time processing on local machines while ensuring the utmost in security and privacy.

Solution

The progression of intelligent MRT customer service demands a shift towards unmanned technology. Introducing the AI voice and visual customer service system, this innovative solution integrates dynamic displays featuring virtual characters/ avatars that closely emulate real-life interactions, providing an interactive approach to answering passenger inquiries regarding basic station information, ticketing, surrounding transportation, and attractions. ASRock Industrial's iEPF-10000S Series Robust Edge AIoT Platform functions as an AI inference edge system equipped with Intel's 13th Gen CPU and NVIDIA GeForce RTX® 4090 graphics card, featuring high-performance CPU, GPU and AI computing power at the edge.

iEPF-10000S Series Robust Edge AIoT Platform features Intel's 13th Gen CPU as advanced AI inference edge system utilizing LLM and ASR speech-to-text technology for enhanced AI ChatBot’s multilingual support

 

This comprehensive system offers simultaneous multilingual support, functioning offline with integrated pre-trained Large Language Model (LLM) models. It excels in providing simultaneous translation in 14 languages (English, Chinese, Japanese, Korean, Thai, Indonesian, Malay, Spanish, French, Russian, Italian, German, Dutch, and Portuguese), along with country-specific sign language support, while also allowing for potential expansion to meet additional language demands. The system ensures swift, zero-lag, and accurate customer service by leveraging a combination of two multimodal translation AIs, guaranteeing the highest quality translations. This multilingual capability provides a seamless and inclusive communication experience for passengers, enhancing the efficiency, quality, and accessibility of MRT customer service.

Supporting Automatic Speech Recognition (ASR) and speech-to-text technology, the system efficiently eliminates language barriers, promoting smooth global communication with enhanced efficiency. Continuously evolving, it remains committed to learning and optimizing AI models for updated knowledge and language support through the AI ChatBot. The execution encompasses vital processes: language input, language text conversion, AI semantic understanding, searching for answers to questions, and integrating virtual avatars with synthesized voice responses. Furthermore, operated locally, the system ensures internet-free functionality with secure privacy features, providing dependable translation services both online and offline without compromising data security.

Benefit

Effective communication with customers globally:

through 14+1 multilingual services, the platform establishes a personal connection with customers, ensuring a clear understanding of presented information while promoting diversity and inclusion. The customized services are crafted to instill trust by providing effective and helpful assistance, thereby boosting customer satisfaction and expanding international engagements.

Multi-lingual AI ChatBot brings about a reduction in labor costs: 

advancement in the seamless integration of AI into fully unmanned services. This innovative solution adeptly tackles the challenges associated with a shortage in multilingual talents, offering a cost-effective alternative while ensuring efficient and uninterrupted customer service.

Efficient real-time and offline operation of AI LLMs: 

at the edge, eliminating the reliance on cloud-based LLMs. This not only enhances data security but also contributes to cost reduction. As AI computing power continues to advance, the system ensures the delivery of high-quality services, even in high-traffic and noisy intersections.

Related Product

iEPF-9020S-EY4

  • Intel® 13th Gen Core™ Processors with R680E Chipset
  • 4 x 260-pin DDR4 SO-DIMM up to 128GB (32GB per DIMM)
  • 1 x PCIe x16 (PCIe Gen4) or 2 x PCIe x8 (PCIe Gen4), 2 x PCIe x 4 (PCIe Gen4)
  • 1 x M.2 Key M, 1 x M.2 Key B, 1 x M.2 Key E, 2 x Mini PCIe
  • 6 x USB 3.2 Gen2x1, 6 x COM, 4 x SATA3, 8 x DI, 8 x DO
  • 5 x Intel 2.5G LAN (2 support PoE, LAN 1 supports vPro)
  • 1 x Displayport, 1 x HDMI 2.0b, 1 x VGA
  • Powerful Edge AI acceleration enabled by the most flexible mechanical, thermal, and power design, with support for 275 mm x 138 mm x 60mm (L x H x D) max. and up to 300W graphic card
Learn More

iEPF-9030S-EW4

  • Intel® 14th Gen Core™ Processors with R680E Chipset
  • 2 x 262-pin DDR5 SO-DIMM up to 96GB (48GB per DIMM)
  • 1 x PCIe x16 (Up to PCIe Gen5) or 2 x PCIe x8 (Up to PCIe Gen5),
  • 2 x PCIe x 4 (PCIe Gen4)
  • 2 x M.2 Key M, 2 x M.2 Key B, 1 x M.2 Key E
  • 6 x USB 3.2 Gen2x1, 6 x COM, 4 x SATA3, 8 x DI, 8 x DO
  • 5 x Intel 2.5G LAN (2 support PoE, LAN 1 supports vPro)
  • 1 x Displayport, 1 x HDMI 2.0b, 1 x VGA
  • Powerful Edge AI acceleration enabled by the most flexible mechanical, thermal, and power design, with support for 275 mm x 138 mm x 60 mm (L x H x D) max. and up to 600W graphic card
Learn More

iEPF-10000S Series

  • ASRock Industrial ATX Industrial Motherboard IMB-1714 or IMB-X1714 inside
  • Intel® 14th/13th Core™ Processor, up to 125W
  • 4 x 288-pin Long-DIMM DDR5, up to 192GB (48GB per DIMM)
  • PNY GEFORCE RTX® 4090 24GB option. NVIDIA Ada Lovelace Streaming Multiprocessors, 4th Generation Tensor Cores, and 3rd Generation RT Cores
  • ASRock Intel Arc A770 Challenger 16GB OC option. Intel® Xe HPG Microarchitecture and Intel® Xe Super Sampling (XeSS) support
  • ATX Power Supply 850W or 1000W option, Complies with ATX12V V3.0 & EPS12V V2.92
Learn More