Introduction

Generate Nano at a Glance

Key features and capabilities of Generate Nano's APK, SDK, and core technology.

APK Highlights

  • Two Specialized Applications: Menu Assistant for restaurant ordering and Device Aid for technical support.
  • Fully Offline Operation: Complete functionality without internet connectivity.
  • Voice-Enabled Interface: Natural language interaction through OpenAI Whisper ASR.
  • Retrieval-Augmented Generation: Combines local data with LLM for accurate responses.
  • Fleet Dashboard: Web-based platform for device management and monitoring.

SDK Highlights

  • Easy Integration: Android Archive (AAR) files for seamless embedding in applications.
  • Hybrid Processing: Intelligent workload distribution across CPU, GPU, and NPU.
  • Cart Management: Built-in order tracking and modification capabilities.
  • Menu Configuration: Flexible JSON-based menu system with extensive customization.
  • Multiple Deployment Options: Local-only, hybrid, and cloud fallback modes.

Core Technology

  • Optimized LLMs: 4-bit quantized models (0.6B parameters) for efficient on-device inference.
  • NPU-Accelerated Voice: Whisper ASR optimized for Qualcomm Neural Processing Unit.
  • Vector Search: Lightweight, high-speed retrieval engine for semantic search.
  • Multi-language Support: Voice recognition in 99 languages.
  • Qualcomm Optimization: Specifically engineered for 6490 and 8550 chipsets.
  • GPU Acceleration: Hybrid CPU/GPU workload distribution for optimal performance.
  • Benchmarked Performance: Up to 23.47 tok/s on 8550 and 14.77 tok/s on 6490 chipsets.

Overview

Generate Nano is a comprehensive AI solution available in both SDK and APK formats, developed for the Qualcomm QCM6490 and 8550 chipsets. It enables developers to embed fully offline, voice-enabled, natural-language assistants into Android applications running on POS terminals, kiosks, and handheld devices.

Generate Nano comes in two versions: Menu Assistant for restaurant ordering and Device Aid for technical support. Both versions use local LLMs (Language Models) combined with retrieval engines to understand user intent, respond conversationally, and perform operations in real time. All inference occurs on-device, with workloads distributed across the CPU, GPU, and NPU to maximize responsiveness while maintaining data privacy and reliability.

Core Capabilities

Generate Nano provides a suite of powerful capabilities that are consistent across all versions:

  • Offline Operation: Functions completely independently without requiring internet connectivity.
  • Voice Interaction: Processes natural language through speech using OpenAI Whisper ASR.
  • Local LLM Processing: Runs optimized language models directly on the device's GPU.
  • Retrieval-Augmented Generation: Uses local data to provide accurate, contextual responses.
  • Hybrid Compute Pipeline: Distributes workloads across CPU, GPU, and NPU for optimal performance.

Blueprint Overview

This blueprint covers all aspects of Generate Nano, including:

  • SDK Integration: How to embed Generate Nano into your own applications.
  • APK Usage: How to use the standalone Generate Nano applications.
  • Technical Architecture: Details on the underlying technology and components.
  • Configuration Options: How to customize Generate Nano for your specific needs.
  • Best Practices: Guidelines for optimal implementation and usage.
  • Troubleshooting: Solutions to common issues and challenges.

Available Versions

  • Menu Assistant: Specialized for restaurant ordering and menu interactions.
  • Device Aid: Focused on technical support and troubleshooting assistance.

Version availability by platform:

  • SDK: Menu Assistant is available for the Qualcomm QCM6490 chipset.
  • APK: Both Menu Assistant and Device Aid versions are available for both Qualcomm QCM6490 and 8550 chipsets.
  • Benchmarking: Comprehensive performance metrics available for both QCM6490 and QCM8550 chipsets.

Blueprint Links

SDK Blueprint

Comprehensive guide to integrating and using the Generate Nano SDK in your applications.

Includes installation instructions, configuration options, key features, components, usage examples, and resources.

View SDK Blueprint View SDK Gallery

APK Blueprint

Complete guide to using the Generate Nano APK applications on your Android devices.

Includes information about Menu Assistant, Device Aid, installation, usage guide, and Fleet Dashboard.

View APK Blueprint View APK Gallery

Benchmarking

Comprehensive performance analysis of Generate Nano on Qualcomm QCM6490 and QCM8550 chipsets.

Includes detailed metrics, comparisons, and optimization recommendations for both chipsets.

View Benchmarks View Comparison