Back to Projects

AstroWeather AI Assistant

LINE Bot API Integration Multimodal AI

AstroWeather is an intelligent LINE chatbot combining real-time environmental data with multimodal generative AI. It delivers an all-in-one interactive experience for daily horoscope readings, AI outfit recommendations, and graphic weather visualization. Tailored for lifestyle-conscious young users, it unifies fragmented daily inquiries ("What should I wear?", "Will it rain today?", "How is my luck?") into an intuitive, visually captivating assistant.

Market Insights & Pain Points

An evaluation of mainstream weather and horoscope services identified several recurring pain points:

  • Fragmented journeys: Checking weather, horoscopes, and outfit inspiration requires switching across three separate apps.
  • Lack of interactivity: Most services rely on static tables or canned snippets with minimal personal resonance.
  • Information fatigue: Text-heavy lists and raw numerical tables create unnecessary cognitive load in morning routines.

While user appetite for conversational AI continues to expand, tools that merge true real-time data with multimodal visual flair are rare. AstroWeather orchestrates web automation, computer vision, and dynamic graphics synthesis to turn routine queries into delightful interactions.

Product Features & Technical Delivery

  • Real-Time Horoscope Queries (Automated Scraping)
    • Selecting a zodiac sign triggers an automated web scraper to fetch and synthesize the latest daily astrological forecast.
    • Eliminates stale data common in static mobile apps.
  • AI Outfit Recommendations (Computer Vision + LLM)
    • Users upload outfit photos; a YOLOv11 model detects clothing types and dominant color schemes.
    • Synthesizing fashion rules with zodiac energy prompts, Gemini LLM generates bespoke styling suggestions.
  • Visual Weather Synthesis (API + Programmatic Graphics)
    • Queries OpenWeatherMap API for hyperlocal temperatures, wind, and conditions.
    • Dynamically applies day/night illustration templates and renders stylized infographic cards in real time.

System Architecture

  • YOLOv11 + OpenCV: Apparel detection and image feature extraction
  • LINE Messaging API + ngrok: High-reliability bot webhook pipeline
  • Gemini API: Contextual fashion advice generation
  • OpenWeatherMap API: Hyperlocal weather data feed
  • Pillow + Graphic Templates: Dynamic typographic card rendering