Vertex AIMLOpsData Science

SNS Operations Analytics Platform

A data analytics platform that collects and analyzes massive amounts of web reviews and social media data, visualizing corporate "favorability assets."

Challenge

Web reviews, social media, and website information were fragmented, making integrated analysis of industry challenges difficult.

Solution

Built an MLOps platform using Vertex AI. Automated data collection from Google Maps and portal sites, vectorized and analyzed reviews using Gemini and Vector Search. Achieved scoring and visualization as a "favorability asset."

Result

Enabled quantitative understanding of hidden trends and customer sentiment through weekly automated report generation. Contributed to faster decision-making and service improvement.

Team

1 member, 2 months

Platform building & analytics model creation

Role

Analytics platform building & data analysis

Handled PoC on Vertex AI Workbench, production migration to Pipelines, scraping, and analytics logic implementation.

Tech Stack

PlatformGoogle Cloud (Vertex AI)
PipelineVertex AI Pipelines / Kubeflow
AI / LLMGemini Pro / Gecko Embeddings
SearchVertex AI Vector Search
DatabaseSupabase / BigQuery

Key Features

01

Stable data collection from Google Maps and portal sites using ScrapingBee

02

Automated workflows for data collection, preprocessing, and inference via Vertex AI Pipelines

03

Discovery of "semantically similar complaints" and "hidden trends" through vector search

04

Multi-axis scoring of "favorability assets (trust, affection, functionality, innovation)" using Gemini

Technical Highlights

Continuous Improvement with MLOps

Adopted Vertex AI Pipelines to automate the entire process from data collection to analysis and reporting, rather than one-off analysis. Built an environment for weekly model improvement cycles.

Quantifying Qualitative Data

Combined Gemini and vector search to quantify unstructured review data into a proprietary "favorability asset" metric. Introduced advanced analytics approaches including Shapley value contribution analysis.