ຊອບແວການຈັດການ AI ລິຂະສິດ
Django RESTPostgreSQLCelery / Redis
Operational Context
The client faced 48-hour latency in pricing decisions due to fragmented data across spreadsheet silos and manual checks of 14+ different wholesale portals.
System Architecture
- Distributed Scraping Network: Implemented Scrapy spiders on a rotating proxy network to asynchronously harvest pricing data every 15 minutes.
- Task Queue Orchestration: Utilized Celery with Redis as a message broker to handle high-concurrency data normalization tasks.
- Predictive Analytics Engine: Developed a Pandas/NumPy algorithm cross-referencing real-time weather API data with historical supply logs to forecast shortages.