tcg_my-server

README

TCG.MY

Server for TCG.MY. API for retrieving Yugioh OCG cards' price by scraping data from bigweb and YUYU-TEI.

Design

1. web scraping with go-colly
2. graphql http caching with apq and lru cache
3. graphql response caching with redis
4. structured logging with slog

Todo

• data loading with graphql
• jwt authentication on APIs

Reference Documentation

• Scraping the Web in Golang with Colly and Goquery
• Web Scraping in Golang: Complete Guide 2023
• web crawl nested HTML elements
• Automatic persisted queries (APQ)
• APQ with gqlgen
• Research project: Which is the best caching strategy with GraphQL for a big relational database?