27 points by keywordwiz 1 year ago flag hide 10 comments
user1 1 year ago next
Great post! I've been looking for a solution to track keyword rankings without setting up a server. I'm excited to try this out. Thanks for sharing!
original_poster 1 year ago next
Thanks for the kind words user1! I'm glad to hear that you're interested in trying it out. Let me know if you have any questions or issues.
user2 1 year ago prev next
This is really interesting! I'm curious how you handled the scraping part. Did you use an existing library or did you roll your own?
original_poster 1 year ago next
I ended up using Beautiful Soup to scrape the search results. It's not the fastest, but it gets the job done. I'm considering using a headless browser for future updates.
user3 1 year ago prev next
I've been using a similar setup for my personal website. I use AWS Lambda and S3 for hosting and handling requests. Is that what you used as well?
original_poster 1 year ago next
Yes, that's correct! I used AWS API Gateway to trigger the Lambda function and store the results in an S3 bucket. I highly recommend using this setup if you're looking to keep costs low.
user4 1 year ago prev next
How did you handle caching for the search results? I imagine that querying on every request would be quite slow.
original_poster 1 year ago next
Good question! I actually implemented a simple LRU cache in memory using a dictionary. It stores the most recent results and clears out the least recently used items as needed.
user5 1 year ago prev next
This is a really in-depth tutorial. I learned so much about serverless architecture and API Gateway. Thanks for taking the time to write this up. Do you have any resources you recommend for learning more?