Hi, I have read few comments under the post, there are great suggestions also your questions regarding task are on the point. But I believe handling this with a script might be not easy. If I were you, I would use Apache Nutch or similar open source software/library.I have used Nutch for my thesis for similar task that I had to scrap a lot of blog pages and the other pages they were referencing. You can configure... Source: over 1 year ago

I've never used it, but I was on a project where we considered Apache Nutch: https://nutch.apache.org/. Source: over 1 year ago

Aside from the built-in prompts powered by awesome-chatgpt-prompts (Are you an ETH dev, a financial analyst, or a personal trainer today?), you can also create, share and debug your chat tools with prompt templates. - Source: dev.to / 5 months ago

I've found the following resources helpful: - 15 Rules For Crafting Effective GPT Chat Prompts (https://expandi.io/blog/chat-gpt-rules/) - Awesome ChatGPT Prompts (https://github.com/f/awesome-chatgpt-prompts) For more resources of like nature, you can search for "mega prompt". - Source: Hacker News / 6 months ago

Someone assembled an adhoc page in Github that is amassing quite a large library of prompt ideas [Github]. Source: 6 months ago

I like to use PromptLayer for this. But you could easily set up a simple CRUD web app to track prompts/average completion token # length, different variations. There is also awesome-chatgpt-prompts (https://github.com/f/awesome-chatgpt-prompts) which has some interesting ones. What are you looking for? - Source: Hacker News / 9 months ago

* Built-In Prompts: Channel creativity using integrated prompts sourced from github.com/f/awesome-chatgpt-prompts. Source: 10 months ago