Hey, I had two feature ideas I wanted to suggest.

First, it would be really nice if there was some kind of robots.txt feature where you can define your bot name and have it automatically respect robots.txt rules. Like, it would block scraping on sites or paths that the bot isn’t allowed to access/scrape.

Second, could there be a timestamps feature for YouTube transcripts? It would be great if each part of the transcript had its corresponding time included.

Thanks a lot!