Skip to main content
Software Engineering

You are not logged in. Your edit will be placed in a queue until it is peer reviewed.

We welcome edits that make the post easier to understand and more valuable for readers. Because community members review edits, please try to make the post substantially better than how you found it, for example, by fixing grammar or adding additional resources and hyperlinks.

Required fields*

8
  • This bot accesses news site only when posting, the rest of the time it analyzes Bluesky posts and doesn't access news sites. Commented Sep 9, 2025 at 21:10
  • And, "read the page sequentially" is possible? Not file but website? Commented Sep 9, 2025 at 21:13
  • @Lamron of course. When you download a page, you always download it chunk by chunk. The data arrives at your computer in network packets, which you can analyze and parse on the fly. In fact browsers do this all the time, they won't wait until entire page is downloaded, they will try to parse, run scripts (and maybe even render it) on the fly. You can do something similar. But how to do that exactly, depends on the language and framework you are using. Commented Sep 10, 2025 at 9:46
  • I found that doesn't work, for example: gist.github.com/lamrongol/c7079bd8b5057aecf1ba916f4c9150a0 . The site returns "Please enable JS and disable any ad blocker" even if only small size is requested. Commented Sep 10, 2025 at 19:02
  • @Lamron: that's a new question about your specific code. Try ask it on Stackoverflow (but make the code part of your question, don't just link to an external site). Commented Sep 10, 2025 at 19:10