How can i scrape sites in scriptable?

[DillaD]

In some situations does

let url = “ “
let wv = new WebView()
await wv.loadURL(url)
let html = await wv.getHTML()

vs.

using Request

not help with content loading??

I’ve also had some moderate success with using

A (Unpkg / CDN) module importer, and a request API

Hi, These scripts have been made for my own use, but you are welcome to use them as well. The first is a request API that aims to be closer to fetch. The API exposes POST, PUT and GET operations with the most common defaults (JSON content, etc.). Usage: const { get, post, put } = importModule("requests"); // post, put and get also accept `headers` const postResult = await post({ url: "https://...", body: {...} }); const putResult = await put({ url: "https://...", body: {...} }); const ge…

and

[TIPS] How to use npm modules in Scriptable

Hi, all! I’m pretty new to Scriptable (just about a few days), but I have some JS/Node background. I’m going to share some tip and source code I wrote. It might be very helpful to someone like me, if not, oh well. I wrote some code to use npm modules in a pretty much same manner that you use in NodeJS. I named it Scriptablify because it makes you to be able to use npm modules in Scriptable. Browserify is what makes npm modules useable in browser, so that’s the naming convention I guess. Ther…

to access some handy modules.