Integrate into Scrapy or similar Python frameworks #1676
-
|
Hi Anyone know if something like this has been done? |
Beta Was this translation helpful? Give feedback.
Replies: 1 comment 1 reply
-
|
Actually, you can run SingleFile from the command line, see https://github.com/gildas-lormeau/single-file-cli, but it's written in JavaScript instead of Python. However, it should be possible to port the code in Python by using a library like https://github.com/HMaker/python-cdp. The code to port would be the following one: https://github.com/gildas-lormeau/single-file-cli/blob/67039bfb016b9742e96a8b48de72fe7a24b79028/lib/cdp-client.js. I guess it's something that could be done easily with some AI tools. |
Beta Was this translation helpful? Give feedback.
-
|
Porting is a interesting idea but I think cli is a better idea especially if using a docker image. |
Beta Was this translation helpful? Give feedback.
Actually, you can run SingleFile from the command line, see https://github.com/gildas-lormeau/single-file-cli, but it's written in JavaScript instead of Python. However, it should be possible to port the code in Python by using a library like https://github.com/HMaker/python-cdp. The code to port would be the following one: https://github.com/gildas-lormeau/single-file-cli/blob/67039bfb016b9742e96a8b48de72fe7a24b79028/lib/cdp-client.js. I guess it's something that could be done easily with some AI tools.