main.py ValueError No URLs in batch

[thiswillbeyourgithub]

Happens in python main.py or in the docker compose

[agausmann]

It looks like a lot is in flux right now - this crawler might be outdated.

See mwmbl/mwmbl#204 for example, maybe try that code instead.

[thiswillbeyourgithub]

Alright but then FYI the readme of the official mwmbl points to here

[daoudclarke]

Apologies, I disabled crawling because of load on the server. I will try and re enable it asap.

[thiswillbeyourgithub]

Don't worry. I'm not commited to running a crawler yet and wanted to first give it a go on my local computer so don't enable it if you're not comfortable with it :)