I setup error log up to 10MB per file up to 5 files. But lxml somehow writes 75 GB in error log file.
I need this to make lxml work until getting memory error and than die. So monitor process can create new process with lxml parser. This is not very clean solution, but i haven't time to find real problem in lxml parser.
For now one of solution that i have it's to monkeypatch the lxml.etree._BaseErrorLog.
I setup error log up to 10MB per file up to 5 files. But lxml somehow writes 75 GB in error log file.
I need this to make lxml work until getting memory error and than die. So monitor process can create new process with lxml parser. This is not very clean solution, but i haven't time to find real problem in lxml parser.
For now one of solution that i have it's to monkeypatch the lxml.etree. _BaseErrorLog.