will probably need to add time to the date in order to avoid filename collisions when restarting a crawler, e.g.
WIDE-5-20101213120000/WIDE-00395.warc.gz
will probably need to add time to the date in order to avoid filename collisions when restarting a crawler, e.g.
WIDE-5- 20101213120000/ WIDE-00395. warc.gz