Commits · master · Gerhard Gossen / warc-subset-extractor

Apr 18, 2016
- Allow splitting of WARC files · 058e29a2
  Gerhard Gossen authored 9 years ago
  
  058e29a2
Feb 08, 2016
- Deal with different date formats in ARC headers · dd8f6b45
  Gerhard Gossen authored 9 years ago
  
  dd8f6b45
Aug 17, 2015
- Skip regex for null URL pattern · 8241cb6f
  Gerhard Gossen authored 9 years ago
  
  8241cb6f
- Clean up POM · 16f802a3
  Gerhard Gossen authored 9 years ago
  
  16f802a3
Jul 28, 2015
- Update build instructions · a89c85f8
  Gerhard Gossen authored 9 years ago
  
  a89c85f8
Jul 20, 2015
- Change value type to helper class from raw Reader · 094f9e5a
  Gerhard Gossen authored 9 years ago
  
  094f9e5a
Jun 02, 2015
- Detect correct charset for content extraction · 8461e0b4
  Gerhard Gossen authored 9 years ago
  8461e0b4
May 28, 2015
- Use CombineInputFormat to reduce number of mappers · 3ae6cf25
  Gerhard Gossen authored 9 years ago
  
  3ae6cf25
May 26, 2015
- Update documentation · b91c305b
  Gerhard Gossen authored 9 years ago
  
  b91c305b
- Small fixes · eb506e71
  Gerhard Gossen authored 9 years ago
  
  eb506e71
May 20, 2015
- Add RecordReader statistics · 39e786ce
  Gerhard Gossen authored 9 years ago
  
  39e786ce
- Skip unparseable ArchiveRecords · 484ce52b
  Gerhard Gossen authored 9 years ago
  
  484ce52b
- Count mime types and status codes of matched records · ba8537fd
  Gerhard Gossen authored 9 years ago
  
  ba8537fd
- Handle missing record type in ARC files · b9d15b7c
  Gerhard Gossen authored 9 years ago
  
  b9d15b7c
- Fix logging setup · 14166768
  Gerhard Gossen authored 9 years ago
  
  14166768
May 19, 2015
- Fix abort of job on broken ARC records · 50767418
  Gerhard Gossen authored 9 years ago
  50767418
- Include mimetype in output · 37f1abf4
  Gerhard Gossen authored 9 years ago
  
  37f1abf4
- Log processed files to find breakage · 130e2c0b
  Gerhard Gossen authored 9 years ago
  
  130e2c0b
- Produce smaller number of output files · 24b731a1
  Gerhard Gossen authored 9 years ago
  
  24b731a1
- Allow filtering also by MIME type or status code · 82e9c6de
  Gerhard Gossen authored 10 years ago
  
  82e9c6de
Apr 20, 2015
- Update documentation · b53dfbca
  Gerhard Gossen authored 10 years ago
  
  b53dfbca
- Fix project setup · ed5247bb
  Gerhard Gossen authored 10 years ago
  
  ed5247bb
- Add readme · 2a6613d5
  Gerhard Gossen authored 10 years ago
  
  2a6613d5
Apr 17, 2015
- Initial version · fed8d230
  Gerhard Gossen authored 10 years ago
  
  fed8d230