Commits · master · Gerhard Gossen / archive-crawler

12 Jan, 2018 7 commits
- Force spec name to spec file basename · c66b9de7
  Gerhard Gossen authored Jan 12, 2018
  
  c66b9de7
- Print crawl configs · bd08880d
  Gerhard Gossen authored Jan 12, 2018
  
  bd08880d
- Prevent overwriting of existing CSV output files · 1c32699e
  Gerhard Gossen authored Jan 12, 2018
  
  1c32699e
- Report more accurate progress · 772527f7
  Gerhard Gossen authored Jan 09, 2018
  
  772527f7
- Update .gitignore · c165da19
  Gerhard Gossen authored Jan 09, 2018
  
  c165da19
- Remove outdated UI URL path segment · 813bea0c
  Gerhard Gossen authored Jan 09, 2018
  
  813bea0c
- Include more parameters in displayed crawl names · de227f73
  Gerhard Gossen authored Jan 09, 2018
  
  de227f73
05 Jan, 2018 1 commit
- Catch exception for invalid dates · c40d2f16
  Gerhard Gossen authored Jan 05, 2018
  
  c40d2f16
15 Jun, 2017 1 commit
- Fix usage text · 7dd73767
  Gerhard Gossen authored Jun 15, 2017
  
  7dd73767
11 Apr, 2017 2 commits
- Add method to extract seed URLs from CDX files · 50207ebd
  Gerhard Gossen authored Apr 11, 2017
  
  50207ebd
- Only use time similarity if content similarity is above threshold · baf7c8e9
  Gerhard Gossen authored Apr 11, 2017
  
  baf7c8e9
03 Apr, 2017 1 commit
- Normalize scores using reference document similarity · 75dec058
  Gerhard Gossen authored Apr 03, 2017
  
  75dec058
14 Feb, 2017 1 commit
- Update dependencies · 4e0caf72
  Gerhard Gossen authored Feb 14, 2017
  
  4e0caf72
13 Feb, 2017 1 commit
- Code cleanuo · a974072e
  Gerhard Gossen authored Feb 13, 2017
  
  a974072e
07 Feb, 2017 9 commits
- Add data & tools for web page date extraction evaluation · 89757d12
  Gerhard Gossen authored Feb 07, 2017
  
  89757d12
- Add wikinews categories for evaluation topics · 88807231
  Gerhard Gossen authored Feb 07, 2017
  
  88807231
- Improve web page date extraction · 87cce025
  Gerhard Gossen authored Feb 07, 2017
  
  87cce025
- Store date and relevance interval for analysed snapshots · 4a6e4039
  Gerhard Gossen authored Feb 07, 2017
  
  4a6e4039
- Skip evaluation using different snapshot counts for time-sensitive WMs · f9a82cfb
  Gerhard Gossen authored Feb 07, 2017
  
  f9a82cfb
- Add Wikinews categories as seed URL sources · bb8b1492
  Gerhard Gossen authored Feb 07, 2017
  
  bb8b1492
- Increase threshold for number keywords · 9e11747e
  Gerhard Gossen authored Jan 25, 2017
  
  9e11747e
- Unwrap some archive URLs when creating crawl spec · ee3259f8
  Gerhard Gossen authored Jan 25, 2017
  
  ee3259f8
- Improve display of metrics in UI · f7154258
  Gerhard Gossen authored Jan 20, 2017
  
  f7154258
20 Jan, 2017 4 commits
- Include modified date in ZIP metadata file · 49a61880
  Gerhard Gossen authored Jan 19, 2017
  
  49a61880
- Formatting · f9bafcde
  Gerhard Gossen authored Jan 19, 2017
  
  f9bafcde
- Replace JodaTime with java.time · fd51b98f
  Gerhard Gossen authored Jan 19, 2017
  
  fd51b98f
- Check multiple snapshots of page and pick best one · d963cb79
  Gerhard Gossen authored Jan 19, 2017
  
  d963cb79
21 Jul, 2016 2 commits
- Fix classpath after cluster config change · 96fb3195
  Gerhard Gossen authored Jul 21, 2016
  
  96fb3195
- Store estimated modification time · de18611c
  Gerhard Gossen authored Jul 20, 2016
  
  de18611c
20 Jul, 2016 1 commit
- Fix regexp for month in modification date estimation · 8fbbff72
  Gerhard Gossen authored Jul 20, 2016
  
  8fbbff72
18 Apr, 2016 2 commits
- Store referrer URL and crawl time in CrawlUrl · 56214a44
  Gerhard Gossen authored Apr 18, 2016
  
  56214a44
- Use ZonedDateTime instead of LocalDateTime · c2fe97d9
  Gerhard Gossen authored Apr 18, 2016
  
  c2fe97d9
02 Mar, 2016 1 commit
- Add properties file · ca28fa73
  Gerhard Gossen authored Mar 02, 2016
  
  ca28fa73
01 Mar, 2016 2 commits
- Add description of zip output format · ab8db4d4
  Gerhard Gossen authored Mar 01, 2016
  
  ab8db4d4
- Add filtering by minimum relevance · 5208f446
  Gerhard Gossen authored Mar 01, 2016
  
  5208f446
29 Feb, 2016 1 commit
- Add ResultStorer that produces .zip files of results · ecf8d9ae
  Gerhard Gossen authored Feb 29, 2016
  
  ecf8d9ae
22 Feb, 2016 1 commit
- Extract base classes for YARN client & app master · e330ad0a
  Gerhard Gossen authored Feb 22, 2016
  
  e330ad0a
10 Feb, 2016 1 commit
- Update to Java 8 · b6cc1069
  Gerhard Gossen authored Feb 10, 2016
  
  b6cc1069
09 Feb, 2016 2 commits
- Prevent NPE for Urls · 7c4de43c
  Gerhard Gossen authored Feb 09, 2016
  
  7c4de43c
- Create crawl spec version without keywords · e4a43c6e
  Gerhard Gossen authored Feb 09, 2016
  
  e4a43c6e