“Today [August 2, 2017] Judicata is publishing data and information that we hope will seed a benchmark for legal search and drive qualitative improvements across the industry. Just as the ImageNet dataset helped drive dramatic improvements in computer vision and deep learning, we’d like to see a growing collection of legal data be used to fuel advances in legal research tools.

Motivating this decision are the following beliefs:

1. The quality of legal search query results can be objectively measured.
2. The performance of legal search engines on those queries can be better or worse.
3. The best legal search engines can and should perform well on all queries…”