Testing at Scale
The OpenStack CI system processes hundreds of patches a day. All the test jobs generate considerable amounts of logs and test results. The OpenStack community has developed tools and infrastructure to …
| Talk Title | Testing at Scale |
| Speakers | Andrea Frittoli (Open Source Developer Advocate, IBM) |
| Conference | Open Source Summit Japan |
| Conf Tag | |
| Location | Tokyo, Japan |
| Date | May 31-Jun 2, 2017 |
| URL | Talk Page |
| Slides | Talk Slides |
| Video | |
The OpenStack CI system processes hundreds of patches a day. All the test jobs generate considerable amounts of logs and test results. The OpenStack community has developed tools and infrastructure to enable CI at scale, and simplify analysis of test results. Elastic-recheck for instance can identify some failures automatically based on a known signature. Finding the right signatures may require a considerate amount of experience and time. Andrea will briefly present what data OpenStack collects from test runs, what tools are available to analyse it, and some of the challenges of testing at this scale. Andrea will dive into the issue of dealing with large amounts of test data: what new knowledge could be extracted from them; he will describe his experience with techniques to make the most relevant information emerge, to help developers in their work, and keep CI running smoothly.
