ICFP 2023
Mon 4 - Sat 9 September 2023 Seattle, Washington, United States
Wed 6 Sep 2023 10:30 - 11:00 at B - Fifth Avenue - Testing Chair(s): Stephen Dolan

Expert users of property-based testing often labor to craft random generators that encode detailed knowledge about what it means for a test input to be valid and interesting. Fortunately, the fruits of this labor can also be put to other uses. In the bidirectional programming literature, for example, generators have been repurposed as validity checkers, while Python's Hypothesis library uses the same structures for shrinking and mutating test inputs.

To unify and generalize these uses and many others, we propose reflective generators, a new foundation for random data generators that can "reflect" on an input value to calculate the random choices that could have been made to produce it. Reflective generators combine ideas from two existing abstractions: free generators and partial monadic profunctors. They can be used to implement and enhance the aforementioned shrinking and mutation algorithms, generalizing them to work for any values that can be produced by the generator, not just ones for which a trace of the generator's execution is available. Beyond shrinking and mutation, reflective generators generalize a published algorithm for example-based generation, and they can also be used as checkers, partial value completers, and other kinds of test data producers.

Wed 6 Sep

Displayed time zone: Pacific Time (US & Canada) change

10:30 - 12:00
TestingICFP Papers and Events at B - Fifth Avenue
Chair(s): Stephen Dolan Jane Street
10:30
30m
Talk
Reflecting on Random GenerationDistinguished Paper
ICFP Papers and Events
Harrison Goldstein University of Pennsylvania, Samantha Frohlich University of Bristol, Meng Wang University of Bristol, Benjamin C. Pierce University of Pennsylvania
DOI
11:00
30m
Talk
Etna: An Evaluation Platform for Property-Based Testing (Experience Report)Experience Report
ICFP Papers and Events
Jessica Shi University of Pennsylvania, Alperen Keles University of Maryland at College Park, Harrison Goldstein University of Pennsylvania, Benjamin C. Pierce University of Pennsylvania, Leonidas Lampropoulos University of Maryland, College Park
DOI
11:30
30m
Talk
Formal Specification and Testing for Reinforcement LearningRemote
ICFP Papers and Events
Mahsa Varshosaz IT University of Copenhagen, Denmark, Mohsen Ghaffari IT University of Copenhagen, Einar Broch Johnsen University of Oslo, Andrzej WÄ…sowski IT University of Copenhagen, Denmark
DOI