Recent research has shown that people can learn more new concepts than the number of examples they are presented with. However, these results relied on strong assumptions about what skills and prior knowledge are required to perform this kind of less-than-one-shot learning. This has included having participants disentangle soft labels that fuzzily map stimuli to multiple concepts, interpret continuous feature weights, and parse complex compositional statements. We propose a novel minimal paradigm that strips away these assumptions to explore how efficiently people can simultaneously learn visual and symbolic concepts. We show theoretically that it should be possible to learn up to $2^{k-1}$ binary features from $k$ examples, and to learn up to $2^{2^{k-1}}$ unique combinations of those features. We validate this empirically, showing that people may be able to learn as many as 8 novel binary features and up to 256 concepts corresponding to unique compositions of those features from just 4 examples.