Yes the dust problem is not during tumbling, it's during the separation process.
For those who don't use cut used dryer sheets and have to deal with dust, the dust does contain soot, some of which is primer compound (lead styphnate) and more of it would fly around when sifting out the media. Do it often enough outdoors in the same place and you'll have a higher concentration of the nasty stuff than if you don't deal with the dust. Is is bad? I don't know but it is at a higher concentration than if you eliminate almost all of it with the dryer sheets.
The brass will also have a higher coating of dust on it when loading if you don't deal with it during the tumbling process. Is it annoying? I don't know, but it is so easily eliminated without any additives that IDK why anyone would not use something that is so simple and free. Even cut up paper towels (the cheaper the better) work better than nothing.