You can produce, with your hands, work that is too derivative of other work such that it's illegal. An LLM can too. In fact, it can only make convolutions of existing works, so it's much more likely to do so. It's not hypocritical at all. There's a spectrum for both you and machine learning models
