Music geekery follows...
As I mentioned a long while back, I'm looking into music composition. My equipment is severely limited, but my studies are not.
One thing I've found in my studies is that I have picked up an unnatural ability to hear synthetic instruments. I suppose this probably came from my sonogram studies. They've started to really grate on my ear.
I don't mean "bweep baweep bweep" instruments. I don't even mean midi- or tracking-fed instrumentation. I mean I can hear filters, compressions, limiters, and the very best synthetic orchestras. I've recently deleted songs I've always had on my playlist, just because they've started grating on my ear.
Synthetic orchestration - especially simplistic versions like midi or tracking, are the most grating. I've turned myself into an elitist!
This is really bad news, since the only capabilities I have are midi. I don't own any physical instruments other than a (primitive) midi keyboard and similar computer software (it should be noted that I canot actually connect the keyboard to the computer...). I'm writing primitive songs, now, but I know that I will never be happy with anything I write, because it'll be in midi. This is especially bad because I'll eventually need music for Machine City and consecutive games.
On the other hand, I know what the problem is with these fake instruments. It's their attacks and sustains. They're unnaturally sharp and flat - not the notes, the envelopes. The computer program doesn't distinguish between a G placed in the middle of a rising sequence or at the beginning of a triumphant reveal. It hits both with the exact same authority.
The author can try to deal with this. It's possible, with great effort, to deal with some of it. You can put in volume changes, accents, and so forth. But it takes time, and there are no fine controls. If there were, it would take even more time!
That got me thinking. Why not make a program with "musicians" in it. You can assign a musician to an instrument, and teach them how you want them to play. You can carry these musicians from composition to composition, even sharing them over the internet. You can train them to play the horn with a certain level of attack and vibrato depending on what kind of sequence is being played at that moment.
Your controls would be largely limited to marking the music with emotional notation that guides the musicians. There's already denotation for sheet music, but this is not enough: we need more explicit terminology, such as "fiery".
If your pattern recognition was good enough, you could leave off with the labels and just instruct the musicians directly. They would work out what kinds of situations called for which kinds of performance, backed and instructed by you.
Or - here's an awesome idea - use the Nintendo Revolution controller to play as a conductor. Ha! That would make my YEAR.
I think there's already a program with this kind of capabilities out there. I've heard a couple of orchestral pieces which must be synthesized, but they're really good, instrumentally. They must simulate the actual instrument, which would probably do the trick nicely. They're still flawed, but they may actually be just badly mastered, mediocre-played real instruments. However, their sustains are still unnatural, so I doubt it...
Anyhow, just musing on the matter.