I don't know - As I understand it, an optical AA filter just spreads the incoming light over a larger area. The fact that it is basically a low-pass optical filter is just due to the fact that it's a very weak filter. So where a line might randomly jump between two columns or rows of pixels (or Bayer patterned sensors), the AA filter "smears" them across both, just like a 1-2px gaussian blur would.
An AA filter always removes detail to quite a bit below what the sensor can resolve.
The result in removing an AA filter would be to get much sharper images with more detail - but only in situations where aliasing/moire is less evident. Since moire is most evident when shooting man-made objects (because of the repeated patterns of straight lines) and I mostly shoot landscape - I think this could benefit me.
furthermore, I don't mind simple aliasing so much because none of my photos are printed at pixel-peeping level. It's the patterned moire that drives people crazy.
I understand that for an APS-C sensor with relatively low resolution (compared with 30MP+ MF), it would be a horrible decision to ship a consumer camera without the AA filter. The thing is, an avid hobbiest or pro with the time, patience and desire to learn and use the software might be able to do much more without the AA than a consumer who uses their camera on auto/jpeg.
I just saw this interesting discussion over at Luminous Landscape:
Luminous Landscape Forum > Anti-aliasing filter effects demonstrated
Thanks for your reply! It made me understand a bit more about what goes on. If I were to write a program to auto-remove the moire, I might use a Fourier transform or DCT to break it down, then filter only the hi-freq data out (drop it) and rebuild the image from the left-over component amplitude/frequencies. If I were really smart, I'd add some kind of detection for exactly which frequencies to drop, probably using a Markov model. The main problem is probably the excessive computational power needed. However, I'd only use the algorithm on small feathered patches rather than the whole image.
Not that I'm smart enough to write that software right now.
I'm sure it must exist "out there" and is probably even patented.
Mainly, I'm interested if anybody out there actually removed the AA filter on a relatively modern Pentax camera so we can see if there is any perceived benefit.
here are some cool examples using the Nikon D200:
Nikon D200HR Of course that company removes AA filters so they might sharpen their sample photos to cheat you... but it's cool none the less.