Optimizing & Defragmenting: A Few Questions

Amie

Mac Convert for Life
I've read several instances where people talk about how it's not necessary to perform manual optimizing of the system (HD) and/or defragmenting because Mac OS X does it in the background as soon as its necessary. What does this mean exactly? Does "optimizing" mean running the cron scripts or something different? I do maintenance and housecleaning once a week by using Disk Utility to run permissions repairs and using MacJanitor to run the cron scripts. I also use OnyX for some cleaning tasks (emptying cache, etc.), but I've never clicked on "Optimize System" in OnyX.

Anyway, I guess my main questions are: 1) Is it necessary to defragment? And 2) What exactly does "optimizing the system" or "optimizing the HD" mean?

Thanks so much to anyone who can offer some insight and clarify these matters for me.

Have a fantastic weekend! :)
 
What it means is that since Panther, Mac OS X should theoretically prebind applications automatically and defragment automatically. There's a limit to what these automated systems can do and do in order not to hinder your daily performance, though. Basically, it means that you should still run the automated scripts from time to time (they have nothing to do with both mentioned tasks, anyway), but can forget about prebinding and defragmenting. Defragmenting might still be important if you're working with really large video files, but then you'd be working with an external FW800 drive which you periodically erase for better performance, anyway. For "normal" users, disk fragmentation is a no-brainer in Mac OS X. Just don't think about it.
If you don't believe me – but why shouldn't you... – here's Apple's words: http://docs.info.apple.com/article.html?artnum=25668
 
Check out this recent thread: http://www.macosx.com/forums/showthread.php?t=268953

What Fryke said is true, but as I stress in the thread I just linked to, generalizing is bad. Fragmentation is a huge problem for people like me, and it's at least a small problem for just about everyone.

OS X's fabled auto-defragmentation is certainly better than nothing, but it's severely overrated.

But the thing with fragmentation is, if you have it bad, you'll probably know it. The telltale disk thrashing is hard to ignore.
 
fryke said:
What it means is that since Panther, Mac OS X should theoretically prebind applications automatically and defragment automatically. There's a limit to what these automated systems can do and do in order not to hinder your daily performance, though. Basically, it means that you should still run the automated scripts from time to time (they have nothing to do with both mentioned tasks, anyway), but can forget about prebinding and defragmenting. Defragmenting might still be important if you're working with really large video files, but then you'd be working with an external FW800 drive which you periodically erase for better performance, anyway. For "normal" users, disk fragmentation is a no-brainer in Mac OS X. Just don't think about it.
If you don't believe me – but why shouldn't you... – here's Apple's words: http://docs.info.apple.com/article.html?artnum=25668
Great! Thanks, Fryke. Since I don't work with large video files or any of that, I can just doing weekly maintenance like running cron scripts and doing housecleaning with OnyX and repairing permissions via Disk Utility ... and I'm in good shape?
 
Mikuro said:
Check out this recent thread: http://www.macosx.com/forums/showthread.php?t=268953

What Fryke said is true, but as I stress in the thread I just linked to, generalizing is bad. Fragmentation is a huge problem for people like me, and it's at least a small problem for just about everyone.

OS X's fabled auto-defragmentation is certainly better than nothing, but it's severely overrated.

But the thing with fragmentation is, if you have it bad, you'll probably know it. The telltale disk thrashing is hard to ignore.
I don't think I'm one of those people who need to defrag--because I don't work with large files, etc. But, what do you mean by "disk thrashing"?
 
You can usually HEAR it when a fragmentation is hurting your performance. I'm sure you can hear your hard disk grinding a bit when you access things. If fragmentation is a problem, then you'll hear the disk grinding a LOT, because it'll need to move a lot more to get what it needs.

For example, just yesterday I heard my disk thrashing like mad as I tried to play a movie. That tells me that it's time for me to defragment that partition again.

Of course, some disks are quieter than others, but I've never encountered an HD that I couldn't hear.
 
Amie

I am glad you brought up this question. I haven't quite got my head around the difference between optimisationad deframentation.

Would simply running 'Optimise System' in Onyx both optimise and defreg?

Calling all experts!!
 
Optimizing in MacOS X is application prebinding. This allows apps to launch faster because they don't have to bind to all required OS resources at launch time. It has absolutely nothing to do with file fragmentation.

On this forum, Mikuro is strong proponent of defragging his Mac. This is despite the fact that Apple has explained in quite good detail that the physical and logical memory maps of MacOS X hard drives are not the same. Since Apple keeps the physical map private, hard drive optimization software will actually work at cross purposes to the user's intent.

I have used Mac utilities since Symantec Utilities for the Macintosh 1.0. During the months between the introduction of HFS+ and Norton's support of the new file system, I also used TechTools Pro. I have benchmarked my system before and after defragmentation and optimization. I have never been able to measure a significant performance boost. I nondestructively converted my HFS drive to HFS+ regaining about 40% of my nominal storage capacity in the process. The conversion left my memory map looking like confetti with several damaged files. TechTools Pro returned my memory map the lovely rainbow that we love so well. Still even this change from most unoptimized to most optimized hard drive yielded no significant performance boost.

My experience with Windows is dramatically different. There, a defrag turned a system that was barely operable into quite a spritely performer. The upshot is that I am convinced that one of two things must be true. People who claim performance increases as a result of MacOS X hard disk defragmentation are either trying to fool themselves or everyone else.

That said, I am willing to look at verifiable hard numbers. Absent hard numbers to the contrary, I remain convinced that defragging your MacOS X hard drive is a waste of money and time.
 
MisterMe said:
I remain convinced that defragging your MacOS X hard drive is a waste of money and time.
Yippee! This means I don't need to worry about defragging and can just stick with my weekly routine maintenance of running the cron scripts, repairing permissions and using OnyX for cache, browser, etc. cleaning. :D
 
MisterMe said:
People who claim performance increases as a result of MacOS X hard disk defragmentation are either trying to fool themselves or everyone else.
..... :( I'll try not to take that as a flame. It's hard, though.

Again, you're generalizing. I don't doubt that your personal experience has not shown defragmenting to help, but that hardly means that it never does for anyone. On the other hand, my personal experience quite clearly proves that it can be an issue. So yes, I am a big proponent of defragmenting, in a way. But I don't blindly recommend it. Note that whenever I speak of defragmenting, I always mention that it's not the answer for everyone, and give people tips on how to know if it's right for them. I think this is more helpful than saying it's not a problem simply because it's never been a problem for you.

On this forum, Mikuro is strong proponent of defragging his Mac. This is despite the fact that Apple has explained in quite good detail that the physical and logical memory maps of MacOS X hard drives are not the same. Since Apple keeps the physical map private, hard drive optimization software will actually work at cross purposes to the user's intent.
I've read a lot of what Apple says on this, and none if it applies to everyone. But I've honestly never heard this map business before. It sounds like you're talking about memory, not disk space. Care to link?

Aside from that, I've never recommended any defragmenting software. I don't trust any of it. As I've mentioned several times, I take care of it simply by backing up, reinitializing and restoring.

In any case, you can spout all the theory you want, but it doesn't change the facts. If you think I'm lying about my experience, though, then there's really nothing I can say to convince you.

That said, I am willing to look at verifiable hard numbers. Absent hard numbers to the contrary, I remain convinced that defragging your MacOS X hard drive is a waste of money and time.
I admit, I've never compiled numbers on it. I never needed to. The obvious effects before and after are enough for me.
Before: Insane disk thrashing accompanying any disk activity. Slow movie playback. Slow file copying. All slowness accompanied by abnormal disk noise.
After: A happy-sounding disk. Good playback performance, even at very high bitrates. Fast copying.

I'm actually about to defragment one of my partitions, as I mentioned before. I will benchmark movie playback and file copying for you before and after, and I'll post the results. Are there any particular tests you'd like me to run as well?


There is no way for an OS to avoid fragmentation without hurting performance even more than fragmentation would. There's just no way. OS X does a fine job trying — much better than other OSes — but there are limits to what it can do, and there are limits even to what it tries to do. It's not perfect. It's not magical. I don't know why so many people insist that it is.

That said, again, I agree that it's good enough for most people. I've never said otherwise. But "most people" is not everyone. So for the non-most-people out there, I think it's worth presenting the other side.

I nondestructively converted my HFS drive to HFS+ regaining about 40% of my nominal storage capacity in the process. The conversion left my memory map looking like confetti with several damaged files. TechTools Pro returned my memory map the lovely rainbow that we love so well. Still even this change from most unoptimized to most optimized hard drive yielded no significant performance boost.
Actually, there's no reason to expect such a thing to yield a performance boost, because the conversion didn't fragment any files — it just created new fragments of free space. So your performance would stay exactly the same as before. If you filled that free space, then it might have become a problem (depending greatly on HOW you filled the space).
 
Lt Major Burns said:
i don't think many people even bother with that. my mac runs like butter and i rarely do any major maintenance
That is essentially why I bought a Mac in the first place--they are reliable and require very little maintenance. :)
 
Mikuro said:
...

I've read a lot of what Apple says on this, and none if it applies to everyone. But I've honestly never heard this map business before. It sounds like you're talking about memory, not disk space. Care to link?
I know the difference between RAM and hard drives. This information is in Apple's KnowledgeBase. You should be able to find it if you search the KB for defragmentation.

Mikuro said:
I admit, I've never compiled numbers on it. I never needed to. The obvious effects before and after are enough for me.
Before: Insane disk thrashing accompanying any disk activity. Slow movie playback. Slow file copying. All slowness accompanied by abnormal disk noise.
After: A happy-sounding disk. Good playback performance, even at very high bitrates. Fast copying.
It did not escape me that you base your support of disk fragmentation on the sound of your computer. You are the very first person I ever heard of who does this. Quite frankly, you would be better served buying a pair of earmuffs. You would quickly pay for the earmuffs in productivity savings.

Mikuro said:
There is no way for an OS to avoid fragmentation without hurting performance even more than fragmentation would. There's just no way. OS X does a fine job trying — much better than other OSes — but there are limits to what it can do, and there are limits even to what it tries to do. It's not perfect. It's not magical. I don't know why so many people insist that it is.
File fragmentation is normal. What is more, it is essential to the efficient operation of your hard drive. Virtual memory OSes continually write to the hard drive, meaning that it is impossible to fully defrag it.

Mikuro said:
Actually, there's no reason to expect such a thing to yield a performance boost, because the conversion didn't fragment any files — it just created new fragments of free space. So your performance would stay exactly the same as before. If you filled that free space, then it might have become a problem (depending greatly on HOW you filled the space).
I didn't claim that the HFS to HFS+ conversion increased my har drive's file fragmentation. However, the conversion made it abundently clear just how fragmented my hard drive was at the time. If there was any performance improvement to be made by defragmentation, it would have been made then. It was not.
 
For what its worth, I occasionally back-up and reinitialise my HD. I find performance improves afterwards.

I suspect it's all down to personal preference and perception.

However, accusations of lack experience in some areas seems a little unnecessary, especially when both you Mikuro and MisterMe have infinitely more knowledge than the likes of me and I am sure many others.

I hate to see good posters quarrelling.
 
Lt Major Burns said:
have to back mikuro on this. MisterMe has obviously never worked with large video files.
Apple allows that large video files may necessitate hard drive defragmention. I do not dispute Apple. Rather than sniping, however, it would be helpful if you would post benchmarks of improvements made by defragmenting the hard drive.
 
Ahem. Not to interrupt a good argument or anything... ;) ...but if one doesn't work with large video files (I'm assuming you're referring to home videos, movies, etc., which I don't do) and basically just use my computer for Internet and writing and the occasional photo, then I probably don't have to worry about defragging and can just stick to the basic maintenance of cron scripts, permissions repairs and cache cleaning. Right?
 
I just want to add to the confusion here. ;) ... -> Harddrive thrashing in _my_ case most of the time means that virtual memory is taking over most of my free harddrive space on the main drive and that open applications are fighting over who gets more time etc. Switching to Adobe Illustrator then takes 10 minutes or more while the system tries to get Illu's memory back from the harddrive (which is almost full!) and at the same time tries to put my Photoshop memory into the VM (which resides on the almost full main drive partially...). I'm aware that I solve this by having much more free space on the main drive. I just want to say that if you hear lots of harddrive thrashing, a good old reboot or relogin will help MUCH, since that frees a lot of memory and harddrive space. So the defragmentation performance increase could also simply be related to freeing up memory while at it. (Since it involves at least a reboot and you'll close your applications for it.)
 
Back
Top