The Ridiculous NTFS.3G and big file write

-
I started noticing this issue recently when I used Ubuntu to copy large files - anything more than 600-700MB. When the copy started, it would start with good speed of about 25-30 MB/S, but then after about 300MB it would slow down and soon go into single digits. Also System Monitor would show kswapd0 popping up and bogging one core so that system performance would take critical hit. This would happen only when the source/destination was ntfs partition.
At first I thought kswapd0 to be the culprit since it was the one hogging the system. But after lots of google searches I found out ntfs.3g driver to be the culprit. What happens is that ntfs.3g driver - whatever version is available in kernel 4.4, allocates huge buffers and does not free them, so if you looked in top, you would see the buff/cache part of memory swelling to ridiculous sizes - in my case when copying 1GB file buff/cache swelled to 3.5GB (WTF!!!) from 500MB.
Anyway after trying a number of solutions below one is the one that worked for me:

while true; do echo 1 > /proc/sys/vm/drop_caches; sleep 5; done


I run this above script in a Sudo shell. It clears the cache every 5secs. It's not the best way, but it gives me responsible system with steady ntfs file copy speed of about 16MBps.

Cheers!!! 

Comments

Post a Comment

Popular posts from this blog

Morning Quotes

-
Image
Source: www.brainyquote.com   I may be drunk, Miss, but in the morning I will be sober and you will still be ugly. Winston Churchill   Prayer is the key of the morning and the bolt of the evening. Mohandas Gandhi   I look upon death to be as necessary to our constitution as sleep. We shall rise refreshed in the morning. Benjamin Franklin  
Read more

QCalendarWidget CSS Stylesheeting

-
Recently I had to implement a calendar for a TouchScreen application. I resorted to css to modify the calendar widget's appearance so that it would be more accessible. Following is the code that enabled me to get a proper calendar. calendar->setStyleSheet("QMenu { font-size:20px; width: 300px; left: 20px; }"     "QToolButton {icon-size: 48px, 48px; font: 20px; height: 70px; width: 100px; }"     "QAbstractItemView {selection-background-color: rgb(255, 174, 0);}"     "QToolButton::menu-indicator{ width: 50px;}"     "QToolButton::menu-indicator:pressed,"     "QToolButton::menu-indicator:open{ top:10px; left: 10px;}"     "QTableView { font: 30px; }"     "QSpinBox { width: 100px; font: 20px;}"     "QSpinBox::up-button { width:40px;}"     "QSpinBox::down-button { width:40px;}");
Read more

Selecting new phone plan

-
I use a Reliance Jio SIM as my one and only cellphone number. I used to have another, but I found little use for that. So I discontinued that other SIM card. It was a Vodafone SIM and I had bought it thinking I would be using it when I visit my hometown. Turns out it's not usable there. So adios. Coming back to Jio, it was working so far so good for a while. And it was quite cheap. Then they increased the fares about 4-5 months ago. And it was costing ~Rs 7 per day. This was for unlimited Jio-Jio calling, ~300minutes free to other telcos, and 1.5GB daily cellular data. Now I got home internet, so I thought to cut costs on this. The current plan goes for INR555 for 84 days. This includes 1.4GB 4G cellular data per day, 300 min calling to other telcos, and jio-jio free. That's Rs 6.6 per day. Now I'm not even using 30minutes calling per day. And due to home internet my cellular usage has gone down. So I decided to go for some other cheaper plan. This one is INR1299 for 336 da...
Read more