Playing with AI

-
So we have gone on an AI bandwagon. Turns out AI in agent mode can be
tremendous help in generating code and documentation. Prompt AI is
good only for handling small problems but agent can integrate with
IDEs and increase productivity by a few times.
The next frontier is locally running AI and so this way one is free
from AI provider plans and the only cost is for electricity and
hardware. Now a good AI system needing a bunch of AI chips is still
costly. But the control could be worth it.
For an experiment I started on my now 10 year old Blue Lenovo laptop
with Pentium B950. This processor is so old that it does not support
AVX2 and so can not really do anything. I can still use this for
coding. Actually the bootup was way slow at about 2 mins. But with
generous help from chatgpt I was able to bring it down to a minute
which is quite good. I also removed a bunch of unneeded things thus
making it quite faster to work too.
So my goal is to use my new laptop with windows to host the AI. I see
that it can run a decent good model like codellama-7b-instruct. Then I
can figure out on how to let my coding machine talk to this hosted AI.
Hopefully I can run this in complete offline mode and see how good it
is. Maybe it needs online help for search, and I should be able to
configure something.
But that's the goal and a way to use AI at cheap. Otherwise cursor,
trae etc AI agents work great but the cost is something I don't want
to pay. Well, that's life. Something interesting going on. Cheers!!

Comments

Post a Comment

Popular posts from this blog

Morning Quotes

-
Image
Source: www.brainyquote.com   I may be drunk, Miss, but in the morning I will be sober and you will still be ugly. Winston Churchill   Prayer is the key of the morning and the bolt of the evening. Mohandas Gandhi   I look upon death to be as necessary to our constitution as sleep. We shall rise refreshed in the morning. Benjamin Franklin  
Read more

QCalendarWidget CSS Stylesheeting

-
Recently I had to implement a calendar for a TouchScreen application. I resorted to css to modify the calendar widget's appearance so that it would be more accessible. Following is the code that enabled me to get a proper calendar. calendar->setStyleSheet("QMenu { font-size:20px; width: 300px; left: 20px; }"     "QToolButton {icon-size: 48px, 48px; font: 20px; height: 70px; width: 100px; }"     "QAbstractItemView {selection-background-color: rgb(255, 174, 0);}"     "QToolButton::menu-indicator{ width: 50px;}"     "QToolButton::menu-indicator:pressed,"     "QToolButton::menu-indicator:open{ top:10px; left: 10px;}"     "QTableView { font: 30px; }"     "QSpinBox { width: 100px; font: 20px;}"     "QSpinBox::up-button { width:40px;}"     "QSpinBox::down-button { width:40px;}");
Read more

[Qt] Compiling ICU with MSVC (Microsoft Visual Studio)

-
Link to original article: http://qt-project.org/wiki/Compiling-ICU-with-MSVC Text highlighted and notes added Compiling ICU with MSVC (Microsoft Visual Studio)     Qt 5 / QtWebkit requires ICU.         Pre-built packages     The ICU Project site [ site.icu-project.org ] provides pre-built packages for MSVC 2010, which should work with compilers too. Anyhow, you have to compile your own version if you want to avoid the MSVC 2010 runtime dependency (because you’re using another MSVC version), or want to tailor the ICU configuration.     download.qt-project.org [ download.qt-project.org ] also hosts packages for MSVC 2012 .        
Read more