{"id":33065,"date":"2024-05-06T19:32:37","date_gmt":"2024-05-06T19:32:37","guid":{"rendered":"https:\/\/www.linuxboxen.dk\/?page_id=33065"},"modified":"2025-01-28T18:08:13","modified_gmt":"2025-01-28T18:08:13","slug":"kor-ai-lokalt-pa-din-linux-box","status":"publish","type":"page","link":"https:\/\/www.linuxboxen.dk\/?page_id=33065","title":{"rendered":"K\u00f8r AI lokalt p\u00e5 din linux box."},"content":{"rendered":"\n<p>Ja du l\u00e6ste rigtigt.<br><br>Du kan nu k\u00f8re AI p\u00e5 din egen Linux box med lidt magic, men det kr\u00e6ver du har et nvidia kort i pc&#8217;en.<br>For at f\u00e5 det til at virke skal du installere et tool fra ollamna.com<br>Hvis du f\u00f8lger denne guide er du hurtigt igang.<br><br>F\u00f8rst install af tool.<br>$ <code><strong>c<\/strong>url -fsSL https:\/\/ollama.com\/install.sh | sh<\/code><br>Installing ollama to \/usr\/local\/bin\u2026<br>[sudo] password for user:<br>Creating ollama user\u2026<br>Adding ollama user to render group\u2026<br>Adding ollama user to video group\u2026<br>Adding current user to ollama group\u2026<br>Creating ollama systemd service\u2026<br>Enabling and starting ollama service\u2026<br>Created symlink \/etc\/systemd\/system\/default.target.wants\/ollama.service \u2192 \/etc\/systemd\/system\/ollama.service.<br><br><code>$ ollama pull llama2<\/code><br>pulling manifest<br>pulling 8934d96d3f08\u2026 100% &#8211; 3.8 GB<br>pulling 8c17c2ebb0ea\u2026 100% &#8211; 7.0 KB<br>pulling 7c23fb36d801\u2026 100% &#8211; 4.8 KB<br>pulling 2e0493f67d0c\u2026 100% &#8211; 59 B<br>pulling fa304d675061\u2026 100% &#8211; 91 B<br>pulling 42ba7f8a01dd\u2026 100% &#8211; 557 B<\/p>\n\n\n\n<p>Det er nogle store filer. <\/p>\n\n\n\n<p><code>$ ollama run llama2<\/code><\/p>\n\n\n\n<p>Fuck det er vildt det her. Min egen AI <br>Pr\u00f8v at sp\u00f8rge den om hvad iron\/jern er.<br><br>Du kan ogs\u00e5 k\u00f8re den nye kina model som er kommet ud den hedder <a href=\"https:\/\/www.deepseek.com\/\">deepseek<\/a>. <br>Den installeres med denne kommando og du er igang.<br><br>$ <code>ollama run <\/code>deepseek-r1<br>pulling manifest <br>pulling 96c415656d37\u2026 100% 4.7Gb<br>osv&#8230;<br>Use Ctrl + d or \/bye to exit.<br>>>> Send a message (\/? for help)<br><\/p>\n\n\n\n<p><br><\/p>\n\n\n\n<p><br><br><br><br><\/p>\n\n\n\n<p><\/p>\n<div class=\"pvc_clear\"><\/div><p id=\"pvc_stats_33065\" class=\"pvc_stats all  \" data-element-id=\"33065\" style=\"\"><i class=\"pvc-stats-icon medium\" aria-hidden=\"true\"><svg aria-hidden=\"true\" focusable=\"false\" data-prefix=\"far\" data-icon=\"chart-bar\" role=\"img\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" viewBox=\"0 0 512 512\" class=\"svg-inline--fa fa-chart-bar fa-w-16 fa-2x\"><path fill=\"currentColor\" d=\"M396.8 352h22.4c6.4 0 12.8-6.4 12.8-12.8V108.8c0-6.4-6.4-12.8-12.8-12.8h-22.4c-6.4 0-12.8 6.4-12.8 12.8v230.4c0 6.4 6.4 12.8 12.8 12.8zm-192 0h22.4c6.4 0 12.8-6.4 12.8-12.8V140.8c0-6.4-6.4-12.8-12.8-12.8h-22.4c-6.4 0-12.8 6.4-12.8 12.8v198.4c0 6.4 6.4 12.8 12.8 12.8zm96 0h22.4c6.4 0 12.8-6.4 12.8-12.8V204.8c0-6.4-6.4-12.8-12.8-12.8h-22.4c-6.4 0-12.8 6.4-12.8 12.8v134.4c0 6.4 6.4 12.8 12.8 12.8zM496 400H48V80c0-8.84-7.16-16-16-16H16C7.16 64 0 71.16 0 80v336c0 17.67 14.33 32 32 32h464c8.84 0 16-7.16 16-16v-16c0-8.84-7.16-16-16-16zm-387.2-48h22.4c6.4 0 12.8-6.4 12.8-12.8v-70.4c0-6.4-6.4-12.8-12.8-12.8h-22.4c-6.4 0-12.8 6.4-12.8 12.8v70.4c0 6.4 6.4 12.8 12.8 12.8z\" class=\"\"><\/path><\/svg><\/i> <img loading=\"lazy\" decoding=\"async\" width=\"16\" height=\"16\" alt=\"Loading\" src=\"https:\/\/www.linuxboxen.dk\/wp-content\/plugins\/page-views-count\/ajax-loader-2x.gif\" border=0 \/><\/p><div class=\"pvc_clear\"><\/div>","protected":false},"excerpt":{"rendered":"<p>Ja du l\u00e6ste rigtigt. Du kan nu k\u00f8re AI p\u00e5 din egen Linux box med lidt magic, men det kr\u00e6ver du har et nvidia kort i pc&#8217;en.For at f\u00e5 det til at virke skal du installere et tool fra ollamna.comHvis du f\u00f8lger denne guide er du hurtigt igang. F\u00f8rst install af tool.$ curl -fsSL https:\/\/ollama.com\/install.sh [&hellip;]<\/p>\n<div class=\"pvc_clear\"><\/div>\n<p id=\"pvc_stats_33065\" class=\"pvc_stats all  \" data-element-id=\"33065\" style=\"\"><i class=\"pvc-stats-icon medium\" aria-hidden=\"true\"><svg aria-hidden=\"true\" focusable=\"false\" data-prefix=\"far\" data-icon=\"chart-bar\" role=\"img\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" viewBox=\"0 0 512 512\" class=\"svg-inline--fa fa-chart-bar fa-w-16 fa-2x\"><path fill=\"currentColor\" d=\"M396.8 352h22.4c6.4 0 12.8-6.4 12.8-12.8V108.8c0-6.4-6.4-12.8-12.8-12.8h-22.4c-6.4 0-12.8 6.4-12.8 12.8v230.4c0 6.4 6.4 12.8 12.8 12.8zm-192 0h22.4c6.4 0 12.8-6.4 12.8-12.8V140.8c0-6.4-6.4-12.8-12.8-12.8h-22.4c-6.4 0-12.8 6.4-12.8 12.8v198.4c0 6.4 6.4 12.8 12.8 12.8zm96 0h22.4c6.4 0 12.8-6.4 12.8-12.8V204.8c0-6.4-6.4-12.8-12.8-12.8h-22.4c-6.4 0-12.8 6.4-12.8 12.8v134.4c0 6.4 6.4 12.8 12.8 12.8zM496 400H48V80c0-8.84-7.16-16-16-16H16C7.16 64 0 71.16 0 80v336c0 17.67 14.33 32 32 32h464c8.84 0 16-7.16 16-16v-16c0-8.84-7.16-16-16-16zm-387.2-48h22.4c6.4 0 12.8-6.4 12.8-12.8v-70.4c0-6.4-6.4-12.8-12.8-12.8h-22.4c-6.4 0-12.8 6.4-12.8 12.8v70.4c0 6.4 6.4 12.8 12.8 12.8z\" class=\"\"><\/path><\/svg><\/i> <img loading=\"lazy\" decoding=\"async\" width=\"16\" height=\"16\" alt=\"Loading\" src=\"https:\/\/www.linuxboxen.dk\/wp-content\/plugins\/page-views-count\/ajax-loader-2x.gif\" border=0 \/><\/p>\n<div class=\"pvc_clear\"><\/div>\n","protected":false},"author":1,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"open","ping_status":"closed","template":"","meta":{"_sitemap_exclude":false,"_sitemap_priority":"","_sitemap_frequency":"","footnotes":""},"class_list":["post-33065","page","type-page","status-publish","hentry"],"_links":{"self":[{"href":"https:\/\/www.linuxboxen.dk\/index.php?rest_route=\/wp\/v2\/pages\/33065","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.linuxboxen.dk\/index.php?rest_route=\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/www.linuxboxen.dk\/index.php?rest_route=\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/www.linuxboxen.dk\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.linuxboxen.dk\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=33065"}],"version-history":[{"count":25,"href":"https:\/\/www.linuxboxen.dk\/index.php?rest_route=\/wp\/v2\/pages\/33065\/revisions"}],"predecessor-version":[{"id":33197,"href":"https:\/\/www.linuxboxen.dk\/index.php?rest_route=\/wp\/v2\/pages\/33065\/revisions\/33197"}],"wp:attachment":[{"href":"https:\/\/www.linuxboxen.dk\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=33065"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}