Run local models in Pi with llama.cpp — fully private, offline, and with no per-token cost. In this tutorial I show you how to install llama.cpp, pick the right GGUF model and quantization for your hardware using Hugging Face’s hardware compatibility feature, and download, load, and use the model directly from Pi with the `/llama` command. By the end you’ll have Qwen3 8B running locally as a coding agent, with no prompts, code, or data ever leaving your machine.
—
🔗 *Links*
– llama.app (llama.cpp installer + model recommendations): https://llama.app
– Qwen3.8 27B on Hugging Face (GGUF): https://huggingface.co/Qwen/Qwen3.8-27B
– Pi llama.cpp documentation: https://pi.dev/docs/latest/llama-cpp
– llama.cpp repository: https://github.com/ggml-org/llama.cpp
—
👋 *Connect with me*
– My website: https://alejandro-ao.com/
– X (Twitter): https://x.com/_alejandroao
– LinkedIn: https://www.linkedin.com/in/alejandro-ao/
—
🤓 *Topics Covered*
– Run local GGUF models in Pi with llama.cpp
– Choose the right quantization for your hardware
– Download and load models with Pi’s `/llama` command
—
⏱️ *Timestamps*
0:00 Intro — why local models in Pi
0:59 Install llama.cpp
1:49 Choose and load a model (Qwen3 8B)
5:24 Outro — hybrid local/cloud workflows
PyTorch Conference North America 2026 offers an excellent opportunity to connect with researchers, developers, and AI engineers from around the world.
In this video, Arun Bhandari, PyTorch Foundation Ambassador and leader of PyTorch Community Nepal, shares why he is excited to connect with the community and explore the latest developments in PyTorch.
Register here to join us in San Jose, CA this October 20-21: https://hubs.la/Q04v88dJ0
Video by CNCF [Cloud Native Computing Foundation] via YouTube
Join CNCF Ambassador Thomas Schuetz as he explores SlimFaas for the first time in this interactive ChatLoopBackOff session. Guided by project maintainer Guillaume Chervet, this unscripted, demo highlights how to simplify serverless workloads using pure open source technology. You will gain a practical understanding of how SlimFaas fits into the modern cloud native landscape to reduce infrastructure overhead and streamline function execution.
George Kichukov (Field CTO at GitLab) and Michael Long (CEO at Kosli) present the Open SDLC Controls Framework, an open-source industry project developed within FINOS. They address the massive inefficiency of banks independently building, maintaining, and defending redundant SDLC policies to auditors and regulators. This session breaks down how financial institutions like Morgan Stanley, Deutsche Bank, NatWest, and major Canadian banks are collaborating to build a standardized, open catalog of SDLC controls, risk mappings, and automated evidence mechanisms.
🗽 Catch Us in New York! Ready to streamline software governance, eliminate developer friction, and standardize SDLC compliance?
Join global technology leaders at OSFF New York on November 4–5, 2026.
🎟️ Register Now: https://hubs.ly/Q04n_bZL0
🔥 20% OFF DISCOUNT CODE: 26YTOSFFNY20C
🕒 Timestamps:
0:00 Introduction & Speaker Backgrounds (Kosli & GitLab)
0:57 What Are SDLC Controls & Why Do They Exist?
2:36 Concrete Example: Code Reviews, Separation of Duties & AI-Generated Code
3:56 Regulatory Ambiguity: OSFI, SOC 2, and Non-Prescriptive Rules
4:30 Mapping Controls Back to Specific Risks & Mitigations
5:27 How SDLC Controls Are Created & Operationalized Today
6:45 The Problem: Redundant Island Engineering Across Financial Institutions
8:03 Terminology Chaos: Standardizing Separation of Duties & Peer Reviews
9:03 The Solution: An Open Industry SDLC Control Catalog in FINOS
10:00 Active Community Contributors (Morgan Stanley, Deutsche Bank, NatWest)
11:53 Audience Q&A: Evolving from Text Policies to Automated Evidence & Code
13:39 Audience Q&A: Aligning SDLC Control Frameworks with AI Governance
15:03 Audience Q&A: Addressing Regulatory Vagueness with Industry Consensus
17:03 Audience Q&A: Distributing & Socializing the Open Framework
📊 The Problem: The High Cost of Isolated Control Engineering
Every bank, insurance carrier, and financial institution currently solves software compliance in isolation. Engineering, risk, and platform teams spend thousands of hours in meetings interpreting vague, non-prescriptive regulations (such as OSFI in Canada, NIST, or SOC 2) and defending their custom control implementations to internal and external auditors. Furthermore, inconsistent terminology (e.g., "separation of duties" vs. "code review") and overly restrictive manual gates introduce severe developer friction, slowing down delivery pipelines without measurably improving security.
🏗️ The Solution: The FINOS Open SDLC Controls Catalog
Inspired by the FINOS AI Governance Framework, the Open SDLC Controls Framework provides a standardized, open-source reference library: Common Taxonomy & Risk Mapping: Establishes a unified vocabulary across financial engineering. Every control in the catalog explicitly maps back to specific risk categories—operational, reliability, cybersecurity, insider threat, quality, and regulatory compliance. Pre-Defined Mitigations & Evidence Standards: Defines clear mitigation steps and standardizes the exact evidence artifacts required to prove compliance, preparing teams for automated evidence collection. Industry Alignment: Created in collaboration with major financial institutions (Morgan Stanley, Deutsche Bank, NatWest, Canadian banks) and DevOps vendors (GitLab, Kosli) to ensure broad regulatory and audit acceptance.
⚙️ Why This Matters for Financial EngineeringRemoving Developer Friction:
Replaces clumsy, manual approval gates with well-defined, automated control specifications that integrate directly into modern CI/CD pipelines. Unified Regulatory Voice: Gives financial institutions a defensible, industry-backed framework to present during regulatory audits, eliminating the need to repeatedly re-justify standard DevSecOps practices.
🌐 More about FINOS: https://www.finos.org/
📧 Join our newsletter: https://www.finos.org/sign-up
🎙️ Listen to our Open Source in Finance Podcast: https://www.youtube.com/@FINOS/podcasts
LinkedIn: https://www.linkedin.com/company/finosfoundation
Support us on Patreon and get an ad-free RSS feed with some early episodes. https://www.patreon.com/LateNightLinux
Audacity’s new major release makes it more like a proper digital workstation, Debian finally gets off the genAI fence and disappoints some of us, California exempts Linux from terrible age verification laws, and Asahi boots on M3 Macs. With guest host Shane from Hybrid Cloud Show.
Racing driver Jamie Chadwick on how she moved from perfectionism to
practicing stoicism, and why letting go of the small stuff sharpens
her focus on the track.
In this Short from Episode 4 of Significant Figures, three-time W Series Champion and Indy NXT race winner Jamie Chadwick joins Ariana Bravo and Jason Bell to unpack her story through the numbers that shaped her career.
CERN is moving more than 2,200 accelerator-control computers to Debian 13 after newer CPU requirements made staying in the Red Hat ecosystem increasingly expensive. The migration is limited to accelerator front-end systems rather than CERN’s entire computing infrastructure.
MacBreak Weekly covers all things Apple: Leo, Andy Ihnatko, Jason Snell, and Christina Warren analyze every bit of news from the most interesting company in tech. From AI to Vision Pro, iPad to iPhone, these Apple experts know-all and tell-all.
You can find more about TWiT.tv and subscribe to our full shows at https://podcasts.twit.tv
Join our community at Club TWiT: https://twit.tv/clubtwit
About us:
TWiT.tv is a technology podcasting network located in the San Francisco Bay Area with the #1 ranked technology podcast This Week in Tech hosted by Leo Laporte. Every week we produce over 30 hours of content on a variety of programs including Tech News Weekly, MacBreak Weekly, Windows Weekly, Security Now, Intelligent Machines, and more.
Get Theme Studio – Massive Introductory Discount
https://payhip.com/LinuxTex
Omarchy 4 is one of the most impressive Linux desktops I have ever used. But it ships with yay, the AUR helper, pre-installed by default. And the Arch User Repository just went through the worst security crisis in its history. So I ran the commands and checked exactly what my Omarchy install was actually trusting, and the answer genuinely surprised me.
In this video I break down the 2026 AUR malware attacks, what the malware actually stole, whether Omarchy 4 (Quattro) uses AUR packages out of the box, the hidden AUR stage inside the Omarchy updater, and why I ended up removing yay from my own machine while still keeping Omarchy as my daily driver.
To be clear up front: Omarchy itself is safe. This video is about the AUR, and about what you choose to install on top of a perfectly good Arch-based distro.
WHAT I COVER IN THIS VIDEO
– What the AUR (Arch User Repository) actually is, and why it is not a vetted, verified app store
– The orphan adoption exploit that let attackers take over real packages with real names and real users
– Around 1,500 AUR packages poisoned across multiple waves, stealing SSH keys, GitHub credentials, browser cookies, Slack and Discord data
– Arch fighting back: closed account registrations, disabled package adoption, and a full ten day freeze on all AUR uploads
– The xsnow package poisoned through a legitimate co-maintainer, with the payload hidden in .install files instead of the PKGBUILD everyone tells you to read
– hyprland-fixes: a brand new malicious package named after the compositor Omarchy actually runs on
– Testing my own system with pacman -Qm to list every foreign package, and what actually came back
– The four repositories Omarchy really pulls from: core, extra, multilib and omarchy
– Why being based on Arch does not mean Omarchy installs packages from the AUR
– The hidden catch: the AUR stage inside omarchy update, and why every future update to an AUR package is code you are trusting sight unseen
– Why Omarchy Stable is a reliability buffer and not an AUR malware quarantine
– What meaningful package review actually takes, and why reading the PKGBUILD is not enough
– Why I removed yay, and why that is not the same thing as disabling the AUR
– Why I now stick to official stores, official websites, official GitHub repos, and Flatpak with verified publishers and sandboxing
SUPPORT THE CHANNEL
If you found this useful, hit the thumbs up and subscribe for more Linux desktop reviews, distro deep dives and Linux security breakdowns.
TOPICS COVERED
omarchy, omarchy 4, omarchy quattro, is omarchy safe, omarchy review, omarchy linux, arch linux, arch user repository, aur, aur malware, aur hacked, aur security, aur malware attack 2026, yay aur helper, remove yay, pacman -Qm, foreign packages arch, hyprland, hyprland-fixes malware, xsnow malware, pkgbuild security, linux supply chain attack, linux malware, linux security, arch linux security, flatpak vs aur, flatpak sandboxing, dhh omarchy, hyprland desktop, linux desktop 2026
We use cookies on our website to give you the most relevant experience by remembering your preferences and repeat visits. By clicking “Accept All”, you consent to the use of ALL the cookies. However, you may visit "Cookie Settings" to provide a controlled consent.
This website uses cookies to improve your experience while you navigate through the website. Out of these, the cookies that are categorized as necessary are stored on your browser as they are essential for the working of basic functionalities of the website. We also use third-party cookies that help us analyze and understand how you use this website. These cookies will be stored in your browser only with your consent. You also have the option to opt-out of these cookies. But opting out of some of these cookies may affect your browsing experience.
Necessary cookies are absolutely essential for the website to function properly. These cookies ensure basic functionalities and security features of the website, anonymously.
Cookie
Duration
Description
cookielawinfo-checkbox-analytics
11 months
This cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Analytics".
cookielawinfo-checkbox-functional
11 months
The cookie is set by GDPR cookie consent to record the user consent for the cookies in the category "Functional".
cookielawinfo-checkbox-necessary
11 months
This cookie is set by GDPR Cookie Consent plugin. The cookies is used to store the user consent for the cookies in the category "Necessary".
cookielawinfo-checkbox-others
11 months
This cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Other.
cookielawinfo-checkbox-performance
11 months
This cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Performance".
viewed_cookie_policy
11 months
The cookie is set by the GDPR Cookie Consent plugin and is used to store whether or not user has consented to the use of cookies. It does not store any personal data.
Functional cookies help to perform certain functionalities like sharing the content of the website on social media platforms, collect feedbacks, and other third-party features.
Performance cookies are used to understand and analyze the key performance indexes of the website which helps in delivering a better user experience for the visitors.
Analytical cookies are used to understand how visitors interact with the website. These cookies help provide information on metrics the number of visitors, bounce rate, traffic source, etc.
Advertisement cookies are used to provide visitors with relevant ads and marketing campaigns. These cookies track visitors across websites and collect information to provide customized ads.
