Lunduke
News • Science & Tech
Make Computers Fun Again - Linux, UNIX, Alternative Operating Systems, Computer History, and Retro Computing. Also dad jokes.
Interested? Want to learn more about the community?
September 19, 2022

I got a mad idea, and I blame DOS week for. The background for this is special_snowflake, the FOSH computer I've been building/writing for the last 5 years. Without going into all the details (because then I'll be here for two days), its new CPU is registerless and directly reads and writes into main memory for all instructions. To make it performant, the "main memory" is 0.5-8 KiB is size and treats the actual RAM as expanded memory, copying bits of it in and out. Like a disk. Now, that leaves me with the question of organization of this expanded memory. I decided I won't go the normal route and I won't implement a virtual memory system. Which leaves me with the question of what to do.

And then it occured to me yesterday. What IF you treated your expanded memory as a literral disk and put FAT on it? To allocate memory, processes create a file of some size. Processes can pass memory objects to each other by passing filesystems paths around. All memory objects are dynamically sized. Some implementations of FAT (DR-DOS 6.0 and others) track user&group ID as well as access permissions for them. You could literally implement the well-understood-by-sysadmins Unix filesystem permissions model for all memory! Super important: a single categorization unites ALL of memory which means ALL of memory is always accounted for. Modern systems have all kinds of weird kinks. Inodes, sysfs, procfs, netlink, ioctl, device nodes, semaphores, muliple kinds of sockets, multiple namespaces for all those kinds of sockets, acl, quotas, memory maps, process trees, uids and guids, mounts, etc, etc... If you put all of those into a filesystem, you suddenly make them all observable and manipulable. Another benefit: it's now possible to dump the entire contents of memory to real disks and examine them or change them. Messing with system internals is now easier than ever! And the best part? Both the running memory and the disk image of it can be manipulated with normal filesystem tools!

This can be made to play real nice in a microkernel design with lots of system daemons offering services. I already checked the extensive Wikipedia article on FAT and I found that it practically nativelly supports being used for this purpose. You would need to repurpose some fields from what Microsoft uses them for, but this is a long and time-honoured tradition. The article (linked below) lists several mutually incompatible standards for various data structures that were all used in parallel by several operating systems from several vendors.

Besides breaking the Microsoft's non-standard on FAT, there are two other problems I can see. The first is that my CPU is big-endian and FAT is used on little-endian machines which means the multi-octet fields will be messed up. That can be lived with - this will only come into effect if somebody attempted to mount the memory image on a little-endian machine, but that can be fixed by the appropriate filesystem driver.

The much bigger problem - and the only serious problem I've so far seen - is that FAT keeps track of file contents in a singly linked list. That's.... inapropriate for quick access. :) Since the use of this scheme implies there is only one daemon which manages the memory filesystem for all other applications, and since this is the only place where file handles (or whatever) is handed out, this limitation can be worked around. The filesystem daemon could keep a special structure for all open files/assigned file handles which has a map to all clusters that are part of the file. So if you want to randomly access parts of a large file, the FS daemon doesn't have to read the entire FAT from the start, it can just read from its map. But the problem is that, since this is a memory management scheme, most files can be expected to be open. Which would mean most files would have an associated fast-access map. But then the question is why have the FAT, if most access is going through the map?

Another mitigation strategy is to take care to have the memory defragmented, and then try to assign memory in large contiguous blocks of clusters. That way, if the random access happens inside such a large block, working out the sector (=page) that is to be accessed should be straightforward. The access map cache from the previous paragraph then only needs to keep track of starts and lenghts of blocks. The scheme is simpler, requires less overhead, and should benefit from the last four decades (!) of improvements to FAT drivers and algorithms.

This manage-memory-as-a-filesystem idea can BTW also be implemented on normal registered CPUs, by having some pages (in the reserved section between the sector 0 and the first FAT table xD ) function as faux main memory for currently running processes and the rest used in the FAT.

Wikipedia page on FAT: https://en.wikipedia.org/wiki/Design_of_the_FAT_file_system

Interested? Want to learn more about the community?
What else you may like…
Videos
Podcasts
Posts
Articles
December 19, 2024
ChatGPT Can Not Say "Bryan Lunduke"

Move over David Mayer, Lunduke joins the list of names which OpenAl will not display. Here's how this was accomplished.

00:22:23
December 19, 2024
Mozilla Executive Pay Doubles as Loss of 80% of Revenue Looms

"Mozilla has shifted much of its work toward Al" as funds directed towards African "Digital Justice", "Queer Youth Inclusion", & "Digital Activism for Young Feminists".

00:25:04
December 17, 2024
Wordpress Contributors Must Now Agree That "Pineapple is Delicious on Pizza'

The Wordpress v. WP Engine legal battle just took a detour into... food.

00:05:57
November 22, 2023
The futility of Ad-Blockers

Ads are filling the entirety of the Web -- websites, podcasts, YouTube videos, etc. -- at an increasing rate. Prices for those ad placements are plummeting. Consumers are desperate to use ad-blockers to make the web palatable. Google (and others) are desperate to break and block ad-blockers. All of which results in... more ads and lower pay for creators.

It's a fascinatingly annoying cycle. And there's only one viable way out of it.

Looking for the Podcast RSS feed or other links? Check here:
https://lunduke.locals.com/post/4619051/lunduke-journal-link-central-tm

Give the gift of The Lunduke Journal:
https://lunduke.locals.com/post/4898317/give-the-gift-of-the-lunduke-journal

The futility of Ad-Blockers
November 21, 2023
openSUSE says "No Lunduke allowed!"

Those in power with openSUSE make it clear they will not allow me anywhere near anything related to the openSUSE project. Ever. For any reason.

Well, that settles that, then! Guess I won't be contributing to openSUSE! 🤣

Looking for the Podcast RSS feed or other links?
https://lunduke.locals.com/post/4619051/lunduke-journal-link-central-tm

Give the gift of The Lunduke Journal:
https://lunduke.locals.com/post/4898317/give-the-gift-of-the-lunduke-journal

openSUSE says "No Lunduke allowed!"
September 13, 2023
"Andreas Kling creator of Serenity OS & Ladybird Web Browser" - Lunduke’s Big Tech Show - September 13th, 2023 - Ep 044

This episode is free for all to enjoy and share.

Be sure to subscribe here at Lunduke.Locals.com to get all shows & articles (including interviews with other amazing nerds).

"Andreas Kling creator of Serenity OS & Ladybird Web Browser" - Lunduke’s Big Tech Show - September 13th, 2023 - Ep 044
post photo preview

Sunday Sounds, because it's Sunday somewhere.

Apostrophe(') was not Frank Zappa's first album. Over the years, he did many albums in many different styles. Always the comedian, but so talented and his band, The Mothers of Invention were fantastic. This is a great place to introduce a newby to Frank's work. This is also my number one album to test a new stereo system or component.

Frank Zappa - Apostrophe(')

https://www.youtube.com/playlist?list=OLAK5uy_mug91Ew3YKUFXp5wOeFKayvtsdrg82U8s

post photo preview
December 20, 2024
post photo preview
Funny Programming Pictures Part LXVII
More funny, nerdy pictures than you can [idiom for large quantity understandable by humans]

There are XXXIX pictures in part LXVII of "Funny Programming Pictures".

IX out of X people reading that sentence just googled "Roman Numeral Converter".

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

Read full Article
December 18, 2024
The real "Year of The Linux Desktop"...
Read full Article
December 16, 2024
Lunduke's Quest - December 16, 2024
Read full Article
See More
Available on mobile and TV devices
google store google store app store app store
google store google store app tv store app tv store amazon store amazon store roku store roku store
Powered by Locals