69 Commits (main)

Author SHA1 Message Date
anna 3910c85cac
x86/mm: fix __boot_clear_page 2 years ago
anna b4ed811920
mm: refactor page allocator
This is hopefully the last time in a while that
something in the mm subsystem needs a refactor
this large.  There are two main changes:
- The page frame allocator returns a vm_page_t
  rather than a virtual address.
- Data for the slab allocator is now stored in
  struct vm_page, which means there is no overhead
  in the slab itself so the space is used in a
  more efficient manner.
2 years ago
anna f8a85a1541
happy new year 2022 uwu
May it be slightly less exhausting than 2021.
2 years ago
anna 56767c59ed
x86/ktrace: improve traceability 2 years ago
anna 79033fbc8b
x86/mm: disable page caching in direct map 2 years ago
anna bd23d2cbc8
lib/x86: add fast memset family of functions 2 years ago
anna 205326bccd
x86: add GDT generator tool 3 years ago
anna c6c92ac39f
x86/trap: fix trap frame layout 3 years ago
anna 2e32e299d2
mm: rewrite slab allocator
This is the final part of the major mm subsystem
refactor (for now).  The new and improved slab
allocator can do *proper* poisoning, with pretty
accurate out-of-bounds and use-after-free
detection.
vm_page_t has also been restructured; its flags
and order are now combined into one atomic field.
3 years ago
anna 36d53093d4
ktrace: don't unwind past ISR entry points 3 years ago
anna 7f92690f84
panic: print stack trace when panicking 3 years ago
anna 385af1b7ef
mm: refactor page frame allocator
This is part 3 of the mm subsystem overhaul.
The allocator doesn't rely on mutexes anymore and
uses individual per-order spinlocks instead.
Also, it is aware of multiple memory zones (normal
and DMA) as well as emergency reserves.
Page bitmaps take up 50 % less overhead now.
3 years ago
anna 825a981d67
clist: make debugging better 3 years ago
anna c620f2ae34
x86: make -march configurable 3 years ago
anna d19e665d47
mm: generalize boot allocator
The boot page frame allocator is now architecture
independent.
This is part 2 of the mm subsystem refactor.
3 years ago
anna 7285c2e076
mm: refactor entire mm subsystem, part 1
Another one of those larger endeavours that take
multiple commits.  This first one introduces the
basic vm_page data structure, as well as the x86
bootstrap code for initializing it.
3 years ago
anna 2ace3d3505
port inttypes.h from FreeBSD 3 years ago
anna 5a5135f416
update license terms
As of now, everything except the code imported
from FreeBSD is proprietary.  Of course, it won't
be like this for long, only until we have decided
which license we like to use.  The rationale is
that releasing everything under a copyleft license
later is always easier than doing so immediately
and then changing it afterwards.
Naturally, any changes made before this commit are
still subject to the terms of the CNPL.
3 years ago
anna 52ac282ac8
x86: move common setup checks to shared file
This should also kind of fix the build.
I don't know whether that's actually the case
because i haven't tried tho lmao.
3 years ago
anna 24ae60225f
amd64: add base 64-bit support files
This has been brewing for quite some time now, and
it still is nowhere near finished, but at least it
compiles now.  A lot has changed, and it's still
quite messy (i386 is almost certainly broken now,
i haven't even checked)
3 years ago
anna eba1c83c2f
x86: add inline CPUID instruction 3 years ago
anna 637ac5ce92
x86/page: add page flagging functions 3 years ago
anna 14630c86bf
x86: remove unnecessary standalone port functions 3 years ago
anna a3941b6dc4
mm: minor page management refactor
This seems like a huge commit but it's really just
renaming a bunch of symbols.  The entire mm
subsystem is probably gonna have to go through
some major changes in the near future, so it's
best to start off with something that is not too
chaotic i guess.
3 years ago
anna 03f31df67f
x86: better separation for i386 specific code
That's it, nothing major is gonna happen anymore
until i get amd64 support working and deprecate
the entire i386 branch.  32-bit just adds so many
extra complications to memory management that i
don't want to waste any more energy on this
platform which is obsolete anyway.
3 years ago
anna ebce7b8e83
mutex: fix lock race conditions 3 years ago
anna 24c6e9504d
add kernel panic utility
This also includes some minor rearrangements in
terms of which header files define what.
3 years ago
anna abd9bb5d43
amd64/atom: fix typo 3 years ago
anna 38d9a9586d
smp: add base for SMP awareness 3 years ago
anna 6d0950501c
page: ensure early page mapping doesn't fail
Up to now, the page frame allocator's
initialization routine relied on the fact that
map_page() never needs to get new pages on i386 if
the mapped page is a hugepage.  This is not at all
true on other architectures, however.
3 years ago
anna c36b03d97c
mutex: avoid wait queue lock if possible
This also tidies up the atomic operations a little
and adds a new atom_cmp_xchg() as well as the same
APIs for longs and pointers.
3 years ago
anna 2b3eaf4ff7
mm: add basic slab allocator
This still needs some work and integration into
kmalloc() but hey i've tested it and it doesn't
immediately fall apart so why not commit it
3 years ago
anna 96378f019c
kmalloc: add shiny new buddy page frame allocator
This is still kind of a work in progress because
it will be the backend to a slab allocator, which
in turn is managed by kmalloc().
3 years ago
anna f0706b802b
boot: ignore unaddressable RAM areas on i386
We don't support PAE or any other fancy hack to
get past the 4 GB limit on 32-bit, so we have to
clip areas that would fall outside that range
3 years ago
anna 45ab27e738
x86/atom: add pause in spin loops 3 years ago
anna d464135ff4
x86: prevent IRQs from firing during init 3 years ago
anna 3fee893f21
x86: begin preparations for amd64 support
This is a huge commit, but it mainly just moves
some files around and doesn't change their
contents much.
A lot of stuff works the same on amd64 as it does
on i386, so i'm moving the parts that are specific
to the latter into separate subdirectories while
the rest can be shared with the amd64 codebase.
3 years ago
anna 4e770a6e58
x86/port: add delay wrappers for x86_io_wait() 3 years ago
anna 2a6dcf8c0c
x86/boot: enable Page Size Extensions
This single fucking bit is the reason 4MB pages
weren't working all along
3 years ago
anna c911ff9009
x86/mm: add huge page support
This is part of a series of commits where i
completely rewrite kmalloc() because it needs to
be able to return physically contiguous memory for
DMA operations.
Yes, i know the build isn't working right now.
3 years ago
anna 6865864444
x86/atom: use neg instead of not/inc
The x86 apparently has a dedicated instruction for
finding the 2's complement.
3 years ago
anna ea89961ed2
x86/atom: use correct names in asm, improve docs 3 years ago
anna 582758e868
x86: add atomic primitives 3 years ago
anna c3847487be
config: refactor kernel address mapping names 3 years ago
anna b2fccf1ecd
sched: add base for scheduling and task switching 3 years ago
anna 14e673b8dd
x86: fix page allocator once and for all 3 years ago
anna 65899b35f1
x86: minor page management refactor
Even Uranium-223 ages better than my code
3 years ago
anna e14bc3ce1e
x86: inline x86_io_wait() 3 years ago
anna 904584ccc0
libc: refactor a couple of string routines
This is just a minor overhaul of several utility
functions, in part because it kept bothering me
and in part because i was bored.
3 years ago
anna afbb3743d5
refactor type and cdefs headers 3 years ago