How can I quickly "unclog" firefox when it runs out of memory (with 1000/2000 tabs)

interdimensionalmeme@lemmy.ml to Firefox@lemmy.ml – 34 points – firefox memory clog
youtu.be

Hi, Once in a while I try to clean up my tabs. First thing I do is use "merge all windows" to put all tabs into one window.

This often causes a memory clog and firefox get stuck in this state for 10-20 minutes

I have recorded one such instance.

I have tried using the "discard all tabs" addon, unfortunately, it is also getting frozen by the memory clog.

Sometimes I will just reboot my PC as that is faster.

Unfortunately, killing firefox this way, does not save the new tab order, so when I start firefox again, it will have 20+ windows open, which I again, merge all pages and then it clogs again !

So far the only solution I have found is just wait the 20 minutes.

Once the "memory clog" is passed, it runs just fine.

I would like better control over tab discard. and maybe some way of limitting bloat. For instance, I would rather keep a lower number of undiscarded youtube that as they seem to be insanely bloated.

In other cases, for most website I would like to never discard the contents.

In my ideal world, I would like the tabs to get frozen and saved to disk permanently, rather than assuming discard tabs can be reloaded. As if the websites were going to exist forever and discarding a tab is like cleaning a cache.

152

Maybe don’t have a THOUSAND tabs

I will, not, do that.

Then you will have software that doesn’t work. This is not a Firefox problem, or a problem of extensions, or anything but a user problem.

If your 1998 Toyota Camry is struggling to haul a cargo container up a hill it’s not the car’s fault. You’re doing it wrong. Whatever tasks you’re trying to do with 1000 tabs, a web browser is the wrong tool for the job.

I'm using the wrong tool in the wrong way and won't stop!!!

Help me!!!

ROFL...

You're not likely going to get any real help since you're insisting on using the browser in an extreme and unconventional way. Your little world is just one browser/OS crash from losing all of those tabs.

What is amazing to me is how some people will come out of the woodwork to tell a person when they think they're using their browser "wrong". Just let them be if you have nothing to contribute.

If someone is trying to achieve a goal through (what they might not know are) impossible means, "letting them be" isn't going to help them.

Although it might not seem very helpful (and indeed there are better ways of helping) pointing out the flaws in the approach is contributing more than "letting them be". Doesn't cost a thing to be civil about it though.

What OP is trying to do isn't impossible it's actually very interesting. There are lots of people who use tab workflows instead of bookmarks. And I think everybody would benefit from better in-browser search. Just because bookmarks is how it was done 30 years ago doesn't mean we can't try new things.

Unless you bring a solution to the table, taking the position that it isn't impossible is just cheap contrarianism on your part. Sure we can try new things, but if it doesn't work and everyone is commenting the approach isn't helping, then maybe take the hint. Or not, and keep swimming against the stream (in which - seeing OP's other comments - they seem to be more interested than actually solving the problem)

Why would it be impossible to search through tab content if it's available in memory?

That's not how it works. Right now the situation is: it doesn't work. You claim it should be a workable situation. Show how it should work, don't ask people to prove a negative.

You dream to small Bookmarks suck and are cumbersome They sucked in 1996 and they still suck today ! Bookmarks have apparently been a crutch to make the browser more usable. Like for instance, instead of discarding a whole tab, keep a text index of the html body and make that searchable. But no, it's an all of nothing thing, either 2gb of youtube javascript per tab, or we only keep URL and tab title.

Also, you don't actually need to bring a solution to the table just to say "this thing is not working right" You don't have to be a mechanic to say "the car is broken" You don't have to be a doctor to say "this person is sick"

Clearly my message just need to be said over and over until it gets implemented. It is obvious where browsers are going. A total web awareness platform that remembers everything you've ever seen. There will be infinite tabs and a local llm will know it all 7 ways from sunday "Firefox, write a song about the 500 first tabs I've seen in June 2017, in the style of a broadway musical"

The resulting song would be useless to everyone, including you. In the hypothetical eventuality where what you're asking for is implemented, only a tiny minority of the tabs you've collected will be of the slightest usefulness to you, ever. Fundamentally, why did you ever open a given tab in the first place? In the case where you ever need to recall it, it will be trivial to open it again in a fresh browser session. You acknowledge googling is easier than managing bookmarks in these volumes, and you're right. That's what you should do. Your current approach is simply hoarding.

You are objectively using it wrong. Its is like asking how to make your minivan break the sound barrier because you want to get to work faster.

They ARE contributing, in this case the correct answer is "don't do that"...

Feel free to use your browser how you want, but I will feel free to not help you troubleshoot your problem because it won't help you in the end.

I'm not going to tell you that you're managing your information wrong. I would physically die if I had ever more than 20 tabs (my ADHD couldn't handle it).

But I think you might be using the wrong tool. A browser (like Firefox) is not really designed as an information manager. It's primary purpose is navigating and visualizing web pages. So when you talk about "a few megabytes of text and images" thats not what your browser sees. Your browser handles more than just the text and images. It also handles fetching and prefetching, a browser history for every tab, a JS context and much much more.

What you want is some kind of personalized archiving system that processes websites into machine processable (ie searchable) structures. Firefox is not that. Maybe data hoarder communities will have the answers you seek.

Well so far, it would be too much friction and extra labour to export each tab to external software.

I'm not even sure what software other than a browser would display live web pages in a more organized manner than firefox ?

I'm pretty sure I just hit a bug that's causing firefox to wake up too many tabs and not handle tab discarding correctly. Firefox does seem like the best tool still even if it's not working right.

What I would like instead is a browser that treats tabs more like virtual machines that you can roll back, suspend to disk and resume. Little package of data that get frozen in time and are externally searchable.

Anyway, here's my setup

What I would like instead is a browser that treats tabs more like virtual machines that you can roll back, suspend to disk and resume. Little package of data that get frozen in time and are externally searchable.

Maybe look at ArchiveBox. IIRC it has pretty much everything you ask for including an import from your browser history and bookmarks.

The solution is to see a psychotherapist because dude is there something strange happening in your brain and it really needs fixing.

I think the machine built to handle hundreds of trillions of operation per second should be better at handling a few gigabytes of text and images.

Fuck, you're welcome to create your own web browser if it’s that easy.

Oh sorry, i forgot you have a lot of shit going on.

Yes, it's a disease called "having a lot of shit going on and not wanted to spend my afternoon sorting tabs" It is cured by "throwing all tabs in the bin and starting over" because today's computer are so incredibly weak they can't handle a few megabytes of text anymore.

Your solution is a database or information management system.

I've researching that and it seems the bottleneck is going to be transfering the tab inner information to secondary storage software. This is often a multi step process and also imperfect. With many website expressly frustrating this attempt by deleting and reloading data which is out of sight.

For instance trying to archive a facebook thread. As you scroll down the thread, it loads tge text ahead, but it also delete a few pages behind.

I'm not sure tab data can be expected to translate reliably to another store systen. It might have to stay in the browser.

Best I could figure so far is a rolling video screenshot, but that makes the data huge and difficult and imprecise to search as you now have to OCR evety frame to make it searchable again.

Okay I know people are being rude. You have to understand its not just text. Your browser sends a request to a server for a webpage and it downloads that webpage, all media included. Its not just text. The only solution here is disabling all of your addons and going one by one until the merge all works. Or finding a work flow that doesn't involve the goal of reaching 20k tabs. Browser are not designed to search through tabs. Firefox has bookmark tags and keywords to search or instantly open a link. But tabs are not meant to be this repository of where you've been.

I mean, look at how much data a youtube tab actually download, versus how much it occupies in memory. I think the strict memory isolation between tabs, so that one tab crash doesn't take down the entire browser, has become uneconomical. I think combining some tab memory. Especially tabs of the same websites, especially their libraries, would greatly reduce the memory consumption and probably overall speed. I rarely ever get crashes until I bust both my ram and swap. I would sacrifice some tab isolation to get some memory back.

because today's computer are so incredibly weak they can't handle a few megabytes of text anymore.

I mean, sites today are more richer compared to earlier 2000s. We have css, more complex js scripts, embedded fonts, embedded videos etc. I'm sure you understand that it takes more than a few megabytes of RAM.

If you need quick access to this many pages I suggest organizing bookmarks. As this is what they are meant for. Tabs are meant for active pages you are working with. So anytime you get that many tabs with any browser its gonna run like shit.

Nah, FF handles thousands of tabs just fine. I literally have just as many if not more tabs than OP and have never seen this issue. It’s either from the merge they’re doing or something else. It would be better if y’all just worked under the assumption that this does work and something is otherwise wrong with op’s setup.

The issue is parsing all that. There is no way you can keep that many tabs readily accessible like tabs are meant to be. Which is why these addons were born and are not official parts of Firefox. This is one of those just because you can doesn't mean you should situations. I get they've adopted this workflow, but reading through this it sounds more like daily driving than actual work. Which makes this even more bizarre, you can't read them all, they have to reload when you open them after a while (ie download again) so all points are moot. You aren't saving the page, you are holding onto a shell that will request the page again when you wake it up. If the server went offline never to be seen again your tab will not hold the information.

With this workflow, it might be better to have a crawler dump everything into folder hierarchies that are content searchable, and then search that like google using specialized software. I dont see any other reason you could even have 1k tabs open efficiently, you aren't searching through that, might as well google again and follow the purple links.

Yeah I think that everyone here is latching onto the workflow part of this, when I don't think that's the problem here at all. OP mentioned that they search these, etc. but the real problem is the merging of windows, correct? So why can't these windows merge properly? Well it's probably the extension sucks (because I can drag hundreds of tabs around in sidebery just fine) or that they have disabled swap mem.

I understand everyone is freaking out about the workflow, but this is the reverse of the XY problem, like what happens on SO. Everyone tells them they're doing it wrong rather than just telling them how to do what they're trying to do. If OP had said "I have 2gb of ram and I have 30 tabs open in different windows and I use this extension to merge them and FF freezes" no one would be batting an eye about helping them.

I find organizing bookmarks incredibly tedious. I have bookmarks folder with thousands of tabs in and it's just easier to use google again to re-find the information than to pick them out of bookmarks. Also tabs just keep the title and URL so you can't even search the text inside. So, organizing a library of tabs is like a much worse version of google without previews. I also use the session manager addon but again, when you open thousands of tabs, it clogs up the memory almost instantly. It's taking multiple gigabytes of ram, just to display a few kilobytes of text ! I wish the browser would just render the page as a static searchable text and image and then ditch all the javascript garbage.

May I ask why you have to have this level of access to thousands of pages? Even for my job I have maybe 8 active that I use Firefox keywords to jump to.

You can also tag your bookmarks and search for those.

I would prefer not to save and tags tabs 500 times per day. It's easier to let them accumulate and handle them all in memory.

500 tab save and tag per day is too much labour, I would spend half my day just fiddling and sorting bookmarks !

If you have over 1000 tabs... learn how to use bookmarks instead. I don't understand how you think 1000+ tabs is a feasible way of organizing.

I search my open tabs in the search bar, and close it when I'm done. Super handy honestly.

You can also search your bookmarks (and your history!) in the search bar.

Yes, but it is easier to have a pool that I can easily remove tabs from. Bookmarks and bookmark folders simply take more steps to manage, and open tabs don't take much ram.

Have you tried bookmarking things instead of leaving them open as tabs?

Yes, I find that it identical to closing a tab. I never go in the bookmarks manager after. It is very clunky to use, it adds extra steps compared to keeping the tab open. At that point, it's usually easier to use google to find it again, since at least google can search text inside the page, not just the title. I do occasionally dump my thousands of tabs into the bookmarks managers, in a single unusable folder. It hasn't yet happenned that one of these tabs was retreived. But I hope in the future that I could dump all these tabs into another piece of software that will fetch all the tab's body data and allow me to search it all with a local LLM based search like "using my bookmarks, create one browser window with all URLs on the topic of the 7 megahertz maser" We're close but not there yet.

geez, just press Ctrl+W when you're done with a tab, or if the tab is older than a couple hours

I don't understand why some are so attached to tabs. Search your history if you need it again.

I tried closing tabs, I have to finish reading them, make sure I got everything and that whatever reason I had for opening that tab was done. The result is that I spend all most all my time trying to close and sort and order tabs instead of doing what I was trying to do in the first place. And then the browser freezes for 10 minutes.

Something is very wrong that 64GB is nowhere near enough to handle a few megabytes of text. And searching text inside of all tabs is an unthinkably difficult operation ?

Where did the web go wrong !?

It's not the web it's you dude. You're not using the software the way it's intended to be used. There is no reason at all to ever need 1000+ tabs open.

It's not the web. It seems to me you might have an attention deficit issue. Try improving your workflow.

My computer should bend to my will, not the other way around.

Then invent the technology that makes what you want to do reasonable, otherwise don't blame a drill for being incapable of hammering nails fast enough for you.

Say these problems are fixed for now. How many tabs is enough? How do you see this tab hoarding progression being sustainable at all?

I would put the full text, image and video of every tab I have ever opened into the context memory of an open source LLM if I could. I would only consciously delete stuff that needs to stop existing immediately, like doxxing data or illegal data or malicious code.

This is like asking, how many email should you keep.

Well at work we auto delete all emails after 60 days.

But my personal email has every email going back to 2006, the last storage failure before backup, and it's all quickly searchable.

The other limit would be storage space, but my cluster has still 180 terabyte empty space, I don't see that getting filled up from plain browser data any time soon.

Of course, I would like better automated data catalogging tools. I would like to ask my local open source LLM to "pull up all tabs regarding 7 megahertz maser project" and it should should open a browser window that contains every tab I have ever come accross on that topic. Including now-dead websites. It should all be sorted by date, it should know to put the more basic tabs to the left and the cutting edge stuff on the right. All this without me tagging a single thing, without wasting a minute of my time doing sorting busywork.

It is the job of the computer to organize my data, in an offline, private, reliable, open source-based, enshittification-proof manner with infinite memory and perfect recall. So that I can get on with doing the stuff that I want to do and not fiddle with browser settings.

Mozilla foundation has revenues in the 500 million range and a 7 million a year CEO, I expect nothing less.

I applaud their initiative with llamafile, however I hope that was just an appetizer.

yeah mate - you need a knowledge management software, not a browser.

tabs were always ephemeral and that's unlikely to change because they're much more than text and images.

that's simply an unreasonable expectation for a browser.

I'm honestly surprised Firefox even handles more than a few hundred open tabs.

That’s fair, maybe you’re using the wrong tool though, something like an internet archive sounds more like what you need.

Take every tab you open and save a PDF, all the text, and all the images, then put a timestamp on them before deleting the tab. That’s not the point of a browser though, that’s an entirely different product.

You’re welcome to build it though, or ask Microsoft if they can make Recall work for tabs.

I was going to also say that OP might be wanting something like Recall (which might be one of the few instances where it constantly saving shit would be perfect). But they would need like the most extreme version that isn't just saving searchable screenshots.

I also think that one major issue for OP is more about how the actual sites are coded these days. As even if a single tab is being used, the shit can just decide to force it to update the contents at any time (like how just having Gmail open you will see new messages just show up even without refreshing your browser).

It seems like the perfect situation for OP would be if the web still worked like it did pre-web 2.0, but with using the current version of FF. Outside of that, it really seems like they need to just start having sites be auto-completely downloaded for full offline use.

I am still shocked that the main issues being had seems to be that it taking 10s of mins to allow FF to process that much stuff is the frustration. Which does seem to mean FF is holding up pretty well given the situation. Their complaint about tab isolation being too much overhead seems odd though. As it would seem that going back to not having that would mean a much higher chance of just everything just being yeet-ed out of nowhere.

I am not sure how their headspace of using virtual machines approach would be much better as shit would still have the issues of sites still self-updating and loading up in the first place. Though given they seem to have dramatically more coding experience, I am much more ignorant of this shit.

Rather than try and force Firefox to deal with thousands of tabs, it’d be easier to use an add-on like SingleFile to download the tabs as self-contained HTML files. After that, you can search their contents using free tools like Agent Ransack or DocFetcher.

If you prefer to keep the data in your browser, then how about using a service like Instapaper that lets you save pages for reading/referencing later as well as search their contents?

I've read this entire thread like three times and watched all the videos you've posted, and I still don't understand your workflow at all.

If searching bookmarks/history is harder than using Google to just find the thing you want to get back to, why do you need to keep the things you want to get back to open rather than just using Google to find the page again later? Or when you want to get back to something you (think you?) have left open, do you find it just by scrolling through all your tabs until a title/favicon looks like what you're looking for?

Your last paragraph makes it seem like maybe you want to keep the tabs open so if the page/content gets deleted off of the server, you don't lose it. Is that correct? I'd imagine that doesn't always accomplish that, though, right? (Particularly for something like YouTube.) If that's a significant part of why you keep the tabs open, though, maybe that bit at least is a good question for a data hoarder community.

I haven't been able to find any "discard all tabs" addon for Firefox by Googling. And I can't guess what exactly it does. (Does it save tab states to disk and suspend - but also leave open - all tabs or something?) Are you sure that's the name of the addon you're using?

why do you need to keep the things you want to get back to open rather than just using Google to find the page again later?

If it's already in memory, that's one few step to reach it.

My tab manager can't search google

do you find it just by scrolling through all your tabs until a title/favicon looks like what you’re looking for?

I search my live memory with Tab Manager Plus

Sadly, it can't search tab body text, only tab titles.

if the page/content gets deleted off of the server, you don’t lose it. Is that correct?

My software should not discard data without my permission. When it runs out of RAM it should dump to disk cache, not delete. But browser have the builtin assumption that the web remembers everything, which is false. I also think bookmarks should save all tab data, all text, all images, all code, all video, and the code should remain as functional as possible. That's a long way off, currently the only way to do that is freeze the tab with its browser and operating system inside a virtual machine live snapshot.

I haven’t been able to find any “discard all tabs

I believe this one can do, discard selected tabs, but not discard all tabs

https://addons.mozilla.org/en-GB/firefox/addon/discard/

Discard is the action where all tab content is deleted, keeping only URL, title and favicon

I haven't found discard all tabs either.

I would like "stop all tabs" to work

https://addons.mozilla.org/en-US/firefox/addon/stop-all-button/

But it will only work after firefox has cleared the clog, it currently freezes with the rest of the browser.

If it's already in memory, that's one few step to reach it.

I search my live memory with Tab Manager Plud

Oh, so you're doing something like Googling just to find the page title and then rather than clicking the link in Google, (closing the Google results page, I hope and) searching through your tab titles with Tab Manager Plus to find and switch to the open tab where you already have the page in question open?

Though, I still don't understand why you keep the tab open in the first place rather than juat closing the tab when you're (at least for the moment) done with it and then Googling to find the content again and clicking the appropriate link to get that same content in a new tab when you do need it again. I asked whether the reason was so that if the content is removed from the server, you didn't lose it, but I don't think anything you said in your last post answered that question. You did say:

My software should not discard data without my permission. When it runs out of RAM it should dump to disk cache, not delete.

Which wasn't quite a direct answer to my question. And you then directly admit that the browser doesn't even keep content that's open in a tab:

But browser have the builtin assumption that the web remembers everything, which is false.

So that must not be why you keep content open in tabs, right?

Is it maybe something like if you keep something open in a tab, the presence of that page title in your tab manager gives you confirmation when you later Google to find the page title that such-and-such particular result in the Google results is indeed the thing you're looking for and not a different page than the one you were looking for?

Just as an aside, my web browser use is probably atypical as well. I have my browser forget all cookies, history, cache, etc (basically everything but my bookmarks) every time I fully close it. And I close it every time I switch activities to keep my online personas isolated from each other. (So I'm never logged into my Google account and my Amazon account at the same time, for instance. To reduce targeted ads and such.)

Also, I'm wondering if something more like a caching proxy with maybe page searching capabilities and finegrained control of what is cached and what isn't might fill part of your use case, but I still don't have a firm grasp on your use case.

A tab suspender extension might help some, but there's only so much you can do to minimize the impact of thousand(s) of tabs. Cleaning out old tabs more frequently is probably a better habit.

I tried a tab suspender, but it would replace tabs with a moz:// address that would end up breaking all my tabs when I copy & pasted them from a text file. Also tab suspender doesn't work once firefox gets into that state. I think the internal scheduler is trying to load tabs and discarding them as fast as possible. What I need is a big "stop button" that stop it all from at least trying to load new tabs.

I think what's happenning is when I merge all windows, many gets get woken up and, like the youtube tabs they seem to gobble up 2 to 4 gb of ram while initializing to that freezes everything.

It's making it really hard to get to 10k 20k tabs when it really falls apart like that with not even 2k tabs.

This makes the browser experience really bogged down where most of the time is spent finishing and closing tabs instead of just getting on with the actual task.

I would really like to spend less time fiddling with my browser and it "just working".

20k tabs? I struggle to see how someone could go through that many tabs, even over a long period of time. Your workflow is something the browser was never made to handle.

Try some popular non-Mozilla tab suspend extensions. I doubt that they all operate the same way.

20k tabs means there are other problems that need to be addressed

Yes, my computer sucks, I need 256GB ram and 128 cpu cores apparently

Although even then it still would be too weak to do something crazy like search for text, in all tabs

3 more...
3 more...

The thing is that, it does work fine as long as I don't disturb too many tabs. It's the action of agglomerating all tabs to a single window that wakes up a bunch of tabs unnecessarily Surely there's a shortcut or something to "stop all tabs" immediately. I would even take a "discard all tabs" to flush the tab memory. It seems to be what happens after a while, but it takes more than 5 minutes to happen on its own.

3 more...
3 more...
3 more...

1000 tabs? What for?

A small subset of the stuff I'm trying to do.

Is this your goal?

Cause I gotta say, I don't think abusing your browser is your best bet.

I'm really curious about the workflow you have that needs that many tabs. How does the History and Bookmark functions fall short of what you need?

It's easier to use google than the bookmarks manager, which can't even find text inside the pages. I do often dump all those thousands of tabs into a bookmarks folder. And it has never happened that I went back into that enormous pile to fetch something that would take hours to find again. I have no use for the history either. A gigantic, alphabetic ordered list of everything I have seen in the last 7 days. Again, easier to just use google.

The one thing that is better and faster than google, is not closing those tabs that may contain the stuff I need.

Of course, it's not really possible to search the text body of open tabs, unless you search them one by one.

But I'm going to ask for only one computing miracle at a time !

What I'd recommend, based on the insistence that seeing to not change your workflow, is to locally download the pages you have open with httrack, wget or a similar application. This would allow you to locally search all your tabs and their contents very quickly without Google, they will load faster because of lack of needing to redownload them, which if I understand correctly Firefox is trying to do at some level.

Thanks, I didn't know that one.

I have been experiementing with a transparent proxy like squid or something like Archive Box, to create static pages on the fly and load that.

But so far I've not made something seamless and pleasant to use. It would have to be at least as low friction as using google.

I am going to try using Mixtral 8x7b to perform natural language search over my archives and pull tabs from the collection of all pages I have ever seen. But that's still a long way away from being operational !

....has Google still been giving you the same results recently? This is an extremely weak link in your setup to me. You'd be better off looking at a locally run search engine like peARs or something similar with locally downloaded and indexed files if you insist on using search, and it'll be waaaay more reliable than an LLM here.

Google is giving me increasingly poor results, I am looking into deploying Searxng locally.

I really would like to operate my own local crawler and sorting algorithm.

I will check out the peARs you mentionned !

Why don't you just open less tabs? Just close the browser when you are done using it

I am not sure what you’re working on but from your answers I’ve read you seems to need access to a lot of information with a few keystrokes, like searching for a keyword or tag.

In my opinion you are using the wrong tool for that. Ditch the browser and learn about the Zettelkasten way of working. It is really powerful for plenty of applications like science, studies, dev, or even the way I use it, author repository of ideas/concepts/stuff I need when writing a book.

You can do that with several software but I like obsidian for that (and because of all its plugins you could probably find something to automatically copy webpage content)

On the downside side :

  • You’ll have to learn Zettelkasten, Obsidian etc
  • Obviously do the work of writing (or copy pasting) your vault.

But on the plus size :

  • You’ll have all the information you need at your fingertips, searchable with keywords, tags, associations etc.
  • Everything is basic text MD files so it will still be readable by any text editor or terminal in the next century.
  • You can have images, run code, do some mathlib, jupyter etc inside.
  • Text is light, easy to store, backup and retrieve.
  • If you do good enough you can have a satisfying visual representation of your new brain, kinda mindmap (which is also possible)

Cool I would love to navigate my data in a manner similar to this. However not obsidian, I am in the process of de-googling and I have severe cloud fatigue. But maybe QOwnNotes

I'm hoping something like Archivebox or squid or some other software can help me, autodump everything in a way that will become accessible to these second party data management software. Hopefully in a manner as transparent as opening a tab.

QOwnNotes is good but the UI is a little bare. Consider logseq

Can you please tell me about that obsidian, google and cloud relationship ? Cause I don’t know anything about that and I’m curious.

I don’t use any cloud except my own, self hosting FTW!

I have no direct solution to you exact problem but your usage of tabs sounds like a nightmare.

A while back I found Omnivore which works like a charm if you want to "freeze" the contents of a website to read them later. You can also self host it if you like.

I took it a step further because I love Obsidian as personal knowledge management and I want to have everything in one place. There's a plugin to sync all your saved pages from Omnivore to Obsidian. In the template for it I then have my marked highlights, the links to the version in Omnivore and the original URL and also the whole content. So I have all of that in markdown which is really nice to work with.

Maybe that's a solution you too could be happy with.

Thanks, never heard of Omnivore

"Distraction free. Privacy focused. Open source"

They do hit the right notes. I was going to try QOwnNotes but I'll put that on my list.

Zotero is a citation manager, with a firefox extension to save an article (but really, a tab) with one click.

It also has fulltext search. You can search snapshots of everything you save.

"But I can't save all my tabs at once"

(There are some solutions, but nothIng official)

Save as you go. Computers simply don't have enough ram for 2000 tabs.

Anyway, it also seems to be able to run javascript plugins, and I saw you have some experience with that.

It also has support for folders, so you can organize it a bit better than tabs work for that.

From a practical standpoint, it's hard to imagine what you could possibly be doing where it's beneficial to have a thousand tabs open.

If I'm writing a research paper, I might want 5 or 10 tabs open at a given time. Let's say I'm a little chaotic so I get up to 20. And then limitations on my working memory kick in, and having any more open tabs actually makes me worse off.

But then let's suppose it's a thesis that's 50 pages long. So I might be relying on 40 or 50 references. I'm not relying on them all at the same time, right? So I definitely don't want to keep those tabs open all at the same time.

What I could do, and what you could consider, is either bookmarking things or using archive.org to make a backup of the pages.

In one of the other comments you mentioned Facebook. That has me a little concerned again with your objectives. If it's something private on Facebook that can't be recovered later, and you need something reliable, then you have no choice but to do long screenshots or scrolling videos. If it's not reliable, then why do you care so much to keep the window open? Just close the window, remember whatever you remember, and move on with your life.

Whatever you do, here's a few rules of thumb... Your web browser is not an archiving tool. Printing to PDF is one way to archive things. There are other ways to archive things too. You don't actually need to archive as much as you might think you need to archive. Most of the things that we think might be important now actually won't be useful at all three months from now. Rarely would one actually want to have a thousand sources of information for any given task.

You have 64GB RAM and that's still not enough for your browser. Wow.

I've come away from this with only more questions. What does your Downloads folder/Filesystem look like? Do you have notebooks or any real world allocation of information? What's that like? What kinds of things do you keep in a junk drawer?

Absolutely fascinating.

I do not waste time sorting, emails, downloads and bookmarks

For my linux ISOs, which I have approx 60 terabyte of, I use dedicated sorting software and it does a really good job of keeping it all organized. I also make liberal use of symlinks and hardlinks to keep the original alive while also keeping things organized.

As for notes, I have notepad++ with an endless series of titled untitled text files of everything I ever want to remembered. Shared accross computers using a local git server

On my phone I have google keep which has a list of notes that has long since become far too long to scroll to the bottom off of. I am in the process of degoogling and I want to switch to a selfhosted file centric markdown note taking web app, not decided on which but this video is probably going to be one of them.

I don't have a junk drawer, my stuff is sorted into bins, here is a glimpse of that

Those ISOs must go back YEARS! Same with the files! What sorting software helps keep track of all that?

Notepad++ surely has some type of global search feature to help find the thought you saved for later, right? I'm utterly impressed with how much stuff you seem to have around, yet can still find and make sense of it. I would have long since buried myself under it all and given up.

Yes, files that go back to 1996 when I first got online. Much older stuff that I got afterwards

I was using Kodi and I am switching to Emby.

Various renamers

https://picard-docs.musicbrainz.org/en/config/options_filerenaming.html

https://github.com/mobeigi/filebot

and many custom bash and batch scripts

Yes, notepad has "search in all open files" which would be great in firefox, "search in all tabs" and then it shows you a tab list with the search text in context with excerpts, kind of like how google does. Then with one click you could jump to that place in the text in that tab.

Kodi and Emby. Ohhhhhh. ISOs. Ha! I knew exactly the types of sorting software that was coming when the idea clicked.

"Search in all tabs" would be so awesome. I don't do 1000 tabs, but when doing research, I regularly have 30-40 I'm flipping through, and I tend to lose my place, know I saw something, and need that exact tab, and it's always a bit of a chore to track it down before I forget why I wanted the tab in the first place.

I hope Firefox gets where you need it to be soon. I recently read the story of the 7000 tab person, so it's clearly a use case.

I terminate Firefox and reopen it any time it's chewing up my RAM, but I usually don't have more than 500 tabs open at any one time. My tabs persist when Firefox starts again, but tabs don't fully load until I click on them again. This saves my memory from getting chewed up immediately, and can usually go a week or so before I need to do it again.

What? Even 500 tabs? I don't understand this. I get about 10 open and I can't read what they are. Please share a pic of what it has to look like with that many tabs open because I totally do not get this? I feel like this would be akin to asking "I can't see out of my car windshield because I have completely covered it with sticky notes. How can I get to where I need to go?" This is not how browsers were designed to work.

I often have 100+, so I set a fixed width for tabs so I can see more and they don't get too small. To find tabs, I use the drop down to see a scrollable list. But honestly, the biggest win is the "switch to tab" feature when typing in the URL bar.

I see about 20 at a time, and they're usually all related to the same topic because I opened them around the same time.

When I'm done with a project, I "close tabs to the right" and it's clean again.

Interesting. I still don't think I could use that workflow. I use bookmarks, and the dropdowns in the bookmark toolbar when I need to organize links into groupings. And even then I only keep the necessary dropdowns in my list. Everything else I organize by bookmark folders and subfolders.

Bookmarks take work, especially when my projects run for a couple weeks at a time. I rarely need to reference stuff after those weeks, so I'd constantly be adding and removing bookmarks.

But everyone's workflow is different.

Here is a quick scroll through my "tab manager plus" view, zoomed out hopefully this doesn't contain doxxing information

https://youtu.be/6TEMLxkEIPo

Thanks for sharing. That was wild... You probably have more tabs than I have bookmarks.

Just buying one little dodad on ali express has me opening 500-1000 tabs, for just one search ! I really wish the computer could keep up with me !

I have over a thousand just like OP and it works fine. Use a tree style tab browser and it’s much more usable than chrome or anything like that. OP’s problem is not having too many tabs.

Why do you need so many open tabs to begin with? What is your usecase?

You are manually caching web content. Were you aware that (a) your browser does that for you; (b) the internet does that for you ?

I'm as guilty of this as anyone and can tell you from experience that it's sutpid.

Sidebery (FOSS, MIT license) has several features that could be used to help you merge thousands of tabs into one window without choking out your memory usage, and generally makes it really easy to organize a massive amount of tabs. It would take several steps. First, you'd right-click the panel (the top-level organizational unit in Sidebery, above the tabs) on each window and select Save to bookmarks (example folder structure: selecting Bookmarks Toolbar/merge/ for a panel named panel1 would save the tabs under Bookmarks Toolbar/merge/panel1; click a folder twice in the selection dialog to expand it). Then you'd close that window and repeat with each window, being careful with the panel names so as not to overwrite any other window's tabs. Once you're down to one window, create an empty panel, right-click it, and select Restore from bookmarks. From this dialog, selecting the top-level folder that all the other bookmarked panels reside in (Bookmarks Toolbar/merge/ in this example) will import every tab from every window that was bookmarked, grouped by the window name.

When Sidebery imports a panel from bookmarks, the tabs are imported in an unloaded state, so they have basically no effect on memory until you actually click into them and load them. I can restore about 50 tabs per second from bookmarks without my system even slowing down, taking me from 0 to 500 tabs in about 10 seconds. It's not exactly a one-click option, but I wager it will be significantly faster and less prone to completely breaking than your current workflow, and a little easier to back up (even if window/session states get wonky, bookmarks sync pretty much instantly).

Once your tabs are all in the same window, you can load tabs you want loaded by selecting a bunch (ctrl-click, shift-click, etc., just like in file explorer) and refreshing them, presumably avoiding YouTube tabs (should probably download those with YT-DLP anyway if you want to keep them). Sidebery will actually limit how many tabs it reloads at once, so it'll never choke out your system by trying to instantly load a thousand of them (unlike if you select "open all in tabs" in Firefox's native bookmarks context menu... eurgh). Even if it isn't faster (though I suspect it is) the browser is at least usable while that's going on. I'm not sure how well this method preserves containers, mainly because I don't use them, so if you do, keep an eye on that if you test it out. All I know for sure is Sidebery supports reopening a tab in a new/different container because that's in the default context menu.

There's more time savings than just window merging and tab loading, there's the tree-style viewing, being able to collapse whole trees of tabs you aren't actively paying attention to, seeing the full titles of 30-40 tabs at a time, no more sideways scrolling, a built in search bar to filter shown tabs by title, fully customizable keyboard shortcuts and context menus... it's actually incredible how much this addon can do, and not only does it have a lot of settings and customization that should let you tailor its behavior to exactly how you want it, you can even sync its actual settings through Firefox! (just make sure to set your device name) Only thing it can't do is remove the tab strip to give you more vertical real estate, but Mozilla might be working on that.

I know what it's like to be attached to a cumbersome workflow. I hope this can help streamline things for you a bit and make life with ~2,000 tabs just a little less troublesome.

Yeah I was going to suggest sidebery as well, but not because of the window merging stuff. It just makes handling thousands of tabs much easier. I’m pretty sure that OP’s problem is the add-on he is using can’t handle his workflow and that it has absolutely nothing to do with Firefox. Because I can drag and drop several hundred tabs from one FF window to another in sidebery without ff even so much as sneezing.

I tend to have ~10,000 tabs because I obsessively fail to clean up. But it never takes much memory or cpu, my PC isn't amazing yet Firefox is always lightning quick.

I've never used the discard or merge windows features though, I can see why those might cause issues. I assume these two functions just aren't optimised for so many tabs.

One addon I might recommend to help keep numbers down is Duplicate Tab Closer, which has options to specify how similar tabs can be to be considered duplicates, and also will detect across all open windows if desired.

10,000 tabs? As in 4 zeros? How do you remember what's open? Can't you just close the browser nightly?

i use auto tab discard and it works great

It blows my mind how many tabs people open. I rarely use more than 4.

I feel like Firefox should just start hard limiting the number of tabs.

Oh, hmm, interesting. I would simply not bother trying to clean up your tabs (it's what I do, 6476 baby!).

Perhaps consider also getting more RAM. 128 is good, 256 is better. Thanks to ddr5, ddr4 isn't all that expensive now (and 5000 series can't use ddr5 anyways).

I got some old HP G8 DL380 servers with 384GB ram in each, I am investigating running firefox in a VM on them and then somehow making only the firefox window appear on my PC. That would be awesome. I would have practically unlimited ram !

Perhaps he needs a machine with 512gb of ram and dual socket motherboard with thread ripper pros. Also he probably needs at least 10 gig if not 25 or 50 gig networking for all the analytics

I came in here knowing exactly what the comments would look like, and I'm still disappointed. "Just don't use so many tabs" is not an answer. If you don't have anything constructive to say, just move on instead of getting uppity about...not using browsers very heavily or understanding other use cases.

Yeah, thousands of tabs seems extreme. But "you should dedicate a larger amount of time and effort all day, every day to make the computer's job easier" is a bad take. That's obviously worse than OP's existing workflow.

Sorry OP, I don't have a real answer either. You might find Arc Browser's tab system to suit you better, but since it's chromium-based I suspect performance might be worse.

Edit: out of curiosity, how much memory does your PC have, and how much is Firefox using during these freezes? I wonder how much of the delay is caused by swapping.

Just don't use so many tabs" is not an answer.

Yes it is. If somone is holding a knife upside down and complaining it doesn't cut their steak, are you rude and ignore them? or comment that they're doing it wrong? OP has the knife upside down.

FF (or any browser AFAIK) is not designed to do this , OP is doing it wrong is a valid answer.

On the flip side OP wants FF to change so it can do what they want, which is also valid. After all, a sensible person adapts to the environment around them, an insane person expects the environment to adapt to them, therefore all progess is made by insane people. Have at it OP :)

Yes it is.

It is worse than OP's existing workflow, even though the existing workflow sucks. "Do this thing that sucks even more" is not an answer. "I don't have this problem, so you must be mentally ill" is also not an answer.

an insane person expects the environment to adapt to them, therefore all progess is made by insane people

LOL. I love this.

FF was designed to do this. There have been hundreds of bug reports that have been fixed over the years to literally make FF handle thousands of tabs just fine. If instead you had operated under the assumption that something was wrong you literally could help OP resolve the issue which is most likely something like their swap mem or the extension itself being written badly.

Frankly the answer is to not use so many tabs.

I think it’s crazy to need more than 10 active tabs open, let along thousands. I’m a software developer who will regularly go down rabbit holes and I’d never dream of opening so many tabs.

The fact is OP isn’t using the browser in a way that it was designed for. Plus they’re being unreceptive and rude in some of their replies.

Ff literally was designed for this. It has had a significant number of bug reports over the years that improved this exact thing, opening thousands of tabs. That’s not the problem (I also have thousands of tabs open). If instead you had operated under the assumption that that wasn’t the problem maybe you could have helped OP find the actual problem, which I bet is probably that they disabled swap mem or the extension they’re using isn’t written well.

I have to ask, how does one even manage thousands of open tabs?

Like how do you find the 1 in 1756 tabs that you are looking for?

Excuse me for thinking that that is an insane way to work and there is no way it can be productive. Like if you have a thousand open at any given moment, what are they all. What are you doing that warrants this? What’s wrong with bookmarks.

I think the consensus here has been clear in that you guys are in the minority of people. And that’s on Lemmy where we skew tech literate and would mostly be power users. I just can’t see how it can be productive.

Not calling you out here. Like I really need to know your workflow with some examples of the why?

You have different windows, different Multi-account containers. And if you type in something into your address bar it will just automatically jump to an open tab if you already have it open. No need to perform another search and find it. It's not hard to maintain this many tabs. Just like it's not hard to know where stuff is in your house. You keep the tools and cars in the garage, the yard equipment in the shed etc. You have thousands of items in your house or apartment, you don't have trouble keeping those separated do you? Unless you're one of those people that just tosses stuff as soon as they don't need it anymore, but I don't think that's the majority of people, at least not from talking to my therapist it isn't.

And it's not about being productive. Like, if I have one window open it might be for the research for a thing I want to buy, for example we're thinking about getting starlink for camping. So I have a window open with like 50 fucking tabs because choosing a powersupply, figuring out the calculations for how much wattage I'm going to be using, etc. I need all those open. I mean I could move that into an obsidian doc, but that's a hell of a lot of stuff to write down for something I only need to research and buy once. And then it gets left open because I already did the research and it's much easier to find if I have to step away to do something else, or I put off the research for a week since we're not camping yet.

The same goes for work stuff. We're testing stuff in salesforce and I have 10 tabs open for every test because you have to verify every single field of data I'm pushing from the backend into salesforce.

But it's not like I'm even noticing the 950+ tabs that are open. I don't have that window open. I use sidebery so I can see all the tabs in my window with their full names at a glance (here's an example of the current window where I've been responding to lemmy comments.

And a lot of the times I open an article to read, then someone messages me to help them, I jump over to help them, and then I come back to the article in a week. Or two weeks. Or three months. And then after I'm finished with it I close it. But I'm not gonna bookmark that. Bookmarks are for stuff you keep coming back to. Managing bookmarks in a browser isn't like managing a bookmark in a book you're reading. Deleting them is harder, filing them is harder, etc.

Yeah, thousands of tabs seems extreme. But "you should dedicate a larger amount of time and effort all day, every day to make the computer's job easier" is a bad take.

Computers don't magically make things easier, it just does as it is told(as instructed by code). Computers don't come out as a self-made human assistant that adapts to your personal needs and can magically do anything you want.

If it's so much of a burden that smarter people haven't figured it out, go at it. You might just fix it.

But "to make computer's job easier" is the dumbest shit I've heard in a while.

How could one manage to open more than 100 tabs is beyond me. Just close the browser. This is insanity. I don't know how you keep track of all those pages.

I am going to keep beating that drum until firefox gets better It's already improving, I used to struggle at 700 tabs now I almost make it to 2000. Of course it is mostly artifice as most tabs get fully discarded and what I want is all tab texts in live memory and the ability to search all tab text. Maybe even text search in all pictures in all tabs using object recognition, but clearly we're not anywhere near that yet !