What distribution is most used in production environment

Nowhereman@lemmy.stonansh.org to Linux@lemmy.ml – 75 points –

I've come across Red Hat allot lately and am wondering if I need to get studying. I'm an avid Ubuntu server user but don't want to get stuck only knowing one distro. What is the way to go if i want to know as much as I can for use in real world situations.

111

RedHat, CentOS, Debian, Ubuntu.

All are good choices.

Well, maybe not Redhat these days...

Red hat with UBI-Micro still mostly deployed after alpine in enterprise and mission critical server, so let us see if it' dwindling in next 3-5 years ahead.

Ubuntu, RedHat, AWS Linux, Arch. Honestly distros in production are pretty similar since they're all headless and pretty pared-down. If you just know the logistics of a few package managers and init systems you'll be good.

I'm surprised to see arch on your list, I know everything runs in containers now but arch seems way too unstable O_o

By unstable I don't mean "buggy", but "you will have to adapt to new major version of package XXX or you can't fetch updates anymore, so no security patches anymore".

I never ran into this so I donโ€™t really know what youโ€™re talking about

You are probably not an IT Admin. Never heard about any server being deployed on Arch anywhere.

I'm a devops professional, not IT. I've managed thousands of servers both in-cloud and in-datacenter. That includes Arch servers managed via Chef.

Now you've heard about it.

So whats the point of a unstable bleeding edge Arch server, seriously curious. Also if you are not IT than I don't know what IT is, lol.

I didnโ€™t find it more unstable or bleeding edge than anything else. All upgrades had to be tested and scripted anyway so the process for upgrading stuff was basically the same as any other distro. I honestly never ran into any of the problems people talked about here.

As for why it was chosen, the person in charge liked it and used it personally.

You mean you never received any major package update on arch ? ๐Ÿ˜›

More seriously, it depends on what we are talking about, if everything runs in container I agree that it kinda doesn't matter, you will just have a more up to date kernel, but it is stable enough.

Other peoples on this thread are talking about actual system dependancies, for example installing a postgres server from official repo. On this example it would require a database migration as soon as a major postgres version is released, which means some downtime and non-scheduled maintainance.

1 more...
1 more...

Depends on context.

If you want to get a job as a "Linux admin" then Red Hat is basically what you want as a "default". Fedora will give you something you can use at home that's broadly similar. You will need to learn more than just that though.

Using Fedora at home because you have to use Red Hat at work? NOPE, thanks. Also I wonder if that RHEL focus is mostly american companies? Because here in europe I rarely see RHEL used from my limited perspective.

To tag onto this, what makes RHEL so special? Is it just the support you get from Red Hat or is there something about the distro that makes it so widely used?

Support contracts for risk mitigation is a big part of it, and the other is RH release engineering is amazing.

Aside from that, RHEL, and clones, is a very straight forward, clean distro. Itโ€™s very focused with everything doted and tidy, and overall, it has a very uncomplicated feel to it. In contrast Debian derivatives are kind of messy, and SUSE tries to stuff every function into a single application.

RHEL does push a lot of technology. Out of the stable distros, it will be the first to put tech into production. RH does a lot with integration with other systems. This has kept me off of SUSE in the past. RHEL was more tech forward, comparatively.

dnf downgrade

dnf history undo

dnf history redo

it's very very very critical for most case :')

you can just snapshot before any transaction in apt / pacman / whatever else.

It's hard, and better have package manager built in. It's not enough in the enterprise sadly... Just saying, and I think most Corporate with agree with it.

the package manager will have it built in with a simple hook. works great with unattended upgrades.

Beyond support agreements that others are mentioning, the huge requirement for the shop I work at (mid-scale high performance computing center) itโ€™s 3rd party vendor package support. Mellanox/nvidia, whamcloud, slurm, vast, and on and on. Driver packages targeting rhel kernels are an industry standard offering if a vendor supports linux. Thatโ€™s not always the case with Debian variants, for instance.

Same with huge applications and proprietary compiler suites (think matlab and the intel compiler suite or OneAPI). These are hugely important packages for a number of shops.

Donโ€™t get me wrong, I can build against plenty of other distros but my vendors target rhel as a first class citizen for both build scripts and straight binary packaging.

The support is a huge part of it. Being able to submit a ticket or call in to get help with a strange quirk is extremely valuable to a lot of companies. Additionally, having a licensed distribution like this means thereโ€™s built in trust. Red Hat has been a big player in this space forever and are well trusted already, too. So thereโ€™s a huge community of people who have used the product to talk to or hire. They also have certifications for rhel, supported by Red Hat, and those carry weight in the industry to some degree.

I once worked in for a small publishing company years ago, circa 2005, where they used CentOS on the desktop and server environments. Deploying a new desktop was as simple as using kickstart. They had their infrastructure down to a science.

I hope I can get my company to go linux. But for now I can only use it for myself. But i'm quietly pushing :)

Good luck, users at my company would flip out if the desktop wallpaper was unfamiliar.

Mostly mission critical server that I deployed in the past, all use RHEL/Clones because their LTS, and stability across packages version.

If for hobbyist, it's Ubuntu. I think you need to learn more about ansible, container/podman/openshift, and SDN for work. Nowdays, there are some use APT in production, but mostly they switch to dnf because dnf have better way to do downgrade, undo, redo, and config package in production.

This applied mostly for ERP project such as SAP Hanna, SQL Server, DB2, etc... Like it not, Red Hat Dwindling isn't now, probably 5-10 years ahead, but I'm not sure, as mostly rant about RHEL are in Community. I do know regional linux user group in Indonesia, some are leaving EL group, but they still can't rip apart most mission critical server on top of RHEL/Clones... so it's still worth learning RHEL/Clones, and use Fedora for day 2 day task, and learn ubuntu, as well ubuntu pro, for learn deploying critical production server.

Debian and Ubuntu are near, and ubuntu is derived from debian, but if you talk spirit, they are different... If you are conscious about what Red Hat do, stay away from it, but if you are working in corporate, you can't go without learning it.

Fun fact. At Heineken Netherlands we also happen to use SAP. the backend is using SLES-11 how ever

Well SLES is quite lean near RHEL, they have same rpm/dnf pkg manager, which is near RHEL, but not B2B compatible, or even ABI compatible, but SUSE is okayish, but I don't know, many corporate that work for aren't keen using it haha.. ๐Ÿ˜‚

Well at least, seems Europe have different kind of market, but having competitor is driving industry forward isn't it?

Well SAP is from German, but I don't know why it's much for popular on top of RHEL, rather than other. I do know Ubuntu support SAP, but never seen one in the wild in Asia Pasific. ๐Ÿ˜‚

Also I remember IBM Watson is on top SLES? ๐Ÿ˜‚๐Ÿ˜‚ Dunno if IBM replace it with Red Hat? Haha.. ๐Ÿ˜‚

All of my personal servers are Debian. My last company switched their entire production fleet from centos to Debian. I think a lot of people switched to Debian back when the Centos Stream debacle went down.

I work for a well known internet company, and its 98% redhat (or derivative) with some alpine and ubuntu scattered about randomly

I've been seeing a lot of alpine based containers recently. Used to see a lot of Ubuntu, debian, redhat.

I think a lot of it depends on if you are spinning a lot of containers up.

It really depends. I work for a large company and we use Ubuntu, Oracle, RedHat, and SLES. We were moving from Oracle to Ubuntu but now we are going back to RedHat.

Currently we deploy like this: Ubuntu: PostgreSQL, web servers, some engineering workstations, and big data Oracle & RedHat: web servers, security applications, and network systems

So just having a fundamental understanding of Linux and you will be fine SUSE: SAP and HR software

What's the reason if I may ask why they are moving to Red Hat instead?

Mostly cost. We used to run a lot of Oracle databases and they have become extremely expensive to keep running. So we are migrating to PostgreSQL. The servers were getting migrated to CentOS but now that RedHat fucked that distro we are going back to RedHat. Part of that deal is switching from chef to Ansible. So to save costs we are consolidating to a single vendor.

Oracle DB are sucking a lot of money, but they fork RHEL for free...(well it is open for everyone), they offer more expensive contract on top of Oracle DB, what a free estate.. haha... Nice work ORACLE... :/

If you want to learn more than one distro, try setting up Docker containers for various services. The base distros in the containers use the same commands as on the base metal

I work at NASA and we use redhat a lot for development work.

ime: red hat & centos dominate with ubuntu, debian, suse and amazon linux all a distant 2nd.

i also expect it to change given red hat's recent decision to stop sharing their source.

A lot of my clients were using CentOS. Not sure what'll happen next now that Red Hat killed CentOD.

I've seen some organisations move from CentOS to Rocky Linux.

100% sure its Debian.

Mission critical server mostly are RHEL or EL Clone or Fedora or it's derivative... If you combine even Azure nowdays, Microsoft Linux is derived from Fedora, same as Amazon Linux, and others... Debian are covering some part, but mostly hobbyist, or SME, and mostly non critical, as they don't have standard across, even on their https://wiki.debian.org/LTS/Extended and https://www.debian.org/consultants/

apt also bad when you got to dowgrade package when something mess up, and get messy with dpkg.. :'(

So I quite doubt if it's production env, mostly go with EL. I do know some company use Ubuntu/Debian, but it's quite few...

If Ubuntu/Debian want to shape Industries, and kick out RHEL, they need to have standard, and better consultancy than RHEL. I hope so that they could grow and make market competitive, but for now it isn't sadly.

5 more...
5 more...

Nobody said Alpine? Youre debugging k8s containers your gonna find Alpine, Ubuntu/Debian and CentOS.

Once you know package managers and basic images you're gonna be able to get what you need.

Ive worked a couple fortune 500s that used ubuntu. If im using aws ill stick with their distro but most of time im happy with ubuntu. I think distro choice matters less and less. Most of the systems ive run recently have had ansible to configure them or have just run docker containers. Most of the gov contracts iveworked on insisted on red hat but honestly the teams making those decsions seemed the least technically capeable ive worked with and it was just a red tape issue to change distros

I think in fortune 500, it's only fraction that use ubuntu/Debian, as most of marketshare hold by red hat, 95% as I remember last time. Than 3% of windows, less than that is everything else.

Almost always use Ubuntu in production. Also a bit of Centos at one point.

The two distros I've seen in the workplace most often were Redhat (because support contracts can be purchased) and Ubuntu (because AWS and Digital Ocean treat Ubuntu VMs as first-class citizens).

Not Linux but there are still a of Unix System V systems out there too. AIX, Solaris and HP-UX. Harder to learn as very much not open source software (although there is the Illumos project with distros like OpenIndiana).

Wow, last time I managed HP-UX, SunOS/Solaris, AIX, and Irix, was last century...

Unfortunately AIX in particular is very much still in use in my industry. Its slowly being phased out but is very much still there.

AIX

Impressive :) starting in the 2000s I was maintaining a park of SCO servers (yes, the infamous SCO) but starting 2010ish it was all Linux...

In banking I suppose? Or airline? Having hard time seeing AS400 in Banking.... at least some are using IBM Z nowdays...

Healthcare. People keep systems for decades.

I see. I seen some still using palmOS. Is there still any palmOS in production?

i dont get why people do not just use debian. especially if they got their own it person / support

No certification and no support. Critical bug will be fixed faster in RHEL than Debian when come to Enterprise, very clear structure and powerful consultancy.

Debian consultancy never near RHEL, that's why they need to work hard on that, and make industry standard.

Red Hat drive the industry standard for more than 20 years... That make every Corp lean to it, and it won't dwindling soon.. Unless other are making Debian standardized.

Ubuntu tried it, still not even taking chunk I guess? Mostly Enterprise is RHEL/Clones.

No certification and no support. Critical bug will be fixed faster in RHEL than Debian when come to Enterprise, very clear structure and powerful consultancy.

that is just corp talk for "it is not my problem"

I dont know ubuntu server, which i mostly use because of livepatch, with unattended upgrades seem to fare better than the rhel deploys that i have done - and the customer never updated. Granted the last is not enterprise but Uni bioinfo servers but still.

Nah, it's not fully about corp talk. I also have some University use RHEL, well, I would argue, in university, some do use ubuntu because it easiness to install and maintain, welp... But selinux vs apparmor... better use selinux in EL than in Ubuntu... haha.... *most junior sysadmin fvk tup in Ubuntu when set it up... so In the end they just use... Well,, EL Clones :/

But for research, I do agree, for NLP/ML, mostly I don't see any EL Clones deployed in labs, most Prof use Ubuntu and Nvidia drivers... Scientific linux is well known then centOS stream, just they still don't budge to move.. this is hard to crack question, I never know why no EL, but I guess because ubuntu nvidia prefered driver done its best, better than CentOS/Fedora

Personal take: RHEL is a very high quality well integrated OS. Debian is a mess of community opinion all conflicting held together by outdated and poor tooling.

i find both rhel and debian tooling very outdated to be honest.

I work at a big company: most of our customers are using RHEL when they use Linux. There are some customers that use SUSE for SAP workloads, but these are about 10% of all linux VMs.

The default Linux image on AWS (Amazon Linux) is RPM-based; but the default image on Google Cloud currently appears to be Debian "bullseye" (the April 2023 release) with an option for "bookworm" (brand new this month). I'm not sure about Microsoft Azure but their docs suggest a Debian default as well.

So that's one impression. Knowing both dpkg/apt and rpm will serve you well.

Major tech companies have their own internal distributions in their production datacenters, which focus much more on their specific needs. Any major tech company using Linux in datacenters will have an engineering team specifically building what they need.

That's interesting to know thanks! I do know some dpkg and apt but nothing about rpm so will learn more about that.

Agreed; I was going to comment something similar: I work with SAP (SAP's HANA database runs on SUSE). When I need a free swrver OS for anything else, I go debian (I used RH from 4.2 to 8.0 when they fooled us once, then went debian).

So being comfortable with a rpm based and a deb based system is good advice.

On the server side, when most administration is through ssh, distro differences are not as relevant as for GUI environments. Package handling is the most impacting difference (and I prefer deb), not that it's a showstopper, when you have yast and aptitude though.

Started with RHEL years ago, migrated to CentOS to get away from the license fees etc. Have since moved to Amazon Linux since we subsequently migrated everything to AWS.

I always use Ubuntu Server. It was my first distro 20 years ago and it's still where I'm most comfortable.

My current job is all Ubuntu LTS, my job before that was all CentOS, and my job before that was a mixture of Debian and FreeBSD.

I'm seeing a lot of very interesting answers but I'm wondering what you mean by "production environment".

Do you mean VFX Production? (English not my first language so if "production" is used in different industries, well, I didn't know).

I'm new to the industry and worked for small companies that don't use Linux. But my VFX peeps use Rocky, Mint, and Ubuntu ( stronger preference for Rocky in studios).

In IT in the US, "production" is commonly used to refer to systems that support actual business operations. In other words, it's as opposed to "development" or "testing" systems.

Thanks! So I gather the default is IT and not VFX, fair enough. It makes sense.

In this context production means servers or machines which make money in a business. The partner term is normally staging: a testbed environment.

I work for a big enterprise, we have RHEL on all our Linux servers save for a few that are SuSe for SAP.

I was working as a DWDM technician sometime ago and IIRC most of DWDM hardware (or at least the Infinera ones, as I had used those the most) were actually running on Gentoo, which was kinda surprising for me.

But in "regular" environments I have mainly seen Ubuntu or Debian.

A company I worked at 2016-2022 used mainly CentOS and Ubuntu for all their servers at customers' sites

I think Ubuntu is the most popular distro in the cloud, at least based on cloud provider metrics. Dockerhub shows like 30 million downloads a week for it regularly, which is a lot compared to most images. Debian would be good to learn as that's what Ubuntu is based on and all the major software with will probably target it. Alpine is good to learn as it's super slim, tends to be used for containers a lot.

I don't use Linux at work (I wish I did), but I default to Ubuntu Server for at-home Docker needs. I might switch to plain Debian at some point.

I recently finished reading a good docker book. They explained why alpine is so great to use: its like 16 MBs or something. I deployed a Minecraft server with it just for fun. Pretty cool. Shrunk the image a good 15 percent from a debian version I believe. Check it out if you want. Have a good one.

Thanks, I'll check it out! I honestly run into disk space issues with Ubuntu Server a lot. I'll give it a partition and it will fill up with this opaque "ubuntu--vg-ubuntu--lv" volume pretty quickly.

Here's a df -h on it right now:

/dev/mapper/ubuntu--vg-ubuntu--lv 38G 17G 20G 47% /

Need to manually prune Docker and run other admin tasks to keep it under control.

This sounds like an automation opportunity. If docker starts to fill up, I assume you pull or build a lot of images. If the reason is rooted in software development, you might wanna look at ci/cd. If not, I suggest going through your process and maybe changing the routine. Like run with a -rm command. Thats what I do when I test stuff. The container gets removed immediately after stopping. There are many neat tricks. Hit me up if you need more info.

You're absolutly right, but this is about host os, not container os

So what are the biggest differences. Or is it mostly the same? Also thanks for the responses!

Most Linux distros are more alike than different. They'll use different package managers, have different sets of software available, have different default settings for some stuff, but at the end of the day, Linux is Linux. Once you know enough, the distro is almost meaningless in terms of what you're capable of. You can do almost anything on any distro with the right knowledge and a bit of effort. It mostly becomes about the effort at that point.

Skills you learn on one will be 98% transferrable to another. That's why everybody says to just get Red Hat certifications; not because Red Hat has a monopoly, but because their certification process is fantastic, respected and accepted almost anywhere regardless of what they actually run. As you've seen, almost every answer you got was completely different on what they actually run in production.

The only standout differences are the newish trend of immutable distros (openSUSE ALP/Aeon, Fedora Kinoite/Silver blue, etc) and NixOS, which is also immutable but its own beast entirely. These have some new considerations separate from the rest, especially NixOS. But they're still relatively fresh on the scene, so there's no rush to learn about them just yet.

For learning system administration, I think Cent OS Stream can be a great choice. Not because it offers something special than others but because it would familiarize you with the RHEL/Fedora family and in my experience majority of enterprise-servers are using one of its family members, be it RHEL, the former CentOS, Oracle Linux, Amazon Linux or some other variant.

Mostly cost. We used to run a lot of Oracle databases and they have become extremely expensive to keep running. So we are migrating to PostgreSQL. The servers were getting migrated to CentOS but now that RedHat fucked that distro we are going back to RedHat. Part of that deal is switching from chef to Ansible. So to save costs we are consolidating to a single vendor.

At work: Alpine-based docker containers. Flatcar Container Linux for host VMs.

Personally: Ubuntu Server. Some alpine docker containers.

anyone using nixOS?

For production server? No. mostly NixOS is for desktop.

Ansible cover what nixOS doesn't in Debian/RHEL space, and it's idempotent and better than nixOS config. Unless they change their approach for server, I don't see any way in near future it will be massively adopted.

At this point? Probably Cent OS, since that's what AWS uses. It's a variation of Ubuntu. So if you don't count it as separate, then definitely Ubuntu.