Want to read Slashdot from your mobile device? Point it at m.slashdot.org and keep reading!

 



Forgot your password?
typodupeerror
×

Comment Re:Question from a non-Linux user (Score 1) 765

Seriously? Try again. I am not confused at all. But you are blind to what is happening.

But you really seems to be very confused since you erroneously talk about systemd contributors needing to pay licensing fees: "Of course this also means external contributors can easily be fended off, as nobody can afford the licenses on their private budget.

That is just totally misunderstanding how things works, so it really seems like you are very confused about even basic facts how systemd is developed.

Comment Re:Watching systemd evolve (Score 1) 765

Disagree or not; logging directly to a full DB is very common, which is why it is a selling point for every commercial syslog implementation I know of.

Regarding the indexing and structuring of log files, this is exactly what journald does. This dramatically reduces work needed to analyse them, even if you re-index them and convert them another structured file format like JSON.
Working with indexed and structured files with defined field values, is always better than working with unstructured, un-indexed text files.

systemd's journal log files will always have an advantage over the poorly defined syslogd text logs, no matter how you spin it.

Comment Re:Watching systemd evolve (Score 1) 765

contain rich meta-data....

What a load of claptrap. People log to log files for reasons of the lowest common denominator. We have things called 'databases' for this kind of stuff and there's perfectly good reasons we don't use them for logging which should be obvious to anyone with an ounce of sense.

Really, are you unaware how common it is to aggregate log files in databases? This is a major selling point for Rsyslog that it is able to do so.
In fact, Rainer started Rsyslog exactly in order to overcome the many deficiencies with syslog(3), including the severe limitations of unstructured text files.

systemd's journal is pretty much a stroke of genius in that it overcomes all the limitations of unstructured, unindexed text logs, while not being a full blown DB either (the journal files are basically appended text files with a different line delimiter and an index in front).

Log files keep on growing every year, because people log more and more, and systems are running more and more daemons. Analysing such logs means machine parsing, and structured and indexed log formats like the journal have a huge advantage for this kind of work.

Since the journald binary logging file format is stable and fully documented....

I sincerely hope Red Hat and Lennart is paying for this piece of contrived PR.

Ah, so now facts and reality is propaganda. Take a look here
http://www.freedesktop.org/wik...
and here (about the file journal file format)
http://www.freedesktop.org/wik...

The arguments against it are based on contrived scenarios

Corrupted logs on a perfectly running system isn't a contrived scenario.

It is when the corruption means squat for the ability to actually read the logs.

For some reason you seem to think that "corruption" discovered by "journalctl" means the logs are unreadable, but as explained, they are often marked "corrupted" just because a single field value in a single log entry was discovered as impossible. This doesn't mean that the log file can't be read.

....through the Linux/Unix concept of piping.

Piping eh? Wow. You give the impression you haven't heard of it before ;-).

I don't care what you think, as long as you agree that the whole notion of not being able to use standard Linux text tools like grep together with systemd's journal is just plain wrong and a total non-issue.

There just aren't any good arguments against structured, indexed log files that can be programmatically accessed and has rich meta-data.

Comment Re:Watching systemd evolve (Score 1) 765

They aren't meant to be corrupted in this manner either, but apparently journald has a fsck option in an attempt to fix it. Crazy. I don't know where editing files was mentioned.

You misunderstand; there _isn't_ a "fsck" option for systemd journals and there won't be because that would be equivalent of "editing the log files".

Ahhhh, the whole 'disk corruption' misdirection. Yes, corruption could also be caused by solar flares, but this isn't, nor is it caused by a failing disk. It is caused by the journalling system itself. No investigation of this has happened, according to the maintainer 'it happens', we rotate and move on. Lunacy of the top order.

You simply don't understand how journald works. Let me explain again: systemd marks certain log entries as "corrupted" if eg. they are plain wrong, that is the client is sending obviously wrong or malformed log entries. That way you avoid impossible field values that may otherwise have screwed the log watch or log analysing programs; think of it as discarding bad data. This is the most common "journal" corruption that people discover when using the journalctl "verify" option. It is usually totally harmless and usually limited to a single log entry. It happens all the time with syslogd text logs too, people just don't discover them because syslogd doesn't have log file integrity checks.

When journald discover such malformed entries, it log rotates as a simple preventive security measure.

Sure, the journald log files are sensitive to real file corruption too (but so is syslogd log files), so clean unmounts of file-systems is a good idea (it always is). But the whole issue is massively overblown by people who doesn't use systemd anyway.

Comment Re:Question from a non-Linux user (Score 1) 765

You seem to be somewhat confused here:

Coverty is static code analysis that find potential stability and security problems. https://scan.coverity.com/
Think "Unix Lint".

Many FOSS projects like the Linux kernel and LibreOffice uses Coverty. It isn't a magic wand, but it plain works nevertheless. No systemd contributor needs a licence in order to contribute to systemd, even if they get commit access. Coverty can trivially be replaced or complemented by other static code analysers, or even be omitted; it is something helpful, not something systemd depend upon.

The Jenkins builder provides: "Continuous Integration with automated test execution", something that really improves code stability since it ensures that eg. a patch isn't committed if it breaks the build.

Again, no contributor needs any kinds of licence for this, and again, this is a nice to have thing, not something systemd depends upon.

You seem to be arguing against code discipline and the use of automated tools, just because systemd have them (while SysVinit doesn't). That is just bizarre.

Anyway, systemd's developer community is extremely vibrant and growing all the time; there are hundreds of people who have contributed already with new ones coming every month. So there doesn't seem to be anything that scares contributors away, unlike, sorry for putting the boot in, the tiny and deteriorating non-systemd developer eco-system.

Comment Re:Watching systemd evolve (Score 1) 765

The major point of systemd's binary logs are that they are both structured, indexed, and contain rich meta-data, something plain syslog logs isn't.

That again means that when you export your logs to a log-sink, you can do so in a format that fits directly into the log-sinks database like JSON format and preserve the rich meta-data like the "_MACHINE_ID" field, that uniquely are tying every log-entry to a certain machine. You can also be sure that that the program claiming to generate the entry actually is correct since journald provides kernel guarantee for this.

If you choose to keep the logs in journald's binary format on the log sink server, you gain the benefit of indexed fields when analysing data; a huge win when it comes to random access. So much faster than trawling through text logs (O(n) complexity and all that).

Every log entry can be traced back to a certain machine (not just hostname), many log fields have kernel guarantee for what they say, besides having integrity checking and even strong cryptographically "forward secure sealing" (FSS) security against tampering.
The journald logs are simply designed from the ground up to be read an analysed on other computers than the one they were generated on, either in their native format or as exported logs.

Since the journald can be accessed programmatically, it can aggregate and analyse logs across different languages and has strong immunity against changing wording of the daemons log output (it operates on fields, not words).

And since the journal logs are structured identically by a documented standard, they are trivial to aggregate, unlike the output of many different syslog implementations.

Since the journald binary logging file format is stable and fully documented, and can be accessed programmatically with language bindings, you don't need a specific binary like "journalctl" to read them. In fact, there are there is a Rsyslog module that allows it to directly read (and export with metadata) systemd journal's. There are also Python modules etc. that acts as journal readers etc.
In fact, it is quite possible to make a systemd journal reader that works on non-systemd platforms like MS-Windows or OSX.

The journald collate all logging on the Linux machine, that means everything can be trivially exported to a remote log-sink, including the kernel ring buffer and the binary utmp and wtmp log files that syslog doesn't know about, and it can include early boot and late shutdown log info because it can work in initramfs, something syslog can't.

How about journald being designed as signal-safe from the ground up (unlike syslog) and that it doesn't silently drop messages under load etc. etc.....

systemd's binary log format is simply a massive win for both the enterprise user and the Linux newbie and everything in between.

The arguments against it are based on contrived scenarios, like professional admins that doesn't have (systemd) boot medias and lack access to a pc, a usb stick and a internet connection so they can make one in 5 minutes.

All the standard Linux text tools like grep, tee, sed, sort etc. work with systemd's journal through the Linux/Unix concept of piping.

Sure, systemd's journal still doesn't have as many tool sets and projects around it as syslog. But that it is simply a matter of time.

Comment KDE and GSoC (Score 4, Informative) 53

There are several very good projects on the Wiki page. My favourites are probably:

Project: Port Amarok to Qt5/Kf5/Plasma5: Something I use every day.

Project: Port KSystemLog to use journald as a backend: With systemd it is actually possible to make a distro agnostic GUI log viewer that isn't just a "less" with windows decorations. I like using the CLI "journalctl", but a GUI, perhaps with some log watch support and real time panel notifications about "syslog level: Error" events and above would be nice.

Project: Implement PDF Poppler features: I like Okular very much, so more features like linearized pdf support would be nice.

Comment Re:Question from a non-Linux user (Score 1) 765

I'm using it and learning with each thing that breaks. Most recent was zfs and there were a few before that. If it hasn't ever caused you any trouble I doubt you've been using it much.

zfs has been working for years now with systemd, despite it not being part of the Linux kernel and therefore not really supported by many major distros.

So if you are experience troubles, it is most likely distro specific troubles like using a distro that haven't converted to systemd yet (Debian) or using zfs on a distro that didn't officially support it in the first place (CentOS/Fedora) and perhaps because you haven't read the zfs support docs carefully enough.

The systemd bugs I have encountered have been really trivial and not pertaining to core functions; it has never let me down by not being able to stop or disable daemons, or having run away processes, or suddenly consume lots of memory or cpu time. It is far better than SysVinit and Upstart in that regard too.

Comment Re:Question from a non-Linux user (Score 4, Informative) 765

No, systemd detractors really is a tiny minority; some ways this really shows is how there are almost no developers working to maintain even critical needed infra structure for non-systemd distros; ConsoleKit has been abandoned for years now, eudev is just a shadow fork of udev with no independent development going on, and several key components like systemd-shim and cgmanager are only kept alive by paid Canonical developers and a few Debian devs; once Ubuntu and Debian shifts to systemd, those projects will languish too. SysVinit will properly also deteriorate completely; Red Hat/Suse was the defacto upstream before, and now it is only Debian as long as it last. So the non-systemd infrastructure will probably deteriorate further as the commercial distros stops to maintain it.

In short, almost no developers are working on maintaining non-systemd infrastructure, this reflects how few the systemd-detractors really are.

The recent Debian debate also show how few the systemd detractors really are when the numbers are shown: The system-detractors made a lot of noise on the Debian mailing list, but after the technical committee had decided that systemd should be the new Debian Linux init system, the detractors were unable to even gather 5 (like in five) Debian developers out of around 1000 to sponsor a vote on this subject.

Even the GR bill trying to keep other init-systems equally supported was clobbered at the GR vote.

So going by the noise on the mailing lists, the systemd-detractors seemed like a force, but when voting they where nowhere to be seen.

Same with Linux distros; you would think that the non-systemd distro ranks would be swelling with the numbers of systemd-refugees. This certainly doesn't seem to be the case. A couple of rather obscure distros like Funtoo and Void are among the few distros that don't want to support systemd. Slackware is undecided on the issue, and Gentoo etc. support systemd, with a growing number of its users that prefer it to OpenRC.

Also no medium/major commercial non-systemd Linux distro have emerged this last couple of years, this is a strong indication that the paying costumers wants systemd, and doesn't care at all for the alleged superiority of SysVinit. Several companies made it clear during the Debian debate that they favoured systemd, none spoke for SysVinit or Upstart.

No wonder; systemd is great and it solves real world problems like daemon management and security much better than any other alternative.

Comment Re:Question from a non-Linux user (Score 2) 765

I have been using systemd since its inception, and it has been rock solid. It is better tested and documented than most other FOSS projects; a Jenkins back-end and Coverty scans, integrated self tests, and rather strict coding practise really helps too in that regard. Take fx. SysVinit; their developers doesn't even have build test framework, so the only way to test whether a new patch doesn't break everything, is to make a live boot. No wonder they haven't made a release for many years despite the patches are accumulating.

Claiming that it isn't ready yet is just plain wrong and just seems to be some sorry excuse for not bothering to learn something new.

Comment Re:Why systemd took over (Score 2) 765

Thanks, that's interesting. I always thought one of the strengths of Linux was that the OS was highly separated from the GUI.

Don't believe him, what he says is demonstrably untrue. Both KDE and Gnome runs just fine on non-systemd distros and on BSD. This couldn't happen if they somehow where totally dependent on systemd.

The real story is that systemd provides some very needed OS infrastructure that Desktop Environments (DE's) like KDE and XFCE needs. The old non-systemd infrastructure that DE's could use instead, like ConsoleKit (CK), hasn't been maintained for years. The DE developers have warned the non-systemd distros for years that they needed to maintain CK, or that things would stop working, but they were ignored.

So Gnome, KDE, XFCE etc. still have support for non-systemd distros that are using eg., CK's login API, but things are beginning to fall apart since nobody have bothered to maintain that for years.

The point is that that Gnome and KDE played no role in why all major Linux distros have shifted to systemd. The simple fact is, that systemd simply is light-years ahead of any competing init-system; integrated groups support so each and every process can be controlled regarding resources, no more hard to write and debug shell scripts to start daemons (executable config files; who thought that was a good idea?), integrated kernel Capabilities(7) to provide defence in depth for all running daemons etc.

Read here for more reason to what systemd can and why it was developed:
http://0pointer.de/blog/projec...

Comment Re:Watching systemd evolve (Score 3, Informative) 765

Here is one of many:

https://bugs.freedesktop.org/s...

The TL;DR resolution: journalctl --fsck after rotation or pump it into a traditional syslog

Lennart Poettering's comments about it:

"our strategy to rotate-on-corruption is the safest thing we can do, as we make sure that the internal corruption is frozen in time, and not attempted to be "fixed" by a tool, that might end up making things worse"

Totally sensible solution, why would you edit log files? They are not meant to be changed.

Besides that, the log entries that are mangled are in them self important info; How can you detect a pattern of a misbehaving program that sends wrong field values if you delete the entry every time it happens?
Or what if the log corruption is caused by a failing disk where the bad blocks are spreading like wildfire? If you silently delete such entries and files, you delete the evidence for that something is wrong.

Comment Re:Question from a non-Linux user (Score 3, Informative) 765

If everyone hates systemd so much, why is it being incorporating into all these Linux distributions? Have all the major ones incorporated it? Does this "evil" Poettering guy really have that much clout in all the disparate distros?

The systemd haters are actually a tiny but vocal minority. They tend to flash-mob systemd threads, so you can often see here on slashdot, how a little handful of systemd-haters post 10-20 anti-systemd posts in anything remotely related to systemd. They seem like they are many, but when counting they are quite few.

No distro have lost users because of switching to systemd, in fact, systemd is part of the whole OS container wave that are fuelling the Linux engine at the moment. Not a single non-systemd commercial Linux distro have emerged since all the major Linux distro announced their shift to systemd, so the server market seems firmly behind systemd.

One reason why Canonical is changing to systemd as fast as it can, is because their OS container costumers are impatiently tapping their feet, waiting for systemd integration.

People have started to ignore this small, sometimes very toxic minority for quite some time, since the anti-systemd people are basically uninformed about any technical aspects of systemd, because they rely on hearsay and random hate blogs for their information about systemd instead of actually reading the systemd documentation.

Slashdot Top Deals

With your bare hands?!?

Working...