Become a fan of Slashdot on Facebook

 



Forgot your password?
typodupeerror
×
User Journal

Journal Journal: OpenZFS 2.2 data corruption issue, high reliability alternatives

There is a rare but repeatable bug in all versions of OpenZFS that silently corrupts data. This includes the pre- releases. 2.2.1 seems to reduce the odds of it happening but does not fix the issue.

From the reports I'm seeing, it would appear that nobody actually understands how ZFS (or Btrfs, for that matter) actually works, they're limited to whatever component they've specialised in.

Linux has a kernel mechanism for improving data reliability on filing systems that support it - dm-integrity.

I've no idea how well tested this component is. I don't recall ever having heard of it before. A quick Google suggests that it works but is very slow, though I would inagine it will improve with time.

Phoronix, OpenZFS Data Corruption Battle
TRUENAS, Corruption with OpenZFS ongoing
YCombinator, OpenZFS silent corruption bug
Level 1 Techs, OpenZFS silent corruption bug

OpenZFS is not included in the Linux kernel by default dud to licensing issues, but I believe it is currently developed on Linux and ported to other OS'. (Wikipedia says that this has been the case since 2013.) It now runs in the kernel, so it's a lot faster than it was when it worked with Fuse.

Wikipedia, OpenZFS

This is a high performance, high reliability filing system, so data corruption is really bad news. It's designed for the enterprise and outclasses Microsoft's RefFS on essentially every stat. Irs main disadvantage is that it is resource-intensive, although the license is another important issue.

One drawback with OpenZFS is that it doesn't currently support RAID. Which is odd, given the intended market.

Interestingly, I don't know of any cloud providers or corporations that actually use OpenZFS. Ext4 tends to be more popular, at the expense of enterprise features.

Oracle has re-closed Solaris' ZFS, so the two filesystems are no longer compatible. But as effectively nobody uses Oracle Solaris, this doesn't matter much.

I guess the main takeaways with the current OpenZFS bug are that filing systems are becoming too complex for the hunt-and-peck approach often used in both commercial and open source projects, and that the popularity of other filing systems in OpenZFS' own domain suggests that feature-rich filesystems might actually be the wrong approach.

User Journal

Journal Journal: Security is still a low priority 8

https://arstechnica.com/security/2023/11/developers-cant-seem-to-stop-exposing-credentials-in-publicly-accessible-code/amp/
https://www.theregister.com/2023/11/13/royal_mail_cybersecurity_still_a/
https://www.itgovernance.co.uk/blog/list-of-data-breaches-and-cyber-attacks-in-2023
https://www.securityweek.com/tens-of-thousands-of-cisco-devices-hacked-via-zero-day-vulnerability/

It would appear, on the face of the above links, that developers still take shortcuts and don't program defensively, and that IT departments avoid applying security fixes and are not taking other protective measures (such as encrypting databases).

Cybersecurity, from the looks of things, is something that is simply never taken seriously. An optional extra that poses no consequences if not applied.

The consequences can be severe. The number of people at risk In Maine from identity theft runs into the millions. The loss of privacy from the intensive care ward that was recently hacked may have severe financial and employment consequences.

And yet neither programmers nor IT managers are altering their behaviour, despite the potential for enormous consequences to those they are responsible for.

Libertarians would argue that people can switch providers, but some providers are either de facto monopolies or natural monopolies. In other cases, there's no evidence that any of the alternatives are any better. Market forces don't function when there's no functional market.

But what's the alternative? There's no evidence regulation is helping, where regulations exist and are meaningfully enforced. It's just considered the cost of doing business.

What, then, would actually help?

User Journal

Journal Journal: Supercomputer quirks

The High-Performance Conjugate Gradient benchmark shows Supercomputer Fugaku top of the list, with Frontier as second place. This is, of course, the reverse order of the Top 500 list.

The stats?

Fugaku:

Cores: 7,630,848
Linpack Performance (Rmax) 442.01 PFlop/s
Theoretical Peak (Rpeak) 537.21 PFlop/s
Nmax 21,288,960
HPCG [TFlop/s] 16,004.5

Frontier:

Cores: 8,730,112
Linpack Performance (Rmax) 1,102.00 PFlop/s
Theoretical Peak (Rpeak) 1,685.65 PFlop/s
Nmax 24,440,832
HPCG [TFlop/s] 14,054.0

This is interesting because Frontier has two and a half times the Rmax and 1.1 million more CPU cores to play with. That's not a trivial figure. Of course, Fugaku is running Linux, whereas Frontier is running an OS from some upstart called Cray, so one might expect Fugaku to do better on those grounds.

For those wanting to compare their own PCs to these computers, here's the source code:

Linpack Source
HPCG Source

User Journal

Journal Journal: DeHavilland Mosquito bomber for sale 1

Yes, an actual WW2 Mosquito is being sold.

A DH98 Mosquito, bomber variant, is being restored (and a good chunk rebuilt from scratch). It'll be the only bomber of this type of plane that is airworthy, on completion.

The current owners also want to sell it. At NZ$11 million plus, it's not cheap. (But it'd be a hell of a way to commute to work.)

I've only ever seen one other Mosquito sold, they're that rare - especially in flying condition. It's this last bit that worries me, as collectors have bought flying Mosquitos purely to let them deteriorate in the open. This is partly why only something like three still fly

This is an amazing plane and, no, I don't honestly thing a whip-round of Slashdotters would get the money needed to but it and keep it in running condition.

This journal entry, then, is more about salivating at this truly geeky aircraft. If anyone has a TARDIS handy, and next week's lottery numbers, this would be a cool toy to have.

User Journal

Journal Journal: Calculating value 5

Some time ago, I put forward an idea for an improved schooling system. It would cost more than a regular school for the same number of students, but should - in theory - result in students getting the education they need rather than some low-grade default that will end up causing harm. But how would you estimate the benefit of such an idea, given that it would be impossible to persuade anyone of the merit of trying it out without some evidence that it would actually generate more value than the extra it would cost?

I've also got some ideas for inventions, but they run into a similar problem - it would cost a fair bit of cash to go from idea to something solid that could be sold, but how do you estimate how much you could make off such inventions without actually investing the money and trying it out? (I don't have the money, so it would take an investment by someone and that would require that I persuade that someone that there'd be a worthwhile return. Which is going to require some sort of estimate and a plan of how to achieve that.)

This is something that big companies can afford to play around with, but if you're starting off from scratch, you don't get play money to throw at such things. You have to know what is likely to work before trying it out. The reason that most start-ups fail is that they have the ideas but either very, very bad estimates or no estimates at all.

If it's impossible to know if an idea is worth pursuing, then only those who are willing to take massive risks will ever pursue their ideas, but those are likely to be the ideas not worth pursuing. The intelligent, rational ideas that are worth chasing up won't ever happen because those are the people who won't have the resources to try the ideas out.

User Journal

Journal Journal: MUD-1, The Source, and other programs

The source code for MUD-1 has been released under GPL-3. This includes the two adventures - MUD and Valley - that the server originally supported. A third, based on Essex University memes and a genocidal interpretation of Fraggle Rock, no longer exists anywhere, regrettably. Instructions for building the game on an emulator running under Linux is provided, but I'd still rather do a proper port to a modern language and not have to run emulators. Essex BCPL is the dialect of BCPL needed to compile the MUD1 sources for the DEC10.

Machine-independent BCPL will compile most of the code and would be the place to start if wanting to run on a Linux box. Be warned, as MUD-1 doesn't use sockets, the networking code would have to be rewritten or emulated if the engine was to be ported.

For those who missed my earlier journal, MUD-1 is the original multi-user text adventure, originally written for a DEC-10 mainframe. For its time, the map is massive, and the full-sentence parser (although primitive) was more powerful than that of any PC adventures (including Infocom's) and, indeed, that of any of the later MUDs. although Discworld's custom game engine comes close.

Porting MUD-1 to a modern language would be tough - BCPL doesn't have many conversion programs out there - but I can't see it as being impossible. This would demonstrate the mad coding skills of people like Richard Bartle (who now writes such software professionally). The alternative would be to write a translator that converted the MUD-1 map and objects into a format suitable for FluffOS (the Discworld MUD game driver that has been publicly released) or one of the other MUD engines. Technically, this should be much easier, but still very challenging.

Also included in the archives released are the original Zork and Spacewar. Zork was converted from MDL to C, by way of Fortran. and one person's archive of this can be found here. MDL isn't BCPL, so I can't use the same code.

For those wanting to run the original original Zork, as opposed to the translated version, MUDDLE is the original name for MDL and this should work. At worst, it's another language for geeks to learn. :)

User Journal

Journal Journal: MUD-1 6

Thanks to Richard Bartle, I have the source code for the original multi-user adventure game MUD-1. Map included. The code is written in BCPL and is intended to run on the Essex DEC-10 mainframe. It sometimes ran on other DEC-10 mainframes, but could be temperamental.

There are essentially four options:

  1. Debug the code so that it'll run smoothly in a DEC-10 emulator
  2. Modify the BCPL code to run under Linux (there is a BCPL compiler for it)
  3. Hack CircleMUD or some other LPMud descendent to re-implement the parser and other missing features, then port the map and puzzles over
  4. Reimplement the entire game in a more modern language

So far, I've been pursuing option 1. It's not easy, those DEC-10 emulators are, in themselves, a bugbear. I'm now switching my attention to option 2. A BCPL interpreter by the same author as the original used by Roy Trubshaw and Richard Bartle to write MUD-1 does exist for Linux. The source is free. The restriction of private or academic might be an issue depending on what that restriction means in practice.

Although I'd normally prefer to go this route and preserve some wonderful historic code, clean-rooming the features may prove easier and would come with fewer entanglements. In either case, I'll need to improve my skills in BCPL, a language that now really only has this one purpose to justify its continued use.

I know there are a few out there who can remember either this specific game or MUDding in general. I'm curious as to what the popular view would be.

It's worth noting that MUD-1 is still actively running on British Legends at https://www.british-legends.com/CMS/

So why bother with trying to get the server up? Because I don't like being tied to an organization that can vanish at any moment, because there's too much PK-ing there, because new wizards/witches don't get added to the graveyard maze, and because they removed the berserker code. (Berserkers in MUD-1 could get twice the value from player killing and were the only ones who could use the broadsword, but could get no points from treasure, had to become berserkers before they reached level 4, and couldn't become wizards/witches.)

Also because there's some nasty bugs left in with NPCs and these really should be fixed.

User Journal

Journal Journal: A question of genetics/epigenetics 3

Genetic Age:
https://www.theguardian.com/science/2022/jun/13/biological-age-startups-why
https://clockfoundation.org/
https://www.mydnage.com/

Whole Genome Sequencing and search engines:
https://nebula.org/
https://www.gedmatch.com/
https://promethease.com/
https://blast.ncbi.nlm.nih.gov/Blast.cgi

Miscellaneous articles:
https://www.today.com/health/do-personalized-diets-work-t183387
https://www.self.com/story/dna-diet
https://www.forbes.com/sites/bernardmarr/2021/02/26/whats-biohacking-all-you-need-to-know-about-the-latest-health-craze/
https://www.webmd.com/vitamins-and-supplements/features/nootropics-smart-drugs-overview

So many tools, so little useful guidance. For example, if you get guidance on diet via a genetics site or a biohacking site, how does that impact your biological age as measured under the Clock Foundation's measures? If at all? If we can objectively test claims, where are the studies showing the experiments?

And if the error bars are too high, then how do we know if the measurements are saying anything at all?

If none of this is known and it's all about doing the experiments, then who is doing those experiments? And what experiments are they doing?

User Journal

Journal Journal: The Internet is Wrong 4

https://physicsworld.com/a/web-of-confusion/

A school teacher has written an excellent piece on how sites give misleading to blatantly incorrect information, even on very basic science.

The idea that people who are given bogus information on the majority of sites can do their own research on the Internet is increasingly dubious, but there's no easy solution as long as the interwebs are regarded as reliable, or better, than subject matter experts.

User Journal

Journal Journal: Thoughts about Linux 1

Someone suggested writing their own Linux distro. That's what I did, back in the day before decent distros. Now we're post-decent, that might not be such a bad idea. But how would you structure it?

My thinking is that you could have some basic, tested, packages that you're sure work fine, plus an automated test suite, plus some cross-compilers and some VM images.

Person X requests a distro and wants a basic. They get the basic, precompiled version.

Person Y requests a distro, wants it tuned and runs a tuning app. This gives a rundown on hardware present. The cross compilers then build optimised binaries for that platform, omitting unwanted drivers and including normally disabled options that can be exploited. This is tested on the VM using the automated tests. Anything that fails the test gets swapped for the basic binaries. Person Y gets emailed their distro is now available for download.

Person Z requests the distro for a normally unsupported platform for which the tuning binary has been built. Same as above, but features that fail the test don't get included.

This gives you the same sort of flexibility as gentoo, without having to mess with flags personally and without having to have the horsepower to compile everything at a decent speed, with the added bonuses that the site can serve the distro to multiple people with similar hardware (so build once, serve many), better testing to avoid hardware quirks, and with easier flag handling for such corner cases.

In principle, this means you have to write thorough automated test suites, but only have to produce a handful of validated releases to support a far wider range of situations.

User Journal

Journal Journal: Isotopic purity matters

https://sst.semiconductor-digest.com/2020/02/theres-still-plenty-of-room-at-the-bottom-isotopically-pure-materials-for-when-every-atom-counts/

Yes, it really does matter if wafers for regular semiconductors are not isotopically pure. Likewise, it matters if the materials in other computer hardware are not isotopically pure.

The question is, how pure can you get things before cost exceeds benefit?

User Journal

Journal Journal: Denisovan find in Laos

Since I'm rewriting this as a journal, I'll add a few more links.

According to the scientific journal Nature: "A fossilized tooth unearthed in a cave in northern Laos might have belonged to a young Denisovan girl that died between 164,000 and 131,000 years ago. If confirmed, it would be the first fossil evidence that Denisovans â" an extinct hominin species that co-existed with Neanderthals and modern humans â" lived in southeast Asia."

Whilst not strictly surprising, as Denisovan genes had previously been found in Tibetan people, there had been no archaeological evidence of Denisovans outside of Siberia, the genes might have arrived later. This new find makes it likely that the Denisovans were there at the time.

There has been work on East-Asia-specific Denisovan markers

In Bajau, the genetic markers that allow Sherpas and other peoples to live at high altitudes also allow islanders to freedive for longer than other humans, which raises some interesting questions over who inhabited what areas in ancient times.

This new find would imply that the Denisovans lived in these areas with humans moving in later on, with the two coexisting for a while, rather than having crossbreeds move in from somewhere else.

User Journal

Journal Journal: Flawed spam detector 2

https://slashdot.org/submission/15967006/denisovan-find-in-laos

This was marked as spam. How and why? It's not a gratuitous quote from the article and is followed by what it implies.

User Journal

Journal Journal: Conspiracy theories 9

If we look at a lot of the modern conspiracy theories (antivax, covid being fake, gun crime against schools being a hoax, global warming being a hoax, etc), they all seem to be things that people feel powerless about.

The four I listed are things individuals can't do much about. And modern society is all about the cult of the individual. It would require large scale collective action to deal with them, and if you reject outright the concept of collective action then the easiest way to cope is to pretend the issues don't exist.

Having vaccine anxiety is distinct here. There, some power does indeed rest with the individual. You can test for hyperactive immune systems and allergies, so can know if a given type of vaccine is safe. And yet people who are anxious aren't obviously getting tested.

Now, some who are aren't getting listened to by doctors, and that's a legitimate complaint. Some of that is because doctors are overworked, and that too is a perfectly legitimate complaint. And there has been (and still is) a lot of sexism and racism in the medical profession, leading to poorer outcomes and unnecessary injury/death.

These issues are verifiable, very real, urgently need to be fixed and should not be accepted by anyone. But that is precisely what makes them different from conspiracy theories. They're trivially verifiable. There are no aliens or crime syndicates hiding this information.

There are other conspiracy theories, such as the tendencies of politicians and the powerful, whether Lord Lucan is alive, a new world order, and so on.

These also look like a feeling of being powerless, and a way to "explain" why the person is powerless. After all, if politicians are alien lizards or part of an organized crime syndicate, then the public would obviously be powerless. That would be a natural conclusion.

The last category, what might be called traditional conspiracy theories, would be the flat Earth movement, the fake moon landings belief, and so on.

The idea here seems to be, again, powerlessness., this time based on the notion that the public isn't being told everything, that scientists are keeping secrets.

I can understand that to some extent. Governments are loathe to let scientists talk freely, it's natural to be suspicious about things you're not told and the paranoia over secrecy extends to things that the public already know.

(Strong encryption exports were only legalised in the US after one person had the RSA algorithm tattooed onto him.)

Extrapolating from this paranoia to the idea that the moon is a hologram is a stretch, but it's understandable that some people will react badly to this feeling of powerlessness and helplessness, and unelected scientists are easy, soft, targets.

All of the above also involve this idea of having secret inside knowlegde about "the truth" (which is also about control, since now you get to be the one who controls it).

Since the underlying issues revolve around the worship of the individual over all else (and thus making personal power sacrosanct and all that denies such power a heresy), maybe one step would be to have schools teach a more balanced approach rather than reinforcing this absolute ideal.

Extremes (be it a communal extreme, an individualist extreme, a hedonistic extreme or an ascetic extreme) are toxic but modern discourse doesn't leave any room for the middle ground any more.

And when that middle ground is claimed, it needs to be claimed by all sides. The extreme position, I suspect, is a reflex reaction of all the other extremes.

The second part is about control issues. Everyone wants to be the leader, nobody likes following, and in a world that respects status and glamour rather than people, there's an obvious reason for that. Control is also a mental health issue and in the whole strong, self-sufficient ideology, mental health issues are something only other people have.

Banish the extremes and the glorification of indvidualism and power. Science isn't the problem, nature is never a problem, and even politicians don't have to be a problem if they don't want to be.

Then we can finally start seeing rational debates and actual solutions to problems.

User Journal

Journal Journal: Slashdot issues 1

For many years now, the side bar on the front page has been linked to DustyM's account but to my account on all of the secondary pages. This has been annoying and I've given feedback on it a few times with no response.

Does anyone know of a way to fix that damn sidebar? If not, I have been using the workaround for a long time now, but it is exceedingly irritating.

Slashdot Top Deals

Crazee Edeee, his prices are INSANE!!!

Working...