Want to read Slashdot from your mobile device? Point it at m.slashdot.org and keep reading!

 



Forgot your password?
typodupeerror

Comment Nothing to see here, likely GPT-3 content (Score 5, Insightful) 76

The TFA was written by a marketing bot or human drone and contains many nuggets of wisdom such as:

"POSIX has been the standard file system interface for Unix-based systems (which includes Linux) since its launch more than 30 years ago. Its usefulness in processing data in the user address space, or memory, has given POSIX-compliant file systems and storage a commanding presence in applications like deep learning that require significant data processing"

"POSIX has its limits, though and features like statefulness, prescriptive metadata, and strong consistency become a performance bottleneck as I/O requests multiply and data scales, limiting the scalability of POSIX-compliant systems. That's often an issue in deep learning[...]"

"Object storage is the most scalable of the three forms of storage (file and block are the others) because it allows enormous amounts of data in any form to be stored and accessed. "

"Using memory mapping to copy object data into the device means that all the data is temporarily stored and processed on the device rather than in POSIX."

"The SSD or other external device has much more available space for computing. The external device (a form of secondary storage for that computer) connects directly to the computer system and the CPU has a path to the data in the device: it is available almost as main memory while attached. Memory stays in the SSD during computing, and actively accessing the data—particularly the metadata—becomes much faster."

"Network computing power and speed will skyrocket. Though this may have its limitations - transferring data in file and block storage to object storage, for one - it will mean new developments for data-intensive computing."

Comment Re:Who actually uses ZFS? (Score 5, Interesting) 279

At my previous job we built all of our data clusters on top of ZFS. Why? Because of being in a highly regulated industry (for security) we ran everything on bare metal in our own datacentres. That and budget constraints meant we only had a finite/small number of machines we could allocate to this. We were able to reach mind blowing performance out of our ElasticSearch and MongoDB clusters by fine tuning ZFS's ARC and L2ARC (our workloads were very read heavy). In fact, ZFS's ARC got us out of trouble more than once. In one instance we ran into some pretty crappy performance issue with MongoDB's own cache flushing logic, ZFS's ARC, despite being completely oblivious to what it was storing, performed better/as expected from the hardware until the MongoDB bug was fixed.

We also ran extensive performance tests for our workloads for months prior to going live (we needed a guaranteed filesystem latency for this platform). We tested FreeBSD and OpenZFS (circa 0.6.8). There was no comparison, the FreeBSD implementation was much more predictable with a much lower latency standard deviation.

So there, we did all that for a fraction of what the equivalent cloud infrastructure would have cost, and we got all the data integrity perks to go with it.
 

Submission + - GlobalSign supports billions of device identities in an effort to secure the IoT (globalsign.com)

broknstrngz writes: GlobalSign, a WebTrust certified CA and identity services provider, has released its high volume managed PKI platform, taking a stab at the current authentication and security weaknesses in the IoT. The new service aims to commodify large scale rapid enrollment and identity management for large federated swarms of devices such as IP cameras, smart home appliances and consumer electronics, core and customer premises network equipment in an attempt to reduce the attack surface exploitable by IoT DDoS botnets such as Mirai.

Strong device identity models are developed in partnership with TPM and hardware cryptographic providers such as Infineon and Intrinsic ID, as well as other Trusted Computing Group members.

Slashdot Top Deals

The F-15 Eagle: If it's up, we'll shoot it down. If it's down, we'll blow it up. -- A McDonnel-Douglas ad from a few years ago

Working...