Back

πFS

217 points4 hoursgithub.com
jamwise2 hours ago

Reminds me of when I tried to use the library of babel as a data compression tool. It led me down a fun rabbit hole and was my first introduction to information theory.

The conclusion being that you basically need the same amount of data to represent the address of your data as the data itself, so it's not really effective at compression, just a fun thought experiment.

The cool part of this in modern times is that LLMs are basically a form of lossy compression that actually achieves the gist of what these tools fail at. Although it is lossy, and requires a massive substrate. This is related to the idea of AI/LLMs being a form of language compression.

dang1 hour ago

Related. Others?

πfs – A data-free filesystem - https://news.ycombinator.com/item?id=36357466 - June 2023 (107 comments)

πfs – A data-free filesystem - https://news.ycombinator.com/item?id=28699499 - Sept 2021 (30 comments)

PiFS – The Data-Free Filesystem - https://news.ycombinator.com/item?id=26208704 - Feb 2021 (1 comment)

Πfs: Never worry about data again - https://news.ycombinator.com/item?id=21359338 - Oct 2019 (1 comment)

The π Filesystem for FUSE: Store Your Data in π - https://news.ycombinator.com/item?id=19223032 - Feb 2019 (1 comment)

pifs - Avoid disk space usage by saving your files in the digits of Pi - https://news.ycombinator.com/item?id=18687275 - Dec 2018 (1 comment)

πfs – A data-free filesystem - https://news.ycombinator.com/item?id=13869691 - March 2017 (105 comments)

Πfs: Stores your data in π - https://news.ycombinator.com/item?id=10856108 - Jan 2016 (1 comment)

Πfs: Never worry about data again - https://news.ycombinator.com/item?id=10847693 - Jan 2016 (1 comment)

File system that stores location of file in Pi - https://news.ycombinator.com/item?id=8018818 - July 2014 (98 comments)

100% Compression Using Pi - https://news.ycombinator.com/item?id=6698852 - Nov 2013 (32 comments)

(Reposts are fine after a year or so; links to past threads are just to satisfy extra-curious readers)

Levitating1 hour ago

How are you generating these lists

programjames1 hour ago

If you click the website's name to the right of the title, it pulls up all the submissions from the same site:

https://news.ycombinator.com/from?site=github.com/philipl

Levitating1 hour ago

Even then I don't see a direct way to extract a list like this.

ChrisMarshallNY58 minutes ago

I think it's safe to assume that dang has access to tools that we mortals are unable to comprehend, without being driven to madness.

jwpapi1 hour ago

He’s the mod hero from HN

adzm2 hours ago

It is worth noting that as the length of data increases it becomes extremely unlikely that the index and length of the sequence within pi would actually be smaller than the data.

Aloisius2 hours ago

That seems easy enough to solve. Simply record the index and length in pi of the index and length in pi.

awesome_dude2 hours ago

See also: Recursion

mondrian1 hour ago

The index of your 20 line file is <20TB number>

12_throw_away2 hours ago

yes I believe that's the joke

jwpapi1 hour ago

He’s aware, he just added some curious information.

Levitating57 minutes ago

> The SDCS is only possible if keys are allowed to become infinite, or the data store is allowed to become infinite (...) This would, of course, make the idea useless.

But Pi is infinite. And thus this genius contraption will work as long as we have Moore's law on our side :)

giancarlostoro2 hours ago

Never heard of that one, that's amazing! Love it.

actusual56 minutes ago

This is why I got pi tattooed. It's a tattoo of all tattoos.

aidenn02 hours ago

I vaguely remember an entry to a compression-benchmark that gamed the benchmark by treating the filename as part of the input to the decompression-algorithm, thus beating the metric that only measured the size of the file.

bobim2 hours ago

This is disturbing to realize that pi then contains all the past and future knowledge, including when I'll pass away.

mike_hock2 hours ago

So does every other random infinite sequence of bits. The unintuitive part comes from infinity, not pi.

It also doesn't contain all past and future knowledge because it also contains all possible falsehoods about the past and future in a way that's indiscernible from the truth.

Encoding information as an offset into a pseudorandom sequence is no more storage efficient than storing the information directly.

sph1 hour ago

Are you aware this is meant as a joke, right?

xp841 hour ago

If it makes you feel better, consider that it also contains all plausible and implausible falsehoods about your demise as well.

nosioptar2 hours ago

The worst part is that it contains Star Wars 4-6 from an alternate timeline where Disney did a reboot casting Chris Pratt as Han Solo.

(Fun fact: "Chrispratt" is an ancient Californian word that means "Joel McHale didn't want the role.")

Yokohiii55 minutes ago

Around here it just means chrisp ratt.

1attice2 hours ago

Thank you for this Prattfall

thih91 hour ago

It also contains all possible falsehoods and comes with no way to distinguish what's true from what isn't.

nighthawk4542 hours ago

And also all the days you don’t, so, by itself not very meaningful. Especially since you can’t tell which one is right in advance. In some sense, so does a calendar

cadamsdotcom2 hours ago

Fear not! It’s probably so deep in pi that you’d pass away listening to someone tell you where!

skulk2 hours ago

this statement is equivalent to "pi is a normal number." While most real numbers are normal and pi is suspected to be so, it isn't known.

https://en.wikipedia.org/wiki/Normal_number

OkayPhysicist2 hours ago

So does a calendar, if you you buy them enough years in advance.

anthonj2 hours ago

So does a random number generator

koolala2 hours ago

It isn't actually proven true.

partsch2 hours ago

Finally, someone is doing something about the rising prices of storage!

thangalin2 hours ago

https://cs.stackexchange.com/a/53737/1704

> Matches that occur early enough in π to attain significant compression will not be varied. That is, it isn't possible to use π to compress interesting, real-world data because real-word strings are unlikely to arise early.

Levitating1 hour ago

> Since the file is 128 bits long, one would expect this place to be around the 2*128th bit.

> Calculate the number of bits to encode that value using log2(938933556), which is ~29.8

Can someone explain these two statements to me?

thangalin57 minutes ago

[dead]

giancarlostoro2 hours ago

I... I can't tell if this is an elaborate troll or pure genius. I love it.

pokstad2 hours ago

Both.

amluto1 hour ago

> Why is this thing so slow? It took me five minutes to store a 400 line text file!

> Well, this is just an initial prototype, and don't worry, there's always Moore's law!

Seriously? They're only storing individual bytes in pi:

> In this implementation, to maximise performance, we consider each individual byte of the file separately, and look it up in π.

So the whole transformation should be trivially reducible to a 256-element lookup table from source byte to location in pi and a similar table used to convert back the other way. Maybe a fancy formula could be used for the (never actually encountered) case in which a byte is encoded by one of the infinite available noncanonical encodings.

mzelling56 minutes ago

Looked at the repo but it says NOTHING about what value this project offers.

I mean, I get that it's "fun" to store information within the digits of pi. But is this just amusement, or is there a value prop for production use here?

(Speaking as a math major, by the way. I'm sympathetic to the cause.)

tcoff9154 minutes ago

I think it's pretty clearly for amusement. And it would kind of spoil the amusement if it were to explicitly mention that it's a joke...

mherkender55 minutes ago

It's a joke.

Lalabadie2 hours ago

Love it! This feels very much in the spirit of Tom7's Harder Drive [1]

[1] https://www.youtube.com/watch?v=JcJSW7Rprio

hnlmorg2 hours ago

This is probably a dumb question, but do we actually know that pi has an infinite number of decimal digits or are we assuming that it does because we haven’t developed a sufficiently powerful computer to calculate the last digit of pi?

I’m guessing this is something that could be formally proven?

hasteg2 hours ago

Here is a one page proof that pi is irrational - https://heuklyd.github.io/papers/pdf/Niven-1947.pdf

partsch2 hours ago

Thanks for the PDF. I feel like I understand even less now than I did before.

hnlmorg2 hours ago

Thanks for sharing. That’s a nice read. I’m glad I asked :)

stackghost2 hours ago

It's amazing how inscrutable calculus can be when you return to reading it after not doing so for a period of time, much like lisp or forth. I don't think I've actually done an integral or taken a derivative in years. I can see the elegance of that proof but I'll be damned if I can actually follow the mathematics from one step to the next.

liglam2 hours ago

[dead]

mike_hock2 hours ago

We definitely know that Pi is irrational, we just don't know if it's normal (i.e. if the PiFS joke even works).

pixel_popping2 hours ago

Well, that should get GPT-5.5 extended thinking going for a few weeks.

adzm2 hours ago

I'm intrigued that π was capitalized to Π presumably automatically in the HN headline.

cbm-vic-202 hours ago

    jshell> "πfs".toUpperCase()
    $1 ==> "ΠFS"

    Welcome to Node.js v26.3.0.
    Type ".help" for more information.
    > "πfs".toUpperCase()
    'ΠFS'

    Python 3.14.5 (main, May 10 2026, 10:21:34) [Clang 21.0.0 (clang-2100.0.123.102)] on darwin
    Type "help", "copyright", "credits" or "license" for more information.
    >>> "πfs".upper()
    'ΠFS'

    echo 'πfs' | awk '{print toupper($0)}'
    ΠFS
noman-land1 hour ago

Why does your Python terminal report May 10th? Today is June 10th.

Yokohiii59 minutes ago

He prepared the comment a month ago.

atvrager1 hour ago

It's the build date of their Python binary

danlitt1 hour ago

Probably daylight savings

koolala2 hours ago

Short Storage Number - SSN

0x123456789ABCDEF0

use this number as a shorter nibble storage alternative...

glitchc2 hours ago

At what point is the metadata larger than the actual file?

wavemode2 hours ago

Part of the joke is that, in this implementation, the metadata is guaranteed to be larger than the file:

> Now, we all know that it can take a while to find a long sequence of digits in π, so for practical reasons, we should break the files up into smaller chunks that can be more readily found.

> In this implementation, to maximise performance, we consider each individual byte of the file separately, and look it up in π.

mike_hock2 hours ago

Half the time it should be larger, right?

consumer4511 hour ago

So, π has been Boltzmann's Brain, this whole time?

charles_f2 hours ago

Posted many, many times before https://news.ycombinator.com/from?site=github.com/philipl

My favourite issue being about GDPR compliance https://github.com/philipl/pifs/issues/56

j3th9n1 hour ago

Why would anyone need πfs, since you can already build such a system yourself quite trivially on Linux.

leephillips2 hours ago

What a brilliant idea! Of course, of course, it’s not in the repository so I can’t apt-get install it. Debian...always so far behind.

Levitating2 hours ago

absolutely genius

spchampion256 minutes ago

This is interesting, but I feel like my use cases would better align with a different irrational number. Could I get an option to do this with e instead? /s

Lapsa1 hour ago

[dead]