The Latest from ThreeFold - Cloud

• ThreeFold Forum
• ThreeFold Main Chat
• ThreeFold Farmers Chat
• ThreeFold Testing Chat
• ThreeFold Foundation GitHub
• ThreeFold Tech GitHub

🔗So what is the partnership all about?

Together with ThreeFold, Artheon aims to create the world’s largest open art database – made for everyone, and owned by everyone. We will provide access to art and cultural heritage to people around the world, without borders. Not just access, but a high-quality and high-resolution virtual reality experience where people can really immerse themselves in their surrounding environment. With Artheon, people can now even touch and hold paintings or artifacts, something that would clearly not be possible in real life. And while today, only a select few (relative to the total global population) have the opportunity to travel and to experience museums and cultural & sacred sites, Artheon will change that!

It’s not only about experience, though, it’s also about community and education and providing a more equal access to art and cultural objects. We’ll bring together a global community of museums, artists, and art seekers who can not only enjoy, but also teach and learn about the art and cultural objects housed within the Artheon universe. For Artheon, it’s imperative that people are able to access information about the artists and the art itself, and then make and share their own perceptions as well. No need or pressure to follow the direction of the current system’s ideology. This is a different angle from how we traditionally learn at school, where narrow or accepted views and concepts are imposed upon us. A key aim of Artheon is to bring different perspectives through collective, participatory, and experiental teaching and learning.

Looking ahead, the vision is that people will be able to create their own virtual spaces and expose them on Artheon. They can create something from scratch or even re-imagine a historical site as it was long ago and share it with the community.

🔗How does ThreeFold benefit Artheon?

From the start, there was a clear connection between Artheon and ThreeFold from a vision, values, and ethos perspective. But there are also some more specific reasons why Artheon chose and benefits from ThreeFold, which mainly revolve around the decentralized nature of the ThreeFold Grid.

Virtual and augmented reality (VR and AR) provide significant benefits to our new digital reality. These technologies open new ways of sharing information in areas such as the arts in the case of Artheon, allowing for upgraded and immersive experiences for users.

Decentralized clouds have been associated with the promise of new digital applications and services that come with a hyper-connected life. Because the graphics of VR/AR experiences require heavy rendering, on-device processes are augmented by splitting workloads between the VR/AR device and a decentralized cloud. So, graphics rendering on a decentralized cloud like what the ThreeFold Grid provides would be significantly improved by achieving a much lower latency. Another advantage of the ThreeFold Grid is that it provides an extremely high level of security and privacy, empowering Artheon and its users with real data sovereignty.

And finally, Artheon experienced an unfortunate event earlier this summer where their servers suffered from an intense heat wave and essentially burned up. There was no backup, and this would have been catastrophic in the scenario of them having millions of users. Good thing they aren’t live yet, but this is a great example of how centralized models fail. With a decentralized infrastructure like ThreeFold, this type of situation would not have occured, as data would be hosted on many locations.

So, by distributing the computing power closer to their users, a VR experience such as Artheon would not only improve their latency speed, security, and privacy, but also the resilience of their business model. 

🔗What is the status of Artheon (and its partnership with ThreeFold)?

Over the past year, Artheon has been making incredible improvements to the graphics and experience, and adding as many new pieces of art as possible into the universe. As you can imagine, the possibilities really are endless, but here are some of the milestones planned for the rest of this year:

• Planning to add partial DLC (downloadable content) support and photogrammetry-scanned locations for users to experience
• New UI for desktop (Windows, MacOS, Linux)
• Implementation of desired social features such as follower and friend system
• People will be able to see who of their friends or people they follow are online – from that, they can connect to a server and join them to share experiences together
• People will also be able to see how many people are online at the moment and where they are located on the globe (if permissions are allowed)
• Allow the possibility for museums to host free or closed paid exhibitions
• Artheon will be hosted on the ThreeFold Grid!
  

🔗What can you do now to get involved?

If you’re reading this section, we’re thrilled you are interested in what is happening with Artheon! We are, too! As Artheon is not yet live, the best option for you is to join the Artheon Early Access chat on Telegram where you can stay tuned there for updates and ask questions directly to Artheon’s creators and contributors.

Welcome back for the second part of this introductory series on ThreeFold Grid technology. Last time we took a high level view of all that the Grid offers. This time, we’ll be zooming in on storage, covering the low level components and how they can provide a familiar experience like the cloud “drives” and “boxes” we use today.

The ThreeFold Grid offers several different storage primitives that can be combined in various ways to meet the needs of developers and end users of Grid capacity. Ultimately, all storage services are a way of presenting the underlying hardware to software workloads in various ways, according to the desired features. ThreeFold has created a few unique storage offerings, providing distinct benefits over legacy cloud infrastructure. From the start, every component has been designed for optimal efficiency and they work together to offer an unprecedented level of security.

Our most basic storage primitive is a “volume”, which simply offers some disk space to an application in a generic way. We’ll focus more on the innovative solutions that are built on the Zero Database, or Zdb. These are compatible with existing use cases but also represent a quantum leap forward for privacy and security. They are called Zdbfs, Zstor, and QSFS. Let’s take a look at each component and how they work together to provide a complete set of tools for developers building on the Grid. We’ll also see why this matters to end users of services that are hosted on the Grid.

🔗Zdb

Zdb is a low level offering that implements with a subset of features from the popular Redis protocol. It is a key-value store, which means that information is indexed like a dictionary. Each “word” in the database is associated with a “definition” or piece of data. Zdb is super fast and efficient, along with operating in an “append only” manner. This means that all new data is added to empty space following the end of existing data, never overwritten. It’s like writing in pen on paper without leaving any white space.

Append only has many advantages, including extending the life of certain hardware and offering archiving features out of the box. The disadvantage, of course, is that old data is retained even when no longer needed. However, this can be addressed by periodically “compacting” the data, to remove what’s no longer needed and restructure what remains with the same level of efficiency. We use Zdb as a base layer for more complex storage implementations that benefit from these features.

🔗Zdbfs

While Zdb has all of those neat properties, it requires that applications utilize a specific database interface. To expand its capabilities, we have the Zdb Filesystem. With Zdbfs, the back end Zdb is exposed through the most common interface used for storing and retrieving data: a filesystem. This is the same format we’re all familiar with from the file explorers on our computers. When running Zdbfs, a new “folder” appears on the system, allowing reading and writing to the connected Zdb without any concern for the underlying database. With Zdbfs, nearly all existing tools for working with data can be plugged in to and benefit from the advantages of Zdb.

🔗Zstor

So far, we’ve been discussing solutions that utilize storage space on a single node only. While this offers flexibility for developers with a variety of needs, it is also limited in the sense that the failure of a single node would result in the loss of all data. With that in mind, we offer the Zstor solution for spreading data across multiple nodes in a way that provides both resilience against failures and unprecedented security.

Zstor takes a single file as input, to be stored among a number of nodes as specified in its configuration. The system is flexible and able to cater to different needs for performance, redundancy, and geographical distribution. Understanding what happens behind the scenes requires a little math, but I’ll provide as simple an explanation as I can. Zstor has a very unique property: it does not actually upload any of the user’s data to the back end nodes, but it is able to reconstruct the data later based on the descriptive information that is stored.

🔗The magic of erasure encoding

Sounds like magic? Well, let’s explore briefly how this is possible. Zstor relies on a technology known as erasure encoding, which was originally designed to protect data against errors that sometimes occur in the normal operation of computer hardware. Rather than simply making copies of the data as backups, a clever scheme is used to efficiently offer the same benefit. With basic redundancy, four extra copies would be needed to accommodate four failures without a loss of data. Erasure encoding can accomplish the same failure tolerance using less than half the space needed for the original data.

While erasure encoding can be implemented by storing the data itself along with some extra data known as “parity”, it can also be implemented without storing the original data at all. As a simplified example, let’s say that we want to store the number 13. First, we take each digit individually, 1 and 3. Next, we calculate 1 + 3 = 4 and 3 - 1 = 2. By storing 4 and 2, along with the instructions to reverse these calculations, we have everything needed to get back to 13. If we add one more equation, say 1 - 3 = -2, we can restore the original data using any two of the numbers we’ve computed.

Each of our values would be stored on separate nodes, while the instructions to recombine them would be stored in yet another location. If an attacker were to compromise one of these nodes, they would only have a number that’s meaningless without the other elements. If a single node fails, the original data can be restored using the remaining nodes, and we can add a new node to bring us back to our desired state. By tuning these values, additional security or redundancy can be achieved. We might decide that we want 9 of 10 values to be present for reconstruction, representing a high level of security. Alternatively, a 2 of 10 arrangement would provide high redundancy, tolerating the failure of 8 nodes.

🔗Quantum Safe Filesystem

With all of these components working together, we have ThreeFold’s flagship storage solution, the Quantum Safe Filesystem or QSFS. It uses Zstor to backup data written to a Zdbfs. This provides the convenient and highly compatible filesystem interface along with the exceptional security and redundancy benefits of Zstor. We call it quantum safe, because even an attacker with a quantum computer would not be able to decode users’ data, if they managed to hack into one of the back end nodes—already an extraordinary feat given the exceptional security of Zero OS.

🔗Bringing it home

So, we’ve toured a good bit of technology which might be feeling a bit abstract at this point. Bringing this home, our front end experience with these technologies can feel no different than any of the “drives” and “boxes” we use to store our files in the cloud. In fact, ThreeFold has already developed a prototype file browser based on QSFS which has many cool features like editing documents and viewing media directly in the web interface. It’s one piece of a full suite of solutions we’re excited to showcase and invite the community to test soon.

I hope you found this piece informative and approachable. Thanks for joining me to learn and explore the wonderful world of ThreeFold technology. We’ll cover more aspects of what makes it all tick in future parts of this series. Do you have questions or feel like chatting about what’s possible with ThreeFold’s technology? We’d love to hear from you on our forum or in our Telegram group.

Find out more about Blockheating here: https://blockheating.com/

Find out more about our partners here: https://threefold.io/partners

🔗Meet the Movement

To understand ThreeFold, you should first understand where we came from. Since the late 90’s, some of the ThreeFold co-founders have worked on Internet storage and cloud technology. And after years of building, and many successful launches, they came to understand that they were part of a broken system that was productizing people and damaging the planet. Despite this, they knew that the Internet held and holds the key to a better world, and that the only way to have a truly sovereign, secure, and energy-efficient Internet was to start from scratch. So we did.

This is how our story began – and over the past four years we have grown and expanded a team of like-minded and passionate people from around the world to bring ThreeFold to life. But for us, we are still in the beginning of something much bigger to come.

We don’t consider ourselves a company, rather a group of humans helping other humans – and our planet. We believe the world needs to change, and we choose to not just talk, but act, to make that change happen. We cannot and would not want to do this alone. There is a strong, passionate, and growing community around us – partners, farmers, ambassadors, technology testers, other contributors, and supporters just like you.

🔗Our Mission, Vision, and Values Drive us Forward

Our mission is to build and expand a data-sovereign and planet-positive Internet owned by the people, for the people. This will enable equal chances for people around the world to learn, partake and succeed, and will help to heal our planet.

Engrained into the work that we do are three key values or principles:

We believe in sovereignty, and in protecting people. Everyone should own their data, and no one else, not even ThreeFold. Our peer-to-peer technology allows every user to be data sovereign – giving them 100% control over their data.

We believe that everyone should be given equal chances to learn, partake and succeed. Internet access is a human right, and at ThreeFold we commit to scale our technology to new regions to empower the unconnected.

And we unify our practices, partnerships, and products around a single mission – to heal our planet. By making our technology actionable, we enable a collective approach to have an impact together.

🔗Together, We Invite the World Into the Fold

It’s important for others to understand who we are. Thus, we identify with and embody three key attributes as a collective, to show the world what the movement is all about:

ThreeFold is purposeful. We exist to help humanity thrive. Our mission is bold and motivates every step we take. We adapt to our evolving environment and passionately strive for excellence.

ThreeFold is empowering. We help people find themselves and do what they love. We provide support to people and projects that help build a better world, whether they have moonshot visions or down-to-earth ambitions. We aren’t the hero of our story – they are.

ThreeFold is approachable. ThreeFold keeps it real. We’re open and honest, avoiding upstage corporate language and phony marketing spins. We don’t see ourselves as a company, but more like humans helping other humans. So being genuine, friendly, and loving comes naturally.

In its essence, the movement is open and inviting. We’ve created a participatory Internet economy, where anybody around the world can plug in a 3Node and add capacity to the ThreeFold Grid. Together, we’re expanding a data sovereign and planet positive Internet infrastructure, owned by the people, across geographical and cultural borders.

We believe in collaboration, not competition. Our technology serves as a responsible underlying layer on top of which anybody can build and create. We have beautiful partners already on board – and an alliance of conscious people and organizations who share our vision – and we are constantly expanding our ecosystem across industries.

And while the ThreeFold Foundation is currently the driving force behind the ThreeFold Movement, we believe in decentralization. We have open channels like a forum, a two-way Telegram chat, Github (Foundation & Tech), and Twitter, where people can and do contribute, ask questions and provide feedback that goes into our everyday decision-making and actions.

As I said at the start, you’ve dreamt of a different world. And so have I. John Lennon once said, “A dream you dream alone is only a dream. A dream you dream together is reality.” Thank you for dreaming with us. Together, this will happen!

Photo by Ahmad Odeh on Unsplash.

🔗An Intro to the ThreeFold Grid

If you are a farmer or member of the ThreeFold community, you may be wondering about the capacity provided by the ThreeFold Grid and how it’s relevant to individuals and businesses who currently rely on centralized corporate clouds. This can be hard to imagine, because the back end infrastructure that makes all of our apps and services tick is generally invisible to us.

This piece will be the first in a series where I’ll be working to understand what the technical components are and how ThreeFold provides an alternative with distinct benefits for individuals, businesses, and for the planet as a whole. But don’t worry, we’ll start from the ground level and build up understanding in a way that’s accessible to everyone.

🔗Infrastructure for a New Internet

So, what is the internet? In short, it is a network of interconnected devices that facilitates communication and commerce. These devices include our mobile phones and personal computers, but also the servers that store and process data to provide the end experiences we enjoy. Currently the vast majority of these servers live in massive data centers controlled by a handful of corporations. ThreeFold is changing this, by allowing anyone to connect computational and storage capacity to an open network that is available for all to use, known as the ThreeFold Grid. Our farmers do include some data centers operating on a smaller scale than major cloud providers, and also many individuals connecting nodes at their home or office all over the world.

On the ThreeFold Grid, servers are known as 3Nodes. A 3Node can be pretty much any modern computer system, offering capacity by running the Zero OS operating system. This is a major distinguishing factor, both from the traditional cloud computing world and also from other projects working to create decentralized networks in this space.

🔗The OS for a Next Generation Cloud

By starting from the operating system level, ThreeFold is able to provide a network with much stronger security and greater efficiency than anything that came before. Zero OS includes a collection of components, known as “primitives”, which provide developers with everything they need. These primitives can be used to migrate existing applications from the legacy cloud and also to create new solutions that leverage the Grid’s capacity in unique ways.

We’re all familiar with operating systems like Windows and MacOS that provide an interface to applications on our personal computers. The OS interacts with the underlying hardware to expose its capabilities in a way that’s useful for both the software it hosts and also the humans who utilize it. For example, when you launch an app on your phone, it is the OS that’s responsible for connecting it to data networks and providing access to peripherals like cameras or microphones. Things are a little different in the world of servers, where rather than through direct interactions, users benefit through the services provided to the applications we use.

To extend the example, when you open a messaging app it will connect to a server somewhere to check for new messages and relay any messages you are sending to the recipient. Here we can see a central issue that has inspired the design of ThreeFold’s technology: when our messages pass through servers controlled by others, it creates an open door for surveillance of all kinds.

ThreeFold farmers, on the other hand, have no administrative access to their nodes. Furthermore, each component offered by the ThreeFold Grid is built with the intention of allowing for secure and private storage, processing, and transmission of information. Of course, sharing is absolutely possible, but only when the creator of data or content chooses for it to happen.

🔗Three Essential Resources

In the world of cloud computing, we speak of three basic resources provided by servers: compute, storage, and network. The ThreeFold Grid provides various primitives in each of these categories, to fulfill all the same needs served by centralized cloud providers. While our offerings have the special properties discussed above, they are also highly compatible with the most popular tools and protocols currently used in the industry. This makes it relatively simple to migrate the back end applications, also known as “workloads”, that provide a kind of connective tissue for all of the digital experiences we enjoy on a daily basis.

Workloads are pieces of software that provide services. If you upload a file to some cloud storage service, there could be a number of individual workloads orchestrated together in order to ensure the data you want to save is successfully transmitted to and stored in the back end system. We can understand the need for each kind of capacity by looking at the journey that your file might take in such a scenario. Starting on your device, a network connection, some processing, and finally storage capacity are all involved in providing the conditions that allow you to retrieve that file later.

🔗Network

Networking takes place over cellular connections, wifi, and wired internet lines to move data from one place to another. For our purposes here, those details aren’t so important—we’ll focus on what happens once communication is completed by whatever means.

When you connect to the cloud storage service, there are network workloads that transmit your data to the appropriate services that process and store it. This might consist of some routing and also authentication that ensures that you and only you access the files that are associated with your account. On the Grid, we provide primitives for secure peer to peer communication and also for allowing public access to back end services.

🔗Compute

Compute is what happens with data once it reaches its destination. Computers are mostly just fancy adding machines that take numbers and turn them into other numbers according to a set of specifications, which we call software. In our example, the compute step might involve compressing the information so it takes up less space and also deriving some useful statistics like the file’s original size.

Of course, there are many details we’re glossing over here, and the compute resources are ultimately responsible for providing much of our end user experience and the interactivity of the apps we utilize. 3Nodes offer a compute environment that natively runs the vast majority of workloads in use today.

🔗Storage

Storage, of course, is the disk space where data resides. It can be a little strange to think about, actually, that all of the information you’ve stored online actually has at least one physical location where it exists as many small electrical charges. On the Grid, application developers can access the disks of nodes directly, in a way that’s optimized for energy efficiency.

We also have more advanced storage solutions that offer unparalleled security and low overhead redundancy, giving users the best possible guarantee that only they have access to their data and that it will actually be there when they go to retrieve it.

🔗Looking Forward

Taken together, network, storage, and compute are the raw elements that give life to the internet we know and love. On the ThreeFold Grid, these elements are expressed in a way that’s both familiar for developers but also pushes the limits of what is possible in terms of technical evolution.

Thanks so much for joining me on this introductory overview of what the Grid provides. Please join me next time for a deeper dive on some of what we’ve covered and more specifics about how ThreeFold technology represents a quantum leap for cloud computing.