The Latest from ThreeFold - Cloud

If you’ve seen The Social Dilemma, you know all too well that today, people are being turned into products. Everything we do online – all of the data we upload and all of our digital activities – is tracked and oftentimes used against us. Targeted advertising is just the beginning.

Personal data is used by algorithms to make incredible important decisions, like whether someone should receive financial or health support or benefits. In China, people are now even receiving “scores” for their behaviors. It sounds like Black Mirror, but it’s real life.

That’s the scary part. The good news is that things don’t have to be this way. ThreeFold is building the engine for an Internet where people can finally be data sovereign.

With today’s Internet, infrastructure is centralized. Companies provide services in exchange for your personal data, which is stored on servers in hyper-scale data centers owned by private companies.

In ThreeFold’s model, those servers are called 3Nodes, and rather than sitting inside centralized data centers, they sit inside the homes or offices (or small data centers) owned by independent people and organizations called Farmers. But the data inside is owned by the person or persons who put it there. They maintain access right as well. From a technical standpoint, data is dispersed across 3Nodes by an algorithm that makes it such that nobody can access it. In addition, connections are peer-to-peer, meaning data goes directly between sender and recipient rather than passing through intermediaries as it does today – bringing further levels of security.

Thus, people can finally be data sovereign, knowing their data is safe, and truly theirs.

Just like a brain is an interconnected network of neurons, the Internet (or internet) is a global interconnected network of computers and devices that communicate with each other via the Internet protocol suite (TCP/IP). The communications infrastructure of the Internet consists of hardware components and a system of software layers that control various aspects of the architecture.

To create a new Internet from scratch, ThreeFold had to start at the operating system (OS) level. An operating system is a software that manages computer hardware, software resources, and provides common services for computer programs. And this is how Zero OS was born

🔗What makes Zero OS special?

Zero OS is a stateless and lightweight operating system. Given it has no shell, remote or server interface, it is much safer than the big majority of the OSs on the market. When storing your data on Zero OS, it is fingerprinted and made available only when requested by you or those you provide access to.

The state of an application represents its state of being in a given moment in time. Think of a stateless transaction as vending machines, a single request and a response. In ThreeFold’s Internet infrastructure, this can be represented as data being accessible only when requested. The only way to access data on Zero OS is via the private key (or fingerprint) of a user. In that sense, the data is not accessible unless the data owner requests access to it.

🔗How does Zero OS apply to developers?

Thanks to its lightweight architecture, Zero OS is a perfect fit to run microservice architectures and emerging IT workloads such as IoT, Blockchains, Big Data, and more. A key benefit of microservice architecture is the freedom it offers you to choose the best runtime for the task at hand.

Let’s take the example of decentralizing service-oriented developing teams. A common challenge there is that most of the time they don’t really understand the applications they are exposing. But no one knows the data infrastructure of the applications better than those who craft them.

ThreeFold permits decentralized developer teams with the ability to share keys (access) to the developing environment on Zero OS and the gateways to the world wide web within the secure peer-to-peer overlay network. This is game changing. Also with all the automation frameworks provided, it creates the perfect environment to develop current and emerging technologies.

Put shortly, decentralized development and integration is now officially an organizational or cultural change, not a technical one anymore.

🔗Zero OS allows anyone to provide sovereign capacity

Given stateless systems separate the OS configuration and user data, Zero OS simplifies the maintenance and the deployment of digital workloads, while making it impossible to hack into user data on a hardware level.

3Nodes provide all the storage, compute and network primitives for a new internet infrastructure. Given they are booted with Zero OS, anyone can now participate in the Internet economy without jeopardizing user data sovereignty and security.

Conclusively, Zero OS is ultra secure, perfect to develop current and future technologies, and enables anyone to take part in the planet positive and data sovereign Internet brought by ThreeFold.

Learn more about Zero OS and the grid primitives here.

There’s no question that climate change is one of the biggest, if not the biggest threats facing humanity today. If we care at all about future generations and the health of our planet, we have no choice but to address these threats, and fast. That’s why one of our biggest aims is to lower the energy usage of our digital lives. But ThreeFold is taking not just a sustainable approach, we’re setting the plan for a planet positive Internet.

Recently, we released information on how our infrastructure saves up-to-90% on energy consumption compared to existing models. We achieve this mainly thanks to an extremely efficient storage system and the concept of a Digital Twin.

From a storage standpoint, we reduce energy by avoiding copies, implementing a multi-layer system, not using fast disks, through read/write caching, and more. With Digital Twin, we have taken a very different approach to how we exist in today’s digital world. Rather than existing 100 times in a huge system of client-server architecture, now we exist only once. We believe that we can run 25 Digital Twins with the same energy as used by one light bulb.

Saving energy is one thing, but there will still be remaining energy. This needs to be offset by carbon credits. Now, in order to regenerate our planet, we work together with Take Action Global to let students farm carbon credits. This has the potential to offset energy usage 100% by the end of 2021, and we have, as an aim to take 2x more carbon out of the air than we put in.

Our planet needs better solutions across industries. No more talking. Now is the time to act.

🔗The Data Center Problem: Cost & Proximity

The centralized data centers that power today’s Internet are located “strategically” mainly in North America, Europe, and select parts of Asia. For populations living in these regions, Internet is accessible and generally relatively affordable. But the further you travel from these data centers, the less available and more expensive the internet becomes. Internet access is mostly an issue Sub-saharan Africa, throughout Asia, and some parts of South America.

Of course some data centers can be and are being built in and near developing and remote regions, but for reasons including cost and audience, this hasn’t been a huge priority to date. Beyond that, the data center model as a whole simply cannot scale to meet the future demands of the internet nor is it sustainable for our planet, so this is not the right option.

🔗The Internet Shutdown Problem: Control & Manipulation

Lack of internet access isn’t always just an availability or affordability problem. Today’s internet can be limited or even shut down at any point, by the right people. Take a quick look at NetBlocks.org, an organization that reports on global internet disruptions or outages. Typically governments are enacting these measures during times of unrest or protest or  important political moments. Even in the United States, the Executive Branch of the government has the power to shut down the internet in a case of a national emergency.

Cutting the internet or restricting certain services based on region (a common practice as well) is not only not right, it’s dangerous. People rely on the internet for information and communication and no government or entity should have the ability to shut the internet down at their discretion.

🔗The ThreeFold Solution: Fair & Neutral Internet for All

In 2016, the United Nations declared internet access to be a human right, yet today if you are reading this post, you are privileged. All humans deserve access to the internet and ThreeFold has the solution.

With the ThreeFold model, nodes can be set up anywhere in the world where an existing internet connection and electricity are present. By putting physical infrastructure at the edge (close to users), greater levels of access can be reached.

Further, the ThreeFold Grid cannot be shut down or manipulated. It is a neutral internet owned by the people, where autonomous technology heals and runs itself and requires minimal human intervention.

Today we are working with partners in the clean energy and network / connectivity to build the solutions that are needed to provide fair and uninterrupted internet access with all corners of the world.

Of course we will need new safe, secure, and private solutions for people to collaborate online. Many of these are already live and deployable via ThreeFold Now Community Solutions. We are working with partners in the education space as well to build toolsets for students to enrich their lives.

We need a more inclusive internet, and that is what we are building.

🔗What is Peer-to-Peer?

Peer-to-peer (P2P) is a term that originated from the distributed computer application architecture where tasks and workloads are shared between peers, popularized by Napster, a revolutionary file storing system from the late 1990s.

The concept inspired new structures and philosophies in many areas of human interaction. P2P systems and groups are typically critical of authoritarian and centralized social structures and believe in equality, meritocracy, flat systems, participatory & circular economies, as the concept represents a concrete pathway to these outcomes or visions.

P2P systems are network, not linear or ‘pyramidal’ hierarchies (though they may share some elements). They are ‘distributed’, though they may have elements of ‘centralization’ and ‘decentralization.’ And intelligence is not located at any center, but everywhere within the system.

🔗How does ThreeFold relate to peer-to-peer?

ThreeFold’s Peer-to-Peer (P2P) computing network is a distributed architecture that splits tasks and workloads between its peers, ThreeFold Farmers. Farmers are equal participants in the network and together they form a peer-to-peer network of nodes, the ThreeFold Grid.

Farmers make their resources, such as processing power, disk storage or network bandwidth, directly available to other network participants, without the need for central coordination by servers or stable hosts. Farmers are both suppliers and consumers of resources, in contrast to the traditional client-server model in which the consumption and supply of resources is divided.

In the near future, ThreeFold will create Digital Twin, which will go beyond the era of peers doing similar things while sharing resources. It will actually enable much more than that. Digital Twin will create a complete new digital world with diverse peers that can bring in unique resources and capabilities to a virtual community on the ThreeFold Grid. This will empower the network of peers to engage in greater tasks beyond those that can be accomplished by individual peers, and are beneficial to all the peers.

🔗Why did ThreeFold choose peer-to-peer? 

Everything starts (or should start) from the why, and the ThreeFold story started a long time ago. Before the inception of ThreeFold, many of the co-founders of the project used to work with the largest IT & Cloud actors. Throughout their experience working in the Industry, they realized that the complexity of the technology and the centralization of knowledge & power led to an inefficient, unsustainable, not scalable and unequally distributed infrastructure. So they decided to redesign the whole Internet and cloud infrastructure bottom-up with the vision of shaping a global internet economy that can scale anywhere efficiently, cost efficiently and sustainably. 

🔗Why does the world needs peer-to-peer? 

By developing the technology, the conviction that peer-to-peer was the best solution for humanity and the planet strengthened itself. Why? Well, put simply, a peer-to-peer system removes all forms of intermediaries, unnecessary steps and complexity from the picture. Therefore, it simplifies the architecture in an incredible way. The benefits are many but here are the most popular benefits:

• Privacy: Our peer-to-peer environment means no middlemen or intermediaries, meaning data travels directly between peers and stored on the nodes of their choice rather than being sent through and stored by a third party.
• Security: Data stored in data centers is susceptible to security breaches. In bypassing data centers and exchanging data directly between peers, we can achieve much greater security as it reduces code and back doors significantly. 
• Scalability: In a many-to-many system, scale is essentially unlimited. There is simply no bottleneck. And hardware (nodes) can be added at ease compared to current data center model.
• Cost-efficiency & Sustainability: End-to-end (direct) connection between peers means a more efficient path for data and less energy is needed. Less energy means less cost, and less harm to our planet.

🔗In 2021 the world is going peer-to-peer! 

We’re now in 4 years into the project, and it is clear that ThreeFold holds the most advanced technology and is probably the only tech company in the world that can achieve a peer-to-peer network & digital world as envisioned by the concept authors. The ThreeFold Grid is running and already at it’s 2.4 version and 2021 will bring various commercial opportunities for the public to partake in the peer-to-peer network, from hosting IT workloads to experiencing P2P end-user solutions. In other words, in 2021, the world will be able to go peer-to-peer.

🔗Simplicity is the key to unlock a better future

Over time, integration suites, middleware solutions, and enterprise service busses have been invented and implemented to cover integration challenges within the current internet. This has further complicated IT architectures, resulting in a loss of actual end user workload performance.

ThreeFold reworked the whole approach to IT architectures and eliminated the layers of complexity. The result is a cloud stack that presents minimal overhead and that requires less hardware – reducing heat generation and eventually cooling requirements. By reducing the need for power, the net result is an energy-efficient Internet grid.

🔗Improving resilience and efficiency through Self-Healing IT

Keeping systems up and running is a major requirement in modern day IT. Leading vendors earn most of their margin by selling maintenance contracts, performance guarantees, and professional services. Their business models bring no incentive to make things simple and efficient for consumers.

Creating a self-healing environment requires only minimal manual intervention to replace broken hardware components. Broken hardware components are inevitable, and the Zero-OS distributed node architecture deals with such failures by turning off broken components and provisioning unused capacity. By removing the need to ship broken parts back and forth, and linking to the corresponding installation knowledge (engineers), a lower carbon footprint can be achieved.

🔗“No painkiller” approach. We tackle the root issue

If a specific piece of software or hardware is not delivering the required performance or reliability, we should analyze the core design/algorithm and its usage of soft/hard components to determine the root causes of persistent issues to be solved.

Currently, most storage vendors follow the path of least resistance when trying to improve on performance. Their solution for meeting performance targets is to use faster components (CPU, memory, network card, proprietary acceleration) rather than looking at the core algorithms that drive the utilization of those components. Swapping components for faster ones perpetuates a cycle of cutting corners and focuses reliance on innovation from hardware component providers rather than solving the more fundamental and underlying issues. That’s a “painkiller” approach.

Zero-OS was designed to solve root problem issues by design. While still using high-performance hardware components on the ThreeFold Grid, the algorithm of Zero-OS maximizes utilization possibilities. This enables greater performance and sustainability. Some key examples how this is achieved:

🔗Eliminating unnecessary elements from standard architectures

Virtualization adds a layer of software between the actual end-user workload and physical hardware. It also allows for multiple workloads to run on the same hardware by using excess capacity. There is definitely merit in building a virtualization solution. Building an effective virtualization solution that does not require abundant context switching is key and this is why Zero-OS has been developed. Zero-OS uses a minimal Linux kernel that allows for a number of user spaces to co-exist. In these user spaces, containerized versions of software can be run, eliminating the need for hypervisors, virtual OS to fuel the virtual machines, and guest operating systems. This also minimizes the required overhead for the host OS.

🔗Minimizing network connections usage

Supercomputing delivered many new technologies. But, not all of them are usable solutions for everyday workloads. One technology invented to make supercomputers performant is the use of Remote Direct Memory Access (RDMA). RDMA allowed physical CPU boards (containing both CPUs and memory) to access other CPU boards in memory stored data over a dedicated channel. This eliminated the need to transport data between CPU nodes over network connections (or other mainstream means to exchange data). The result was a considerable reduction in overhead created when allowing distributed end user workloads to operate over multiple physical cores. The leading server and storage solutions brands have never considered nor implemented such mechanisms. This resulted in an increased need for faster networks - increasing complexity, costs, efforts and resources needed to operate solutions.

RDMA is only used in certified farms and requires involvement of TFTech.

🔗Minimizing disk usage

The storage solution uses slow and big (the bigger the better) HDD disks which drive in rack density. As they spin slower they consume less power and need less cooling. But then, how can you deal with read/write intensive workloads? The storage algorithm uses a SSD cache to acknowledge Inputs/Outputs coming from the applications, fills the erasure coded data blocks in large (up to 64MB) storage containers and writes the big chunks of data on the big and slow HHDs. If you are familiar with HDD disks, you know they like to be streamed on instead of having a lot of small bits written in a scratchy way.

Continuous innovation in all of these areas are leading to an efficient technology stack.