New Ethereum talks, every Monday. The week's conference uploads by event, in your inbox.

Loading player…

Join Swaroop I Composable Data Networks for Web3 I Powerloom I Pragma Sydney 2024

ETHGlobalWed, Oct 9, 2024, 12:00 AM

Saurabh from Powerloom presents a groundbreaking approach to composable data networks at Pragma Sydney 2024. Discover how Powerloom's decentralized protocol enables trustless access to on-chain data through its network of 4,700+ nodes. The demo showcases live implementations of Uniswap analytics and unreleased features, demonstrating how developers can build on this open-source infrastructure. Learn about running snapshot nodes, contributing to data markets, and creating permissionless data solutions that maintain blockchain's decentralized ethos while delivering enterprise-grade analytics. 00:00 - Introduction to Composable Data Challenges 01:29 - Powerloom's Mission: Democratizing Data Access 02:41 - From Polygon Infrastructure to Decentralized Solutions 03:44 - The Problem with Current Data Indexing 05:22 - Powerloom Protocol Architecture Explained 06:29 - Network Stats: 4,700+ Active Nodes 07:30 - Base Network Implementation Demo 08:35 - Atomic Data Markets Deep Dive 09:45 - Live Ethereum Block Visualization 10:46 - Running a Powerloom Node: Live Demo 12:34 - Node Configuration & Use Case Selection 13:36 - Testnet Participation & Future Rewards 14:37 - Unannounced Feature Preview 15:41 - Advantages of Pre-Compute Data Model 16:10 - Open Source Ecosystem & Community Contributions 17:13 - Developer Resources & Documentation 17:44 - Getting Started with Powerloom Network _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 🇦🇺 *Pragma Sydney* The Sydney edition of Pragma took place at The View by Sydney in May 2024 with a curated series of high-quality talks that sparked thought and discussion. Ever since we first introduced our new event series, Pragma, in Tokyo in the spring of 2023, we have been fostering a curated, global community of individuals who deeply care about web3. Watch the full Pragma Sydney playlist here: https://youtube.com/playlist?list=PLXzKMXK2aHh7rvaHBM14peT1TwI3QX38p&si=MzGrEYwYjxSQFiFM ETHGlobal's Pragma series takes place in cities around the world, and is designed to be a different kind of event. Pragma is a one-stage conference with founders-only on stage, bringing together a small group of curated attendees and speakers to discuss the future of web3 and reflect on the past. _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ ✅ *Follow Swaroop Hegde* X: https://x.com/SwaroopH ✅ *Follow Powerloom* X: https://x.com/Powerloom ✅ *Follow ETHGlobal* X: https://x.com/ETHGlobal​ Warpcast: https://warpcast.com/ethglobal Website: https://ethglobal.com YouTube: https://www.youtube.com/c/ETHGlobal _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _Are you interested in Ethereum development and entrepreneurship?_ 👉 Sign up for the next ETHGlobal event: https://ethglobal.com/events 🎁 Get exclusive access and perks with ETHGlobal Plus! https://ethglobal.com/plus 📣 Want us to throw an event in your city? Tell us where! https://ethglobal.com/city _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _

Transcript

[Music] all right welcome back everybody we are going to resume the last section of pragma today before we go into our happy hour so please uh grab a seat and we'll get started in a few seconds so we got about four more talks to go before we conclude today and the next talk is going to be a super interesting one because it takes advantage of all the things that we know are about to be big problem and it gives you good intuition for how do you solve for it we are going to learn about how do we actually make data on web3 more composable and use that in multiple places without actually compromising on the Integrity of that information or the origins of how that information was gathered to talk about that I want to bring on S who is the co-founder and CEO of powerloom an amazing project that takes advantage of onchain data and S is going to share you how to build composable web 3 Network so please welcome s on stage thank you K can you guys hear me oh thank you so much Karthik um excited to be here um uh my name is suup I'm one of the co-founders of powerloom uh I live in Vancouver Canada super excited to finally come down to Australia sorry for bringing the rain apparently I'm bringing into Everywhere I Go including Dubai for those who know what happened a week ago as long as it doesn't flood here all good and um it's it's even more exciting to be able to do this uh so I'm going to try and attempt to do live demos which uh I think I have a nice experience of having to do that every time I come here uh from probably been a little less than a year since I first introduced what palum does uh it's probably it Global waterl um and um so the whole concept of composable data networks right so one of the main reasons um to give a little bit of history of how we got started here uh a little over 3 years ago uh I used to run infrastructure for our a small Network called mic which eventually became polygon uh so for a lot of the r BCS and explorers was all run by my twers team including me uh having a lot of sleepless nights um and as we sort of scale that from a little probably the first customer was poly Market um doing like a million calls a day to doing uh a billion calls a day which is like 1,000x and the whole segmentation that we used to run into uh and it would essentially be centralized around us so if you we would go down uh that would bring the network down and my biggest worry always used to be is what if something gets compromised whether it's defi or um you know obviously at that time a lot of exchanges didn't exist but we were starting to move away from calized exchanges um and as we saw the explosion of Unis Swap and arway and many other D5 projects it was super crucial because as you're building on new high Thro chains and now it's sort of become the defacto standard and super exciting to see like Kane and his team sort of making that the defao thing so I'll be looking forward to in 12 um days on uh what it look like and so yeah so we've been on this mission to democratize data accessibility and composability uh now what me what I mean here is like it's about complex data stuff right so it's not just the raw RPC which we were doing before but when you sort of add more more layers so for example and if I were to I'm going to try and like maybe not do a live demo here but we talked about how I think he gave an example of uh was it Bon to Pepe since I'm a more eth guy I'm going to stick around with uh e base tokens uh but let's say I have de token on base and I want to swap this right now it of course queries the RPC and gives you uh sort of a price code liquidity and the amm sort of takes care of that um execution of that trade but if you were to sort of now analyze that data you you go deeper into things like unisoft provides you this sort of complex dashboard uh where you can see all the top tokens uh the top pairs what's happening in between each of this now this data isn't coming the source of it is on chain but when it's being presented to the end users uh it's actually not uh coming through a decentralized source now of course it's run through different protocols there's graph and many other indexers but in the end we sort of make compromises right so what ends up happening is if another uh decentralized like a Dap wants to access it they have to sort of rely on some sort of centralized hosted service which beats the purpose of why we're doing this in the first place so that's kind of how me and my co-founders S of started working on powerloom uh we started building this protocol where our purpose was very simple how do we take the same the same thing but turn it into something where you do not one you don't need to query a centralized node and even if you are querying a network the result of that is something that should be easily accessible so I'm going to try without hopefully the internet doesn't give up on me but this exact same page is is a clone of that same unisoft dashboard the difference being that it doesn't really query the network so all of the data you see despite the slowness of the the internet that I am on right now it's able to load that because it doesn't have to query another source fetch that data so all of this is actually sitting on an ipfs hash now how we sort of get there is this composable Data Network that we've been building and to uh I was I was thinking about the last time I sort of did this and this was uh in watero at that time time we had six uh snapshot of notes uh this was like the first time we had open up our test net um and since then um I think if I look at the latest count let me see uh This Is Us on base uh let me see where is our there we go so we currently the network uh still on testnet but the data that we actually track is um the one that I visualize right now so all of these are being run through these sort of noes and uh currently we have around 4700 active notes I I believe totally there are about 5,300 so any of the you in the audience can actually go and mint that note as well uh I I won't go into deep into it uh purely because um I'm concerned about the legal ramifications of Australia I don't know how the laws work here at least I'm very restricted from saying certain things in Canada and us so I'm just going to leave it at that but you can mint your note and you can actually take part in this network um however I'm going to try and skip through that and um show you how it works and so this resulting interface that you see is exactly the same data set uh that's coming in but there's about 4,000 notes who have distributed this workload and they're reaching that same uh data point now how we do it is of course a protocol is sort of designed that you can build any sort of a use case on top of it so similarly we have uh what we have done the exact same use case we have configured it for the base Network here so it's obviously has has different pairs and different pools and in the same way the snapshots sort of capture that data and then when uh it gets aggregated by different set of notes uh we see the end result and all they have to go through is like some sort of a basic consensus that we built so I'm going to try and see if I can show this on our Explorer um this let me try to show it live and if it's not working then okay cool at least it's sinking so we've had about 100 million of um these sort of transactions is what we call it but inherently they're just um um for every Epoch uh when we have all these data markets all these notes sort of combine together and uh reach consensus for each of those points so as you can see there are sort of ding in we are using um this sort of a new layer three um using conduit um this way we are able to run this on on a more evm based consensus but that's something that we're working towards improving that for our main net which should hopefully come out uh a month or two and so when you sort of look at every individual transaction you can actually go deeper into it and understand what is that in um Atomic data market for example in this case it's like a pair contract where we looking at total reserves for a certain pair on that specific use case of unisoft and for each uh for that particular Epoch ID which is related to maybe an ethereum block or maybe a bunch of ethereum blocks depending on who's sort of consuming that data you're able ble to actually post a signature and then once it reaches consensus uh the finalization occurs and we have a little dashboard that I was trying to load up today but let's see if this loads up okay there whenever it okay there we go so if we open this should hopefully be a live ethereum block from maybe a few minutes ago or maybe even more recent clearly this is why I try to not do live demos but I have some cast results to show I just didn't want to in in the spirit of detalization I didn't want to like show some screenshots that I've already prepared so we're going to try perfect it's loaded up so yeah so this particular block is from like a minute ago obviously that's the time it took to probably load this up so for that particular Epoch there's all these different use cases that are on our Network right now so whether it's this ethereum base one which this one sorry this one is the base uh Pairs and these are the ethereum pairs so these are all way different set of data markets right so but they all sort of reach that same finalization and what you see as the end result is something that daps can use uh and even even unisoft or other foundations who want to rely on it instead of looking at centralized Solutions as you can see in the network calls they could actually be using powerloom and the good thing is that the network is itself is capable of giving this data as on simple storage protocols like ipfs so if you use a browser like Brave you can actually fetch it even on your own computers you don't need some complicated RPC setup to fetch all this information cool so I I'm still doing good on time so I'm going to try and see if I can uh do a live demo of how this uh network works so what I've done is I have already minted the node uh and I will walk you through one of our dashboards and let me make sure perfect okay so as you can see this node is not running since like a day ago this is like our internal uh Network dashboard where people who want to contribute to this network the good thing is they're just doing very small bits of work uh depending on the use case they want to uh contribute to and uh it's very simple you essentially just have a Docker based setup U that you configure maybe even a free RPC um you set up your um um wallet and we have this concept of a burner wallet the idea behind that is that it does doesn't matter where you minted this nft for your uh node uh we call them internally snapshots because they are constantly snapshotting data and to run the snapshot of node you can just assign any sort of a burner wallet doesn't need to have any gas we've sort of taken care of all that abstraction and all you need to do is run it once and let's let's give it a try so at this point it um pulls from our open source repository uh runs the command and it's connects to that same network that I was showing you here on the Explorer uh fetches all the uh data markets that it needs to talk to and let me see okay it's at least spinning up cool so it's sort of making sure that all our configuration is in place is RPC URL provided uh in this case it's talking to ethereum based data networks so it's only going to be helping with those data markets but you can switch to any of the use cases so all these use cases are currently seated by us and and thanks to uh some of the hackathons we've been sponsoring so we did one at scaling ethereum we're going to be sponsoring the one over the weekend here as well and there's um let's see I'm I got a small exception from the RPC wonderful uh but it should still go through in terms of health but let me double check if it does load and and it's as simple as that so this could be run on a way very basic computer like we have done it like I think we have some folks running it on Raspberry Pi they also I I believe when I did this demo like 11 months ago the the goal was like it should be as simple as possible um there's also oneclick setups so we worked with some Partners so we have done with like previously um we had some companies who wanted to run these powerloom nodes on their decent Li networks so as you can see my node is now actually running so that's awesome and so over the course of 24 hours it uh contributes to the network and it gets awarded uh sort of XP points for now because we are still in testnet there's no real token but once the main net goes live um that's how so all you have to do is run this uh protocol and um you can contribute to it you don't need uh very sophisticated Hardware that's been our goal and as we sort of add more and more use cases this is kind of where we wanted to build a much bigger network uh with more and more users and I think um you know we've done a pretty good job of getting like about 4,000 unique uh people from like all over the world uh I think we have a bunch of folks here in Australia as well I think I noticed on my Twitter yesterday they the running noes they reached out uh they probably weren't able to make it to the event because it's sold out clearly uh but uh hoping to meet them as well and excited to have some of you uh joining in um I am still doing good on time this is awesome so I actually wanted to uh showcase something we haven't announced yet um it's a very similar use case um but we wanted to work uh on a a different kind of a I protocol to Showcase that hey it's not just about unisoft or nfts and all these things so we've been working um one of the things that I use the most personally um and of course one of our backers is also the Creator uh of this protocol Stan and I've been thinking like how do we take that same use case could be sort of ported over so it's open source and we worked with one of our developers who actually had wanted to contribute to the protocol and take this exact same a data and also snapshot that using problems protocol so super excited to show you something that is not public yet uh but I did have to make it public for the case of this demo um and it's the exact same thing running through powerlooms protocol um I'm going to try and see the demo so it's a little faster than the unisoft one so it shows all of those data points um no need to query any sort of uh centralized server to fetch all of this data so something that we are able to solve thanks to our approach uh is that the data is readily wellable um because it's sort of a pre-compute model now it definitely has its um challenges uh compared to a query based model but our goal was that we wanted more people to be able to contribute to the network not only the ones who are sort of curating the data set but also the ones who are sort of running these notes and ensuring that it's secure so I think that's kind of uh where we want to do so super cool actually when I was trying the demo yesterday after landing it wasn't working so that's awesome to have it working while this is going on so yeah so it's similar to um it's basically the a dashboard but it's completely ported over um I would recommend most people to check out our poom repositories so we have all everything is open source uh not only is the aspect of running the notes but all these use cases that we see so we call them snapshot computes so all of these computes have like for every use case that we have built and also all individual hackers who have been hacking through our hackathons and now those who are contributing to the protocol are also able to sort of contribute to this repository and eventually once the network goes live on mainnet uh we want it to be built in a way that um anyone can sort of propose uh a certain data need so if they have a specific purpose that maybe it's for their DB or whether it's something that they already running they may be able to propose it on chain and it'll be like 100% uh automated because then a developer could also be uh contributing um using a just a simple GitHub issue so yeah I think that's uh all the demo I wanted to Showcase um please check out our documentation on how all of this works uh I didn't want to go super technical on um what it is so our docs are live uh also along with the code um the documentation also it's something we've been working hard to make it better so if you see some gaps uh please feel free to open a PR or ask for some feedback um and if you want to run your own note without having to Mint the nft and spend any money we have built a full-fledged developer dashboard it's if you go to poom dodev it takes you to this sort of a devet that we've built specifically for hackers who are building new use cases and if you are interested and you want to actually take part in the real uh Network then you can go to po. network hopefully it does open here in Australia usually doesn't whenever I do demos um and yeah please do follow us on Twitter for more updates uh I'm suup uh Pao Miss Pao mq and we are also active on foraster um thank you so much for listening and awesome to have you all here bye

Automatic transcript — names and jargon may be misspelled.