Hi Angela, love the work you are doing around TE and I’m eager to follow this project and learn more.
Just one question about how you calculate success of a project, do you account for partial success if it was partially completed? I’m curious if you have any insight on what a very good grant efficiency level looks like, from your experience in other projects.
Hi davidecrapis,
Great question!
We measure grant efficiency as % of proposals that are successful at least 2 times across 3 rounds.
So we actually don’t measure completion directly.
Instead, for grant efficiency, we take into account two aspects:
a) Is a proposal successful in the voting? Voters decide if a proposal is worth funding. The DAO’s policies define if a partially completed project can propose again - and it’s on voters to signal if funding should continue in this case.
b) Does a team come back and propose again successfully? There can be many reasons for a team to be not successful with a follow-up proposal. In any event, the funds aren’t spent most efficiently.
A because follow-up proposal doesn’t pass = not efficient
B because they give up and don’t submit a follow-up proposal = not efficient
C because still funds left, no need to propose again = not efficient, grants should incentivize spending the funds for maximal output
C because mission completed = that’s great. However, continuing to add value to OCEAN would be even better! Not max efficient.
Final remark: It might be worth reviewing the timespan. Due to data availability, we only analyzed 3 rounds. A longer timespan could make sense, worth exploring in the research initiative!
I have participated in several TE projects in the past and have gained valuable insights as well as great connections in the process. Thank you so much for your hard work!
I think this proposal is missing a bunch of qualities that regular proposals have and so I’d like to encourage you the author to adjust your proposal:
It’s unclear what is actually done with the money requested in the proposal. Specifically; What is TE going to work on with this money? “Core research team confirmed” isn’t a really deliverable; the research team completing some work would be. I understand that TE can aid OceanDAO in governance design: But if it wants money in this process here; I’d advise to stick to actual and specific deliverables as e.g. “We analyze all votes in the oceanDAO rounds and see how whales influenced the votes”.
“Grant efficiency” isn’t really an existing metric to my knowledge so I’d suggest to use a metric listed in the oceanDAO wiki
There are differences between research projects and building tech, and that’s why I’m grateful for the chance to clarify.
“‘Core research team confirmed’ isn’t really a deliverable”
We put the step research team confirmed in our roadmap, because we’ll review the research scope next week with members of Ocean DAO and Ocean Pearl. Depending on that, we’ll see if we focus on analyzing the existing grants process or on parameter setting and simulations for new components like Conviction Voting. This will have an impact on what expertise we’ll need in the core research team.
“stick to actual and specific deliverables”
Defining the actual questions is part of the research process. We could certainly take the OCEAN DAO roadmap, pick one element, work on it as pre-defined in our proposal and come back in 3 months. We think it’s better to dig deeper before we define our actual deliverable.
Here’s an example: What is the actual motivation behind aiming for "more stable funding available to support larger teams "? (see OceanDAO roadmap). Ask OceanDAO teams, ask the stakeholders! This gives us insights on the best mechanism to choose (conviction voting? combination with grant process?) and how to configure the mechanisms we choose. And only then we choose the method like we a) run simulations or b) set up an experiment with stakeholders, resulting in the actual deliverable.
On our metric Grant efficiency.
We are 100% pro ROI calculation.
Metrics suggested are Datatoken Consuming Volume or TVL, however we can come up with new metrics, in case we think it’s more appropriate. https://github.com/oceanprotocol/oceandao/wiki/On-Roi
In our case, our aim is to take a metric that a) Rewards Systems can most directly drive, and b) we can measure the outcome in USD.
Grant Efficiency checks both boxes.
Actually we’ve started with ‘TVL in the voting process’, driving OCEAN demand. But it’s hard to draw the direct line between reward system improvements and TVL due to network growth. We’ve discussed this on Discord, here’s the full conversation: https://discord.com/channels/612953348487905282/776848812534398986/894591592273416223
Hope this helps, happy to answer on any further questions!
That’s exactly my criticism. You should have come up with a set of specific deliverables before you make a proposal to the OceanDAO. Not after. I think you’d expect that from others too.
I think it’s vital to understand the functioning of the oceanDAO due diligence process, as this way is how the “project standing” of the OceanDAO works. With your current set of deliverables for example there’s basically no work that you’re committing to doing until the next round in November. So why should anyone vote for you?
What are the actual steps towards “Core research team confirmed”? And why is it the only deliverable until November? Also you say that in total you need 60k USD. So the deliverables you’ve mentioned; will you fulfill them all with the 20k USD of this vote until March 2022? Or will you raise more money in the OceanDAO until then?
I’d heavily favor a set of deliverables for the much shorter term (e.g. October) and then reapply. I know that there’s a potential conflict of interest here as you’re arguably getting special treatment from OPF members but being total real: This is how things work for most projects in the community. And they should work this way for you too.
I think its irrelevant to discuss your preferred mode of working and if research has a different process than other knowledge work. The OceanDAO is flexible enough to encompass all work; it’s a matter of framing in the proposal. The reality is that the OceanDAO has a set of rules that apply to all its participants; so also to you.
The only person that continues to talk about Conviction Voting is Trent. Actual Ocean stake holders are asking for improvement to problems; they’re not asking for specific solutions. Already there you can evaluate buy-in towards what should be a favorable outcome of the oceanDAO research.
I think one problem with assuming that all burned Ocean tokens are bad Ocean tokens is that a model-building approach is skewing reality. I’ve been active in votes that ended up burning tokens and in each it was better burning tokens than investing them into projects. A few things should be considered in general:
Not all Ocean holders have a homogenious opinion about the future of the Ocean project
It’s very good that there’s a wide range of diversity of opinions as this will strengthen the OCEAN token over time.
So as a counter balance to the popular OPF employee view that all Ocean tokens should always be invested; I’m happy to be the one providing arguments in the other direction.
IMO, the outcomes of R6-R8 - also the tokens that were burned - were in the interest of all Ocean token holders. The OCEAN token market confirms this.
All this to say that you should frame yourself as any other OceanDAO member and use the metrics available to everyone. Thanks.
First: this is Community Research Initiative
Before we kick-off the program in Mid November, we
design the educational lectures
confirm mentors for the program
scout for and select the community researchers (in total 20, best fit to cases!), and make sure they are available and committed
confirm facilitators (we’ll need to cover 3 months in total, with 1-2 sessions per week!)
further specify the scope (as outlined in my message earlier)
This is why we apply for a grant now. I’ve added this to the milestones on top.
Second: We are acquiring additional funds from other partners to cover the total funds needed. So no follow-up proposal at OceanDAO for Rewards Systems.
However - in the spirit of Grants Efficiency - I’d be glad to continue collaboration with OceanDAO for token engineering education & research
For the rest of your comments, I see that you have something to say about developing DAO rewards systems. Welcome to the research group!
Please register here: https://forms.gle/zNNLdi8aUKystz3QA
Glad to see academic efforts, cultivating new concepts like Governance and Decentralisation into a new educational branch. Especially at a field like crypto where the pace, sometimes doesn’t give enough time to do some research beforehand, this effort long term can make this environment into a healthier and more transparent ecosystem.
I saw that you wish to analyse the data from the OceanDAO and wondered what data that would exactly be?
Also another branch to consider in the study of the voting process is perhaps ethical issues on transparency and privacy. Votes are anonymous, but the process which enables the votes leverage the publicly accessed ledger. For someone who has the knowledge how to query it, one can see wallets who voted on each project and see which projects were voted before in previous rounds and with time, it might reveal some patterns or hints into the identity of the wallet owner. It makes sense for each project participant to when holding tokens, to vote on their own project as well, which makes wallets easier identifiable. Is it ethical to make it transparent and have votes with identity where technology behind it, enables it in an indirect way? Or is it better to change how the voting is done to make wallets completely anonymous? And how it affect the health of the voting process as well as the dynamics in the DAO, can be sth to debate.
Thanks for TE efforts, enabling a progressive Ocean DAO!
For OceanDAO we will certainly aim for the full picture with all off-chain & on-chain data collected, plus qualitative data to understand the context. And, as mentioned earlier: define research scope first.
Many thanks to everyone who supported our proposal, thanks for voting YES for Token Engineering research.
And thank you to those who asked critical questions!
We’ll work hard to prove that funds have been spent efficiently - can’t wait to kick-off the program!
Great news!
We promised to get additional funding partners on board - and so we did: Boson Protocol and NearDAO confirmed to support this program as partners! Plus we are currently in phase 2 of a Gnosis DAO proposal - so there’s even more to come
Milestone 1 / End of October 2021
Core research team confirmed Milestone 2 / End of October 2021
1-3 co-funding partners confirmed [ ]Milestone 3 / End of November 2021
min. 20 TE Community Researchers onboarded [ ]Milestone 4 / End of December 2021
Educational program delivered, mind. 8 public lectures provided on topics like computer-aided governance, game design, behavioral economics, currency design, monetary theory, and token engineering [ ]Milestone 5 / Mid January 2022
Check-in with TE Community Researchers, review research plans (OceanDAO/OceanPearl.io and research group) [ ]Milestone 6 / End of February 2022
Presentation of research results [ ]Milestone 7 / Mid March 2022
Workshop with Ocean DAO team/OceanPearl for follow-up proposals, implementation etc.
our proposal at Gnosis DAO to come on board as a partner for Rewards Systems was confirmed with 100% YES votes!
last week we’ve onboarded in total 41 community researchers to our research initiative.
Again, we have an amazing mix of backgrounds, skills and world views. I highly recommend to watch one of our session recordings, like this one - or just drop by and listen in, here’s our session calendar:
Milestone 1 / End of October 2021
Core research team confirmed Milestone 2 / End of October 2021
1-3 co-funding partners confirmed Milestone 3 / End of November 2021
min. 20 TE Community Researchers onboarded [ ]Milestone 4 / End of December 2021
Educational program delivered, mind. 8 public lectures provided on topics like computer-aided governance, game design, behavioral economics, currency design, monetary theory, and token engineering [ ]Milestone 5 / Mid January 2022
Check-in with TE Community Researchers, review research plans (OceanDAO/OceanPearl.io and research group) [ ]Milestone 6 / End of February 2022
Presentation of research results [ ]Milestone 7 / Mid March 2022
Workshop with Ocean DAO team/OceanPearl for follow-up proposals, implementation etc.
Our Rewards Systems Research Initiative finished phase 1with two major events:
a) We’ve hosted a full day of talks and discussions about DAO Rewards Systems open to the public! The recordings are available here, if you are interested in all things rewards, this is a really unique collection to binge watch over the holidays
b) And there’s more: Our community researchers have explored the Ocean DAO grants system, and came up with first analytics and metrics for Ocean DAO system healthiness. Check the PRESENTATIONS HERE!
And make sure to join our Discord in case you have comments or questions.
Milestone 1 / End of October 2021
Core research team confirmed Milestone 2 / End of October 2021
1-3 co-funding partners confirmed Milestone 3 / End of November 2021
min. 20 TE Community Researchers onboarded Milestone 4 / End of December 2021
Educational program delivered, mind. 8 public lectures provided on topics like computer-aided governance, game design, behavioral economics, currency design, monetary theory, and token engineering [ ]Milestone 5 / Mid January 2022
Check-in with TE Community Researchers, review research plans (OceanDAO/OceanPearl.io and research group) [ ]Milestone 6 / End of February 2022
Presentation of research results [ ]Milestone 7 / Mid March 2022
Workshop with Ocean DAO team/OceanPearl for follow-up proposals, implementation etc.