Streaming Data Asset in Ocean Marketplace
Build & Integrate
Extend the StreamingDataAsset so it handles time-based subscriptions.
1.An extension of Ocean Marketplace that supports a streaming data asset type with time-based subscription options. This entails adding functionality for multiple prices keyed to time lengths:
- The asset publishing form will get a third tab in the pricing subform with a UI for the publisher to customize time lengths and prices.
- In the backend the JSON storage of the Collected Form Values will be extended to store time/price values (it won’t change the DDO).
- The UI of the public catalog pages will be modified so the payment panel offers time-based options from which a consumer can choose.
2.Tables will be constructed (in Tableland) for analytics and be updated as we discover more details.
- User Story: https://hackmd.io/@kitblake/B1yzFBd3q
- Publishing & Metadata Analysis: https://streamingdataasset.notion.site/Asset-Publishing-34a59bebc14940e2b2a42dadee7fed97
- Mockups of changes in the Marketplace:
- This is the modified publishing form: https://htmlpreview.github.io/?https://github.com/chaineresearch/assets/blob/main/market_mockups/publish.html
- This is the adjusted procurement page: https://htmlpreview.github.io/?https://github.com/chaineresearch/assets/blob/main/market_mockups/paid.html
- Ocean DDO Metadata Entities (Tableland): https://docs.google.com/spreadsheets/d/1Oj_q-XcZYeKkspGIC6eUnOFpVboU-fr7/edit#gid=1230539258 1
- Entity Relationship Diagram (Tableland): https://raw.githubusercontent.com/chaineresearch/assets/main/OceanMetadataEntitiesTableland.png
This project will enhance the functionality and usage of the Marketplace so that it handles streaming data assets and ultimately (in a future iteration) streaming payments.
Once we have basic procurement working, we intend to enhance the pricing options on the Marketplace. Subscriptions are usually offered with time-based pricing schemes. This will be configurable by the data provider when publishing a StreamingDataAsset.
The publisher will key the price to time limits. The limit selection will be defined as options, e.g. 1h, 4h, 8h, 1D, 1W, 1M, or Forever. The options and corresponding prices will need to be stored in the metadata of the product. This will require modification of the UI in the third subform of the asset publishing form as well as in the public procurement UI. The catalog must render the time limit options so a consumer can choose before proceeding to payment.
This approach makes the assumption that when a time limit is reached, the provider will stop the stream and the user may purchase a new subscription.
The pricing in the initial implementation will be a one-time payment, the same as the Marketplace supports now. In a future iteration we’d like to implement streaming payments, using Superfluid or LlamaPay, which will run continuously, in the background.
As live data from IoT and sensor sources becomes more common, we’d like to see the Ocean Marketplace support streaming data and payments. This will require a different product type, in addition to static assets with datasets/files and algorithms. Some examples of data streams include the public transport and weather data being provisioned by cities like Helsinki: https://www.hsl.fi/en/hsl/open-data
The below Process Flow Diagram shows how the Ocean Marketplace, which acts as the proxy-host between the source/provider and the consumer for static data, morphs into a facilitator between the two parties when it comes to streaming data. The market enables the dealmaking and channeling of the payment, while the fulfillment happens in a peer-to-peer fashion, between the data stream provider and the consumer.
This is similar to ecommerce sites which include streaming products in their catalog. For example, a customer finds a streaming product, such as an audio book or podcast, and pays for it. Instead of downloading a file from the ecommerce site, the customer directly connects to a stream provided by the publisher.
As shown in the below example, the podcast provider (the data source in our case) deals with the consumer directly for delivery/fulfillment.
In the center is the Ocean Marketplace App with two extensions extending to the right. The upper one, Streaming Data Extension, is the subject of this grant, specifically the subscription payment options. In a future iteration we would like to implement the Streaming Payment Extension.
As an additional benefit, we’re also enabling an integration with Tableland (a web3-SQL app), thereby SQL-izing the DDO and metadata. The idea is to let Marketplace users access the Tableland instance in order to perform analytics on dataset-level metadata and metrics such as prices.
A Data Market that supports multiple types of data and payments. Static datasets, algorithms, and dynamically generated analytic data will be procured with a single transaction, while streaming data will be provisioned as a streaming transaction.
1. This project will expand the functionality and product offering of the Marketplace so that it handles streaming data assets, time-based subscriptions, and (in a future iteration) streaming payments.
2. Users will be able to work with live data from IoT and sensor sources.
3. Users can also take advantage of the integration with Tableland (a web3-SQL app) that will enhance their analytics capabilities.
Name: Kit Blake
Role: Product Manager
+ Entrepreneur, cofounder of Infrae bv (content management), Gauss App (social local mobile), and Chaîne Research (non-profit climate data initiative)
+ Active in various blockchain communities such as RChain, Superfluid, and PieDAO
+ Public speaker and blogger
+ Recently completed the Ocean 101 Ambassador course
GitHub: kitblake · GitHub
Background/Experience: Product development, project management, team formation, marketing, communications, finance, HTML/CSS, writing.
Role: Data Engineer
+ Intelligent Systems Grad
+ Co-founded a Climate Action Data Shop - https://chaineresearch.org
+ Ocean Ambassador
Background/Experience: Data Architecture & Engineering, Product Management, Business Analysis, and Writing, mainly in Finance and Customer Engagement.
Name: Ekpenyong Okpo
Role: Blockchain Engineer
+ Sofware Engineer/Reservoir Engineer, Laser Engineering (2014 -2020)
+ Cofounder, Exzing Technologies (https://www.exzing.com)
+ Mobile Engineer, DataUnion.app (2020 - 2022)
+ Ocean Ambassador
Background/Experience: Software Engineering, Petroleum Engineering, Research Publication, Web3 Product Development, Ocean Protocol, Smart Contracts.
Our three team members have assorted interaction with the community. Abhi (@databeetle on Discord) and Okpo (@okpo.e) are both Ocean Ambassadors. Okpo is known within the community for his work with DataUnion.app. @kitblake has completed the Ambassador course and has been following the Ocean project since inception, was an investor in the ICO in March 2019, and is an Ocean liquidity provider on Uniswap.
Minimum Funding Requested