0xReclamation@bbs profile imagefeatured creator badge

Tyler

Partner0xReclamation@bbs
Copied to clipboard
Crypto, tech & PC enthusiast. Community Admin of METABBS
Posts
61Followers
5Following

Testing AI Analysis on BBS Network Boards

Hey everyone!  I wanted to share with everyone some of my findings on using AI for analysis on board quality, and the potential it shows for the Engagement Mining program. I'll display my methodology here along with the results and my next areas to look at for refinement if we continue this idea. Methodology Extract posts & comments for processing - Utilize BBS search to identify Top 5 posts within 56 days (https://bbs.market/bbs/METABBS/search/posts?q=*&tokenName=METABBS&sortBy=bestMatch&range=56) - Sort posts by ‘Visits’ - Extract contents of top posts NOT created by an owner or moderator. - Combine extractions into one file for AI utilization - Add the board’s ‘About’ section for contextual information - Repeat for each board After extraction and data cleanup, several .TXT files remain such as (boardname)top5.txt along with the guidelies.txt which contains the publicly listed criteria & explanation for EM qualifications & guidelines. Process AI Review w/ Claude AI Claude AI allows for long-context prompts, giving users the ability to input several documents at once for context and comprehension, this is the AI model we will be using in our discovery. - Upload the relevant TXT files, in this test we are using 'EMCriteria.txt', 'gamtechtop.txt', 'mwatalktop.txt','sativatop.txt', and 'theorytop.txt'. Only five uploads are currently allowed with Claude. - Prompt Claude with the following instructions: AI Results NOTE: These are just TEST RESULTS, they are NOT indicative of my own opinions, and are not being considered as an accurate and complete analysis. Areas for Improvement & Notes - Top 5 posts were used in processing, need to process more posts to see if more thorough results can be achieved. - Need to identify, or implement placeholders for, multimedia assets in extraction (images, videos, etc.) as Claude and other longer context LLMs can only process text. - Prompting a singular board review at a time may result in better AI comprehension & more attention per board.- Long-context LLMs tend to be expensive, might be best to meet in the middle       somewhere here - Results not completely accurate, likely due to a limited depth of content to review for each board, guidelines not being completely tuned for AI comprehension, and a need for more instruction iteration.  - Ability to ‘continue’ the conversation for board owners could be very insightful. Long term opening up an AI quality assessor and assistant for board owners could be hugely impactful. Next Steps & Further Testing - Refine extraction process to allow for more comprehensive analysis (extract more top posts & comments and contextual information per board, implement placeholders for multimedia assets). Also future possibilities for further integration (i.e. board activity, mod activity, etc) - Iterate further instructions, attempting both simple & comprehensive instructions. Possibly iterate instructions within the guidelines themselves. - Iterate prompts with just one or two boards to find a good balance of depth for each - Expand guidelines to be fully comprehensive and specific for AI review - Prepare utilization of Claude API once prompting is refined Conclusion While this look shows just one test, we can see that harnessing the potential of AI in monitoring and refining digital community spaces offers transformative possibilities. As demonstrated, our approach goes beyond mere content analysis, bringing a deep understanding of user engagement and alignment with set guidelines. With further refinement and iterative learning, the potential for these tools grows exponentially. They can ensure that approved boards not only remain vibrant and engaging but also adapt with the evolving needs of their audiences.  Further, there is massive potential in allowing board owners or community creators the ability to interface with an AI and communicate directly. While resources to utilize long-context AI models may prove prohibitive, the BBS model could theoretically integrate a way to use rewards for usage of the AI model at cost.  In other tests, I've also given the AI model single posts to analyze alongside the METABBS Extended Guidelines and our Super Comment guidelines in order to have AI processed suggestions for tip amounts and individual post feedback. Tests there also showed a powerful understanding of the content and comments within posts, and tended to be close to a realistic tipping suggestion for the content. AI analysis could be potentially integrated into several layers in the BBS Network system as I've mentioned above: At the higher level of Engagement Mining management and analysis, at the mid level of board management and review, and even at the individual level to review post quality, suggest tips, or even suggest moderation action. These integrations could be solely advisory, but there is also an option to give functional integration (i.e. the AI actually does something like take moderation action along with its report/advisory response).  The potential here is near-limitless, and AI language models are advancing at an incredible rate. The comprehension and quality of analysis will only get better, and utilization of longer-context or higher quality models will inevitably become more and more cost effective. If we can achieve results like these with minimal testing in current models, what could we do with further refinement, or even more advanced models? Let me know what you think about this test, the analysis, your suggestions, your feedback, or any other comments you may have! These tests have been fascinating and I'm happy to share more if there are more specific requests as well. Claude still has yet to release their API, so there is time for testing and iteration before any functional exploration. Do you have a question for me to ask the AI? Let me know! Want to know more about another test or try out your own iteration? Let me know!
Aug 24, 2023
RTB Token & Network
RTB Token & Network
RTB Token & Network

METABBS Expanded Community Guidelines

This post will act as a “living document” for the METABBS goal, rules, and guidelines. The Goal of METABBS The goal of METABBS is to cultivate healthy and productive discussion of the BBS Network as a whole. Discussions around platform mechanics, DAO proposals, development direction, future features, suggestions, feedback, and more are welcome and encouraged. Community Guidelines - Posts must be directly relevant to the BBS Network - Posts and comments must be in English. - Do not repost content the BBS team has already shared - No images or memes with the BBS logo on it - No advertising unless through the BBS Ad feature - Do not copy/repost other’s posts - Linking to content is allowed and welcome, but copyright violations will be hidden - Do not create posts or comments asking for Partner - Publishers may only tag up to 5 members per post LIVE Chat Guidelines - No Spam / Scam links - No advertising or self-promotion - No hate speech - No Partner request in LIVE Chat - No harassment or trolling - Don’t spam words or use all-caps - Don’t argue over chat  - Use English in LIVE Chat Expanded Guidelines Rule 1. Posts must be directly relevant to the BBS Network All posts in METABBS should be in accordance with the purpose of the board as explained before. For discussion of other topics, users should utilize other relevant boards on the network. Users are encouraged to create their own BBS if discussion for a topic cannot be found. As an extension of this clarification, the following types of posts are given as examples of not being relevant to BBS Network as a whole: - Cashable Targets and Impression Count Display - Motivation Posts and Posts calling for Engagement - Posts about Personal Goals - Posts that are intended as a Report - METABBS General Activity Level - Greetings Posts (Good morning / Good Night) - Partner Requests / Unban Requests for other boards - Repetitive 'spam' posting of the same/similar topic The post list here is not exhaustive and only serves as an example of what type of post is not considered relevant to BBS Network. Any irrelevant post, whether mentioned here or not, is subject to moderation.  For topics that are loosely relevant to BBS Network, please use the pinned Daily Discussion post on METABBS which will allow more general discussion of METABBS or BBS Network such as goals, greetings, etc. Rule 2. Posts and comments must be in English METABBS is an English-only board. This rule is necessary to provide proper help and moderation to users while preventing bottlenecks. The METABBS team is committed to the BBS Network and its users, and in cases of extreme language barriers we urge members to contact moderators directly. We welcome anyone who can create and sustain a similar board in their regional languages to come forward and implement the same. Rule 3. Do not repost content the BBS team has already shared Direct copying of content the BBS team has shared is not permitted, however discussion around the content the BBS team shares is permitted. Feedback and suggestions around updates or releases are welcome. Rule 4. No images or memes with the BBS logo on them The BBS logo should not be applied to images or memes submitted to METABBS. Rule 5. No advertising unless through the BBS Ad feature All advertising of goods and services must be done through the built-in advertising feature of BBS Network.  However, promotion of other boards is allowed in moderation. A BBS may be promoted once per day but no more than 3 times per week on METABBS, and only with the promoted board’s owner’s approval.  Rule 6. Do not copy/repost other’s posts Meaningful discussions around other’s posts which derive unique results are allowed, but copied or plagiarized content will be hidden. If including part of another user’s post, a link to the post itself should be given as well. Reposting your own content is allowed no more than once a month and still must follow community guidelines. Rule 7. Linking to content is allowed and welcome, but copyright violations will be hidden Linking to content elsewhere in BBS or outside of BBS is allowed and encouraged, but copying content directly into your post from other sources would be hidden if considered a copyright violation. Content within posts that is not self-made must be sourced. Rule 8. Do not create posts or comments asking for Partner Partnering with METABBS is invite-only, and only the top, high-quality contributors will be considered to be Partners. As such, all posts requesting Partner will be hidden with or  without further explanation. Rule 9. Publishers may only tag up to 5 members per post To prevent excessive tagging, publishers may only tag up to 5 members per post. Further comment tags will lead to the comment or even the post itself being hidden. Anyone found breaking these rules consistently will be banned from METABBS.  Please use the Report button in order to report content or users that violate these guidelines, or message the moderators directly.
Jun 28, 2022
RTB Token & Network