Platform that scrapes the internet for tagged media, and automates the training of classifying AI. This in turn allows for media to be uploaded to it, and quickly classified into tag groups for identification and modderation.
TLDR; Allows you to find out if an image is copyrighted, pornographic, ext. So you can automate some aspects of site moderation.
Uses about 2 dozzen micro services to achieve this goal.
Planing on breaking this into 2 sepperate projects to reduce bloat. 1 For app IAM user managment and ext. and one for this service itself.
Development status: IN PROGRESS
user-manager
https://gitlab.dzwxgames.com/bonearr/usermanager
Multi app management server provides service to service authentication using PKI though Kerberos protocol. User to service and user to resource management and authentication is provided through IAM policy’s provided though a web interface. User login to service is provided though OAuth, and can be implemented easily in apps using OpenID.
drone-queue
https://gitlab.dzwxgames.com/bonearr/drone-queue
Manager for Drone project. Allows for drones to query API to receive tasks and post results.
Drone
Individual instance that talks with drone-queue, for task allocation across a distributed botnet.
Drone asks for a task, gets it. processes it and returns the results based on data workflow of Visual-Scraper
APP-Gateway
https://gitlab.dzwxgames.com/bonearr/app-gateway
Encapsulates services for external access via Identity Access management (IAM)
Visual-Scraper
https://gitlab.dzwxgames.com/bonearr/visual-scraper
Web interface to management of scraping tasks via visual scripting.
Similar to: N8N
Script-Manager
Stores scripts to be used by drones.
messaging-server
Sending messages between users.
texting-server
API for sending txt messages (2fa and acc recovery)
webui
Web interface for viewing of collected content and tags
search-server
Elasticsearch API helper.
file-server
File access service
thum-server
thumbnail generation service
mail-server
Service for sending emails for verification and alerts.
tag-server
Service for managment of tags
service-manager
Platform provisioner for app-image managment and deployment.
image-fingerprinter
generates fingerprints of images
ai-training-data-service
Trains AI.
password-helper
Works with Short stack net (SSN) to check users password on acc creation