Platform that scrapes the internet for tagged media, and automates the training of classifying AI. This in turn allows for media to be uploaded to it, and quickly classified into tag groups for identification and modderation.
TLDR; Allows you to find out if an image is copyrighted, pornographic, ext. So you can automate some aspects of site moderation.
Uses about 2 dozzen micro services to achieve this goal.
Planing on breaking this into 2 sepperate projects to reduce bloat. 1 For app IAM user managment and ext. and one for this service itself.
Development status: IN PROGRESS
Multi app management server provides service to service authentication using PKI though Kerberos protocol. User to service and user to resource management and authentication is provided through IAM policy’s provided though a web interface. User login to service is provided though OAuth, and can be implemented easily in apps using OpenID.
Manager for Drone project. Allows for drones to query API to receive tasks and post results.
Individual instance that talks with drone-queue, for task allocation across a distributed botnet.
Drone asks for a task, gets it. processes it and returns the results based on data workflow of Visual-Scraper
Encapsulates services for external access via Identity Access management (IAM)
Web interface to management of scraping tasks via visual scripting.
Similar to: N8N
Stores scripts to be used by drones.
Sending messages between users.
API for sending txt messages (2fa and acc recovery)
Web interface for viewing of collected content and tags
Elasticsearch API helper.
File access service
thumbnail generation service
Service for sending emails for verification and alerts.
Service for managment of tags
Platform provisioner for app-image managment and deployment.
generates fingerprints of images
Works with Short stack net (SSN) to check users password on acc creation