Top-level design of a scalable database.
The database is used for machine learning models creating and storing. There are tens of thousands of classes and billions of images.
The database should store images of different items accumulated for the purpose of training machine learning classification models. the data for the models will be constantly updated from sources around the world and update models are to be created from the images.
The models from the images are to be converted to JSON'S and H5 files for deployment as API's.
The purpose of this job is to create a top-level design of the database, sketch the architecture, structure and the best tools.
Something in the area of DynamoDB, S3, IoT Gateway, lots of Lambdas and maybe ElasticSearch for the front end. I don't have RDBMS in mind, like MySQL or Postgres.