What is a good solution to store and process structured data with around a few hundred GB. It should be real time or at least near real time.
Hi @dustpurple,
For few hundred GBs, you can use relational databases like MySQL and PostgreSQL. With proper indexes, the query time will be really less.
Hope this helps.
Thanks
In Addition to what Abhinav has suggested, if the growth of your data is going to beyond from few hundreds of GBs then you might want to look at Big Data stack.
Also, a lot depends on what you mean by the word “process” in your question. If processing is complex such a machine learning task (say a recommendation engine), the same work would become a big data task and would require multiple computers to solve it.