Back-end:
datatabase: Snowflake, terradata, Mangodb, elastic db
Search engine: Elasticsearch is a search engine based on the Lucene library, Azure Search
Presto (SQL query engine) -- big data query language which includes multiple sources
queries: sql,lucene
Visualization: grafana, kibana, power-bi
Data stream pipelines: Kafka, rabbitmq
APIs:
Flow will be top to bottom:
Grafana
|
{API}
|
Kafaka
|
Feed to database
|
Write to schema1 & schema2 (Elastic-database)
