DSE database management services

DSE database management services:

1) Performance service:

This collects and Organizes performance diagnostic information into data dictionary tables.

These metrics can be related to Cassandra, DSE Search, DSE Analytics.

Some of the metrics that can be gathered are

a) Slow queries

b) Latency metrics for non-system keyspaces

c) Node/Cluster wide life time metrics by table and keyspace

d) Statistics like number of SSTables, latency, partition sizes.

e) Read/Write activity on a per client, per-node

f) Bottle necks in DSE Search

g) Resources used in DSE Analytics

dse_perf is the keyspace that stores performance metrics. Alter the keyspace with desired replication strategy and replication factor.

ALTER KEYSPACE "dse_perf" WITH REPLICATION = {'class' : 'NetworkTopologyStrategy', 'dc1' : 2, 'dc2' : 2};

Types of diagnostic metrics that can be collected.

Type 1: Cassandra Performance service diagnostic table refernce:

https://docs.datastax.com/en/archived/datastax_enterprise/4.8/datastax_enterprise/mngServ/performSrv/prfSrvTblRef.html

example: Enable in dse.yaml

node_slow_log table: Queries on a node exceeding the threshold_ms parameter.

Type 2: DSE serach performance service diagnostic table reference:

https://docs.datastax.com/en/archived/datastax_enterprise/4.8/datastax_enterprise/mngServ/solrPerformSrv/solrPrfDiagTOC.html

example: Enable in dse.yaml

solr_slow_sub_query_log_options: Reports distributed sub-queries that take longer than specified time.

Temporarily enable by, dsetool perf solrslowlog enable

solr_indexing_error_log_options: Records errors that occur during document indexing.

Type 3: Monitoring Spark with Spark Performance Objects:

https://docs.datastax.com/en/archived/datastax_enterprise/4.8/datastax_enterprise/mngServ/performSrv/sparkPerformanceObjectsOverview.html

This collects data associated with spark cluster and spark applications.

example: Enable in dse.yaml

spark_cluster_info_options & spark_application_info_options

***