DOC-12456 genericServicesLogLevel settings for XDCR (#3840)

* non-pipeline-services-settings

* whats-new-entry

* implemented-editorial-inputs

Author: rao-shwe

modules/introduction/partials/new-features-80.adoc

@@ -120,10 +120,9 @@ Additional information sent by clients at connection time can be found in the lo
 https://jira.issues.couchbase.com/browse/MB-61048[MB-61048]::
 Once faulty remote cluster credentials are fixed, XDCR will now be able to more quickly restart replications that depend on the repaired references.
 
-https://jira.issues.couchbase.com/browse/MB-62639[MB-62639]::
-XDCR UI supports network type for connecting to the target cluster.
-The options are Auto, Force using alternate address, and Force using internal address.
-For more information, see xref:manage:manage-xdcr/create-xdcr-reference.adoc#create-an-xdcr-reference-with-the-ui[Create an XDCR Reference with the UI].
+https://jira.issues.couchbase.com/browse/MB-62507[MB-62507]::
+XDCR supports Generic Services Log Level configuration using the REST API through the `genericServicesLogLevel` settings.
+For more information, see xref:rest-api:rest-xdcr-adv-settings.adoc[XDCR Advanced Settings].
 
 [#section-new-feature-800-query-service]
 === Query Service

modules/rest-api/pages/rest-xdcr-adv-settings.adoc

@@ -94,32 +94,57 @@ If successful, the call returns an object similar to the following:
 
 ----
 {
+  "cLogConnPoolGCIntervalMs": 60000,
+  "cLogConnPoolLimit": 30,
+  "cLogConnPoolReapIntervalMs": 120000,
+  "cLogErrorTimeWindowMs": 120000,
+  "cLogMaxErrorCount": 10,
+  "cLogNetworkRetryCount": 5,
+  "cLogNetworkRetryIntervalMs": 2000,
+  "cLogPoolGetTimeoutMs": 5000,
+  "cLogQueueCapacity": 6000,
+  "cLogReattemptDurationMs": 600000,
+  "cLogSetTimeoutMs": 5000,
+  "cLogWorkerCount": 20,
+  "casDriftThresholdSecs": 3900,
   "checkpointInterval": 600,
   "ckptSvcCacheEnabled": true,
+  "collectionsOSOMode": true,
   "compressionType": "Auto",
+  "conflictLogging": {},
+  "dcpEnablePurgeRollback": false,
   "desiredLatency": 50,
+  "disableHlvBasedShortCircuit": false,
   "docBatchSizeKb": 2048,
   "failureRestartInterval": 10,
+  "filterBinary": false,
   "filterBypassExpiry": false,
   "filterBypassUncommittedTxn": false,
   "filterDeletion": false,
   "filterExpiration": false,
+  "genericServicesLogLevel": {
+    < ... diagnostic items cut out due to length ... >
+  },
   "goGC": 100,
   "goMaxProcs": 4,
-  "hlvPruningWindowSec": 259200,
   "jsFunctionTimeoutMs": 20000,
   "logLevel": "Info",
   "mergeFunctionMapping": {},
+  "mobile": "Off",
   "networkUsageLimit": 0,
   "optimisticReplicationThreshold": 256,
+  "preCheckCasDriftThresholdHours": 8760,
   "preReplicateVBMasterCheck": true,
   "priority": "High",
   "replicateCkptIntervalMin": 20,
+  "retryOnErrExceptAuthErrMaxWaitSec": 360,
   "retryOnRemoteAuthErr": true,
-  "retryOnRemoteAuthErrMaxWaitSec": 3600,
+  "retryOnRemoteAuthErrMaxWaitSec": 360,
+  "skipReplSpecAutoGc": false,
   "sourceNozzlePerNode": 2,
   "statsInterval": 1000,
   "targetNozzlePerNode": 2,
+  "targetTopologyLogFrequency": 1800,
   "workerBatchSize": 500
 }
 ----
@@ -295,6 +320,60 @@ If successful, the call returns an object containing all current settings for th
 }
 ----
 
+===== Change Settings for XDCR Generic Services Log Levels
+
+The following example modifies the log levels for XDCR Generic Services, for a specific replication.
+Usually, you modify the log levels only when requested by Couchbase Support.
+
+----
+curl -X POST -u Administrator:password http://localhost:8091/settings/replications -d 'genericServicesLogLevel={"RemoteClusterService":"Debug","ReplicationSpecService":"Error","BucketTopologyService":"Debug","CheckpointService":"Error"}'
+----
+
+If successful, the call returns an object containing all current Generic Services related log level settings for the replication, including what's changed:
+
+----
+{
+...
+"genericServicesLogLevel": {
+    "AdminPort": "Info",
+    "AuditService": "Info",
+    "BackfillManager": "Info",
+    "BackfillReplicationService": "Info",
+    "BucketTopologyService": "Debug",
+    "CapiService": "Info",
+    "CheckpointService": "Error",
+    "CollectionsManifestService": "Info",
+    "Default": "Info",
+    "GenericSupervisor": "Info",
+    "GlobalSettingsService": "Info",
+    "HttpServer": "Info",
+    "InternalSettingsService": "Info",
+    "ManifestService": "Info",
+    "MessageUtils": "Info",
+    "MetaKVMetadataService": "Info",
+    "MigrationService": "Info",
+    "P2PManagerService": "Info",
+    "PipelineManager": "Info",
+    "RemoteClusterService": "Debug",
+    "ReplicationSettingService": "Info",
+    "ReplicationSpecService": "Error",
+    "ResourceManager": "Info",
+    "SecurityService": "Info",
+    "ThroughputThrottlerService": "Info",
+    "TopologyService": "Info",
+    "UtilsService": "Info",
+    "XDCRFactory": "Info"
+  },
+...
+}
+----
+
+To view the current log levels for XDCR Generic Services anytime, use the following command:
+
+----
+curl -s -X GET  -u Administrator:password http://localhost:8091/settings/replications  | jq
+----
+
 [#xdcr-advanced-settings-rest]
 == List of Advanced Settings
 
@@ -409,6 +488,20 @@ For supported expressions, see xref:xdcr-reference:xdcr-filtering-reference-intr
 
 This setting can only be established for and retrieved from an individual replication: it cannot be established or retrieved as part of global settings.
 
+| `genericServicesLogLevel`
+| JSON Object
+| This is the Generic Services related log level settings for the replication.
+
+The keys represent service names and the associated values represent log levels.
+
+In the example, the log level for `RemoteClusterService` is set to `Debug`, and for `ReplicationSpecService`, it's set to `Error`.
+
+By default, non-pipeline specific services use the `Info` log level.
+You can also set the log level to `Error`, `Debug`, or `Trace`.
+
+The `Default` key sets the log level for shared utilities like connection pools and data pools, which are used by multiple services.
+All these utilities use the same default logger, so changing the log level in `Default` affects all logger dependent utilities.
+
 | `goGC`
 | Integer (0 to 100) or String ("off")
 | Default: 100.