[BUG] Indices do not pass initializiation in v3.3.0

[cinhtau]

What is the bug?

ISM fails to initialize new indices after upgrading from v3.2.0 to v3.3.0
New created indices not managed by ISM, despite having a policy

How can one reproduce the bug?
Steps to reproduce the behavior:

1. Use OpenSearch v3.2.0
2. Create index and add some docs, add to index policy with rollover_alias
3. In-place upgrade OpenSearch v3.3.0
4. Rollover manually
5. Wait for index initialization
6. No errors nor initialization

Reproduced on 1 clusters

• Production Cluster with 24 nodes
• Single Node Monitoring Cluster - works
• Replication type: DOCUMENT

What is the expected behavior?

• Successful initialization with State, Action and Info
• After init, proceed to new states, e.g. rollover, allocation, etc

What is your host/environment?

• OS: RHEL-8 8.10
• Version: 3.3.0
• Plugins: ISM

Do you have any screenshots?

Do you have any additional context?

Could it be related with the timestamp problem? See opensearch-project/OpenSearch#19646

[cinhtau]

Index Settings on a manual rollover index

GET ha-prod-m1-005133/_settings?human

{
  "ha-prod-m1-005133": {
    "settings": {
      "index": {
        "replication": {
          "type": "DOCUMENT"
        },
        "creation_date_string": "2025-11-01T09:26:56.794Z",
        "refresh_interval": "10s",        
        "plugins": {
          "index_state_management": {
            "policy_id": "ha-prod",
            "rollover_alias": "ha-prod",
            "auto_manage": "false"
          }
        },
        "provided_name": "ha-prod-m1-005133",        
        "number_of_replicas": "1",
        "uuid": "AcHNxYNSTCawfNZQeBkPNw",
        "version": {
          "created_string": "3.3.0",
          "created": "137247827"
        },
        "codec": "best_compression",        
        "number_of_shards": "2"
      }
    }
  }
}

This index in the monitoring cluster was initialized.

{
  "platform-logs-000014": {
    "settings": {
      "index": {
        "replication": {
          "type": "DOCUMENT"
        },
        "creation_date_string": "2025-11-01T11:28:54.641Z",
        "mapping": {
          "total_fields": {
            "limit": "12500"
          }
        },
        "refresh_interval": "5s",
        "plugins": {
          "index_state_management": {
            "policy_id": "platform-logs",
            "rollover_alias": "platform-logs"
          }
        },
        "provided_name": "platform-logs-000014",
        "query": {
          "default_field": [
            "message",
            "tags",
            "application",
            "host.name",
            "fields.*"
          ]
        },
        "creation_date": "1761996534641",
        "number_of_replicas": "0",
        "uuid": "Ha6ocZRtRyuFlLrvmec6hg",
        "version": {
          "created_string": "3.3.0",
          "created": "137247827"
        },
        "number_of_shards": "1",
        "max_docvalue_fields_search": "200"
      }
    }
  }
}

[cinhtau]

Inspecting the ism config

curl -k --cert admin.pem --key admin-key.pem -XGET "https://shiny-cluster:9200/.opendistro-ism-config/_settings?human" | jq .
{
  ".opendistro-ism-config": {
    "settings": {
      "index": {
        "replication": {
          "type": "DOCUMENT"
        },
        "creation_date_string": "2023-11-09T15:19:28.985Z",
        "hidden": "true",
        "number_of_shards": "1",
        "provided_name": ".opendistro-ism-config",
        "creation_date": "1699543168985",
        "number_of_replicas": "1",
        "uuid": "-3HbZbIySBqBLg-8W0FR5g",
        "version": {
          "upgraded": "136407927",
          "created_string": "2.9.0",
          "upgraded_string": "2.19.1",
          "created": "136307827"
        }
      }
    }
  }
}

Difference to the working monitoring cluster

{
  ".opendistro-ism-config": {
    "settings": {
      "index": {
        "replication": {
          "type": "DOCUMENT"
        },
        "creation_date_string": "2024-10-02T08:46:07.839Z",
        "hidden": "true",
        "number_of_shards": "1",
        "provided_name": ".opendistro-ism-config",
        "creation_date": "1727858767839",
        "number_of_replicas": "1",
        "uuid": "v054ASaQTtaZXEX2-amltQ",
        "version": {
          "upgraded": "137247827",
          "created_string": "2.17.0",
          "upgraded_string": "3.3.0",
          "created": "136387827"
        }
      }
    }
  }
}

[cinhtau]

• Create new index with mapping from .opendistro-ism-config
• Reindex .opendistro-ism-config to new index
• Stop ISM management
• Delete old index
• Reindex back into new .opendistro-ism-config
• Start ISM again
• ISM working again
• Rolling restart to remove all locks or blocking processes

[simonelbaz]

Hi @cinhtau ,

I stumbled over the same issue: https://forum.opensearch.org/t/ism-policy-applied-to-data-stream-keeps-initializing-and-default-state-not-applied-to-backing-index/27482.

Thanks to Anton who pointed me to your issue.

Please which mapping did you apply to the new .opendistro-ism-config ? Is it related to an OS 3.3.0 evolution ?
Thanks

[cinhtau]

Please which mapping did you apply to the new .opendistro-ism-config ?

Basically fetch mapping from existing index and create a new one.

This is the mapping I use in the Dev console at that time.

PUT opendistro-ism-config
{"mappings":{"dynamic":"strict","_meta":{"schema_version":24},"properties":{"managed_index":{"properties":{"change_policy":{"properties":{"is_safe":{"type":"boolean"},"policy_id":{"type":"keyword"},"state":{"type":"keyword"},"user":{"properties":{"backend_roles":{"type":"text","fields":{"keyword":{"type":"keyword"}}},"custom_attribute_names":{"type":"text","fields":{"keyword":{"type":"keyword"}}},"name":{"type":"text","fields":{"keyword":{"type":"keyword","ignore_above":256}}},"roles":{"type":"text","fields":{"keyword":{"type":"keyword"}}}}}}},"enabled":{"type":"boolean"},"enabled_time":{"type":"date","format":"strict_date_time||epoch_millis"},"index":{"type":"keyword"},"index_uuid":{"type":"keyword"},"jitter":{"type":"double"},"last_updated_time":{"type":"date","format":"strict_date_time||epoch_millis"},"name":{"type":"text","fields":{"keyword":{"type":"keyword","ignore_above":256}}},"policy":{"type":"object","enabled":false},"policy_id":{"type":"keyword"},"policy_primary_term":{"type":"long"},"policy_seq_no":{"type":"long"},"schedule":{"properties":{"cron":{"properties":{"expression":{"type":"keyword"},"schedule_delay":{"type":"long"},"timezone":{"type":"keyword"}}},"interval":{"properties":{"period":{"type":"integer"},"schedule_delay":{"type":"long"},"start_time":{"type":"date","format":"strict_date_time||epoch_millis"},"unit":{"type":"keyword"}}}}}}},"managed_index_metadata":{"properties":{"action":{"properties":{"action_properties":{"properties":{"has_rollup_failed":{"type":"boolean"},"max_num_segments":{"type":"integer"},"rollup_id":{"type":"keyword"},"shrink_action_properties":{"type":"object","enabled":false},"snapshot_name":{"type":"keyword"},"transform_action_properties":{"type":"object","enabled":false}}},"consumed_retries":{"type":"integer"},"failed":{"type":"boolean"},"index":{"type":"integer"},"last_retry_time":{"type":"date","format":"strict_date_time||epoch_millis"},"name":{"type":"text","fields":{"keyword":{"type":"keyword","ignore_above":256}}},"start_time":{"type":"date","format":"strict_date_time||epoch_millis"}}},"index":{"type":"text","fields":{"keyword":{"type":"keyword","ignore_above":256}}},"index_creation_date":{"type":"date","format":"strict_date_time||epoch_millis"},"index_uuid":{"type":"keyword"},"info":{"type":"object","enabled":false},"policy_completed":{"type":"boolean"},"policy_id":{"type":"keyword"},"policy_primary_term":{"type":"long"},"policy_seq_no":{"type":"long"},"retry_info":{"properties":{"consumed_retries":{"type":"integer"},"failed":{"type":"boolean"}}},"rolled_over":{"type":"boolean"},"rolled_over_index_name":{"type":"keyword"},"state":{"properties":{"name":{"type":"text","fields":{"keyword":{"type":"keyword","ignore_above":256}}},"start_time":{"type":"date","format":"strict_date_time||epoch_millis"}}},"step":{"properties":{"name":{"type":"text","fields":{"keyword":{"type":"keyword","ignore_above":256}}},"start_time":{"type":"date","format":"strict_date_time||epoch_millis"},"step_status":{"type":"keyword"}}},"transition_to":{"type":"text","fields":{"keyword":{"type":"keyword","ignore_above":256}}}}},"policy":{"properties":{"default_state":{"type":"keyword"},"description":{"type":"text","fields":{"keyword":{"type":"keyword","ignore_above":256}}},"error_notification":{"properties":{"channel":{"properties":{"id":{"type":"keyword"}}},"destination":{"properties":{"chime":{"properties":{"url":{"type":"text","fields":{"keyword":{"type":"keyword","ignore_above":256}}}}},"custom_webhook":{"properties":{"header_params":{"type":"object","enabled":false},"host":{"type":"text"},"password":{"type":"text"},"path":{"type":"keyword"},"port":{"type":"integer"},"query_params":{"type":"object","enabled":false},"scheme":{"type":"keyword"},"url":{"type":"text","fields":{"keyword":{"type":"keyword","ignore_above":256}}},"username":{"type":"text"}}},"last_update_time":{"type":"date","format":"strict_date_time||epoch_millis"},"name":{"type":"text","fields":{"keyword":{"type":"keyword","ignore_above":256}}},"slack":{"properties":{"url":{"type":"text","fields":{"keyword":{"type":"keyword","ignore_above":256}}}}},"type":{"type":"keyword"}}},"message_template":{"type":"object","enabled":false}}},"ism_template":{"properties":{"index_patterns":{"type":"keyword"},"last_updated_time":{"type":"date","format":"strict_date_time||epoch_millis"},"priority":{"type":"long"}}},"last_updated_time":{"type":"date","format":"strict_date_time||epoch_millis"},"policy_id":{"type":"text","fields":{"keyword":{"type":"keyword","ignore_above":256}}},"schema_version":{"type":"long"},"states":{"type":"nested","properties":{"actions":{"type":"nested","properties":{"alias":{"properties":{"actions":{"type":"object","enabled":false}}},"allocation":{"properties":{"exclude":{"type":"object","enabled":false},"include":{"type":"object","enabled":false},"require":{"type":"object","enabled":false},"wait_for":{"type":"boolean"}}},"close":{"type":"object"},"convert_index_to_remote":{"properties":{"repository":{"type":"keyword"},"snapshot":{"type":"keyword"}}},"custom":{"type":"object","enabled":false},"delete":{"type":"object"},"force_merge":{"properties":{"max_num_segments":{"type":"integer"}}},"index_priority":{"properties":{"priority":{"type":"integer"}}},"notification":{"properties":{"channel":{"properties":{"id":{"type":"keyword"}}},"destination":{"properties":{"chime":{"properties":{"url":{"type":"text","fields":{"keyword":{"type":"keyword","ignore_above":256}}}}},"custom_webhook":{"properties":{"header_params":{"type":"object","enabled":false},"host":{"type":"text"},"password":{"type":"text"},"path":{"type":"keyword"},"port":{"type":"integer"},"query_params":{"type":"object","enabled":false},"scheme":{"type":"keyword"},"url":{"type":"text","fields":{"keyword":{"type":"keyword","ignore_above":256}}},"username":{"type":"text"}}},"last_update_time":{"type":"date","format":"strict_date_time||epoch_millis"},"name":{"type":"text","fields":{"keyword":{"type":"keyword","ignore_above":256}}},"slack":{"properties":{"url":{"type":"text","fields":{"keyword":{"type":"keyword","ignore_above":256}}}}},"type":{"type":"keyword"}}},"message_template":{"type":"object","enabled":false}}},"open":{"type":"object"},"read_only":{"type":"object"},"read_write":{"type":"object"},"replica_count":{"properties":{"number_of_replicas":{"type":"integer"}}},"retry":{"properties":{"backoff":{"type":"keyword"},"count":{"type":"integer"},"delay":{"type":"keyword"}}},"rollover":{"properties":{"copy_alias":{"type":"boolean"},"min_doc_count":{"type":"keyword"},"min_index_age":{"type":"keyword"},"min_primary_shard_size":{"type":"keyword"},"min_size":{"type":"keyword"}}},"rollup":{"properties":{"ism_rollup":{"properties":{"description":{"type":"text"},"dimensions":{"type":"nested","properties":{"date_histogram":{"properties":{"calendar_interval":{"type":"keyword"},"fixed_interval":{"type":"keyword"},"source_field":{"type":"keyword"},"target_field":{"type":"keyword"},"timezone":{"type":"keyword"}}},"histogram":{"properties":{"interval":{"type":"double"},"source_field":{"type":"keyword"},"target_field":{"type":"keyword"}}},"terms":{"properties":{"source_field":{"type":"keyword"},"target_field":{"type":"keyword"}}}}},"metrics":{"type":"nested","properties":{"metrics":{"type":"nested","properties":{"avg":{"type":"object"},"max":{"type":"object"},"min":{"type":"object"},"sum":{"type":"object"},"value_count":{"type":"object"}}},"source_field":{"type":"keyword"},"target_field":{"type":"keyword"}}},"page_size":{"type":"long"},"target_index":{"type":"text","fields":{"keyword":{"type":"keyword","ignore_above":256}}},"target_index_settings":{"type":"object","dynamic":"true"}}}}},"shrink":{"properties":{"aliases":{"type":"object","enabled":false},"force_unsafe":{"type":"boolean"},"max_shard_size":{"type":"keyword"},"num_new_shards":{"type":"integer"},"percentage_of_source_shards":{"type":"double"},"switch_aliases":{"type":"boolean"},"target_index_name_template":{"type":"object","enabled":false}}},"snapshot":{"properties":{"include_global_state":{"type":"boolean"},"repository":{"type":"keyword"},"snapshot":{"type":"keyword"}}},"stop_replication":{"type":"object"},"timeout":{"type":"keyword"},"transform":{"properties":{"ism_transform":{"properties":{"aggregations":{"type":"object","enabled":false},"data_selection_query":{"type":"object","enabled":false},"description":{"type":"text"},"groups":{"properties":{"date_histogram":{"properties":{"calendar_interval":{"type":"keyword"},"fixed_interval":{"type":"keyword"},"source_field":{"type":"keyword"},"target_field":{"type":"keyword"},"timezone":{"type":"keyword"}}},"histogram":{"properties":{"interval":{"type":"double"},"source_field":{"type":"keyword"},"target_field":{"type":"keyword"}}},"terms":{"properties":{"source_field":{"type":"keyword"},"target_field":{"type":"keyword"}}}}},"page_size":{"type":"long"},"target_index":{"type":"text","fields":{"keyword":{"type":"keyword","ignore_above":256}}}}}}}}},"name":{"type":"keyword"},"transitions":{"type":"nested","properties":{"conditions":{"type":"object","enabled":false},"state_name":{"type":"keyword"}}}}},"user":{"properties":{"backend_roles":{"type":"text","fields":{"keyword":{"type":"keyword"}}},"custom_attribute_names":{"type":"text","fields":{"keyword":{"type":"keyword"}}},"name":{"type":"text","fields":{"keyword":{"type":"keyword","ignore_above":256}}},"roles":{"type":"text","fields":{"keyword":{"type":"keyword"}}}}}}},"rollup":{"properties":{"continuous":{"type":"boolean"},"delay":{"type":"long"},"description":{"type":"text"},"dimensions":{"properties":{"date_histogram":{"properties":{"calendar_interval":{"type":"keyword"},"fixed_interval":{"type":"keyword"},"source_field":{"type":"keyword"},"target_field":{"type":"keyword"},"timezone":{"type":"keyword"}}},"histogram":{"properties":{"interval":{"type":"double"},"source_field":{"type":"keyword"},"target_field":{"type":"keyword"}}},"terms":{"properties":{"source_field":{"type":"keyword"},"target_field":{"type":"keyword"}}}}},"enabled":{"type":"boolean"},"enabled_time":{"type":"date","format":"strict_date_time||epoch_millis"},"last_updated_time":{"type":"date","format":"strict_date_time||epoch_millis"},"metadata_id":{"type":"keyword"},"metrics":{"type":"nested","properties":{"metrics":{"type":"nested","properties":{"avg":{"type":"object"},"max":{"type":"object"},"min":{"type":"object"},"sum":{"type":"object"},"value_count":{"type":"object"}}},"source_field":{"type":"keyword"},"target_field":{"type":"keyword"}}},"page_size":{"type":"long"},"roles":{"type":"text","fields":{"keyword":{"type":"keyword","ignore_above":256}}},"rollup_id":{"type":"text","fields":{"keyword":{"type":"keyword","ignore_above":256}}},"schedule":{"properties":{"cron":{"properties":{"expression":{"type":"keyword"},"schedule_delay":{"type":"long"},"timezone":{"type":"keyword"}}},"interval":{"properties":{"period":{"type":"integer"},"schedule_delay":{"type":"long"},"start_time":{"type":"date","format":"strict_date_time||epoch_millis"},"unit":{"type":"keyword"}}}}},"schema_version":{"type":"long"},"source_index":{"type":"text","fields":{"keyword":{"type":"keyword","ignore_above":256}}},"target_index":{"type":"text","fields":{"keyword":{"type":"keyword","ignore_above":256}}},"target_index_settings":{"type":"object","dynamic":"true"},"user":{"properties":{"backend_roles":{"type":"text","fields":{"keyword":{"type":"keyword"}}},"custom_attribute_names":{"type":"text","fields":{"keyword":{"type":"keyword"}}},"name":{"type":"text","fields":{"keyword":{"type":"keyword","ignore_above":256}}},"roles":{"type":"text","fields":{"keyword":{"type":"keyword"}}}}}}},"rollup_metadata":{"properties":{"after_key":{"type":"object","enabled":false},"continuous":{"properties":{"next_window_end_time":{"type":"date","format":"strict_date_time||epoch_millis"},"next_window_start_time":{"type":"date","format":"strict_date_time||epoch_millis"}}},"failure_reason":{"type":"text"},"last_updated_time":{"type":"date","format":"strict_date_time||epoch_millis"},"rollup_id":{"type":"text","fields":{"keyword":{"type":"keyword","ignore_above":256}}},"stats":{"type":"object","enabled":false},"status":{"type":"keyword"}}},"sm_metadata":{"properties":{"creation":{"properties":{"current_state":{"type":"keyword"},"latest_execution":{"properties":{"end_time":{"type":"date","format":"strict_date_time||epoch_millis"},"info":{"properties":{"cause":{"type":"text"},"message":{"type":"text"}}},"start_time":{"type":"date","format":"strict_date_time||epoch_millis"},"status":{"type":"keyword"}}},"retry":{"properties":{"count":{"type":"integer"}}},"started":{"type":"keyword"},"trigger":{"properties":{"time":{"type":"date","format":"strict_date_time||epoch_millis"}}}}},"current_state":{"type":"keyword"},"deletion":{"properties":{"current_state":{"type":"keyword"},"latest_execution":{"properties":{"end_time":{"type":"date","format":"strict_date_time||epoch_millis"},"info":{"properties":{"cause":{"type":"text"},"message":{"type":"text"}}},"start_time":{"type":"date","format":"strict_date_time||epoch_millis"},"status":{"type":"keyword"}}},"retry":{"properties":{"count":{"type":"integer"}}},"started":{"type":"keyword"},"trigger":{"properties":{"time":{"type":"date","format":"strict_date_time||epoch_millis"}}}}},"name":{"type":"keyword"},"policy_primary_term":{"type":"long"},"policy_seq_no":{"type":"long"}}},"sm_policy":{"properties":{"creation":{"properties":{"schedule":{"properties":{"cron":{"properties":{"expression":{"type":"keyword"},"schedule_delay":{"type":"long"},"timezone":{"type":"keyword"}}}}},"time_limit":{"type":"keyword"}}},"deletion":{"properties":{"condition":{"properties":{"max_age":{"type":"keyword"},"max_count":{"type":"integer"},"min_count":{"type":"integer"}}},"schedule":{"properties":{"cron":{"properties":{"expression":{"type":"keyword"},"schedule_delay":{"type":"long"},"timezone":{"type":"keyword"}}}}},"time_limit":{"type":"keyword"}}},"description":{"type":"text"},"enabled":{"type":"boolean"},"enabled_time":{"type":"date","format":"strict_date_time||epoch_millis"},"last_updated_time":{"type":"date","format":"strict_date_time||epoch_millis"},"name":{"type":"keyword"},"notification":{"properties":{"channel":{"properties":{"id":{"type":"keyword"}}},"conditions":{"properties":{"creation":{"type":"boolean"},"deletion":{"type":"boolean"},"failure":{"type":"boolean"},"time_limit_exceeded":{"type":"boolean"}}}}},"schedule":{"properties":{"interval":{"properties":{"period":{"type":"integer"},"schedule_delay":{"type":"long"},"start_time":{"type":"date","format":"strict_date_time||epoch_millis"},"unit":{"type":"keyword"}}}}},"schema_version":{"type":"long"},"snapshot_config":{"type":"object","enabled":false},"user":{"properties":{"backend_roles":{"type":"text","fields":{"keyword":{"type":"keyword"}}},"custom_attribute_names":{"type":"text","fields":{"keyword":{"type":"keyword"}}},"name":{"type":"text","fields":{"keyword":{"type":"keyword","ignore_above":256}}},"roles":{"type":"text","fields":{"keyword":{"type":"keyword"}}}}}}},"transform":{"properties":{"aggregations":{"type":"object","enabled":false},"continuous":{"type":"boolean"},"data_selection_query":{"type":"object","enabled":false},"description":{"type":"text"},"enabled":{"type":"boolean"},"enabled_at":{"type":"date","format":"strict_date_time||epoch_millis"},"groups":{"properties":{"date_histogram":{"properties":{"calendar_interval":{"type":"keyword"},"fixed_interval":{"type":"keyword"},"format":{"type":"keyword"},"source_field":{"type":"keyword"},"target_field":{"type":"keyword"},"timezone":{"type":"keyword"}}},"histogram":{"properties":{"interval":{"type":"double"},"source_field":{"type":"keyword"},"target_field":{"type":"keyword"}}},"terms":{"properties":{"source_field":{"type":"keyword"},"target_field":{"type":"keyword"}}}}},"metadata_id":{"type":"keyword"},"page_size":{"type":"long"},"roles":{"type":"text","fields":{"keyword":{"type":"keyword","ignore_above":256}}},"schedule":{"properties":{"cron":{"properties":{"expression":{"type":"keyword"},"schedule_delay":{"type":"long"},"timezone":{"type":"keyword"}}},"interval":{"properties":{"period":{"type":"integer"},"schedule_delay":{"type":"long"},"start_time":{"type":"date","format":"strict_date_time||epoch_millis"},"unit":{"type":"keyword"}}}}},"schema_version":{"type":"long"},"source_index":{"type":"text","fields":{"keyword":{"type":"keyword","ignore_above":256}}},"target_index":{"type":"text","fields":{"keyword":{"type":"keyword","ignore_above":256}}},"transform_id":{"type":"text","fields":{"keyword":{"type":"keyword","ignore_above":256}}},"updated_at":{"type":"date","format":"strict_date_time||epoch_millis"},"user":{"properties":{"backend_roles":{"type":"text","fields":{"keyword":{"type":"keyword"}}},"custom_attribute_names":{"type":"text","fields":{"keyword":{"type":"keyword"}}},"name":{"type":"text","fields":{"keyword":{"type":"keyword","ignore_above":256}}},"roles":{"type":"text","fields":{"keyword":{"type":"keyword"}}}}}}},"transform_metadata":{"properties":{"after_key":{"type":"object","enabled":false},"continuous_stats":{"type":"object","enabled":false},"failure_reason":{"type":"text"},"last_updated_at":{"type":"date","format":"strict_date_time||epoch_millis"},"shard_id_to_global_checkpoint":{"type":"object","enabled":false},"stats":{"type":"object","enabled":false},"status":{"type":"keyword"},"transform_id":{"type":"text","fields":{"keyword":{"type":"keyword","ignore_above":256}}}}}}}}

Is it related to an OS 3.3.0 evolution ? Thanks

• I think it is an issue if the index version < 3.3.0.
• Release 3.3.1 brought the backward compatibility back.
• I have pushed the upgrade to v3.3.2.

[simonelbaz]

Hi,

I reinstalled opensearch 3.3.2 on Debian 11. I still have the issue.
The policy is still initializing on the data-stream backing indexes. The rollover has been made manually from dashboards.
How could I debug the policy ?

_cluster/settings is:

{"persistent":{},"transient":{"logger":{"_root":"DEBUG"}}}

However, no logs show why the indexes state is not set.

• mappings

{
  ".opendistro-ism-config" : {
    "mappings" : {
      "dynamic" : "strict",
      "_meta" : {
        "schema_version" : 24
      },
      "properties" : {
        "managed_index" : {
          "properties" : {
            "change_policy" : {
              "properties" : {
                "is_safe" : {
                  "type" : "boolean"
...

• settings

{
  ".opendistro-ism-config": {
    "settings": {
      "index": {
        "replication": {
          "type": "DOCUMENT"
        },
        "creation_date_string": "2025-11-15T20:50:13.751Z",
        "hidden": "true",
        "number_of_shards": "1",
        "provided_name": ".opendistro-ism-config",
        "creation_date": "1763239813751",
        "number_of_replicas": "1",
        "uuid": "WowxBpGPSQ-Zm2yFs9CslA",
        "version": {
          "created_string": "3.3.2",
          "created": "137248027"
        }
      }
    }
  }
}

{
  ".ds-mce-index-w-ds-000001" : {
    "index.plugins.index_state_management.policy_id" : "policy_1",
    "index.opendistro.index_state_management.policy_id" : "policy_1",
    "index" : ".ds-mce-index-w-ds-000001",
    "index_uuid" : "IrpNXEZOSlWKG3MljWdCWw",
    "policy_id" : "policy_1",
    "enabled" : true,
    "policy" : {
      "policy_id" : "policy_1",
      "description" : "hot warm delete workflow",
      "last_updated_time" : 1763242741720,
      "schema_version" : 24,
      "error_notification" : {
        "channel" : {
          "id" : "channelexploitantdev"
        },
        "message_template" : {
          "source" : "The index {{ctx.index}} failed during policy execution.",
          "lang" : "mustache"
        }
      },
      "default_state" : "hot",
...

green open .ds-mce-index-w-ds-000001        IrpNXEZOSlWKG3MljWdCWw 2 1 5648882 0   1.6gb 843.7mb
green open .plugins-ml-config               JK43MtEFTWmctTCkfR-59w 1 7       1 0  32.5kb     4kb
green open .ds-mce-index-w-ds-000002        R_aviHCyQtao-F2joPblZA 2 1  460401 0 330.1mb   165mb
green open .ql-datasources                  VC1Autu9TB2cl4oaLv7KZg 1 2       0 0    624b    208b
green open top_queries-2025.11.15-85605     by3ABG4jTvK-lau48wkXvA 1 2      15 0 469.4kb 117.9kb
green open .opensearch-sap-log-types-config K_hOcLcPS76gY_F0YosxTA 1 7     455 0   1.4mb 388.8kb
green open .opendistro-ism-config           WowxBpGPSQ-Zm2yFs9CslA 1 1      12 9 131.6kb  59.5kb
green open .opendistro_security             ZA2TNZ9LRIqBvUiOZ8ebAA 1 7       9 0 530.3kb  66.2kb
green open .kibana_1                        l_Tq7MTRRduSeerL3IeoZw 1 1       3 0  35.3kb  17.6kb
green open .opensearch-notifications-config 3krUNvj8QImIYh34gHblDA 1 2       4 0  74.1kb  24.7kb

[cinhtau]

Top of my head did you activate ISM? Your cluster settings should have it listed.

If that is the case set the interval to 1 minute.

Make a rolling cluster restart and check each node's log.

[simonelbaz]

Top of my head did you activate ISM? Your cluster settings should have it listed.

If that is the case set the interval to 1 minute.

Make a rolling cluster restart and check each node's log.

From what I can read, it is enabled by default: https://docs.opensearch.org/latest/im-plugin/ism/settings/

Moreover, the include_defaults flags shows it is enabled:

_cluster/settings?include_defaults=true

      "index_state_management": {
        "coordinator": {
          "backoff_millis": "50ms",
          "sweep_period": "10m",
          "backoff_count": "2"
        },
        "restricted_index_pattern": "\\.opendistro_security|\\.kibana.*|\\.opendistro-ism-config",
        "allow_list": [
          "alias",
          "allocation",
          "close",
          "delete",
          "force_merge",
          "index_priority",
          "notification",
          "open",
          "read_only",
          "read_write",
          "replica_count",
          "rollup",
          "rollover",
          "shrink",
          "snapshot",
          "transform",
          "stop_replication",
          "convert_index_to_remote"
        ],
        "history": {
          "max_age": "24h",
          "number_of_shards": "1",
          "rollover_retention_period": "30d",
          "rollover_check_period": "8h",
          "max_docs": "2500000",
          "number_of_replicas": "1",
          "enabled": "true"
        },
        "job_interval": "5",
        "enabled": "true",
        "snapshot": {
          "deny_list": []
        }

I have also modified the policy ism_templates in order to include .ds*backing index name:

      "ism_template" : [
        {
          "index_patterns" : [
            "mce-index-w-*",
            ".ds-mce-index-w-*"
          ],
          "priority" : 100,
          "last_updated_time" : 1763320424123

But no default state is applied to backing index.

[cinhtau]

Yeah that sounds strange. What I can think of as try and diagnose

• I would disable ISM
• Make a backup by reindexing
• Delete the ism config
• Enable ISM

The index management plugin should create a new one.

• You should have a new and empty ism index.
• Make a test policy and just see if the policy gets applied.

If that works, reindex from the backup your old config. Since the plugin should create the new index, no need for mapping handling.

[simonelbaz]

Hi,

.opendistro-job-scheduler-lock index was missing (probably due to a bad opensearch dashboards install).
After OS Dashboards uninstall/install, the missing index is present and ISM is now OK.

[andrross]

Catch All Triage - 1 2 3